The 44 controls / TS42
TS42 · AI crawling and agents
Each automated agent is governed according to its documented purpose.
Protocol wording · 0.1.0-draft.28 · Documentation view; no website assessment.
Control rule version : 0.1.0-draft.28
Reading guide: start with applicability and required evidence, then read expectations together with their limitations. Understand C, NC, NT and NA outcomes · Prepare a dossier
Expectations and evidence
- Required inputs (protocol identifiers)
- configuration, operator-docs, intent
- When it applies
- Automated agents covered by site policy.
- How to check
- Document mappings and their review, retain the owner decision, then compare its implementation under agent-governance-v1; retain coupled purposes and unknowns.
- Expectation
- All three rules pass for each declared target and mechanism; qualified policy matches the accepted choice, with supplied review and responsibility.
- Evidence to retain
- Mechanism/purpose inventory, dated operator sources bound to reviews, owner decision and tradeoffs, captured robots policy.
- Non-applicability
- No agent policy in the declared scope, with a reason provided.
- Limitations
- Supplied scope and bounded robots profile; no automatic registry. Sources, reviews and decisions are unauthenticated; no inferred visit, real identity, operator compliance, indexing or citation.
- Outcome clarification
- C requires all expectations across the declared scope. NC requires evidenced contradiction; otherwise NT. NA requires evidence of non-applicability.
- Reference scope
- Technical reference; the TSEP acceptance rule remains an editorial proposal.
Atomic rules
TS42-A01 — Documented purposes and mechanisms
- Required inputs (protocol identifiers)
- operator-docs, intent
- When it applies
- Each target URL and mechanism of the previously declared policy.
- How to check
- Bind operator, actor, token, mechanism and purposes to dated UTF-8 sources; check hashes and supplied bound review.
- Expectation
- Every mapping has a complete, dated, bound supported review with explicit robots applicability. A bound contradiction fails.
- Evidence to retain
- Inputs, dates, hashes and detailed findings under docs/agent-usage-policy.md.
- Assumptions
- Supplied inventory; declared source interpretation and personal authority, without automatic authentication.
- Inconclusive outcome
- Missing, stale or ambiguous source; missing hash, binding, completeness or review.
- Non-applicability
- No automatic atomic exemption.
- Limitations
- Supplied scope and bounded robots profile; no automatic registry. Sources, reviews and decisions are unauthenticated; no inferred visit, real identity, operator compliance, indexing or citation.
TS42-A02 — Owner decisions and tradeoffs
- Required inputs (protocol identifiers)
- intent
- When it applies
- Each target URL and mechanism of the previously declared policy.
- How to check
- Check every reasoned choice, the separate declared owner/delegate decision and its plan binding; retain any arbitration of coupled purposes.
- Expectation
- Each mechanism/purpose pair has a choice and reason; the owner accepts the plan and its exact tradeoffs. A bound rejection fails.
- Evidence to retain
- Inputs, dates, hashes and detailed findings under docs/agent-usage-policy.md.
- Assumptions
- Supplied inventory; declared source interpretation and personal authority, without automatic authentication.
- Inconclusive outcome
- Missing/undeclared author, unbound decision, inconsistent dates, incomplete choice or arbitration.
- Non-applicability
- No automatic atomic exemption.
- Limitations
- Supplied scope and bounded robots profile; no automatic registry. Sources, reviews and decisions are unauthenticated; no inferred visit, real identity, operator compliance, indexing or citation.
TS42-A03 — Captured policy and effective choice
- Required inputs (protocol identifiers)
- configuration, operator-docs, intent
- When it applies
- Each target URL and mechanism of the previously declared policy.
- How to check
- Group tokens case-insensitively, qualify mappings and compare Allow/Disallow with the effective choice; retain reading, tradeoffs, contradictions and unknowns.
- Expectation
- For each qualified group, the attributable client robots 200 policy matches the accepted choice. Any independent contradiction fails.
- Evidence to retain
- Inputs, dates, hashes and detailed findings under docs/agent-usage-policy.md.
- Assumptions
- Supplied inventory; declared source interpretation and personal authority, without automatic authentication.
- Inconclusive outcome
- Opposing purposes without arbitration, unsupported mechanism, ignored field or missing HTTP/source/decision evidence; other robots profiles unqualified.
- Non-applicability
- No automatic atomic exemption.
- Limitations
- Supplied scope and bounded robots profile; no automatic registry. Sources, reviews and decisions are unauthenticated; no inferred visit, real identity, operator compliance, indexing or citation.