# SEO and GEO directive matrix Edition 2026-11-07.1 · Edikka — TSEP · CC BY 4.0 [HTML](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix) · [JSON](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix.json) · [CSV](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix.csv) · [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) TSEP factual compilation and editorial classifications. Source documents retain their original terms. ## Method and review Documentary comparison of six engines, based on official pages archived for this edition. “Documented” describes a declared rule, not behaviour observed on a test site. “Unconfirmed” means retained sources do not establish support. It does not mean “unsupported”. For IndexNow, “Not listed” refers only to published endpoints. Examples are illustrative and scoped. Precedence is not universal: Google generally applies the most restrictive meta rule; Yandex documents different precedence for permitting indexing rules. Crawlers must be able to access tags and headers. The verification date refers to the source capture, not the rule’s launch. Timelines contain only explicitly documented dates. Readings and translations are AI-assisted; human review is stated separately. Each capture contains received bytes compressed with gzip. SHA-256 applies to the decompressed document. Independent manifest timestamping proves captures existed no later than the signed time, not the truth of claims or observed crawler behaviour. Human review FR/EN : Bertrand Morel · 2026-11-07T10:52:31.208480+00:00 Latest source capture: 2026-11-07T10:51:28+00:00 ## noindex — Exclude a page from the index [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-noindex) Exclude a resource from results. The crawler must read the rule. Disallow can prevent discovery; noindex does not secure confidential content. HTML · Google, Bing, Yandex, Naver, Applebot ``` ``` - **Google** — Documented [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Documented [S08](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingrep) - **Yandex** — Documented. Yandex documentation gives permitting rules precedence when combined with prohibitions. Do not generalise Google’s most-restrictive precedence. [S17](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-yandex) - **Naver** — Documented [S15](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-naver) - **Baidu** — Unconfirmed - **Applebot** — Documented [S01](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-apple) [TS05](https://tsep-protocol.org/en/controls/TS05) [TS07](https://tsep-protocol.org/en/controls/TS07) ## nofollow — Ask the crawler not to follow links on the page [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-nofollow) Indicate that links on this page should not be followed. Does not deindex the page or destinations. A crawler may discover URLs through other links. HTML · page scope ``` ``` - **Google** — Documented [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Documented [S08](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingrep) - **Yandex** — Documented [S17](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-yandex) - **Naver** — Documented [S15](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-naver) - **Baidu** — Unconfirmed - **Applebot** — Documented [S01](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-apple) [TS07](https://tsep-protocol.org/en/controls/TS07) [TS17](https://tsep-protocol.org/en/controls/TS17) ## nosnippet — Suppress the page snippet [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-nosnippet) Exclude text snippets and some display or AI-response uses. Scope varies by engine. Not a general AI-training opt-out; consult the AI crawler register for that use. HTML · check differences below ``` ``` - **Google** — Documented. Also covers Discover, AI Overviews and AI Mode; prevents direct input to those two AI features. A static thumbnail may remain. [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Documented [S05](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingdata) - **Yandex** — Unconfirmed - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Documented. Excludes descriptions and web answers, and content use as context for Apple AI responses; URL discovery remains possible. [S01](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-apple) [TS07](https://tsep-protocol.org/en/controls/TS07) [TS42](https://tsep-protocol.org/en/controls/TS42) ## max-snippet — Limit snippet length [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-max-snippet) Set a maximum snippet length in characters. 0 suppresses the snippet; -1 lets the engine choose. Guarantees neither a snippet nor an AI citation. HTML · Google and Bing · 160 is an example ``` ``` - **Google** — Documented. Also limits direct input to AI Overviews and AI Mode, except separately permitted uses, including some structured data or licences. [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Documented [S07](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingoptions) - **Yandex** — Unconfirmed - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed [TS07](https://tsep-protocol.org/en/controls/TS07) ## max-image-preview — Set the maximum image preview size [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-max-image-preview) Define the maximum image-preview size. Values: none, standard, large. Permission does not require an image display. This is not noimageindex. HTML · Google and Bing ``` ``` - **Google** — Documented [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Documented [S07](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingoptions) - **Yandex** — Unconfirmed - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed [TS07](https://tsep-protocol.org/en/controls/TS07) ## max-video-preview — Limit video preview length [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-max-video-preview) Limit video previews to a number of seconds. 0 allows at most a static image; -1 imposes no limit. The video may remain indexable. HTML · Google and Bing · 10 is an example ``` ``` - **Google** — Documented [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Documented [S07](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingoptions) - **Yandex** — Unconfirmed - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed [TS07](https://tsep-protocol.org/en/controls/TS07) ## data-nosnippet — Exclude a passage from the snippet [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-data-nosnippet) Exclude a passage from snippets without removing the whole page. Content remains accessible. Google documents span, div and section; Bing accepts any HTML element. HTML · Google and Bing ```
Passage exclu / Excluded passage
``` - **Google** — Documented. On span, div and section. Restricts snippets; it does not deindex the text. [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Documented. Any HTML element. Content remains indexable and available for ranking, but is excluded from snippets and AI summaries. [S05](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingdata) - **Yandex** — Unconfirmed - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed [TS07](https://tsep-protocol.org/en/controls/TS07) [TS42](https://tsep-protocol.org/en/controls/TS42) ## noimageindex — Prevent images from being indexed from this page [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-noimageindex) Request that images on the page not be indexed. Documented here for Google. Distinct from thumbnail size or blocking access to an image file. HTML · Google ``` ``` - **Google** — Documented [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Unconfirmed - **Yandex** — Unconfirmed - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed [TS07](https://tsep-protocol.org/en/controls/TS07) ## indexifembedded — Index embedded content despite noindex [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-indexifembedded) Allow content to be indexed when embedded elsewhere. For Google, only takes effect alongside noindex; do not assume all engines support this exception. HTML · Google only in this register ``` ``` - **Google** — Documented [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Unconfirmed - **Yandex** — Unconfirmed - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed [TS07](https://tsep-protocol.org/en/controls/TS07) ## unavailable_after — Specify when a page should stop appearing in results [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-unavailable_after) Schedule the end of a page’s appearance at a specified date. Google must read the rule. Use a valid date and explicit time zone; adapt the example to the intended expiry. HTML · Google · example date ``` ``` - **Google** — Documented [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Unconfirmed - **Yandex** — Unconfirmed - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed [TS07](https://tsep-protocol.org/en/controls/TS07) [TS09](https://tsep-protocol.org/en/controls/TS09) ## notranslate — Disable translation in results [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-notranslate) Ask Google not to offer result translation. Does not define page language and does not replace hreflang. HTML · Google ``` ``` - **Google** — Documented [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Unconfirmed - **Yandex** — Unconfirmed - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed [TS07](https://tsep-protocol.org/en/controls/TS07) ## noarchive — Control the cached copy or specific AI uses depending on the engine [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-noarchive) Legacy cached-copy control whose scope depends on the engine. No effect in Google Search. In Bing, do not confuse legacy AI-use controls with deindexing; migration announced for 2027. HTML · legacy, check the engine ``` ``` - **Google** — Unused. Google Search retired its cached link. [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Announced transition. For training and grounding: new preferences honoured from 2027-02-01; migrate before 2027-03-01. Legacy rules are disregarded when new preferences are detected on the site. [S03](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingarchive) - **Yandex** — Documented. Hides the link to the saved copy. [S17](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-yandex) - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed - 2026-10-30 — Bing announces migration to separate AI preferences. [S03](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingarchive) - 2027-02-01 — Announced start of new preference processing as pages are crawled. [S03](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingarchive) - 2027-03-01 — Deadline for migrating legacy training and grounding controls. [S03](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingarchive) [TS07](https://tsep-protocol.org/en/controls/TS07) [TS42](https://tsep-protocol.org/en/controls/TS42) ## nocache — Legacy cache and AI-use control [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-nocache) Legacy Bing preference related to caching and AI uses. Not an HTTP browser-cache control. Google does not use it. Consult the Bing transition schedule before changing it. HTML · Bing, announced transition ``` ``` - **Google** — Unused. Google Search does not use this rule. [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Announced transition. For training and grounding: new preferences honoured from 2027-02-01; migrate before 2027-03-01. Legacy rules are disregarded when new preferences are detected on the site. [S03](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingarchive) - **Yandex** — Unconfirmed - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed - 2026-10-30 — Bing announces migration to separate AI preferences. [S03](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingarchive) - 2027-02-01 — Announced start of new preference processing as pages are crawled. [S03](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingarchive) - 2027-03-01 — Deadline for migrating legacy training and grounding controls. [S03](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingarchive) [TS07](https://tsep-protocol.org/en/controls/TS07) [TS42](https://tsep-protocol.org/en/controls/TS42) ## X-Robots-Tag — Send directives through an HTTP header [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-X-Robots-Tag) Send directives in the HTTP response, including for a PDF. A delivery mechanism, not a standalone rule. Check each value and crawler target; an inaccessible rule cannot be read. HTTP header · noindex example ``` X-Robots-Tag: noindex ``` - **Google** — Documented [S12](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlemeta) - **Bing** — Documented [S07](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingoptions) - **Yandex** — Documented [S17](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-yandex) - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Documented [S01](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-apple) [TS01](https://tsep-protocol.org/en/controls/TS01) [TS07](https://tsep-protocol.org/en/controls/TS07) ## rel=canonical — Identify the preferred URL among duplicates [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-rel=canonical) Suggest the preferred URL for identical or similar content. A signal, not a redirect or indexing prohibition. Google may choose a different canonical from the declared one. HTML · replace with the real canonical URL ``` ``` - **Google** — Documented [S10](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-canonical) - **Bing** — Documented. Bing recommends canonical tags when multiple versions must remain accessible. Source: official article dated 19 December 2025; a preference signal, not a redirect. [S04](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingcanonical) - **Yandex** — Documented [S18](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-ycan) - **Naver** — Documented [S15](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-naver) - **Baidu** — Documented. Historical official guide: one tag in head; the target must not be an error or blocked by robots.txt. [S02](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-baican) - **Applebot** — Unconfirmed [TS10](https://tsep-protocol.org/en/controls/TS10) [TS11](https://tsep-protocol.org/en/controls/TS11) [TS12](https://tsep-protocol.org/en/controls/TS12) ## hreflang — Associate language or region variants [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-hreflang) Connect language or regional versions of the same content. For Google, reciprocal and self-referencing links. Does not replace canonical or actual translation. HTML · Google example on both pages ``` ``` - **Google** — Documented [S13](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-hreflang) - **Bing** — Unconfirmed - **Yandex** — Documented [S20](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-yhre) - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed [TS22](https://tsep-protocol.org/en/controls/TS22) [TS23](https://tsep-protocol.org/en/controls/TS23) ## Disallow — Restrict crawling of a path [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-Disallow) Ask the crawler not to crawl a path. May not prevent the URL appearing in results and does not secure a directory. A noindex rule behind the block may be unreadable. robots.txt · Googlebot example, illustrative path ``` User-agent: Googlebot Disallow: /internal-search/ ``` - **Google** — Documented [S11](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlebot) - **Bing** — Documented [S08](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingrep) - **Yandex** — Documented [S21](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-yrobots) - **Naver** — Documented [S16](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-navrobots) - **Baidu** — Unconfirmed - **Applebot** — Documented [S01](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-apple) [TS04](https://tsep-protocol.org/en/controls/TS04) [TS05](https://tsep-protocol.org/en/controls/TS05) ## Allow — Allow crawling of a path [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-Allow) Allow a more specific path within a restricted area. Precedence depends on the crawler and User-agent group. This Google example uses the most specific rule; equal matches prefer the least restrictive. robots.txt · Googlebot example ``` User-agent: Googlebot Disallow: /assets/ Allow: /assets/public/ ``` - **Google** — Documented [S11](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlebot) - **Bing** — Documented [S08](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingrep) - **Yandex** — Documented [S21](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-yrobots) - **Naver** — Documented [S16](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-navrobots) - **Baidu** — Unconfirmed - **Applebot** — Documented [S01](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-apple) [TS04](https://tsep-protocol.org/en/controls/TS04) ## Sitemap — Provide the absolute URL of a sitemap [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-Sitemap) Tell crawlers the absolute location of a sitemap. Helps discover URLs; does not guarantee indexing or override access restrictions. robots.txt · replace the domain ``` Sitemap: https://example.com/sitemap.xml ``` - **Google** — Documented [S11](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlebot) - **Bing** — Documented [S09](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingsite) - **Yandex** — Documented [S21](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-yrobots) - **Naver** — Documented [S16](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-navrobots) - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed [TS04](https://tsep-protocol.org/en/controls/TS04) [TS13](https://tsep-protocol.org/en/controls/TS13) ## Crawl-delay — Ask a crawler to space out requests [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-Crawl-delay) Adjust crawl pacing when the crawler supports it. Documented by Bing; unsupported by Google and Applebot, retired by Yandex. Avoid treating it as universal. robots.txt · Bing · 5 is an example ``` User-agent: bingbot Crawl-delay: 5 ``` - **Google** — Unsupported [S11](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlebot) - **Bing** — Documented [S06](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-bingdelay) - **Yandex** — Unused. Ignored since 2018. [S19](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-ycrawl) - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unsupported. Apple explicitly states that its crawler does not follow Crawl-delay. [S01](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-apple) - 2018-02-22 — Yandex stops taking Crawl-delay into account. [S19](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-ycrawl) [TS04](https://tsep-protocol.org/en/controls/TS04) [TS43](https://tsep-protocol.org/en/controls/TS43) ## Clean-param — Identify URL parameters that do not change the content [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-Clean-param) Tell Yandex which parameters do not change content. Must not hide a useful content variant. Yandex-specific in this edition’s sources. robots.txt · Yandex · ref is an example ``` User-agent: Yandex Clean-param: ref /catalog/ ``` - **Google** — Unsupported [S11](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-googlebot) - **Bing** — Unconfirmed - **Yandex** — Documented [S21](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-yrobots) - **Naver** — Unconfirmed - **Baidu** — Unconfirmed - **Applebot** — Unconfirmed [TS04](https://tsep-protocol.org/en/controls/TS04) [TS19](https://tsep-protocol.org/en/controls/TS19) ## IndexNow — Notify engines of added, updated or deleted URLs via an API. Each engine decides whether to index them. [Record](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#directive-IndexNow) Notify a URL addition, change or deletion. Not a robots.txt directive. Accepted notification guarantees neither immediate crawling nor indexing; an ownership key is required. HTTP GET · illustrative example, replace key and URL ``` https://api.indexnow.org/indexnow?url=https%3A%2F%2Fexample.com%2Fpage%2F&key=REPLACE_WITH_SITE_KEY ``` - **Google** — Not listed [S14](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-indexfaq) - **Bing** — Documented [S14](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-indexfaq) - **Yandex** — Documented [S14](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-indexfaq) - **Naver** — Documented [S14](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-indexfaq) - **Baidu** — Not listed [S14](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-indexfaq) - **Applebot** — Not listed [S14](https://tsep-protocol.org/en/updates/seo-geo-directive-matrix#proof-indexfaq) [TS13](https://tsep-protocol.org/en/controls/TS13) ## Archived sources - **S01** [Apple · Applebot](https://support.apple.com/en-us/119829) · 2026-11-06T18:03:31+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/30c9ef308e140287d2a6310879414df7f87a65314234b51d00bd971d6f4daad3.gz) SHA-256: `30c9ef308e140287d2a6310879414df7f87a65314234b51d00bd971d6f4daad3` - **S02** [Baidu · Canonical URLs](https://ziyuan.baidu.com/college/documentinfo?id=1689&page=3) · 2026-11-06T18:03:33+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/d580df80bc9fe05b9ae4ec45b01f7f2ae35c568caa791a059b4bf5416176c5f0.gz) SHA-256: `d580df80bc9fe05b9ae4ec45b01f7f2ae35c568caa791a059b4bf5416176c5f0` - **S03** [Bing · AI preference transition](https://blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/) · 2026-11-06T18:03:33+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/989edfcce11f91b5c34f54102d7a431c1cd62747ff6b865281600ee1cc9a5f1b.gz) SHA-256: `989edfcce11f91b5c34f54102d7a431c1cd62747ff6b865281600ee1cc9a5f1b` - **S04** [Bing · Canonical URLs](https://blogs.bing.com/webmaster/2025/12/Does-Duplicate-Content-Hurt-SEO-and-AI-Search-Visibility/) · 2026-11-07T10:51:28+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/38799c89bb6d84b73cae164f0f585a3b16408d44376cce42001b1a06b43eefc3.gz) SHA-256: `38799c89bb6d84b73cae164f0f585a3b16408d44376cce42001b1a06b43eefc3` - **S05** [Bing · data-nosnippet](https://blogs.bing.com/webmaster/2025/10/Bing-Introduces-Support-for-the-data-nosnippet-HTML-Attribute/) · 2026-11-06T18:03:32+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/0f87b957c30bd66d06506cbb273017460d8e2db3d05a447b5e401adb1209df46.gz) SHA-256: `0f87b957c30bd66d06506cbb273017460d8e2db3d05a447b5e401adb1209df46` - **S06** [Bing · Crawl controls](https://blogs.bing.com/webmaster/2012/5/To-crawl-or-not-to-crawl%2C-that-is-BingBot-s-questi/) · 2026-11-06T18:03:33+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/5a61100fc34011a0e60be33638721608560fe1709b6537c348579cb45f550905.gz) SHA-256: `5a61100fc34011a0e60be33638721608560fe1709b6537c348579cb45f550905` - **S07** [Bing · Result previews](https://blogs.bing.com/webmaster/2020/4/Announcing-new-options-for-webmasters-to-control-their-snippets-at-Bing/) · 2026-11-06T18:03:33+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/e32c9cee56f54236f1211be0d37ebfc47426086497236c6cde06c1d6f13ee6ed.gz) SHA-256: `e32c9cee56f54236f1211be0d37ebfc47426086497236c6cde06c1d6f13ee6ed` - **S08** [Bing · Robots Exclusion Protocol](https://blogs.bing.com/webmaster/June-2008/Robots-Exclusion-Protocol-joining-together-to-pro) · 2026-11-06T18:03:34+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/36ee8f501d9b32604db8b62a043d0199ea93762943d1f0ea85afb8c91df34c8b.gz) SHA-256: `36ee8f501d9b32604db8b62a043d0199ea93762943d1f0ea85afb8c91df34c8b` - **S09** [Bing · Sitemaps](https://blogs.bing.com/webmaster/2025/7/Keeping-Content-Discoverable-with-Sitemaps-in-AI-Powered-Search/) · 2026-11-06T18:03:34+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/61b382c5590c4e4eb24d40e0787319540fb596a75dd09615862bf02ac4c43701.gz) SHA-256: `61b382c5590c4e4eb24d40e0787319540fb596a75dd09615862bf02ac4c43701` - **S10** [Google · Canonicalisation](https://developers.google.com/search/docs/crawling-indexing/consolidate-duplicate-urls) · 2026-11-06T18:03:34+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/927f250222f73d7be9907a3e74b40c6bad9f2f52258112d74cbcf2d750b6fb39.gz) SHA-256: `927f250222f73d7be9907a3e74b40c6bad9f2f52258112d74cbcf2d750b6fb39` - **S11** [Google · Robots.txt specification](https://developers.google.com/crawling/docs/robots-txt/robots-txt-spec) · 2026-11-06T18:03:33+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/3f6dcd84f1e21c794f7fc5d1481080df224ecf862dcf993e87a4a7bf6ff80d20.gz) SHA-256: `3f6dcd84f1e21c794f7fc5d1481080df224ecf862dcf993e87a4a7bf6ff80d20` - **S12** [Google · Robots meta and snippets](https://developers.google.com/search/docs/crawling-indexing/robots-meta-tag) · 2026-11-06T18:03:34+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/0448020585bc91e9b1b2b4f23d2d8e6614caa27cb54a95d8527746095db2aa16.gz) SHA-256: `0448020585bc91e9b1b2b4f23d2d8e6614caa27cb54a95d8527746095db2aa16` - **S13** [Google · Localised versions](https://developers.google.com/search/docs/specialty/international/localized-versions) · 2026-11-06T18:03:34+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/ab5f28e4930d36259af3b221ba060093aa4f3bca1ad2d3ddd3cd0cfdb4217291.gz) SHA-256: `ab5f28e4930d36259af3b221ba060093aa4f3bca1ad2d3ddd3cd0cfdb4217291` - **S14** [IndexNow · FAQ](https://www.indexnow.org/faq) · 2026-11-06T18:03:34+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/fa678ff2c69ef503f1848421050509290010918242989255a93d417244382868.gz) SHA-256: `fa678ff2c69ef503f1848421050509290010918242989255a93d417244382868` - **S15** [Naver · HTML structure](https://searchadvisor.naver.com/guide/markup-structure) · 2026-11-06T18:03:38+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/a8534737367bc7d748b65e057b454eb67f19a97f157ac2d264ede42b33179b08.gz) SHA-256: `a8534737367bc7d748b65e057b454eb67f19a97f157ac2d264ede42b33179b08` - **S16** [Naver · robots.txt](https://searchadvisor.naver.com/guide/seo-basic-robots) · 2026-11-06T18:03:38+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/49daa0f9041621cc2ce53a7c7e12a6ba79a346ac979aa6196d1c80d01502faf4.gz) SHA-256: `49daa0f9041621cc2ce53a7c7e12a6ba79a346ac979aa6196d1c80d01502faf4` - **S17** [Yandex · Robots meta and headers](https://yandex.com/support/webmaster/en/controlling-robot/html) · 2026-11-06T18:03:35+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/85e2b619502a81981a55a628873a0b95443284bf89b92c99dd2ca443c85ed479.gz) SHA-256: `85e2b619502a81981a55a628873a0b95443284bf89b92c99dd2ca443c85ed479` - **S18** [Yandex · Canonical URLs](https://yandex.com/support/webmaster/en/robot-workings/canonical) · 2026-11-06T18:03:35+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/f4ee0aa481e4043f8a392a1ae81e65b884965ea7743355d46b3cbe5ca895b639.gz) SHA-256: `f4ee0aa481e4043f8a392a1ae81e65b884965ea7743355d46b3cbe5ca895b639` - **S19** [Yandex · Crawl-delay withdrawal](https://yandex.com/support/webmaster/en/robot-workings/crawl-delay) · 2026-11-06T18:03:35+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/20ba4a0c608980f937558b2ee5a7e1d661f8e2e178b3ba7949924253139d9694.gz) SHA-256: `20ba4a0c608980f937558b2ee5a7e1d661f8e2e178b3ba7949924253139d9694` - **S20** [Yandex · Localised versions](https://yandex.com/support/webmaster/en/yandex-indexing/locale-pages) · 2026-11-06T18:03:35+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/76195bff3bee33c77ffd6ab33d5a7f58e9494f121e69eaa5b7533250c8abe54d.gz) SHA-256: `76195bff3bee33c77ffd6ab33d5a7f58e9494f121e69eaa5b7533250c8abe54d` - **S21** [Yandex · robots.txt](https://yandex.com/support/webmaster/en/controlling-robot/robots-txt) · 2026-11-06T18:03:35+00:00 · [Gzip capture](https://tsep-protocol.org/assets/watch-directives/52622f8f52e11f1d3836236032d683f83bb928f0a1ac663e8bda04b91b6d5ed1.gz) SHA-256: `52622f8f52e11f1d3836236032d683f83bb928f0a1ac663e8bda04b91b6d5ed1` ## DigiCert · RFC 3161 2026-11-07T10:51:59+00:00 · 21 captures [Verification bundle](https://tsep-protocol.org/assets/watch-directives-timestamps/6a0816037d2e429ffac10d0e6c05b0d5ce69d6f9a3c26684b341fb6b8c0e5d3e.zip) SHA-256: `6a0816037d2e429ffac10d0e6c05b0d5ce69d6f9a3c26684b341fb6b8c0e5d3e` ## Edition history - **2026-11-07.1** — FR/EN review confirmed by Bertrand Morel. Reservation on point 30: the 2009 Bing reference announced future support. At his request, it is replaced by the official 19 December 2025 article recommending canonical for duplicates. Documentary correction made by the assistant; new capture and newly timestamped manifest. Other captures retain their 6 November dates. - **2026-11-06.1** — 22 mechanisms; examples, limits, engine differences, downloadable captures and exports. Correction: Applebot does not follow Crawl-delay. Announced transitions distinguished from applied rules. - **2026-11-05** — Initial matrix of 16 mechanisms for six engines. [AI crawlers and controls](https://tsep-protocol.org/en/updates/ai-crawlers-and-robots-txt)