SEO & AI Search Updates

What changes. At the source.

Official announcements. SEO and AI search, their sources and related TSEP controls.

tracked sources
50
retained announcements
181
RSS
Updated:

AI training

Supporting a shared AI training control for websites

Impact
Evidence
Official publication
First detected
2026-11-05
Last seen in the source
2026-11-12
Topic
AI training
Status
Status by provider

Added during the historical import.

Shortened excerpt · normalized text, not verbatim.

Today, we're announcing our plans to support a shared AI training control in robots.txt. This will help…

Supporting a shared AI training control for websites

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-12

Source capture · Download (gzip) · SHA-256
5801f586c09d2c5da76bb071305f00a7fdf51c9eba92f56efc6c1ca95a607000
Compared text · Download (gzip) · SHA-256
4d0ab73b960c96b2e07dcad87993171d782634b4d7445cfc52c017723bdd3b16

Existence timestamped by DigiCert on · Verify timestamp

Updated common crawlers page to mention future AI training control support

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-12

Source capture · Download (gzip) · SHA-256
0b016d23d83635edc32fc8a7da77a0dab84eb1bcca35f5737c55a2a6b0b8e653
Compared text · Download (gzip) · SHA-256
2b1c7949a09467740495061478274258fd6e13e1c8506f0ca7ffaf12aa6a78d0

Existence timestamped by DigiCert on · Verify timestamp

Your content, your choice: clearer preferences for training and grounding

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-12

Source capture · Download (gzip) · SHA-256
485728a612d7fe221c10c80c709871afbaef1335aa9ab3662098b3de2dece1d7
Compared text · Download (gzip) · SHA-256
e34ff3d5f65c816f914b4f4bfe6047188288180770f908d1172ca6c818b4a620

Existence timestamped by DigiCert on · Verify timestamp

Making it easier for websites to express AI training preferences

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-12

Source capture · Download (gzip) · SHA-256
a0a2b9bc5914cb528f31cab6f8f73f9524f6b14089f775fc4a80b24d0e95982e
Compared text · Download (gzip) · SHA-256
c630dfb7fc316a8086e2e09a8ecdda7c10826c11a57b7e70af5da12c0a3be83c

Existence timestamped by DigiCert on · Verify timestamp

How Anthropic honors website preferences for AI training

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-12

Source capture · Download (gzip) · SHA-256
e602ce6895e8e0d41177f00512c3ac06cdde17eac9f78fc43bb905de142cc122

Existence timestamped by DigiCert on · Verify timestamp

Machine-Readable Training Preference Signal

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
50ae1b9b63e6e1abe8f3f01e58981fb5c36a77745d8c381436d4042106dfa625
Compared text · Download (gzip) · SHA-256
81b3855f3dd3a5205aedcc9bb5c1427a1b331ae6b0a28583a286947756faeb4e

Existence timestamped by DigiCert on · Verify timestamp

Permalink

AIPREF: revision 08 of the AI usage preference vocabulary

Original A Vocabulary For Expressing AI Usage Preferences

Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Beta or preview

Added during the historical import.

A Vocabulary For Expressing AI Usage Preferences

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
375388b9925d03e94ad191c74f999efdcd01a2abe2e15b3569ded3abaaa49310
Compared text · Download (gzip) · SHA-256
898de32a344872b92af7171d47164883d10b7db32d23ad0b1b6d1ec893af9d10

Existence timestamped by DigiCert on · Verify timestamp

Permalink

AIPREF: revision 05 of the draft attaching usage preferences to HTTP and robots.txt

Original Associating AI Usage Preferences with Content in HTTP

Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Beta or preview

Added during the historical import.

Associating AI Usage Preferences with Content in HTTP

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
68b7ecee2c71dc4f5167ade6bcf13d6f8afaf59cb95cb0fca00646bec08181f5
Compared text · Download (gzip) · SHA-256
2a041b34e13f88251c9a5f800e1f8cc9f02d25d0b003801536cd3323e9a25a5c

Existence timestamped by DigiCert on · Verify timestamp

Permalink

GPAI Code: Commission confirms the adequacy of the voluntary tool

Original Commission Opinion on the assessment of the General-Purpose AI Code of Practice

Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Published

Added during the historical import.

Commission Opinion on the assessment of the General-Purpose AI Code of Practice

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
93c5bb5fda3c1915376db8d0fb0280c67d67e7def755498e1ada1334414f74d4
Compared text · Download (gzip) · SHA-256
cdeb379ea313e4bf9c2098bc3d76522f90eaf26a03fee9dd976b027cdaeae2e2

Existence timestamped by DigiCert on · Verify timestamp

Permalink

GPAI: public training-content summary template published

Original Explanatory Notice and Template for the Public Summary of Training Content for general-purpose AI models

Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Published

Added during the historical import.

Explanatory Notice and Template for the Public Summary of Training Content for general-purpose AI models

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
36a58fcdd847274ac215c97c4d524c8232ef694eb76dda7c72d98ac4e276ed36
Compared text · Download (gzip) · SHA-256
a7498525dc761a6be361f0c4d76c0f68feca85a493e78bad07d9b162be64f99c

Existence timestamped by DigiCert on · Verify timestamp

Permalink

GPAI Code: final version published, including transparency and copyright chapters

Original General-Purpose AI Code of Practice now available

Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Published

Added during the historical import.

General-Purpose AI Code of Practice now available

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
8515069fef7bbba42f67a1adb6285b14e8cbb7f8b6dca5ae8f20ac6367c94afa
Compared text · Download (gzip) · SHA-256
bcc3e6e89c12d4b1ebd245d8d954f59036add1f50852d0f4dd7e4f09d8dc3abd

Existence timestamped by DigiCert on · Verify timestamp

Permalink

AIPREF: first draft for expressing preferences in HTTP and robots.txt

Original Indicating Preferences Regarding Content Usage

Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Beta or preview

Added during the historical import.

Indicating Preferences Regarding Content Usage

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
25b07c3be0cc4ee3b47e356a8627eca54d01e2fa8b1280ccfca2095c5ce6c6e2
Compared text · Download (gzip) · SHA-256
70f9b8533848153efb0501218c43d59c980324b61ab07e3d3588f8add60e0303

Existence timestamped by DigiCert on · Verify timestamp

Permalink

AIPREF: first vocabulary draft for content usage preferences

Original Proposal for an Opt-Out Vocabulary

Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Beta or preview

Added during the historical import.

Proposal for an Opt-Out Vocabulary

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
cefdbd5cd7097b308a28dd3e975bce444d9cf97114235e8e24fa4c5f1e4c1332
Compared text · Download (gzip) · SHA-256
ccc70769c7bab2a7011d7a0e9c1d692a805d08e37747edf9dcb530de5dcc5ceb

Existence timestamped by DigiCert on · Verify timestamp

Permalink

GPAI Code: third draft and clearer copyright provisions

Original Third Draft of the General-Purpose AI Code of Practice published, written by independent experts

Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Beta or preview

Added during the historical import.

Third Draft of the General-Purpose AI Code of Practice published, written by independent experts

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
9f3a1f09fae250bf444a107c5d591622fea3955a2d37293cf786d74ff27328d2
Compared text · Download (gzip) · SHA-256
fe403a175cf1d9effd3abaf773eb4bda75903e0f91aa7618267ab0b5a43b7106

Existence timestamped by DigiCert on · Verify timestamp

Permalink

GPAI Code: second draft following the first consultation

Original Second Draft of the General-Purpose AI Code of Practice published, written by independent experts

Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Beta or preview

Added during the historical import.

Second Draft of the General-Purpose AI Code of Practice published, written by independent experts

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
64411f7e1cd60a3d3e7bd141e6f9da2331143e8242fb0923822d4bb4db6653fe
Compared text · Download (gzip) · SHA-256
1b3cf3932e3f2a438eaaecf25d0286473abda08afc78da5f8f949a9d161eb6da

Existence timestamped by DigiCert on · Verify timestamp

Permalink

Reference data

The registers.

Coverage check

What the feed missed.

2 / 3

events found

67 %

2 / 6 provider mentions found

Reports missed by month-end

Shared AI training preference

Google · Microsoft · OpenAI · Anthropic

Events and comparison sources

An event counts once when any of its official reports enters the collection. Each provider is counted separately. Later backfills preserve the month-end score.

Figures cover the sampled events only, compared with independent publications at the end of each month (UTC).

Directory · 50 tracked sources

Sources and coverage.

Google16 sources
Microsoft · Bing4 sources
AI and other platforms16 sources
  • Amazon search and AI crawlers · Hourly Last successful read ·
  • Anthropic crawlers and access · Hourly Last successful read · 1 archived publication Oct 2026
  • Apple Business local presence release notes · Nightly Last successful read · 5 archived publications May 2026 – Oct 2026
  • Apple Business locations and brands · Nightly Last successful read · 1 archived publication Mar 2026
  • Apple Applebot · Hourly Last successful read ·
  • ByteDance Bytespider and access · Nightly Last successful read ·
  • Common Crawl CCBot and access · Nightly Last successful read ·
  • DuckDuckGo DuckAssistBot · Nightly Last successful read · Last attempt failed ·
  • Grok (xAI) announcements and release notes · Hourly Last successful read · 9 archived publications Dec 2024 – May 2026
  • Grok (xAI) web search and sources · Hourly Last successful read ·
  • Meta crawlers and access · Hourly Last successful read ·
  • Mistral AI announcements · Hourly Last successful read · 6 archived publications Nov 2024 – Sep 2026
  • Mistral AI crawlers and access · Hourly Last successful read ·
  • OpenAI publisher announcements · Hourly Last successful read · 2 archived publications Jul 2026 – Oct 2026
  • OpenAI search crawlers · Hourly Last successful read ·
  • Perplexity search crawlers and access · Hourly Last successful read ·
Standards and institutions11 sources
Outside the default selection3 sources
  • Baidu search resource platform · Nightly Last successful read · 6 archived publications Sep 2026 – Nov 2026 Official source
  • Naver Search & Tech · Nightly Last successful read · 18 archived publications Jul 2026 – Nov 2026 Official source
  • Yandex webmaster news · Nightly Last successful read · 5 archived publications Aug 2026 – Oct 2026 Official source

Available archives vary by source. Changes to undated documentation pages are reviewed before they may appear in the feed.

Primary sources feed the editorial selection. Baidu, Naver and Yandex remain available by filter and in search.

The method

Facts. With context.

  1. Collect

    Critical sources are checked hourly; all sources are checked nightly. One record keeps the original title, published date and sources for each event. Undated documentation changes are held for review. The French and English RSS feeds support WebSub to notify compatible subscribers after publication.

  2. Classify

    A yellow square marks a change that may affect a TSEP check, access rule, diagnosis or deadline. Recurring publications and events remain background information. A yellow triangle identifies background news; a dashed circle means classification is pending. Translations are editorial.

  3. Review for TSEP

    Each month, the review connects announcements to relevant TSEP controls. For each item reviewed, the team decides whether the protocol already covers it, a change needs consideration, or monitoring should continue or close.

Impact explains practical consequences after human review in the displayed language. View adds a distinct editorial position: it is public only after personal approval, with the author’s name and reviewed language. AI-assisted proposals remain in the private workspace.

Report an error