SEO & AI Search Updates

What changes. At the source.

Official announcements. SEO and AI search, their sources and related TSEP controls.

tracked sources
50
retained announcements
179
RSS
Updated:

Filtered announcements.

AIPREF: revision 08 of the AI usage preference vocabulary 

Original A Vocabulary For Expressing AI Usage Preferences

Read the editorial context
Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Beta or preview

Added during the historical import.

A Vocabulary For Expressing AI Usage Preferences

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
375388b9925d03e94ad191c74f999efdcd01a2abe2e15b3569ded3abaaa49310
Compared text · Download (gzip) · SHA-256
898de32a344872b92af7171d47164883d10b7db32d23ad0b1b6d1ec893af9d10

Existence timestamped by DigiCert on · Verify timestamp

Permalink

AIPREF: revision 05 of the draft attaching usage preferences to HTTP and robots.txt 

Original Associating AI Usage Preferences with Content in HTTP

Read the editorial context
Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Beta or preview

Added during the historical import.

Associating AI Usage Preferences with Content in HTTP

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
68b7ecee2c71dc4f5167ade6bcf13d6f8afaf59cb95cb0fca00646bec08181f5
Compared text · Download (gzip) · SHA-256
2a041b34e13f88251c9a5f800e1f8cc9f02d25d0b003801536cd3323e9a25a5c

Existence timestamped by DigiCert on · Verify timestamp

Permalink

AIPREF: first draft for expressing preferences in HTTP and robots.txt 

Original Indicating Preferences Regarding Content Usage

Read the editorial context
Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Beta or preview

Added during the historical import.

Indicating Preferences Regarding Content Usage

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
25b07c3be0cc4ee3b47e356a8627eca54d01e2fa8b1280ccfca2095c5ce6c6e2
Compared text · Download (gzip) · SHA-256
70f9b8533848153efb0501218c43d59c980324b61ab07e3d3588f8add60e0303

Existence timestamped by DigiCert on · Verify timestamp

Permalink

AIPREF: first vocabulary draft for content usage preferences 

Original Proposal for an Opt-Out Vocabulary

Read the editorial context
Evidence
Official publication
First detected
2026-11-06
Last seen in the source
2026-11-06
Topic
AI training
Status
Beta or preview

Added during the historical import.

Proposal for an Opt-Out Vocabulary

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-06

Source capture · Download (gzip) · SHA-256
cefdbd5cd7097b308a28dd3e975bce444d9cf97114235e8e24fa4c5f1e4c1332
Compared text · Download (gzip) · SHA-256
ccc70769c7bab2a7011d7a0e9c1d692a805d08e37747edf9dcb530de5dcc5ceb

Existence timestamped by DigiCert on · Verify timestamp

Permalink

Reference data

The registers.

Coverage check

What the feed missed.

2 / 3

events found

67 %

2 / 6 provider mentions found

Reports missed by month-end

Shared AI training preference

Google · Microsoft · OpenAI · Anthropic

Events and comparison sources

An event counts once when any of its official reports enters the collection. Each provider is counted separately. Later backfills preserve the month-end score.

Figures cover the sampled events only, compared with independent publications at the end of each month (UTC).

Directory · 50 tracked sources

Sources and coverage.

Google16 sources
Microsoft · Bing4 sources
AI and other platforms16 sources
  • Amazon search and AI crawlers · Hourly Last successful read ·
  • Anthropic crawlers and access · Hourly Last successful read · 1 archived publication Oct 2026
  • Apple Business local presence release notes · Nightly Last successful read · 5 archived publications May 2026 – Oct 2026
  • Apple Business locations and brands · Nightly Last successful read · 1 archived publication Mar 2026
  • Apple Applebot · Hourly Last successful read ·
  • ByteDance Bytespider and access · Nightly Last successful read ·
  • Common Crawl CCBot and access · Nightly Last successful read ·
  • DuckDuckGo DuckAssistBot · Nightly Last successful read ·
  • Grok (xAI) announcements and release notes · Hourly Last successful read · 9 archived publications Dec 2024 – May 2026
  • Grok (xAI) web search and sources · Hourly Last successful read ·
  • Meta crawlers and access · Hourly Last successful read ·
  • Mistral AI announcements · Hourly Last successful read · 6 archived publications Nov 2024 – Sep 2026
  • Mistral AI crawlers and access · Hourly Last successful read ·
  • OpenAI publisher announcements · Hourly Last successful read · 2 archived publications Jul 2026 – Oct 2026
  • OpenAI search crawlers · Hourly Last successful read ·
  • Perplexity search crawlers and access · Hourly Last successful read ·
Standards and institutions11 sources
Outside the default selection3 sources
  • Baidu search resource platform · Nightly Last successful read · 6 archived publications Sep 2026 – Nov 2026 Official source
  • Naver Search & Tech · Nightly Last successful read · 18 archived publications Jul 2026 – Nov 2026 Official source
  • Yandex webmaster news · Nightly Last successful read · 5 archived publications Aug 2026 – Oct 2026 Official source

Available archives vary by source. Changes to undated documentation pages are reviewed before they may appear in the feed.

Primary sources feed the editorial selection. Baidu, Naver and Yandex remain available by filter and in search.

The method

Facts. With context.

  1. Collect

    Critical sources are checked hourly; all sources are checked nightly. One record keeps the original title, published date and sources for each event. Undated documentation changes are held for review. The French and English RSS feeds support WebSub to notify compatible subscribers after publication.

  2. Classify

    A yellow square marks a change that may affect a TSEP check, access rule, diagnosis or deadline. Recurring publications and events remain background information. A yellow triangle identifies background news; a dashed circle means classification is pending. Translations are editorial.

  3. Review for TSEP

    Each month, the review connects announcements to relevant TSEP controls. For each item reviewed, the team decides whether the protocol already covers it, a change needs consideration, or monitoring should continue or close.

Report an error