TSEP Technical SEOEvidence Protocol
App

SEO & AI Search Updates

What changes. At the source.

Official announcements. SEO and AI search, their sources and related TSEP controls.

tracked sources
50
retained announcements
179
RSS
Updated:

Filtered announcements.

1 result

Clear allEdit filters
Google Crawling documentation

Added an overview page about Google's web crawling 

Crawler access
Evidence
Official publication
First detected
2026-11-05
Last seen in the source
2026-11-11
Topic
Crawling and indexing
Status
Documentation updated

Added during the historical import.

Shortened excerpt · normalized text, not verbatim.

What: Added a new page about how Google's crawling works.…

Added an overview page about Google's web crawling

Captures were made on the dates below, sometimes after first detection. Hashes apply to decompressed files. Compared text is a normalized extraction; the source capture retains the received bytes.

First capture · · Passage last seen on 2026-11-11

Source capture · Download (gzip) · SHA-256
0b016d23d83635edc32fc8a7da77a0dab84eb1bcca35f5737c55a2a6b0b8e653
Compared text · Download (gzip) · SHA-256
22de61d85ab8ecae3fe435653d3e87f1566b3c5514a02ae860c28192da4e2a95

Existence timestamped by DigiCert on · Verify timestamp

Related documentation · Permalink

Reference data

The registers.

Coverage check

What the feed missed.

2 / 3

events found

67 %

2 / 6 provider mentions found

Reports missed by month-end

Shared AI training preference

Google · Microsoft · OpenAI · Anthropic

Events and comparison sources

An event counts once when any of its official reports enters the collection. Each provider is counted separately. Later backfills preserve the month-end score.

Figures cover the sampled events only, compared with independent publications at the end of each month (UTC).

Directory · 50 tracked sources

Sources and coverage.

Google16 sources
Microsoft · Bing4 sources
AI and other platforms16 sources
  • Amazon search and AI crawlers · Hourly Last successful read ·
  • Anthropic crawlers and access · Hourly Last successful read · 1 archived publication Oct 2026
  • Apple Business local presence release notes · Nightly Last successful read · 5 archived publications May 2026 – Oct 2026
  • Apple Business locations and brands · Nightly Last successful read · 1 archived publication Mar 2026
  • Apple Applebot · Hourly Last successful read ·
  • ByteDance Bytespider and access · Nightly Last successful read ·
  • Common Crawl CCBot and access · Nightly Last successful read ·
  • DuckDuckGo DuckAssistBot · Nightly Last successful read ·
  • Grok (xAI) announcements and release notes · Hourly Last successful read · 9 archived publications Dec 2024 – May 2026
  • Grok (xAI) web search and sources · Hourly Last successful read ·
  • Meta crawlers and access · Hourly Last successful read ·
  • Mistral AI announcements · Hourly Last successful read · 6 archived publications Nov 2024 – Sep 2026
  • Mistral AI crawlers and access · Hourly Last successful read ·
  • OpenAI publisher announcements · Hourly Last successful read · 2 archived publications Jul 2026 – Oct 2026
  • OpenAI search crawlers · Hourly Last successful read ·
  • Perplexity search crawlers and access · Hourly Last successful read ·
Standards and institutions11 sources
Outside the default selection3 sources
  • Baidu search resource platform · Nightly Last successful read · 6 archived publications Sep 2026 – Nov 2026 Official source
  • Naver Search & Tech · Nightly Last successful read · 18 archived publications Jul 2026 – Nov 2026 Official source
  • Yandex webmaster news · Nightly Last successful read · 5 archived publications Aug 2026 – Oct 2026 Official source

Available archives vary by source. Changes to undated documentation pages are reviewed before they may appear in the feed.

Primary sources feed the editorial selection. Baidu, Naver and Yandex remain available by filter and in search.

The method

Facts. With context.

  1. Collect

    Critical sources are checked hourly; all sources are checked nightly. One record keeps the original title, published date and sources for each event. Undated documentation changes are held for review. The French and English RSS feeds support WebSub to notify compatible subscribers after publication.

  2. Classify

    A yellow square marks a change that may affect a TSEP check, access rule, diagnosis or deadline. Recurring publications and events remain background information. A yellow triangle identifies background news; a dashed circle means classification is pending. Translations are editorial.

  3. Review for TSEP

    Each month, the review connects announcements to relevant TSEP controls. For each item reviewed, the team decides whether the protocol already covers it, a change needs consideration, or monitoring should continue or close.

Report an error