{"id":"tsep-directives","publisher":"Edikka — TSEP","license":"https://creativecommons.org/licenses/by/4.0/","license_scope":{"fr":"Données et classement éditoriaux de TSEP. Les documents cités conservent leurs conditions d’origine.","en":"TSEP factual compilation and editorial classifications. Source documents retain their original terms."},"url":{"fr":"https://tsep-protocol.org/veille/matrice-directives-seo-geo","en":"https://tsep-protocol.org/en/updates/seo-geo-directive-matrix"},"slug":{"fr":"matrice-directives-seo-geo","en":"seo-geo-directive-matrix"},"title":{"fr":"Matrice des directives SEO et GEO","en":"SEO and GEO directive matrix"},"description":{"fr":"Comparez les règles d’indexation, d’extraits et d’exploration, les signaux d’URL et IndexNow pour six moteurs.","en":"Compare indexing, snippet and crawling rules, URL signals and IndexNow across six engines."},"edition":"2026-11-07","engines":["Google","Bing","Yandex","Naver","Baidu","Applebot"],"groups":{"meta":{"fr":"Indexation et extraits","en":"Indexing and snippets"},"urls":{"fr":"En-têtes et variantes d’URL","en":"Headers and URL variants"},"robots":{"fr":"Exploration · robots.txt","en":"Crawling · robots.txt"},"notify":{"fr":"Notification des moteurs","en":"Search engine notifications"}},"rows":[{"id":"noindex","name":{"fr":"Exclure une page de l’index","en":"Exclude a page from the index"},"cells":{"Google":{"status":"documented","source":"googlemeta"},"Bing":{"status":"documented","source":"bingrep"},"Yandex":{"status":"documented","source":"yandex","note":{"fr":"La documentation Yandex donne priorité aux règles autorisant l’indexation lorsqu’elles sont combinées à des interdictions. Ne pas généraliser la priorité restrictive de Google.","en":"Yandex documentation gives permitting rules precedence when combined with prohibitions. Do not generalise Google’s most-restrictive precedence."}},"Naver":{"status":"documented","source":"naver"},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"documented","source":"apple"}},"group":"meta","kind":"directive","related_controls":["TS05","TS07"],"effect":{"fr":"Exclure une ressource des résultats.","en":"Exclude a resource from results."},"limits":{"fr":"Le robot doit pouvoir lire la règle. Disallow peut empêcher sa découverte ; noindex ne protège pas un contenu confidentiel.","en":"The crawler must read the rule. Disallow can prevent discovery; noindex does not secure confidential content."},"example":{"scope":{"fr":"HTML · Google, Bing, Yandex, Naver, Applebot","en":"HTML · Google, Bing, Yandex, Naver, Applebot"},"code":"<meta name=\"robots\" content=\"noindex\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta","bingrep","yandex","naver","apple"],"history":[]},{"id":"nofollow","group":"meta","name":{"fr":"Demander au robot de ne suivre aucun lien de la page","en":"Ask the crawler not to follow links on the page"},"cells":{"Google":{"status":"documented","source":"googlemeta"},"Bing":{"status":"documented","source":"bingrep"},"Yandex":{"status":"documented","source":"yandex"},"Naver":{"status":"documented","source":"naver"},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"documented","source":"apple"}},"kind":"directive","related_controls":["TS07","TS17"],"effect":{"fr":"Indiquer que les liens de cette page ne doivent pas être suivis.","en":"Indicate that links on this page should not be followed."},"limits":{"fr":"Ne désindexe ni la page ni les destinations. Un robot peut découvrir les URL par d’autres liens.","en":"Does not deindex the page or destinations. A crawler may discover URLs through other links."},"example":{"scope":{"fr":"HTML · portée page","en":"HTML · page scope"},"code":"<meta name=\"robots\" content=\"nofollow\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta","bingrep","yandex","naver","apple"],"history":[]},{"id":"nosnippet","name":{"fr":"Masquer l’extrait d’une page","en":"Suppress the page snippet"},"cells":{"Google":{"status":"documented","source":"googlemeta","note":{"fr":"Concerne aussi Discover, AI Overviews et AI Mode ; empêche l’usage du contenu comme entrée directe pour ces deux fonctions IA. Une vignette statique peut subsister.","en":"Also covers Discover, AI Overviews and AI Mode; prevents direct input to those two AI features. A static thumbnail may remain."}},"Bing":{"status":"documented","source":"bingdata"},"Yandex":{"status":"unverified","source":null},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"documented","source":"apple","note":{"fr":"Exclut la description et la réponse web, ainsi que l’usage du contenu comme contexte des réponses IA Apple ; la découverte de l’URL reste possible.","en":"Excludes descriptions and web answers, and content use as context for Apple AI responses; URL discovery remains possible."}}},"group":"meta","kind":"directive","related_controls":["TS07","TS42"],"effect":{"fr":"Exclure l’extrait textuel et certains usages de présentation ou de réponse IA.","en":"Exclude text snippets and some display or AI-response uses."},"limits":{"fr":"La portée varie selon le moteur. Ce n’est pas une interdiction générale d’entraînement IA ; consulter le registre des robots IA pour cet usage.","en":"Scope varies by engine. Not a general AI-training opt-out; consult the AI crawler register for that use."},"example":{"scope":{"fr":"HTML · vérifier les différences ci-dessous","en":"HTML · check differences below"},"code":"<meta name=\"robots\" content=\"nosnippet\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta","bingdata","apple"],"history":[]},{"id":"max-snippet","name":{"fr":"Limiter la longueur de l’extrait","en":"Limit snippet length"},"cells":{"Google":{"status":"documented","source":"googlemeta","note":{"fr":"Limite aussi l’entrée directe pour AI Overviews et AI Mode, sauf autorisations distinctes, notamment certaines données structurées ou licences.","en":"Also limits direct input to AI Overviews and AI Mode, except separately permitted uses, including some structured data or licences."}},"Bing":{"status":"documented","source":"bingoptions"},"Yandex":{"status":"unverified","source":null},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"group":"meta","kind":"directive","related_controls":["TS07"],"effect":{"fr":"Fixer une longueur maximale d’extrait en caractères.","en":"Set a maximum snippet length in characters."},"limits":{"fr":"0 supprime l’extrait ; -1 laisse le moteur choisir. Ne garantit ni un extrait ni une citation IA.","en":"0 suppresses the snippet; -1 lets the engine choose. Guarantees neither a snippet nor an AI citation."},"example":{"scope":{"fr":"HTML · Google et Bing · 160 est un exemple","en":"HTML · Google and Bing · 160 is an example"},"code":"<meta name=\"robots\" content=\"max-snippet:160\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta","bingoptions"],"history":[]},{"id":"max-image-preview","group":"meta","name":{"fr":"Limiter la taille des aperçus d’image","en":"Set the maximum image preview size"},"cells":{"Google":{"status":"documented","source":"googlemeta"},"Bing":{"status":"documented","source":"bingoptions"},"Yandex":{"status":"unverified","source":null},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"kind":"directive","related_controls":["TS07"],"effect":{"fr":"Définir la taille maximale des aperçus d’images.","en":"Define the maximum image-preview size."},"limits":{"fr":"Valeurs : none, standard, large. Une permission n’oblige pas le moteur à afficher une image. Ce n’est pas noimageindex.","en":"Values: none, standard, large. Permission does not require an image display. This is not noimageindex."},"example":{"scope":{"fr":"HTML · Google et Bing","en":"HTML · Google and Bing"},"code":"<meta name=\"robots\" content=\"max-image-preview:large\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta","bingoptions"],"history":[]},{"id":"max-video-preview","name":{"fr":"Limiter la durée de l’aperçu vidéo","en":"Limit video preview length"},"group":"meta","cells":{"Google":{"status":"documented","source":"googlemeta"},"Bing":{"status":"documented","source":"bingoptions"},"Yandex":{"status":"unverified","source":null},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"kind":"directive","related_controls":["TS07"],"effect":{"fr":"Limiter l’aperçu vidéo à un nombre de secondes.","en":"Limit video previews to a number of seconds."},"limits":{"fr":"0 autorise au plus une image statique ; -1 n’impose pas de limite. La vidéo peut rester indexable.","en":"0 allows at most a static image; -1 imposes no limit. The video may remain indexable."},"example":{"scope":{"fr":"HTML · Google et Bing · 10 est un exemple","en":"HTML · Google and Bing · 10 is an example"},"code":"<meta name=\"robots\" content=\"max-video-preview:10\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta","bingoptions"],"history":[]},{"id":"data-nosnippet","name":{"fr":"Exclure un passage de l’extrait","en":"Exclude a passage from the snippet"},"cells":{"Google":{"status":"documented","source":"googlemeta","note":{"fr":"Sur span, div et section. La règle limite les extraits ; elle ne désindexe pas le texte.","en":"On span, div and section. Restricts snippets; it does not deindex the text."}},"Bing":{"status":"documented","source":"bingdata","note":{"fr":"Tout élément HTML. Le contenu reste indexable et utilisable pour le classement, mais est exclu des extraits et synthèses IA.","en":"Any HTML element. Content remains indexable and available for ranking, but is excluded from snippets and AI summaries."}},"Yandex":{"status":"unverified","source":null},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"group":"meta","kind":"attribute","related_controls":["TS07","TS42"],"effect":{"fr":"Retirer un passage des extraits sans retirer toute la page.","en":"Exclude a passage from snippets without removing the whole page."},"limits":{"fr":"Le contenu reste accessible. Google documente span, div et section ; Bing accepte tout élément HTML.","en":"Content remains accessible. Google documents span, div and section; Bing accepts any HTML element."},"example":{"scope":{"fr":"HTML · Google et Bing","en":"HTML · Google and Bing"},"code":"<div data-nosnippet>Passage exclu / Excluded passage</div>"},"reviewed":"2026-11-06","evidence_keys":["googlemeta","bingdata"],"history":[]},{"id":"noimageindex","group":"meta","name":{"fr":"Empêcher l’indexation des images à partir de cette page","en":"Prevent images from being indexed from this page"},"cells":{"Google":{"status":"documented","source":"googlemeta"},"Bing":{"status":"unverified","source":null},"Yandex":{"status":"unverified","source":null},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"kind":"directive","related_controls":["TS07"],"effect":{"fr":"Demander de ne pas indexer les images de la page.","en":"Request that images on the page not be indexed."},"limits":{"fr":"Portée documentée ici pour Google. Ne pas confondre avec la taille d’une vignette ou l’interdiction d’explorer le fichier image.","en":"Documented here for Google. Distinct from thumbnail size or blocking access to an image file."},"example":{"scope":{"fr":"HTML · Google","en":"HTML · Google"},"code":"<meta name=\"googlebot\" content=\"noimageindex\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta"],"history":[]},{"id":"indexifembedded","name":{"fr":"Indexer un contenu intégré malgré noindex","en":"Index embedded content despite noindex"},"group":"meta","cells":{"Google":{"status":"documented","source":"googlemeta"},"Bing":{"status":"unverified","source":null},"Yandex":{"status":"unverified","source":null},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"kind":"directive","related_controls":["TS07"],"effect":{"fr":"Permettre l’indexation d’un contenu lorsqu’il est intégré ailleurs.","en":"Allow content to be indexed when embedded elsewhere."},"limits":{"fr":"Chez Google, n’a d’effet qu’avec noindex ; ne pas le lire comme une exception prise en charge par tous les moteurs.","en":"For Google, only takes effect alongside noindex; do not assume all engines support this exception."},"example":{"scope":{"fr":"HTML · Google uniquement dans ce registre","en":"HTML · Google only in this register"},"code":"<meta name=\"googlebot\" content=\"noindex, indexifembedded\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta"],"history":[]},{"id":"unavailable_after","group":"meta","name":{"fr":"Indiquer à partir de quand retirer une page des résultats","en":"Specify when a page should stop appearing in results"},"cells":{"Google":{"status":"documented","source":"googlemeta"},"Bing":{"status":"unverified","source":null},"Yandex":{"status":"unverified","source":null},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"kind":"directive","related_controls":["TS07","TS09"],"effect":{"fr":"Prévoir la fin d’apparition d’une page à une date donnée.","en":"Schedule the end of a page’s appearance at a specified date."},"limits":{"fr":"Google doit lire la règle. Utiliser une date valide et un fuseau explicite ; l’exemple est à adapter à la date souhaitée.","en":"Google must read the rule. Use a valid date and explicit time zone; adapt the example to the intended expiry."},"example":{"scope":{"fr":"HTML · Google · exemple de date","en":"HTML · Google · example date"},"code":"<meta name=\"googlebot\" content=\"unavailable_after: 2027-12-31T23:59:59+00:00\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta"],"history":[]},{"id":"notranslate","name":{"fr":"Désactiver la traduction dans les résultats","en":"Disable translation in results"},"group":"meta","cells":{"Google":{"status":"documented","source":"googlemeta"},"Bing":{"status":"unverified","source":null},"Yandex":{"status":"unverified","source":null},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"kind":"directive","related_controls":["TS07"],"effect":{"fr":"Demander à Google de ne pas proposer la traduction du résultat.","en":"Ask Google not to offer result translation."},"limits":{"fr":"Ne définit pas la langue de la page et ne remplace pas hreflang.","en":"Does not define page language and does not replace hreflang."},"example":{"scope":{"fr":"HTML · Google","en":"HTML · Google"},"code":"<meta name=\"googlebot\" content=\"notranslate\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta"],"history":[]},{"id":"noarchive","group":"meta","name":{"fr":"Contrôler la copie en cache ou certains usages IA selon le moteur","en":"Control the cached copy or specific AI uses depending on the engine"},"cells":{"Google":{"status":"unused","source":"googlemeta","note":{"fr":"La recherche Google a retiré le lien en cache.","en":"Google Search retired its cached link."}},"Bing":{"status":"transition","source":"bingarchive","note":{"fr":"Pour l’entraînement et le grounding : nouvelles préférences lues dès le 01/02/2027 ; migration avant le 01/03/2027. Les anciennes règles sont écartées si de nouvelles préférences sont détectées sur le site.","en":"For training and grounding: new preferences honoured from 2027-02-01; migrate before 2027-03-01. Legacy rules are disregarded when new preferences are detected on the site."}},"Yandex":{"status":"documented","source":"yandex","note":{"fr":"Masque le lien vers la copie enregistrée.","en":"Hides the link to the saved copy."}},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"kind":"legacy","related_controls":["TS07","TS42"],"effect":{"fr":"Ancien contrôle de copie en cache, dont la portée dépend du moteur.","en":"Legacy cached-copy control whose scope depends on the engine."},"limits":{"fr":"Sans effet dans Google Search. Chez Bing, ne pas confondre l’ancien contrôle d’usage IA avec une désindexation ; migration annoncée pour 2027.","en":"No effect in Google Search. In Bing, do not confuse legacy AI-use controls with deindexing; migration announced for 2027."},"example":{"scope":{"fr":"HTML · historique, vérifier le moteur","en":"HTML · legacy, check the engine"},"code":"<meta name=\"robots\" content=\"noarchive\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta","bingarchive","yandex"],"history":[{"date":"2026-10-30","basis":"announcement","source":"bingarchive","text":{"fr":"Bing annonce la migration vers des préférences IA distinctes.","en":"Bing announces migration to separate AI preferences."}},{"date":"2027-02-01","basis":"scheduled","source":"bingarchive","text":{"fr":"Début annoncé de la prise en compte des nouvelles préférences, lors de l’exploration.","en":"Announced start of new preference processing as pages are crawled."}},{"date":"2027-03-01","basis":"scheduled","source":"bingarchive","text":{"fr":"Échéance de migration des anciennes directives pour l’entraînement et le grounding.","en":"Deadline for migrating legacy training and grounding controls."}}]},{"id":"nocache","name":{"fr":"Ancien réglage de cache et d’usage IA","en":"Legacy cache and AI-use control"},"group":"meta","cells":{"Google":{"status":"unused","source":"googlemeta","note":{"fr":"Google Search n’utilise pas cette règle.","en":"Google Search does not use this rule."}},"Bing":{"status":"transition","source":"bingarchive","note":{"fr":"Pour l’entraînement et le grounding : nouvelles préférences lues dès le 01/02/2027 ; migration avant le 01/03/2027. Les anciennes règles sont écartées si de nouvelles préférences sont détectées sur le site.","en":"For training and grounding: new preferences honoured from 2027-02-01; migrate before 2027-03-01. Legacy rules are disregarded when new preferences are detected on the site."}},"Yandex":{"status":"unverified","source":null},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"kind":"legacy","related_controls":["TS07","TS42"],"effect":{"fr":"Ancienne préférence Bing liée au cache et aux usages IA.","en":"Legacy Bing preference related to caching and AI uses."},"limits":{"fr":"N’est pas un contrôle HTTP de cache navigateur. Google ne l’utilise pas. Se reporter au calendrier Bing avant toute modification.","en":"Not an HTTP browser-cache control. Google does not use it. Consult the Bing transition schedule before changing it."},"example":{"scope":{"fr":"HTML · Bing, transition annoncée","en":"HTML · Bing, announced transition"},"code":"<meta name=\"bingbot\" content=\"nocache\">"},"reviewed":"2026-11-06","evidence_keys":["googlemeta","bingarchive"],"history":[{"date":"2026-10-30","basis":"announcement","source":"bingarchive","text":{"fr":"Bing annonce la migration vers des préférences IA distinctes.","en":"Bing announces migration to separate AI preferences."}},{"date":"2027-02-01","basis":"scheduled","source":"bingarchive","text":{"fr":"Début annoncé de la prise en compte des nouvelles préférences, lors de l’exploration.","en":"Announced start of new preference processing as pages are crawled."}},{"date":"2027-03-01","basis":"scheduled","source":"bingarchive","text":{"fr":"Échéance de migration des anciennes directives pour l’entraînement et le grounding.","en":"Deadline for migrating legacy training and grounding controls."}}]},{"id":"X-Robots-Tag","name":{"fr":"Transmettre les directives dans un en-tête HTTP","en":"Send directives through an HTTP header"},"cells":{"Google":{"status":"documented","source":"googlemeta"},"Bing":{"status":"documented","source":"bingoptions"},"Yandex":{"status":"documented","source":"yandex"},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"documented","source":"apple"}},"group":"urls","kind":"header","related_controls":["TS01","TS07"],"effect":{"fr":"Transmettre des directives dans la réponse HTTP, y compris pour un PDF.","en":"Send directives in the HTTP response, including for a PDF."},"limits":{"fr":"C’est un support de transmission, pas une règle autonome. Vérifier chaque valeur et le ciblage du robot ; une règle inaccessible ne peut pas être lue.","en":"A delivery mechanism, not a standalone rule. Check each value and crawler target; an inaccessible rule cannot be read."},"example":{"scope":{"fr":"En-tête HTTP · exemple noindex","en":"HTTP header · noindex example"},"code":"X-Robots-Tag: noindex"},"reviewed":"2026-11-06","evidence_keys":["googlemeta","bingoptions","yandex","apple"],"history":[]},{"id":"rel=canonical","name":{"fr":"Indiquer l’URL préférée parmi des doublons","en":"Identify the preferred URL among duplicates"},"cells":{"Google":{"status":"documented","source":"canonical"},"Bing":{"status":"documented","source":"bingcanonical","note":{"fr":"Bing recommande la balise canonical lorsque plusieurs versions doivent rester accessibles. Source : article officiel du 19 décembre 2025 ; signal de préférence, pas une redirection.","en":"Bing recommends canonical tags when multiple versions must remain accessible. Source: official article dated 19 December 2025; a preference signal, not a redirect."}},"Yandex":{"status":"documented","source":"ycan"},"Naver":{"status":"documented","source":"naver"},"Baidu":{"status":"documented","source":"baican","note":{"fr":"Guide officiel historique : une seule balise dans head ; la cible ne doit être ni une erreur ni bloquée par robots.txt.","en":"Historical official guide: one tag in head; the target must not be an error or blocked by robots.txt."}},"Applebot":{"status":"unverified","source":null}},"group":"urls","kind":"signal","related_controls":["TS10","TS11","TS12"],"effect":{"fr":"Proposer l’URL de référence de contenus identiques ou proches.","en":"Suggest the preferred URL for identical or similar content."},"limits":{"fr":"Un signal, pas une redirection ni une interdiction d’indexation. Pour Google, la canonique retenue peut différer de celle déclarée.","en":"A signal, not a redirect or indexing prohibition. Google may choose a different canonical from the declared one."},"example":{"scope":{"fr":"HTML · remplacer par l’URL canonique réelle","en":"HTML · replace with the real canonical URL"},"code":"<link rel=\"canonical\" href=\"https://example.com/page/\">"},"reviewed":"2026-11-07","evidence_keys":["canonical","bingcanonical","ycan","naver","baican"],"history":[]},{"id":"hreflang","name":{"fr":"Associer les variantes de langue ou de région","en":"Associate language or region variants"},"cells":{"Google":{"status":"documented","source":"hreflang"},"Bing":{"status":"unverified","source":null},"Yandex":{"status":"documented","source":"yhre"},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"group":"urls","kind":"signal","related_controls":["TS22","TS23"],"effect":{"fr":"Relier des versions de langue ou de région d’un même contenu.","en":"Connect language or regional versions of the same content."},"limits":{"fr":"Pour Google, liens réciproques et référence à soi-même. Ce signal ne remplace ni canonical ni la traduction réelle.","en":"For Google, reciprocal and self-referencing links. Does not replace canonical or actual translation."},"example":{"scope":{"fr":"HTML · exemple Google sur chacune des deux pages","en":"HTML · Google example on both pages"},"code":"<link rel=\"alternate\" hreflang=\"fr\" href=\"https://example.com/fr/\">\n<link rel=\"alternate\" hreflang=\"en\" href=\"https://example.com/en/\">"},"reviewed":"2026-11-06","evidence_keys":["hreflang","yhre"],"history":[]},{"id":"Disallow","name":{"fr":"Restreindre l’exploration d’un chemin","en":"Restrict crawling of a path"},"group":"robots","cells":{"Google":{"status":"documented","source":"googlebot"},"Bing":{"status":"documented","source":"bingrep"},"Yandex":{"status":"documented","source":"yrobots"},"Naver":{"status":"documented","source":"navrobots"},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"documented","source":"apple"}},"kind":"directive","related_controls":["TS04","TS05"],"effect":{"fr":"Demander au robot de ne pas explorer un chemin.","en":"Ask the crawler not to crawl a path."},"limits":{"fr":"N’empêche pas nécessairement l’URL d’apparaître dans les résultats et ne sécurise pas un dossier. Une règle noindex derrière ce blocage peut rester illisible.","en":"May not prevent the URL appearing in results and does not secure a directory. A noindex rule behind the block may be unreadable."},"example":{"scope":{"fr":"robots.txt · exemple Googlebot, chemin fictif","en":"robots.txt · Googlebot example, illustrative path"},"code":"User-agent: Googlebot\nDisallow: /internal-search/"},"reviewed":"2026-11-06","evidence_keys":["googlebot","bingrep","yrobots","navrobots","apple"],"history":[]},{"id":"Allow","name":{"fr":"Autoriser un chemin à l’exploration","en":"Allow crawling of a path"},"group":"robots","cells":{"Google":{"status":"documented","source":"googlebot"},"Bing":{"status":"documented","source":"bingrep"},"Yandex":{"status":"documented","source":"yrobots"},"Naver":{"status":"documented","source":"navrobots"},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"documented","source":"apple"}},"kind":"directive","related_controls":["TS04"],"effect":{"fr":"Autoriser un chemin plus précis dans une zone restreinte.","en":"Allow a more specific path within a restricted area."},"limits":{"fr":"La priorité dépend du robot et du groupe User-agent. L’exemple Google utilise la règle la plus spécifique ; à égalité, la moins restrictive.","en":"Precedence depends on the crawler and User-agent group. This Google example uses the most specific rule; equal matches prefer the least restrictive."},"example":{"scope":{"fr":"robots.txt · exemple Googlebot","en":"robots.txt · Googlebot example"},"code":"User-agent: Googlebot\nDisallow: /assets/\nAllow: /assets/public/"},"reviewed":"2026-11-06","evidence_keys":["googlebot","bingrep","yrobots","navrobots","apple"],"history":[]},{"id":"Sitemap","group":"robots","name":{"fr":"Indiquer l’adresse absolue d’un sitemap","en":"Provide the absolute URL of a sitemap"},"cells":{"Google":{"status":"documented","source":"googlebot"},"Bing":{"status":"documented","source":"bingsite"},"Yandex":{"status":"documented","source":"yrobots"},"Naver":{"status":"documented","source":"navrobots"},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"kind":"discovery","related_controls":["TS04","TS13"],"effect":{"fr":"Indiquer l’adresse absolue d’un sitemap aux robots.","en":"Tell crawlers the absolute location of a sitemap."},"limits":{"fr":"Aide à découvrir les URL ; ne garantit pas leur indexation et ne lève pas les restrictions d’accès.","en":"Helps discover URLs; does not guarantee indexing or override access restrictions."},"example":{"scope":{"fr":"robots.txt · remplacer le domaine","en":"robots.txt · replace the domain"},"code":"Sitemap: https://example.com/sitemap.xml"},"reviewed":"2026-11-06","evidence_keys":["googlebot","bingsite","yrobots","navrobots"],"history":[]},{"id":"Crawl-delay","group":"robots","name":{"fr":"Demander au robot d’espacer ses requêtes","en":"Ask a crawler to space out requests"},"cells":{"Google":{"status":"unsupported","source":"googlebot"},"Bing":{"status":"documented","source":"bingdelay"},"Yandex":{"status":"unused","source":"ycrawl","note":{"fr":"Ignorée depuis 2018.","en":"Ignored since 2018."}},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unsupported","source":"apple","note":{"fr":"Apple précise que son robot ne suit pas Crawl-delay.","en":"Apple explicitly states that its crawler does not follow Crawl-delay."}}},"kind":"directive","related_controls":["TS04","TS43"],"effect":{"fr":"Moduler la cadence d’exploration lorsque le robot le prévoit.","en":"Adjust crawl pacing when the crawler supports it."},"limits":{"fr":"Documenté chez Bing ; non pris en charge par Google et Applebot, abandonné par Yandex. Éviter une règle générique appliquée à tous.","en":"Documented by Bing; unsupported by Google and Applebot, retired by Yandex. Avoid treating it as universal."},"example":{"scope":{"fr":"robots.txt · Bing · 5 est un exemple","en":"robots.txt · Bing · 5 is an example"},"code":"User-agent: bingbot\nCrawl-delay: 5"},"reviewed":"2026-11-06","evidence_keys":["googlebot","bingdelay","ycrawl","apple"],"history":[{"date":"2018-02-22","basis":"effective","source":"ycrawl","text":{"fr":"Yandex cesse de tenir compte de Crawl-delay.","en":"Yandex stops taking Crawl-delay into account."}}]},{"id":"Clean-param","group":"robots","name":{"fr":"Signaler des paramètres d’URL sans effet sur le contenu","en":"Identify URL parameters that do not change the content"},"cells":{"Google":{"status":"unsupported","source":"googlebot"},"Bing":{"status":"unverified","source":null},"Yandex":{"status":"documented","source":"yrobots"},"Naver":{"status":"unverified","source":null},"Baidu":{"status":"unverified","source":null},"Applebot":{"status":"unverified","source":null}},"kind":"signal","related_controls":["TS04","TS19"],"effect":{"fr":"Indiquer à Yandex des paramètres qui ne changent pas le contenu.","en":"Tell Yandex which parameters do not change content."},"limits":{"fr":"Ne doit pas masquer une variante utile. Spécifique à Yandex dans les sources de cette édition.","en":"Must not hide a useful content variant. Yandex-specific in this edition’s sources."},"example":{"scope":{"fr":"robots.txt · Yandex · ref est un exemple","en":"robots.txt · Yandex · ref is an example"},"code":"User-agent: Yandex\nClean-param: ref /catalog/"},"reviewed":"2026-11-06","evidence_keys":["googlebot","yrobots"],"history":[]},{"id":"IndexNow","group":"notify","name":{"fr":"Signaler les URL ajoutées, modifiées ou supprimées via une API. L’indexation reste à la décision du moteur.","en":"Notify engines of added, updated or deleted URLs via an API. Each engine decides whether to index them."},"cells":{"Google":{"status":"no_endpoint","source":"indexfaq"},"Bing":{"status":"documented","source":"indexfaq"},"Yandex":{"status":"documented","source":"indexfaq"},"Naver":{"status":"documented","source":"indexfaq"},"Baidu":{"status":"no_endpoint","source":"indexfaq"},"Applebot":{"status":"no_endpoint","source":"indexfaq"}},"kind":"notification","related_controls":["TS13"],"effect":{"fr":"Notifier un ajout, une modification ou une suppression d’URL.","en":"Notify a URL addition, change or deletion."},"limits":{"fr":"Ce n’est pas une directive robots.txt. Une notification acceptée ne garantit ni exploration immédiate ni indexation ; une clé de propriété est nécessaire.","en":"Not a robots.txt directive. Accepted notification guarantees neither immediate crawling nor indexing; an ownership key is required."},"example":{"scope":{"fr":"HTTP GET · exemple fictif, clé et URL à remplacer","en":"HTTP GET · illustrative example, replace key and URL"},"code":"https://api.indexnow.org/indexnow?url=https%3A%2F%2Fexample.com%2Fpage%2F&key=REPLACE_WITH_SITE_KEY"},"reviewed":"2026-11-06","evidence_keys":["indexfaq"],"history":[]}],"evidence":{"apple":{"url":"https://support.apple.com/en-us/119829","sha256":"30c9ef308e140287d2a6310879414df7f87a65314234b51d00bd971d6f4daad3","capture":"/assets/watch-directives/30c9ef308e140287d2a6310879414df7f87a65314234b51d00bd971d6f4daad3.gz","observed":"2026-11-06T18:03:31+00:00","label":{"fr":"Apple · Applebot","en":"Apple · Applebot"}},"baican":{"url":"https://ziyuan.baidu.com/college/documentinfo?id=1689&page=3","sha256":"d580df80bc9fe05b9ae4ec45b01f7f2ae35c568caa791a059b4bf5416176c5f0","capture":"/assets/watch-directives/d580df80bc9fe05b9ae4ec45b01f7f2ae35c568caa791a059b4bf5416176c5f0.gz","observed":"2026-11-06T18:03:33+00:00","label":{"fr":"Baidu · URL canoniques","en":"Baidu · Canonical URLs"}},"bingarchive":{"url":"https://blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/","sha256":"989edfcce11f91b5c34f54102d7a431c1cd62747ff6b865281600ee1cc9a5f1b","capture":"/assets/watch-directives/989edfcce11f91b5c34f54102d7a431c1cd62747ff6b865281600ee1cc9a5f1b.gz","observed":"2026-11-06T18:03:33+00:00","label":{"fr":"Bing · Transition des préférences IA","en":"Bing · AI preference transition"}},"bingcanonical":{"url":"https://blogs.bing.com/webmaster/2025/12/Does-Duplicate-Content-Hurt-SEO-and-AI-Search-Visibility/","sha256":"38799c89bb6d84b73cae164f0f585a3b16408d44376cce42001b1a06b43eefc3","capture":"/assets/watch-directives/38799c89bb6d84b73cae164f0f585a3b16408d44376cce42001b1a06b43eefc3.gz","observed":"2026-11-07T10:51:28+00:00","label":{"fr":"Bing · URL canoniques","en":"Bing · Canonical URLs"}},"bingdata":{"url":"https://blogs.bing.com/webmaster/2025/10/Bing-Introduces-Support-for-the-data-nosnippet-HTML-Attribute/","sha256":"0f87b957c30bd66d06506cbb273017460d8e2db3d05a447b5e401adb1209df46","capture":"/assets/watch-directives/0f87b957c30bd66d06506cbb273017460d8e2db3d05a447b5e401adb1209df46.gz","observed":"2026-11-06T18:03:32+00:00","label":{"fr":"Bing · data-nosnippet","en":"Bing · data-nosnippet"}},"bingdelay":{"url":"https://blogs.bing.com/webmaster/2012/5/To-crawl-or-not-to-crawl%2C-that-is-BingBot-s-questi/","sha256":"5a61100fc34011a0e60be33638721608560fe1709b6537c348579cb45f550905","capture":"/assets/watch-directives/5a61100fc34011a0e60be33638721608560fe1709b6537c348579cb45f550905.gz","observed":"2026-11-06T18:03:33+00:00","label":{"fr":"Bing · Contrôle de l’exploration","en":"Bing · Crawl controls"}},"bingoptions":{"url":"https://blogs.bing.com/webmaster/2020/4/Announcing-new-options-for-webmasters-to-control-their-snippets-at-Bing/","sha256":"e32c9cee56f54236f1211be0d37ebfc47426086497236c6cde06c1d6f13ee6ed","capture":"/assets/watch-directives/e32c9cee56f54236f1211be0d37ebfc47426086497236c6cde06c1d6f13ee6ed.gz","observed":"2026-11-06T18:03:33+00:00","label":{"fr":"Bing · Aperçus des résultats","en":"Bing · Result previews"}},"bingrep":{"url":"https://blogs.bing.com/webmaster/June-2008/Robots-Exclusion-Protocol-joining-together-to-pro","sha256":"36ee8f501d9b32604db8b62a043d0199ea93762943d1f0ea85afb8c91df34c8b","capture":"/assets/watch-directives/36ee8f501d9b32604db8b62a043d0199ea93762943d1f0ea85afb8c91df34c8b.gz","observed":"2026-11-06T18:03:34+00:00","label":{"fr":"Bing · Robots Exclusion Protocol","en":"Bing · Robots Exclusion Protocol"}},"bingsite":{"url":"https://blogs.bing.com/webmaster/2025/7/Keeping-Content-Discoverable-with-Sitemaps-in-AI-Powered-Search/","sha256":"61b382c5590c4e4eb24d40e0787319540fb596a75dd09615862bf02ac4c43701","capture":"/assets/watch-directives/61b382c5590c4e4eb24d40e0787319540fb596a75dd09615862bf02ac4c43701.gz","observed":"2026-11-06T18:03:34+00:00","label":{"fr":"Bing · Sitemaps","en":"Bing · Sitemaps"}},"canonical":{"url":"https://developers.google.com/search/docs/crawling-indexing/consolidate-duplicate-urls","sha256":"927f250222f73d7be9907a3e74b40c6bad9f2f52258112d74cbcf2d750b6fb39","capture":"/assets/watch-directives/927f250222f73d7be9907a3e74b40c6bad9f2f52258112d74cbcf2d750b6fb39.gz","observed":"2026-11-06T18:03:34+00:00","label":{"fr":"Google · Canonicalisation","en":"Google · Canonicalisation"}},"googlebot":{"url":"https://developers.google.com/crawling/docs/robots-txt/robots-txt-spec","sha256":"3f6dcd84f1e21c794f7fc5d1481080df224ecf862dcf993e87a4a7bf6ff80d20","capture":"/assets/watch-directives/3f6dcd84f1e21c794f7fc5d1481080df224ecf862dcf993e87a4a7bf6ff80d20.gz","observed":"2026-11-06T18:03:33+00:00","label":{"fr":"Google · Spécification robots.txt","en":"Google · Robots.txt specification"}},"googlemeta":{"url":"https://developers.google.com/search/docs/crawling-indexing/robots-meta-tag","sha256":"0448020585bc91e9b1b2b4f23d2d8e6614caa27cb54a95d8527746095db2aa16","capture":"/assets/watch-directives/0448020585bc91e9b1b2b4f23d2d8e6614caa27cb54a95d8527746095db2aa16.gz","observed":"2026-11-06T18:03:34+00:00","label":{"fr":"Google · Meta robots et extraits","en":"Google · Robots meta and snippets"}},"hreflang":{"url":"https://developers.google.com/search/docs/specialty/international/localized-versions","sha256":"ab5f28e4930d36259af3b221ba060093aa4f3bca1ad2d3ddd3cd0cfdb4217291","capture":"/assets/watch-directives/ab5f28e4930d36259af3b221ba060093aa4f3bca1ad2d3ddd3cd0cfdb4217291.gz","observed":"2026-11-06T18:03:34+00:00","label":{"fr":"Google · Versions localisées","en":"Google · Localised versions"}},"indexfaq":{"url":"https://www.indexnow.org/faq","sha256":"fa678ff2c69ef503f1848421050509290010918242989255a93d417244382868","capture":"/assets/watch-directives/fa678ff2c69ef503f1848421050509290010918242989255a93d417244382868.gz","observed":"2026-11-06T18:03:34+00:00","label":{"fr":"IndexNow · Questions fréquentes","en":"IndexNow · FAQ"}},"naver":{"url":"https://searchadvisor.naver.com/guide/markup-structure","sha256":"a8534737367bc7d748b65e057b454eb67f19a97f157ac2d264ede42b33179b08","capture":"/assets/watch-directives/a8534737367bc7d748b65e057b454eb67f19a97f157ac2d264ede42b33179b08.gz","observed":"2026-11-06T18:03:38+00:00","label":{"fr":"Naver · Structure HTML","en":"Naver · HTML structure"}},"navrobots":{"url":"https://searchadvisor.naver.com/guide/seo-basic-robots","sha256":"49daa0f9041621cc2ce53a7c7e12a6ba79a346ac979aa6196d1c80d01502faf4","capture":"/assets/watch-directives/49daa0f9041621cc2ce53a7c7e12a6ba79a346ac979aa6196d1c80d01502faf4.gz","observed":"2026-11-06T18:03:38+00:00","label":{"fr":"Naver · robots.txt","en":"Naver · robots.txt"}},"yandex":{"url":"https://yandex.com/support/webmaster/en/controlling-robot/html","sha256":"85e2b619502a81981a55a628873a0b95443284bf89b92c99dd2ca443c85ed479","capture":"/assets/watch-directives/85e2b619502a81981a55a628873a0b95443284bf89b92c99dd2ca443c85ed479.gz","observed":"2026-11-06T18:03:35+00:00","label":{"fr":"Yandex · Meta et en-têtes robots","en":"Yandex · Robots meta and headers"}},"ycan":{"url":"https://yandex.com/support/webmaster/en/robot-workings/canonical","sha256":"f4ee0aa481e4043f8a392a1ae81e65b884965ea7743355d46b3cbe5ca895b639","capture":"/assets/watch-directives/f4ee0aa481e4043f8a392a1ae81e65b884965ea7743355d46b3cbe5ca895b639.gz","observed":"2026-11-06T18:03:35+00:00","label":{"fr":"Yandex · URL canoniques","en":"Yandex · Canonical URLs"}},"ycrawl":{"url":"https://yandex.com/support/webmaster/en/robot-workings/crawl-delay","sha256":"20ba4a0c608980f937558b2ee5a7e1d661f8e2e178b3ba7949924253139d9694","capture":"/assets/watch-directives/20ba4a0c608980f937558b2ee5a7e1d661f8e2e178b3ba7949924253139d9694.gz","observed":"2026-11-06T18:03:35+00:00","label":{"fr":"Yandex · Retrait de Crawl-delay","en":"Yandex · Crawl-delay withdrawal"}},"yhre":{"url":"https://yandex.com/support/webmaster/en/yandex-indexing/locale-pages","sha256":"76195bff3bee33c77ffd6ab33d5a7f58e9494f121e69eaa5b7533250c8abe54d","capture":"/assets/watch-directives/76195bff3bee33c77ffd6ab33d5a7f58e9494f121e69eaa5b7533250c8abe54d.gz","observed":"2026-11-06T18:03:35+00:00","label":{"fr":"Yandex · Versions localisées","en":"Yandex · Localised versions"}},"yrobots":{"url":"https://yandex.com/support/webmaster/en/controlling-robot/robots-txt","sha256":"52622f8f52e11f1d3836236032d683f83bb928f0a1ac663e8bda04b91b6d5ed1","capture":"/assets/watch-directives/52622f8f52e11f1d3836236032d683f83bb928f0a1ac663e8bda04b91b6d5ed1.gz","observed":"2026-11-06T18:03:35+00:00","label":{"fr":"Yandex · robots.txt","en":"Yandex · robots.txt"}}},"editorial_version":"2026-11-07.1","snapshot_at":"2026-11-07T10:51:28+00:00","method":[{"fr":"Comparaison documentaire de six moteurs, fondée sur les pages officielles archivées pour cette édition. « Documenté » décrit une règle déclarée, pas un comportement observé sur un site témoin.","en":"Documentary comparison of six engines, based on official pages archived for this edition. “Documented” describes a declared rule, not behaviour observed on a test site."},{"fr":"« Non confirmé » signifie que les sources retenues ne suffisent pas à conclure. Cela ne signifie pas « non pris en charge ». Pour IndexNow, « Non listé » porte uniquement sur les points d’accès publiés.","en":"“Unconfirmed” means retained sources do not establish support. It does not mean “unsupported”. For IndexNow, “Not listed” refers only to published endpoints."},{"fr":"Les exemples sont illustratifs et ciblés. Les priorités ne sont pas universelles : Google retient généralement la règle meta la plus restrictive ; Yandex documente une priorité différente pour ses règles autorisant l’indexation. Les balises et en-têtes doivent rester accessibles au robot.","en":"Examples are illustrative and scoped. Precedence is not universal: Google generally applies the most restrictive meta rule; Yandex documents different precedence for permitting indexing rules. Crawlers must be able to access tags and headers."},{"fr":"La date de vérification correspond à la capture de la source, pas au lancement de la règle. Seules les dates explicitement documentées figurent dans les chronologies. Les lectures et traductions sont assistées par IA ; la relecture humaine est indiquée séparément.","en":"The verification date refers to the source capture, not the rule’s launch. Timelines contain only explicitly documented dates. Readings and translations are AI-assisted; human review is stated separately."},{"fr":"Chaque capture contient les octets reçus, compressés en gzip. SHA-256 porte sur le document décompressé. L’horodatage indépendant du manifeste atteste l’existence des captures au plus tard à l’heure signée, pas la véracité des affirmations ni l’observation d’un robot.","en":"Each capture contains received bytes compressed with gzip. SHA-256 applies to the decompressed document. Independent manifest timestamping proves captures existed no later than the signed time, not the truth of claims or observed crawler behaviour."}],"revisions":[{"version":"2026-11-07.1","fr":"Relecture FR/EN confirmée par Bertrand Morel. Réserve du point 30 : la référence Bing de 2009 annonçait une prise en charge future. À sa demande, elle est remplacée par l’article officiel du 19 décembre 2025 qui recommande canonical pour les doublons. Correction documentaire réalisée par l’assistant ; nouvelle capture et nouveau manifeste horodaté. Les autres captures conservent leur date du 6 novembre.","en":"FR/EN review confirmed by Bertrand Morel. Reservation on point 30: the 2009 Bing reference announced future support. At his request, it is replaced by the official 19 December 2025 article recommending canonical for duplicates. Documentary correction made by the assistant; new capture and newly timestamped manifest. Other captures retain their 6 November dates."},{"version":"2026-11-06.1","fr":"22 mécanismes ; exemples, limites, différences par moteur, captures téléchargeables et exports. Correction : Applebot ne suit pas Crawl-delay. Distinction des transitions annoncées et des règles appliquées.","en":"22 mechanisms; examples, limits, engine differences, downloadable captures and exports. Correction: Applebot does not follow Crawl-delay. Announced transitions distinguished from applied rules."},{"version":"2026-11-05","fr":"Première matrice de 16 mécanismes pour six moteurs.","en":"Initial matrix of 16 mechanisms for six engines."}],"timestamp":{"authority":"DigiCert","standard":"RFC 3161","signed_at":"2026-11-07T10:51:59+00:00","manifest_sha256":"d0fec04eab4cbdb5857fc5fb5d80ae196582a6c37f521b897f48bf1ed32a8816","captures":["0448020585bc91e9b1b2b4f23d2d8e6614caa27cb54a95d8527746095db2aa16","0f87b957c30bd66d06506cbb273017460d8e2db3d05a447b5e401adb1209df46","20ba4a0c608980f937558b2ee5a7e1d661f8e2e178b3ba7949924253139d9694","30c9ef308e140287d2a6310879414df7f87a65314234b51d00bd971d6f4daad3","36ee8f501d9b32604db8b62a043d0199ea93762943d1f0ea85afb8c91df34c8b","38799c89bb6d84b73cae164f0f585a3b16408d44376cce42001b1a06b43eefc3","3f6dcd84f1e21c794f7fc5d1481080df224ecf862dcf993e87a4a7bf6ff80d20","49daa0f9041621cc2ce53a7c7e12a6ba79a346ac979aa6196d1c80d01502faf4","52622f8f52e11f1d3836236032d683f83bb928f0a1ac663e8bda04b91b6d5ed1","5a61100fc34011a0e60be33638721608560fe1709b6537c348579cb45f550905","61b382c5590c4e4eb24d40e0787319540fb596a75dd09615862bf02ac4c43701","76195bff3bee33c77ffd6ab33d5a7f58e9494f121e69eaa5b7533250c8abe54d","85e2b619502a81981a55a628873a0b95443284bf89b92c99dd2ca443c85ed479","927f250222f73d7be9907a3e74b40c6bad9f2f52258112d74cbcf2d750b6fb39","989edfcce11f91b5c34f54102d7a431c1cd62747ff6b865281600ee1cc9a5f1b","a8534737367bc7d748b65e057b454eb67f19a97f157ac2d264ede42b33179b08","ab5f28e4930d36259af3b221ba060093aa4f3bca1ad2d3ddd3cd0cfdb4217291","d580df80bc9fe05b9ae4ec45b01f7f2ae35c568caa791a059b4bf5416176c5f0","e32c9cee56f54236f1211be0d37ebfc47426086497236c6cde06c1d6f13ee6ed","f4ee0aa481e4043f8a392a1ae81e65b884965ea7743355d46b3cbe5ca895b639","fa678ff2c69ef503f1848421050509290010918242989255a93d417244382868"],"archive":"/assets/watch-directives-timestamps/6a0816037d2e429ffac10d0e6c05b0d5ce69d6f9a3c26684b341fb6b8c0e5d3e.zip","archive_sha256":"6a0816037d2e429ffac10d0e6c05b0d5ce69d6f9a3c26684b341fb6b8c0e5d3e","files":{"manifest.json":"d0fec04eab4cbdb5857fc5fb5d80ae196582a6c37f521b897f48bf1ed32a8816","request.tsq":"daa12e8c815472c1e65f937bf7dfef2cab42c8416d6ebdd346281e68db4cb348","response.tsr":"82af849dd014e6df999545056bcdfcc04a832485724facbdf056cf68205eb59f","authority.pem":"ce7d6b44f5d510391be98c8d76b18709400a30cd87659bfebe1c6f97ff5181ee","chain.pem":"5e13de210e735b614d6ec948361aadef9dd6c0ef575382a75f57fd59e183b90e","verification.txt":"46839cac1bd5523afe067e03677cecac5cdba586cfd77c7bec955ad74e8e09f0"}},"human_review":{"name":"Bertrand Morel","date":"2026-11-07T10:52:31.208480+00:00","languages":["fr","en"],"content_sha256":"ff1eeadabd10318127b55ec228c81ae8aee5bac3f19d34e48b454b0296deb3dc","edition":"2026-11-07.1","attestation":"Points 1 à 29 et 31 à 40 vérifiés par le relecteur. Point 30 réservé : remplacement de la source Bing et publication de la relecture expressément demandés par Bertrand Morel.","confirmation":"28 à 40 vérifiés, sauf le point 30. Corrige la source Bing, ajoute la relecture humaine au nom de Bertrand Morel, puis bascule en ligne et vérifie en FR et EN.","reservation":{"point":30,"correction":"Référence historique de 2009 remplacée à la demande du relecteur par la publication officielle Bing du 19 décembre 2025. Correction documentaire et vérification de source réalisées par l’assistant.","replacement_source":"https://blogs.bing.com/webmaster/2025/12/Does-Duplicate-Content-Hurt-SEO-and-AI-Search-Visibility/","capture_sha256":"38799c89bb6d84b73cae164f0f585a3b16408d44376cce42001b1a06b43eefc3"}},"content_sha256":"ff1eeadabd10318127b55ec228c81ae8aee5bac3f19d34e48b454b0296deb3dc","ai_rows":[{"id":"usage-ai-training","name":"__usage_ai-training","scope":{"fr":"Exprime un refus d’entraînement génératif, pour les acteurs qui appliquent le signal.","en":"Expresses a generative-training opt-out to providers implementing the signal."},"scope_verified":true,"source_url":"https://datatracker.ietf.org/doc/draft-kelley-aipref-training-preference-signal/","group":"training","related_controls":["TS42"],"cells":{"Google":{"status":"planned","url":"https://developers.google.com/search/blog/2026/10/ai-training-control","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:05:01+00:00","verified":"2026-11-12T02:16:08+00:00","raw":"1ffcc15ef8fabaf4f131a81be2103415c78a1c85ace17538c0c3dfa7431edb46","passage":"5594bbabcbcca82026587ff3fe42db5255605c8fc475a54f31bb687aa0f6c349","diff":null},"timing":{"fr":"Début 2027 visé","en":"Early 2027 target"},"priority":{"fr":"Google prévoit d’interpréter le refus commun comme un refus Google-Extended lorsqu’aucune règle Google-Extended explicite ne s’applique. Cette correspondance aurait aussi un effet sur le grounding dans Gemini Apps et dans Grounding with Google Search sur Vertex AI. Une règle explicite garde la priorité.","en":"Google plans to map a shared opt-out to a Google-Extended disallow when no explicit Google-Extended rule applies. That mapping would also affect grounding in Gemini Apps and Grounding with Google Search on Vertex AI. An explicit rule takes precedence."},"additional_evidence":{"google-blog-article":{"seq":1,"observed":"2026-11-05T17:04:55+00:00","verified":"2026-11-12T02:16:05+00:00","raw":"dd73e97c8e5e942f3e48bcc14904951542d429cbe279c25f0decad9d8519e832","passage":"e08a69aa04ce4b099030b1935b587bee792c987f5027536eae9d9612514043e0","diff":null}}},"Microsoft · Bing":{"status":"planned","url":"https://blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:05:02+00:00","verified":"2026-11-12T02:16:09+00:00","raw":"989edfcce11f91b5c34f54102d7a431c1cd62747ff6b865281600ee1cc9a5f1b","passage":"a577becb8222f398914b1cb231901636213618d580bd70cd7f2819777165d28c","diff":null},"timing":{"fr":"Bing commence à lire les nouvelles préférences d’entraînement et de grounding au fil des explorations.","en":"Bing starts applying the new training and grounding preferences as it crawls."},"priority":{"fr":"Les sites utilisant déjà NoArchive ou NoCache le 15 décembre pourront choisir une préférence temporaire de grounding dans Bing Webmaster Tools. Pour l’entraînement, la préférence de la page primera sur robots.txt.","en":"Sites already using NoArchive or NoCache on December 15 can set a temporary grounding preference in Bing Webmaster Tools. For training, the page-level preference will take precedence over robots.txt."},"effective_date":"2027-02-01"},"OpenAI":{"status":"planned","url":"https://openai.com/index/helping-websites-express-ai-training-preferences","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:05:00+00:00","verified":"2026-11-12T02:16:08+00:00","raw":"a0a2b9bc5914cb528f31cab6f8f73f9524f6b14089f775fc4a80b24d0e95982e","passage":"1256781c54c61b681c4f5104722fe94136795d6c5ea943f2290acbb85ef487a2","diff":null},"timing":{"fr":"Dans les prochains mois ; date non fixée","en":"Coming months; no fixed date"},"priority":{"fr":"OpenAI annonce une mise en œuvre à venir. GPTBot et les contrôles actuels restent valables. L’annonce ne fixe pas de jour de bascule.","en":"OpenAI announces future implementation. GPTBot and current controls remain in place. The announcement gives no switch-on date."},"article_reading":{"date":"2026-11-05","excerpt":"We aim to implement the signal in the coming months","sha256":"21d97738ac06b28a6bb90449075ef55d4d0722625aef32d3bcd5986f19aa094d"}},"Anthropic":{"status":"rolling","url":"https://privacy.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:04:54+00:00","verified":"2026-11-12T02:16:04+00:00","raw":"e602ce6895e8e0d41177f00512c3ac06cdde17eac9f78fc43bb905de142cc122","passage":"184fc8b017b0c1cca4eb7595a8c2b378fb539e3444d02d436ea6f39d41c86c6b","diff":null},"timing":{"fr":"Depuis le 30 oct. 2026 · déploiement progressif","en":"Since Oct 30, 2026 · gradual rollout"},"priority":{"fr":"Anthropic déclare avoir commencé à reconnaître le signal. Pour un chemin donné, une règle qui nomme ClaudeBot prime. L’éditeur décrit un déploiement progressif dans ses services.","en":"Anthropic says recognition has begun. A rule naming ClaudeBot takes precedence for the path concerned. The provider describes a gradual rollout across its services."}},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"ietf-training-draft":"bdf049b0af3476ff980f033a2a99f05b631cbacef6238cb7a4fd918fec0e1af2"},"uses":["training"],"effect":{"fr":"Exprime un refus d’entraînement génératif, pour les acteurs qui appliquent le signal.","en":"Expresses a generative-training opt-out to providers implementing the signal."},"limits":{"fr":"Le groupe User-agent: * ne vaut pas préférence. Sans groupe dédié, aucune préférence commune n’est exprimée. Les règles propres aux acteurs et les accords privés peuvent primer. Le jeton ne bloque pas les requêtes HTTP.","en":"User-agent: * does not express this preference. Without a dedicated group, no shared preference is stated. Provider-specific rules and private agreements may take precedence. The token does not block HTTP requests."},"examples":[{"label":{"fr":"Refuser l’entraînement sur tout le site","en":"Opt out of training site-wide"},"format":"robots.txt","code":"User-agent: __usage_ai-training\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"display_name":{"fr":"Préférence commune d’entraînement IA","en":"Shared AI training preference"},"token":"__usage_ai-training","status_note":{"fr":"Contribution individuelle IETF, version -00 du 30 octobre 2026 ; expiration le 3 mai 2027. Pas une norme adoptée.","en":"Individual IETF submission, version -00 dated 30 October 2026; expires 3 May 2027. Not an adopted standard."},"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null,"provider_notes":{"Google":{"fr":"La règle Google-Extended explicite garde la priorité.","en":"An explicit Google-Extended rule retains priority."},"Microsoft · Bing":{"fr":"La préférence d’entraînement de la page prime sur robots.txt.","en":"The page-level training preference overrides robots.txt."},"OpenAI":{"fr":"Contrôles actuels maintenus ; priorité du nouveau signal non précisée.","en":"Current controls remain; new-signal precedence is unspecified."},"Anthropic":{"fr":"Une règle nommant ClaudeBot prime sur le signal commun.","en":"A rule naming ClaudeBot overrides the shared signal."}}},"display_name":{"fr":"Préférence commune d’entraînement IA","en":"Shared AI training preference"}},{"id":"gptbot","name":"GPTBot","scope":{"fr":"Refuse l’utilisation des contenus collectés pour entraîner les modèles de fondation génératifs d’OpenAI.","en":"Opts crawled content out of OpenAI generative foundation-model training."},"scope_verified":true,"source_url":"https://developers.openai.com/api/docs/bots","group":"training","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"documented","url":"https://developers.openai.com/api/docs/bots","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:04:53+00:00","verified":"2026-11-12T02:16:04+00:00","raw":"78caa706896816acebafc0b949ca1680411273c4a24bea157b1dd8bf4333252a","passage":"b7c5a2b25a2fd1fcd65f7a22fe4cc23b7be11057953d41a36a3e9093c330b112","diff":null}},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"openai-bots":"b7c5a2b25a2fd1fcd65f7a22fe4cc23b7be11057953d41a36a3e9093c330b112"},"uses":["training"],"effect":{"fr":"Refuse l’utilisation des contenus collectés pour entraîner les modèles de fondation génératifs d’OpenAI.","en":"Opts crawled content out of OpenAI generative foundation-model training."},"limits":{"fr":"La recherche ChatGPT se règle séparément avec OAI-SearchBot.","en":"ChatGPT search is configured separately using OAI-SearchBot."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: GPTBot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"GPTBot","http_user_agents":[{"value":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot","kind":"documented_example"}],"ip_list_urls":["https://openai.com/gptbot.json"],"authentication_note":{"fr":"Le nom peut être usurpé. Vérifier les adresses avec la méthode officielle avant toute attribution.","en":"The name can be spoofed. Verify addresses using the official method before attributing traffic."},"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"claudebot","name":"ClaudeBot","scope":{"fr":"Signale que les futurs contenus doivent être exclus des jeux d’entraînement de Claude.","en":"Signals that future content should be excluded from Claude training datasets."},"scope_verified":true,"source_url":"https://privacy.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler","group":"training","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"documented","url":"https://privacy.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:04:54+00:00","verified":"2026-11-12T02:16:04+00:00","raw":"e602ce6895e8e0d41177f00512c3ac06cdde17eac9f78fc43bb905de142cc122","passage":"184fc8b017b0c1cca4eb7595a8c2b378fb539e3444d02d436ea6f39d41c86c6b","diff":null}},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"anthropic-bots":"184fc8b017b0c1cca4eb7595a8c2b378fb539e3444d02d436ea6f39d41c86c6b"},"uses":["training"],"effect":{"fr":"Signale que les futurs contenus doivent être exclus des jeux d’entraînement de Claude.","en":"Signals that future content should be excluded from Claude training datasets."},"limits":{"fr":"N’applique pas le même choix à Claude-SearchBot ni à Claude-User. La règle ClaudeBot dédiée prime sur le signal commun.","en":"Does not apply the same choice to Claude-SearchBot or Claude-User. Dedicated ClaudeBot rules override the shared signal."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: ClaudeBot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":["https://claude.com/crawling/bots.json"],"http_user_agent_status":"not_established","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"bing-ai-training","name":"ai-training","scope":{"fr":"Refuse l’entraînement génératif pour la page.","en":"Opts the page out of generative training."},"scope_verified":true,"source_url":"https://blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/","group":"training","related_controls":["TS42"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"planned","url":"https://blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:05:02+00:00","verified":"2026-11-12T02:16:09+00:00","raw":"989edfcce11f91b5c34f54102d7a431c1cd62747ff6b865281600ee1cc9a5f1b","passage":"a577becb8222f398914b1cb231901636213618d580bd70cd7f2819777165d28c","diff":null}},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"bing-preferences":"a577becb8222f398914b1cb231901636213618d580bd70cd7f2819777165d28c"},"uses":["training"],"effect":{"fr":"Refuse l’entraînement génératif pour la page.","en":"Opts the page out of generative training."},"limits":{"fr":"La préférence de page prime sur le signal robots.txt. Elle doit pouvoir être lue par Bingbot ; Allow ne lève pas un blocage d’exploration.","en":"The page preference overrides the robots.txt signal. Bingbot must be able to read it; Allow does not lift a crawl block."},"examples":[{"label":{"fr":"Balise HTML de la page","en":"Page HTML tag"},"format":"HTML","code":"<meta name=\"Bingbot\" content=\"ai-training:disallow\">"},{"label":{"fr":"Autre forme : en-tête HTTP","en":"Alternative: HTTP header"},"format":"HTTP","code":"X-Robots-Tag: Bingbot: ai-training:disallow"}],"effective_date":"2027-02-01","effective_date_precision":"day","implementation_delay":null,"observed_behavior":null,"effectivity":{"fr":"Application annoncée dès le 1er février 2027, au fil des explorations.","en":"Application announced from 1 February 2027, as pages are crawled."},"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"google-extended","name":"Google-Extended","scope":{"fr":"Refuse l’entraînement Gemini et le grounding dans Gemini Apps et Grounding with Google Search sur Vertex AI.","en":"Opts out of Gemini training and grounding in Gemini Apps and Grounding with Google Search on Vertex AI."},"scope_verified":true,"source_url":"https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers","group":"training","related_controls":["TS42"],"cells":{"Google":{"status":"documented","url":"https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:05:01+00:00","verified":"2026-11-12T02:16:08+00:00","raw":"1ffcc15ef8fabaf4f131a81be2103415c78a1c85ace17538c0c3dfa7431edb46","passage":"5594bbabcbcca82026587ff3fe42db5255605c8fc475a54f31bb687aa0f6c349","diff":null}},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"google-extended":"5594bbabcbcca82026587ff3fe42db5255605c8fc475a54f31bb687aa0f6c349","google-ai":"7b26e939691a185030910c7e853aa6a306630a80b9e21192c728bb2c6a219e40"},"uses":["training","grounding"],"effect":{"fr":"Refuse l’entraînement Gemini et le grounding dans Gemini Apps et Grounding with Google Search sur Vertex AI.","en":"Opts out of Gemini training and grounding in Gemini Apps and Grounding with Google Search on Vertex AI."},"limits":{"fr":"Sans effet sur l’inclusion ou le classement dans Search, ni sur AI Overviews ou AI Mode. Ce jeton n’identifie pas un robot HTTP distinct.","en":"Does not affect Search inclusion or ranking, AI Overviews or AI Mode. This token does not identify a separate HTTP crawler."},"examples":[{"label":{"fr":"Refuser les usages Google-Extended","en":"Disallow Google-Extended uses"},"format":"robots.txt","code":"User-agent: Google-Extended\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"bing-ai-grounding","name":"ai-grounding","scope":{"fr":"Disallow refuse le grounding. DisallowExtended le limite aux expériences exploitées par Microsoft et exclut ses services de grounding destinés aux tiers.","en":"Disallow opts out of grounding. DisallowExtended limits it to Microsoft-operated experiences, excluding Microsoft grounding services for third parties."},"scope_verified":true,"source_url":"https://blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/","group":"grounding","related_controls":["TS42"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"planned","url":"https://blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:05:02+00:00","verified":"2026-11-12T02:16:09+00:00","raw":"989edfcce11f91b5c34f54102d7a431c1cd62747ff6b865281600ee1cc9a5f1b","passage":"a577becb8222f398914b1cb231901636213618d580bd70cd7f2819777165d28c","diff":null}},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"bing-preferences":"a577becb8222f398914b1cb231901636213618d580bd70cd7f2819777165d28c"},"uses":["grounding"],"effect":{"fr":"Disallow refuse le grounding. DisallowExtended le limite aux expériences exploitées par Microsoft et exclut ses services de grounding destinés aux tiers.","en":"Disallow opts out of grounding. DisallowExtended limits it to Microsoft-operated experiences, excluding Microsoft grounding services for third parties."},"limits":{"fr":"Réglage uniquement à la page, jamais dans robots.txt. Indépendant de l’entraînement et sans changement d’éligibilité aux résultats classiques de Bing.","en":"Page-level only, never in robots.txt. Independent of training, with no change to eligibility for traditional Bing results."},"examples":[{"label":{"fr":"Refuser tout grounding","en":"Disallow all grounding"},"format":"HTML","code":"<meta name=\"Bingbot\" content=\"ai-grounding:disallow\">"},{"label":{"fr":"Limiter aux expériences Microsoft","en":"Limit to Microsoft-operated experiences"},"format":"HTML","code":"<meta name=\"Bingbot\" content=\"ai-grounding:disallowextended\">"},{"label":{"fr":"Autre forme : en-tête HTTP","en":"Alternative: HTTP header"},"format":"HTTP","code":"X-Robots-Tag: Bingbot: ai-grounding:disallowextended"}],"effective_date":"2027-02-01","effective_date_precision":"day","implementation_delay":null,"observed_behavior":null,"effectivity":{"fr":"Application annoncée dès le 1er février 2027, au fil des explorations.","en":"Application announced from 1 February 2027, as pages are crawled."},"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"noarchive-nocache","name":"NoArchive / NoCache","scope":{"fr":"Les anciennes préférences IA de Bing doivent être remplacées avant le 1er mars 2027.","en":"Bing’s legacy AI preferences should be replaced before 1 March 2027."},"scope_verified":true,"source_url":"https://blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/","group":"grounding","related_controls":["TS42"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"transition","url":"https://blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:05:02+00:00","verified":"2026-11-12T02:16:09+00:00","raw":"989edfcce11f91b5c34f54102d7a431c1cd62747ff6b865281600ee1cc9a5f1b","passage":"a577becb8222f398914b1cb231901636213618d580bd70cd7f2819777165d28c","diff":null}},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"bing-preferences":"a577becb8222f398914b1cb231901636213618d580bd70cd7f2819777165d28c"},"uses":["training","grounding"],"effect":{"fr":"Les anciennes préférences IA de Bing doivent être remplacées avant le 1er mars 2027.","en":"Bing’s legacy AI preferences should be replaced before 1 March 2027."},"limits":{"fr":"Pour les sites concernés : choix temporaire de grounding dès le 15 décembre 2026 ; nouvelles règles lues dès le 1er février ; fin du temporaire à la réexploration ou le 30 septembre 2027.","en":"For eligible sites: temporary grounding choice from 15 December 2026; new rules read from 1 February; temporary choice ends at recrawl or on 30 September 2027."},"examples":[],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"status_note":{"fr":"Migration : utiliser les fiches ai-training et ai-grounding.","en":"Migration: use the ai-training and ai-grounding records."},"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"search-console","name":"Search Console","scope":{"fr":"Le choix d’exclusion retire liens et contenu d’AI Overviews, d’AI Mode et des fonctions génératives de Discover.","en":"The exclusion setting removes links and content from AI Overviews, AI Mode and generative features in Discover."},"scope_verified":true,"source_url":"https://support.google.com/webmasters/answer/16908024?hl=en","group":"search","related_controls":[],"cells":{"Google":{"status":"documented","url":"https://support.google.com/webmasters/answer/16908024?hl=en","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:05:04+00:00","verified":"2026-11-12T02:16:11+00:00","raw":"9265c70566faffc412699db6d856852bf28a2269c01ddcbd17cff4c1834b9cf3","passage":"eaa354880f18bf54448d9ab868a8080f33d89987939a4222bf4aa2d452afe412","diff":null}},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"google-search-ai-control":"eaa354880f18bf54448d9ab868a8080f33d89987939a4222bf4aa2d452afe412"},"uses":["search","grounding"],"effect":{"fr":"Le choix d’exclusion retire liens et contenu d’AI Overviews, d’AI Mode et des fonctions génératives de Discover.","en":"The exclusion setting removes links and content from AI Overviews, AI Mode and generative features in Discover."},"limits":{"fr":"Ne contrôle pas l’entraînement et ne modifie pas le classement ou l’inclusion dans les autres résultats Search. Les propriétés enfants peuvent hériter du réglage parent.","en":"Does not control training or ranking/inclusion in other Search results. Child properties may inherit the parent setting."},"examples":[],"effective_date":"2026-08-31","effective_date_precision":"day","implementation_delay":{"days_min":1,"days_max":2,"approximate":true,"note":{"fr":"Généralement quelques jours ; 1 à 2 jours après activation, parfois davantage avec les caches.","en":"Generally a few days; 1–2 days after activation, sometimes longer due to caches."}},"observed_behavior":null,"setting_path":{"fr":"Search Console → Paramètres → IA générative dans la recherche → Exclure les liens et le contenu du site.","en":"Search Console → Settings → Search generative AI → Exclude my site’s links and content."},"effectivity":{"fr":"Déploiement mondial annoncé comme achevé le 31 août 2026.","en":"Worldwide rollout reported complete on 31 August 2026."},"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"oai-searchbot","name":"OAI-SearchBot","scope":{"fr":"Le refus retire le site des réponses de recherche ChatGPT, mais des liens de navigation restent possibles.","en":"Opt-out removes the site from ChatGPT search answers, although navigational links may remain."},"scope_verified":true,"source_url":"https://developers.openai.com/api/docs/bots","group":"search","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"documented","url":"https://developers.openai.com/api/docs/bots","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:04:53+00:00","verified":"2026-11-12T02:16:04+00:00","raw":"78caa706896816acebafc0b949ca1680411273c4a24bea157b1dd8bf4333252a","passage":"b7c5a2b25a2fd1fcd65f7a22fe4cc23b7be11057953d41a36a3e9093c330b112","diff":null}},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"openai-bots":"b7c5a2b25a2fd1fcd65f7a22fe4cc23b7be11057953d41a36a3e9093c330b112"},"uses":["search","grounding"],"effect":{"fr":"Le refus retire le site des réponses de recherche ChatGPT, mais des liens de navigation restent possibles.","en":"Opt-out removes the site from ChatGPT search answers, although navigational links may remain."},"limits":{"fr":"Ne règle pas GPTBot. Pour autoriser la recherche, les accès réseau doivent aussi fonctionner.","en":"Does not configure GPTBot. Allowing search also requires working network access."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: OAI-SearchBot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":{"hours":24,"approximate":true,"note":{"fr":"Environ 24 h pour les systèmes de recherche.","en":"About 24 hours for search systems."}},"observed_behavior":null,"identity":{"robots_token":"OAI-SearchBot","http_user_agents":[{"value":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot","kind":"documented_example"}],"ip_list_urls":["https://openai.com/searchbot.json"],"authentication_note":{"fr":"Le nom peut être usurpé. Vérifier les adresses avec la méthode officielle avant toute attribution.","en":"The name can be spoofed. Verify addresses using the official method before attributing traffic."},"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"claude-searchbot","name":"Claude-SearchBot","scope":{"fr":"Le refus empêche l’indexation destinée à améliorer les résultats de recherche de Claude.","en":"Opt-out prevents indexing intended to improve Claude search results."},"scope_verified":true,"source_url":"https://privacy.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler","group":"search","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"documented","url":"https://privacy.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:04:54+00:00","verified":"2026-11-12T02:16:04+00:00","raw":"e602ce6895e8e0d41177f00512c3ac06cdde17eac9f78fc43bb905de142cc122","passage":"184fc8b017b0c1cca4eb7595a8c2b378fb539e3444d02d436ea6f39d41c86c6b","diff":null}},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"anthropic-bots":"184fc8b017b0c1cca4eb7595a8c2b378fb539e3444d02d436ea6f39d41c86c6b"},"uses":["search","grounding"],"effect":{"fr":"Le refus empêche l’indexation destinée à améliorer les résultats de recherche de Claude.","en":"Opt-out prevents indexing intended to improve Claude search results."},"limits":{"fr":"Peut réduire visibilité et précision dans la recherche ; entraînement et accès utilisateur se règlent séparément.","en":"May reduce search visibility and accuracy; training and user-requested access are configured separately."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: Claude-SearchBot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":["https://claude.com/crawling/bots.json"],"http_user_agent_status":"not_established","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"applebot-extended","name":"Applebot-Extended","scope":{"fr":"Refuse l’usage des données Applebot pour entraîner les modèles de fondation.","en":"Opts Applebot data out of foundation-model training."},"scope_verified":true,"source_url":"https://support.apple.com/en-us/119829","group":"training","kind":"preference","related_controls":["TS42"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"documented","url":"https://support.apple.com/en-us/119829","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:05:18+00:00","verified":"2026-11-12T02:16:21+00:00","raw":"30c9ef308e140287d2a6310879414df7f87a65314234b51d00bd971d6f4daad3","passage":"58cfc33eeebcef38f90dd04942c45862a15e4038451adfad5e4f7950709463cd","diff":null}},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"applebot":"58cfc33eeebcef38f90dd04942c45862a15e4038451adfad5e4f7950709463cd"},"uses":["training"],"effect":{"fr":"Refuse l’usage des données Applebot pour entraîner les modèles de fondation.","en":"Opts Applebot data out of foundation-model training."},"limits":{"fr":"Ne bloque pas Applebot ni la recherche Apple. Ce jeton de préférence n’est pas un robot autonome.","en":"Does not block Applebot or Apple search. This preference token is not a standalone crawler."},"examples":[{"label":{"fr":"Refuser l’entraînement Apple","en":"Opt out of Apple training"},"format":"robots.txt","code":"User-agent: Applebot-Extended\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"mistralai-training","name":"MistralAI-Training","scope":{"fr":"Refuse la collecte de MistralAI-Training pour l’entraînement génératif.","en":"Opts out of MistralAI-Training collection for generative training."},"scope_verified":true,"source_url":"https://docs.mistral.ai/robots","group":"training","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"documented","url":"https://docs.mistral.ai/robots","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T05:24:07+00:00","verified":"2026-11-12T02:16:22+00:00","raw":"b4539f23004f3dae36adfc1142c7f09584bf365d5f3a94cb3d8ab1d90f2a3602","passage":"7ae2e284a1dfaf3bcdbf76c301a9ed26f96ec1f5c040ffe90f7a3dc84fffadd4","diff":null}},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"mistral-bots":"7ae2e284a1dfaf3bcdbf76c301a9ed26f96ec1f5c040ffe90f7a3dc84fffadd4"},"uses":["training"],"effect":{"fr":"Refuse la collecte de MistralAI-Training pour l’entraînement génératif.","en":"Opts out of MistralAI-Training collection for generative training."},"limits":{"fr":"MistralAI-Index et MistralAI-User conservent leurs propres réglages.","en":"MistralAI-Index and MistralAI-User retain their own settings."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: MistralAI-Training\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"MistralAI-Training","http_user_agents":[{"value":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots)","kind":"documented_example"}],"ip_list_urls":[],"http_user_agent_status":"documented","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"meta-externalagent","name":"meta-externalagent","scope":{"fr":"Refuse la collecte de cet agent pour l’entraînement et l’amélioration des produits Meta.","en":"Disallows this agent’s collection for training and Meta product improvement."},"scope_verified":true,"source_url":"https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/","group":"training","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"documented","url":"https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:25+00:00","verified":"2026-11-12T02:16:26+00:00","raw":"a4d5f103e841ac5b6fd7b2abf86a42a6a93c17dfdc072abed0466e5ba3e38008","passage":"5210cb46fad2ff54b5038bdb0e648c593311a4ffc120a40f8073874cc2484fe9","diff":null}},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"meta-crawlers":"5210cb46fad2ff54b5038bdb0e648c593311a4ffc120a40f8073874cc2484fe9"},"uses":["training","search"],"effect":{"fr":"Refuse la collecte de cet agent pour l’entraînement et l’amélioration des produits Meta.","en":"Disallows this agent’s collection for training and Meta product improvement."},"limits":{"fr":"Sa portée inclut aussi l’indexation des produits ; ce n’est pas une préférence d’entraînement isolée.","en":"Its scope also includes product indexing; it is not an isolated training preference."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: meta-externalagent\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"meta-externalagent","http_user_agents":[{"value":"meta-externalagent/1.1","kind":"documented_example"}],"ip_list_urls":[],"http_user_agent_status":"documented","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"amazonbot","name":"Amazonbot","scope":{"fr":"Refuse l’exploration d’Amazonbot, utilisé pour ses produits et potentiellement l’entraînement.","en":"Disallows Amazonbot crawling, used for its products and potentially training."},"scope_verified":true,"source_url":"https://developer.amazon.com/docs/amazonbot/amazonbot.html","group":"training","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"documented","url":"https://developer.amazon.com/docs/amazonbot/amazonbot.html","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:24+00:00","verified":"2026-11-12T02:16:25+00:00","raw":"ba11a19e5f9b6ae39ea2595b26c6e98fd84144f69cc1f7f443a29f4ac8cca1b6","passage":"215416ad07464eaaecefb14a0782ff38c98aedd2037e7553e940f92a5f88e7a4","diff":null}},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"amazon-bots":"215416ad07464eaaecefb14a0782ff38c98aedd2037e7553e940f92a5f88e7a4"},"uses":["training"],"effect":{"fr":"Refuse l’exploration d’Amazonbot, utilisé pour ses produits et potentiellement l’entraînement.","en":"Disallows Amazonbot crawling, used for its products and potentially training."},"limits":{"fr":"Les règles Amzn-SearchBot et Amzn-User sont indépendantes.","en":"Amzn-SearchBot and Amzn-User settings are independent."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: Amazonbot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":{"hours":24,"approximate":true,"note":{"fr":"Environ 24 h annoncées par Amazon ; aucun délai garanti pour une page donnée.","en":"About 24 hours stated by Amazon; no guaranteed per-page delay."}},"observed_behavior":null,"identity":{"robots_token":"Amazonbot","http_user_agents":[{"value":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36","kind":"documented_example"}],"ip_list_urls":["https://developer.amazon.com/amazonbot/ip-addresses/"],"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"perplexitybot","name":"PerplexityBot","scope":{"fr":"Refuse l’exploration pour la recherche Perplexity.","en":"Disallows crawling for Perplexity search."},"scope_verified":true,"source_url":"https://docs.perplexity.ai/docs/resources/perplexity-crawlers","group":"search","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"documented","url":"https://docs.perplexity.ai/docs/resources/perplexity-crawlers","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:23+00:00","verified":"2026-11-12T02:16:24+00:00","raw":"8b0b02c3c0b8529c60eb3a0e9e29a2e41cf7854406e9e1fdbe59fc2a1d3134b1","passage":"bcb760d7c84755ab6da10bcaa5a72d7f81f7d2ff02acb1d2fa118a978b0f88ef","diff":null}},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"perplexity-bots":"bcb760d7c84755ab6da10bcaa5a72d7f81f7d2ff02acb1d2fa118a978b0f88ef"},"uses":["search"],"effect":{"fr":"Refuse l’exploration pour la recherche Perplexity.","en":"Disallows crawling for Perplexity search."},"limits":{"fr":"Perplexity-User reste distinct ; le fournisseur ne présente pas ce robot comme un collecteur d’entraînement.","en":"Perplexity-User is separate; the provider does not describe this bot as a training crawler."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: PerplexityBot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":{"hours":24,"kind":"up_to","note":{"fr":"Jusqu’à 24 h pour la prise en compte des changements, selon Perplexity. Délai annoncé, non mesuré par TSEP.","en":"Up to 24 hours for changes to take effect, according to Perplexity. Stated delay, not measured by TSEP."}},"observed_behavior":null,"identity":{"robots_token":"PerplexityBot","http_user_agents":[{"value":"Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)","kind":"documented_example"}],"ip_list_urls":["https://www.perplexity.ai/perplexitybot.json"],"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"mistralai-index","name":"MistralAI-Index","scope":{"fr":"Refuse l’indexation automatique pour la recherche Mistral.","en":"Disallows automated Mistral search indexing."},"scope_verified":true,"source_url":"https://docs.mistral.ai/robots","group":"search","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"documented","url":"https://docs.mistral.ai/robots","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T05:24:07+00:00","verified":"2026-11-12T02:16:22+00:00","raw":"b4539f23004f3dae36adfc1142c7f09584bf365d5f3a94cb3d8ab1d90f2a3602","passage":"7ae2e284a1dfaf3bcdbf76c301a9ed26f96ec1f5c040ffe90f7a3dc84fffadd4","diff":null}},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"mistral-bots":"7ae2e284a1dfaf3bcdbf76c301a9ed26f96ec1f5c040ffe90f7a3dc84fffadd4"},"uses":["search"],"effect":{"fr":"Refuse l’indexation automatique pour la recherche Mistral.","en":"Disallows automated Mistral search indexing."},"limits":{"fr":"Ce robot n’est pas utilisé pour entraîner les modèles génératifs.","en":"This crawler is not used for generative-model training."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: MistralAI-Index\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"MistralAI-Index","http_user_agents":[{"value":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Index/1.0; +https://docs.mistral.ai/robots)","kind":"documented_example"}],"ip_list_urls":["https://mistral.ai/mistralai-index-ips.json"],"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"meta-webindexer","name":"meta-webindexer","scope":{"fr":"Refuse l’indexation pour la recherche et les citations de Meta AI.","en":"Disallows indexing for Meta AI search and citations."},"scope_verified":true,"source_url":"https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/","group":"search","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"documented","url":"https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:25+00:00","verified":"2026-11-12T02:16:26+00:00","raw":"a4d5f103e841ac5b6fd7b2abf86a42a6a93c17dfdc072abed0466e5ba3e38008","passage":"5210cb46fad2ff54b5038bdb0e648c593311a4ffc120a40f8073874cc2484fe9","diff":null}},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"meta-crawlers":"5210cb46fad2ff54b5038bdb0e648c593311a4ffc120a40f8073874cc2484fe9"},"uses":["search"],"effect":{"fr":"Refuse l’indexation pour la recherche et les citations de Meta AI.","en":"Disallows indexing for Meta AI search and citations."},"limits":{"fr":"Ne remplace pas les réglages des autres agents Meta.","en":"Does not replace settings for other Meta agents."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: meta-webindexer\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"meta-webindexer","http_user_agents":[{"value":"meta-webindexer/1.1","kind":"documented_example"}],"ip_list_urls":[],"http_user_agent_status":"documented","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"amzn-searchbot","name":"Amzn-SearchBot","scope":{"fr":"Refuse l’exploration dédiée aux recherches dans les produits Amazon.","en":"Disallows crawling dedicated to search in Amazon products."},"scope_verified":true,"source_url":"https://developer.amazon.com/docs/amazonbot/amazonbot.html","group":"search","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"documented","url":"https://developer.amazon.com/docs/amazonbot/amazonbot.html","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:24+00:00","verified":"2026-11-12T02:16:25+00:00","raw":"ba11a19e5f9b6ae39ea2595b26c6e98fd84144f69cc1f7f443a29f4ac8cca1b6","passage":"215416ad07464eaaecefb14a0782ff38c98aedd2037e7553e940f92a5f88e7a4","diff":null}},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"amazon-bots":"215416ad07464eaaecefb14a0782ff38c98aedd2037e7553e940f92a5f88e7a4"},"uses":["search"],"effect":{"fr":"Refuse l’exploration dédiée aux recherches dans les produits Amazon.","en":"Disallows crawling dedicated to search in Amazon products."},"limits":{"fr":"Sans règle dédiée, Amazon peut reprendre les règles d’autres robots de recherche autorisés. Ce robot ne collecte pas pour l’entraînement génératif.","en":"Without a dedicated rule, Amazon may use rules for other allowed search crawlers. This bot does not crawl for generative training."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: Amzn-SearchBot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":{"hours":24,"approximate":true,"note":{"fr":"Environ 24 h annoncées par Amazon ; aucun délai garanti pour une page donnée.","en":"About 24 hours stated by Amazon; no guaranteed per-page delay."}},"observed_behavior":null,"identity":{"robots_token":"Amzn-SearchBot","http_user_agents":[{"value":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-SearchBot/0.1) Chrome/W.X.Y.Z Safari/537.36","kind":"documented_example"}],"ip_list_urls":["https://developer.amazon.com/amazonbot/searchbot-ip-addresses/"],"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"applebot","name":"Applebot","scope":{"fr":"Le blocage d’Applebot peut retirer la présence dans la recherche Apple.","en":"Blocking Applebot can remove presence in Apple search."},"scope_verified":true,"source_url":"https://support.apple.com/en-us/119829","group":"search","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"documented","url":"https://support.apple.com/en-us/119829","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:05:18+00:00","verified":"2026-11-12T02:16:21+00:00","raw":"30c9ef308e140287d2a6310879414df7f87a65314234b51d00bd971d6f4daad3","passage":"58cfc33eeebcef38f90dd04942c45862a15e4038451adfad5e4f7950709463cd","diff":null}},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"applebot":"58cfc33eeebcef38f90dd04942c45862a15e4038451adfad5e4f7950709463cd"},"uses":["search","grounding","training"],"effect":{"fr":"Le blocage d’Applebot peut retirer la présence dans la recherche Apple.","en":"Blocking Applebot can remove presence in Apple search."},"limits":{"fr":"Pour limiter seulement l’entraînement, utiliser Applebot-Extended ; pour les réponses IA de connaissances générales, nosnippet. Sans règle Applebot, Apple reprend les règles Googlebot si présentes.","en":"For training only, use Applebot-Extended; for AI broad world knowledge answers, use nosnippet. Without Applebot rules, Apple uses Googlebot rules if present."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: Applebot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"Applebot","http_user_agents":[],"ip_list_urls":["https://search.developer.apple.com/applebot.json"],"http_user_agent_status":"not_established","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"perplexity-user","name":"Perplexity-User","scope":{"fr":"Un groupe robots.txt ne garantit pas le refus de ces accès à la demande.","en":"A robots.txt group does not guarantee exclusion of these user-requested accesses."},"scope_verified":true,"source_url":"https://docs.perplexity.ai/docs/resources/perplexity-crawlers","group":"user","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"documented","url":"https://docs.perplexity.ai/docs/resources/perplexity-crawlers","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:23+00:00","verified":"2026-11-12T02:16:24+00:00","raw":"8b0b02c3c0b8529c60eb3a0e9e29a2e41cf7854406e9e1fdbe59fc2a1d3134b1","passage":"bcb760d7c84755ab6da10bcaa5a72d7f81f7d2ff02acb1d2fa118a978b0f88ef","diff":null}},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"perplexity-bots":"bcb760d7c84755ab6da10bcaa5a72d7f81f7d2ff02acb1d2fa118a978b0f88ef"},"uses":["user"],"effect":{"fr":"Un groupe robots.txt ne garantit pas le refus de ces accès à la demande.","en":"A robots.txt group does not guarantee exclusion of these user-requested accesses."},"limits":{"fr":"Accès déclenché par une demande utilisateur. Perplexity précise que ces accès ignorent généralement robots.txt ; ils ne sont pas une collecte d’entraînement.","en":"User-requested access. Perplexity says these requests generally ignore robots.txt; they are not training crawls."},"examples":[],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"status_note":{"fr":"Aucun extrait présenté comme un blocage garanti. Vérifier l’accès réel côté serveur.","en":"No snippet is presented as a guaranteed block. Check actual server access."},"identity":{"robots_token":"Perplexity-User","http_user_agents":[{"value":"Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)","kind":"documented_example"}],"ip_list_urls":["https://www.perplexity.ai/perplexity-user.json"],"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"amzn-user","name":"Amzn-User","scope":{"fr":"Un groupe robots.txt ne garantit pas le refus de ces accès à la demande.","en":"A robots.txt group does not guarantee exclusion of these user-requested accesses."},"scope_verified":true,"source_url":"https://developer.amazon.com/docs/amazonbot/amazonbot.html","group":"user","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"documented","url":"https://developer.amazon.com/docs/amazonbot/amazonbot.html","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:24+00:00","verified":"2026-11-12T02:16:25+00:00","raw":"ba11a19e5f9b6ae39ea2595b26c6e98fd84144f69cc1f7f443a29f4ac8cca1b6","passage":"215416ad07464eaaecefb14a0782ff38c98aedd2037e7553e940f92a5f88e7a4","diff":null}},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"amazon-bots":"215416ad07464eaaecefb14a0782ff38c98aedd2037e7553e940f92a5f88e7a4"},"uses":["user"],"effect":{"fr":"Un groupe robots.txt ne garantit pas le refus de ces accès à la demande.","en":"A robots.txt group does not guarantee exclusion of these user-requested accesses."},"limits":{"fr":"Accès à la demande pour répondre à un utilisateur, sans entraînement. Amazon indique que ces requêtes peuvent ne pas suivre toutes les règles robots.txt.","en":"On-demand access to answer a user, without training. Amazon says these requests may not follow every robots.txt rule."},"examples":[],"effective_date":null,"effective_date_precision":null,"implementation_delay":{"hours":24,"approximate":true,"note":{"fr":"Environ 24 h annoncées par Amazon ; aucun délai garanti pour une page donnée.","en":"About 24 hours stated by Amazon; no guaranteed per-page delay."}},"observed_behavior":null,"status_note":{"fr":"Aucun extrait présenté comme un blocage garanti. Vérifier l’accès réel côté serveur.","en":"No snippet is presented as a guaranteed block. Check actual server access."},"identity":{"robots_token":"Amzn-User","http_user_agents":[{"value":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-User/0.1) Chrome/W.X.Y.Z Safari/537.36","kind":"documented_example"}],"ip_list_urls":["https://developer.amazon.com/amazonbot/live-ip-addresses/"],"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"mistralai-user","name":"MistralAI-User","scope":{"fr":"Contrôle les sites accessibles aux demandes utilisateur de Vibe.","en":"Controls sites accessible to Vibe user requests."},"scope_verified":true,"source_url":"https://docs.mistral.ai/robots","group":"user","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"documented","url":"https://docs.mistral.ai/robots","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T05:24:07+00:00","verified":"2026-11-12T02:16:22+00:00","raw":"b4539f23004f3dae36adfc1142c7f09584bf365d5f3a94cb3d8ab1d90f2a3602","passage":"7ae2e284a1dfaf3bcdbf76c301a9ed26f96ec1f5c040ffe90f7a3dc84fffadd4","diff":null}},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"mistral-bots":"7ae2e284a1dfaf3bcdbf76c301a9ed26f96ec1f5c040ffe90f7a3dc84fffadd4"},"uses":["user"],"effect":{"fr":"Contrôle les sites accessibles aux demandes utilisateur de Vibe.","en":"Controls sites accessible to Vibe user requests."},"limits":{"fr":"Ce n’est ni une exploration automatique ni une collecte d’entraînement.","en":"Neither automated web crawling nor training collection."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: MistralAI-User\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"MistralAI-User","http_user_agents":[{"value":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-User/1.0; +https://docs.mistral.ai/robots)","kind":"documented_example"}],"ip_list_urls":["https://mistral.ai/mistralai-user-ips.json"],"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"meta-externalfetcher","name":"meta-externalfetcher","scope":{"fr":"Un groupe robots.txt ne garantit pas le refus de ces accès à la demande.","en":"A robots.txt group does not guarantee exclusion of these user-requested accesses."},"scope_verified":true,"source_url":"https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/","group":"user","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"documented","url":"https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:25+00:00","verified":"2026-11-12T02:16:26+00:00","raw":"a4d5f103e841ac5b6fd7b2abf86a42a6a93c17dfdc072abed0466e5ba3e38008","passage":"5210cb46fad2ff54b5038bdb0e648c593311a4ffc120a40f8073874cc2484fe9","diff":null}},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"meta-crawlers":"5210cb46fad2ff54b5038bdb0e648c593311a4ffc120a40f8073874cc2484fe9"},"uses":["user"],"effect":{"fr":"Un groupe robots.txt ne garantit pas le refus de ces accès à la demande.","en":"A robots.txt group does not guarantee exclusion of these user-requested accesses."},"limits":{"fr":"Récupération de liens à la demande et évaluation de capacités agentiques. Meta indique que certains accès peuvent contourner robots.txt.","en":"Retrieves links on demand and evaluates agent capabilities. Meta says some requests may bypass robots.txt."},"examples":[],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"status_note":{"fr":"Aucun extrait présenté comme un blocage garanti. Vérifier l’accès réel côté serveur.","en":"No snippet is presented as a guaranteed block. Check actual server access."},"identity":{"robots_token":"meta-externalfetcher","http_user_agents":[{"value":"meta-externalfetcher/1.1","kind":"documented_example"}],"ip_list_urls":[],"http_user_agent_status":"documented","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"ccbot","name":"CCBot","scope":{"fr":"Refuse les futures collectes conformes de Common Crawl.","en":"Disallows future compliant Common Crawl crawls."},"scope_verified":true,"source_url":"https://commoncrawl.org/ccbot","group":"corpus","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"documented","url":"https://commoncrawl.org/ccbot","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:24+00:00","verified":"2026-11-12T02:16:26+00:00","raw":"462fee13c76952805dc093782518a4ee50034c8d73e081cae5177ce55a67d8f9","passage":"51b4b9b75218fa051e37afbbc4fce8506c0f68fb90fa3689e6b3854bb8143cb3","diff":null}},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"common-crawl":"51b4b9b75218fa051e37afbbc4fce8506c0f68fb90fa3689e6b3854bb8143cb3"},"uses":["corpus"],"effect":{"fr":"Refuse les futures collectes conformes de Common Crawl.","en":"Disallows future compliant Common Crawl crawls."},"limits":{"fr":"Ne retire pas les copies déjà publiées ni leur réutilisation par des tiers.","en":"Does not withdraw already published copies or third-party reuse."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: CCBot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"CCBot","http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"content-signal","name":"Content-Signal","scope":{"fr":"Déclare les préférences search, ai-input et ai-train. La documentation présente aussi un champ use en expérimentation.","en":"Declares search, ai-input and ai-train preferences. The documentation also presents an experimental use field."},"scope_verified":true,"source_url":"https://developers.cloudflare.com/bots/additional-configurations/managed-robots-txt/","group":"policy","kind":"preference","related_controls":["TS42"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"documented","url":"https://developers.cloudflare.com/bots/additional-configurations/managed-robots-txt/","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:27+00:00","verified":"2026-11-12T02:16:27+00:00","raw":"ff7d1b9bbe5e25c70f7800aeaa2bfb451bc398ecf06d01c6244496d8629ed33f","passage":"bda25ec127fb70eb91f3ddedc9595e123bafde65c2786b6bb4f5732c6c7200e4","diff":null}},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"cloudflare-content-signals":"bda25ec127fb70eb91f3ddedc9595e123bafde65c2786b6bb4f5732c6c7200e4"},"uses":["policy","search","training","grounding"],"effect":{"fr":"Déclare les préférences search, ai-input et ai-train. La documentation présente aussi un champ use en expérimentation.","en":"Declares search, ai-input and ai-train preferences. The documentation also presents an experimental use field."},"limits":{"fr":"use=immediate : interaction sans conservation ; reference : index, extrait et lien ; full : résumé et reproduction. La page est datée du 2 novembre, ce qui ne prouve pas la date de début du test. Aucun blocage réseau ni respect universel n’est garanti. Les exemples avec Allow: / doivent être conciliés avec vos exclusions existantes.","en":"use=immediate: interact without retention; reference: index, excerpt and link; full: summarize and reproduce. The page is dated 2 November; this does not establish the test start date. Neither network blocking nor universal compliance is guaranteed. Examples containing Allow: / must be reconciled with existing exclusions."},"examples":[{"label":{"fr":"Exemple du réglage géré par Cloudflare","en":"Cloudflare-managed example"},"format":"robots.txt","code":"User-agent: *\nContent-Signal: search=yes, ai-train=no, use=reference\nAllow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"license","name":"License","scope":{"fr":"Associe le contenu à un document de licence XML RSL.","en":"Associates content with an RSL XML license document."},"scope_verified":true,"source_url":"https://rslstandard.org/rsl","group":"policy","kind":"license","related_controls":["TS42"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"documented","url":"https://rslstandard.org/rsl","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:27+00:00","verified":"2026-11-12T02:16:27+00:00","raw":"5667103bb443c15c723911b192bc721ababb27bf1fc76c599e87b995301310de","passage":"9b13e4e1caea2b43a25df581cb878abdbc2bb347c5932d1f6abcb2705c2e114a","diff":null}},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"rsl":"9b13e4e1caea2b43a25df581cb878abdbc2bb347c5932d1f6abcb2705c2e114a"},"uses":["policy"],"effect":{"fr":"Associe le contenu à un document de licence XML RSL.","en":"Associates content with an RSL XML license document."},"limits":{"fr":"Le fichier de licence doit exister et définir les droits. License ne remplace pas Allow/Disallow et dépend des clients qui appliquent RSL.","en":"The license file must exist and define rights. License does not replace Allow/Disallow and depends on clients implementing RSL."},"examples":[{"label":{"fr":"Exemple de déclaration de licence à adapter","en":"License discovery example to adapt"},"format":"robots.txt","code":"User-agent: *\nLicense: https://example.com/rsl-license.xml"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"bytespider","name":"Bytespider","scope":{"fr":"Exprime le refus d’exploration pour Bytespider selon la documentation ByteDance.","en":"Expresses a Bytespider crawl opt-out under ByteDance documentation."},"scope_verified":true,"source_url":"https://zhanzhang.toutiao.com/docs/intro/26899","group":"search","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"documented","url":"https://zhanzhang.toutiao.com/docs/intro/26899","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T11:31:52+00:00","verified":"2026-11-12T02:16:27+00:00","raw":"2905dcc31528f09fe690cdc46f45a9867620bfc63231afdc6f9d6e7b54962676","passage":"a67f04988875799a7c2aab5d6c32546adba7820faa9d58f863e558ca457d9000","diff":null}},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"bytedance-bytespider":"a67f04988875799a7c2aab5d6c32546adba7820faa9d58f863e558ca457d9000"},"uses":["search"],"effect":{"fr":"Exprime le refus d’exploration pour Bytespider selon la documentation ByteDance.","en":"Expresses a Bytespider crawl opt-out under ByteDance documentation."},"limits":{"fr":"La documentation ne suffit pas à conclure que les accès observés respectent cette règle ni à attribuer tout le trafic du groupe.","en":"Documentation alone does not establish observed compliance or identify all group traffic."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: Bytespider\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"Bytespider","http_user_agents":[{"value":"Mozilla/5.0 (compatible; Bytespider; https://zhanzhang.toutiao.com/) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36","kind":"documented_example"},{"value":"Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://zhanzhang.toutiao.com/)","kind":"documented_example"},{"value":"Mozilla/5.0 (iPhone; CPU iPhone OS 7_1_2 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Version/7.0 Mobile Safari/537.36 (compatible; Bytespider; https://zhanzhang.toutiao.com/)","kind":"documented_example"}],"ip_list_urls":[],"ip_prefixes_as_documented":["110.249.201.0/24","110.249.202.0/24","111.225.148.0/24","111.225.149.0/24","220.243.135.0/24","220.243.136.0/24","220.243.188.0/24","220.243.189.0/24","60.8.123.0/24","60.8.151.0/24"],"ip_prefixes_capture_date":"2026-11-06T11:31:52+00:00","http_user_agent_status":"documented","ip_list_status":"documented_prefixes"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"chatgpt-user","name":"ChatGPT-User","scope":{"fr":"Un groupe robots.txt ne garantit pas le refus de ces accès à la demande.","en":"A robots.txt group does not guarantee exclusion of these user-requested accesses."},"scope_verified":true,"source_url":"https://developers.openai.com/api/docs/bots","group":"user","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"documented","url":"https://developers.openai.com/api/docs/bots","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T14:55:39+00:00","verified":"2026-11-12T02:16:04+00:00","raw":"b63a02a9eb2ec848efc5dbeb16e63c04cf6d425fb79423bc534267a456c14cca","passage":"6d11f6beab02ffe889ac8bfac323d0c69d4e7e5040b7bcc4406a2c49b0239818","diff":null}},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"openai-bots-complete":"6d11f6beab02ffe889ac8bfac323d0c69d4e7e5040b7bcc4406a2c49b0239818"},"uses":["user"],"effect":{"fr":"Un groupe robots.txt ne garantit pas le refus de ces accès à la demande.","en":"A robots.txt group does not guarantee exclusion of these user-requested accesses."},"limits":{"fr":"Récupère une page à la demande d’un utilisateur de ChatGPT ou d’un GPT personnalisé. Ces accès peuvent ne pas appliquer robots.txt.","en":"Retrieves pages at a ChatGPT or custom GPT user’s request. These requests may not apply robots.txt rules."},"examples":[],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"status_note":{"fr":"Aucun extrait présenté comme un blocage garanti. Vérifier l’accès réel côté serveur.","en":"No snippet is presented as a guaranteed block. Check actual server access."},"identity":{"robots_token":"ChatGPT-User","http_user_agents":[{"value":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot","kind":"documented_example"}],"ip_list_urls":["https://openai.com/chatgpt-user.json"],"authentication_note":{"fr":"Le nom peut être usurpé. Vérifier les adresses avec la méthode officielle avant toute attribution.","en":"The name can be spoofed. Verify addresses using the official method before attributing traffic."},"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"claude-user","name":"Claude-User","scope":{"fr":"Le refus empêche Claude de récupérer le contenu en réponse à une demande utilisateur.","en":"Opt-out prevents Claude from retrieving content in response to a user query."},"scope_verified":true,"source_url":"https://privacy.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler","group":"user","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"documented","url":"https://privacy.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:04:54+00:00","verified":"2026-11-12T02:16:04+00:00","raw":"e602ce6895e8e0d41177f00512c3ac06cdde17eac9f78fc43bb905de142cc122","passage":"184fc8b017b0c1cca4eb7595a8c2b378fb539e3444d02d436ea6f39d41c86c6b","diff":null}},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"anthropic-bots":"184fc8b017b0c1cca4eb7595a8c2b378fb539e3444d02d436ea6f39d41c86c6b"},"uses":["user"],"effect":{"fr":"Le refus empêche Claude de récupérer le contenu en réponse à une demande utilisateur.","en":"Opt-out prevents Claude from retrieving content in response to a user query."},"limits":{"fr":"Peut réduire la visibilité dans ces réponses ; les autres robots Claude restent indépendants.","en":"May reduce visibility in these answers; other Claude crawlers remain independent."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: Claude-User\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"Claude-User","http_user_agents":[],"ip_list_urls":["https://claude.com/crawling/bots.json"],"http_user_agent_status":"not_established","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"googlebot","name":"Googlebot","scope":{"fr":"Refuse l’exploration du robot principal de recherche Google.","en":"Disallows Google’s main search crawler."},"scope_verified":true,"source_url":"https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers","group":"search","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"documented","url":"https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T14:55:43+00:00","verified":"2026-11-12T02:16:08+00:00","raw":"03b62207ae01bfa409db09177986f4df4b9574d74e6af9fbc0ad5a75bc00481e","passage":"d8c7efdef95daf256d2a6889b886443324243ef4d2068e587e0deebe69ef5030","diff":null}},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"google-common-crawlers":"d8c7efdef95daf256d2a6889b886443324243ef4d2068e587e0deebe69ef5030","google-ai":"7b26e939691a185030910c7e853aa6a306630a80b9e21192c728bb2c6a219e40","google-search-ai-control":"eaa354880f18bf54448d9ab868a8080f33d89987939a4222bf4aa2d452afe412"},"uses":["search"],"effect":{"fr":"Refuse l’exploration du robot principal de recherche Google.","en":"Disallows Google’s main search crawler."},"limits":{"fr":"Aucune règle robots.txt dédiée ne cible seulement AI Overviews ou AI Mode : bloquer Googlebot touche la recherche Google dans son ensemble. Pour limiter l’affichage, utiliser nosnippet, data-nosnippet, max-snippet ou noindex selon la portée souhaitée ; le réglage Search Console permet d’exclure les fonctions génératives. Une URL interdite à l’exploration peut rester connue : robots.txt ne remplace pas noindex.","en":"No dedicated robots.txt rule targets only AI Overviews or AI Mode: blocking Googlebot affects Google Search as a whole. Use nosnippet, data-nosnippet, max-snippet or noindex to limit display according to the intended scope; the Search Console setting can exclude generative features. A URL blocked from crawling may remain known: robots.txt does not replace noindex."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: Googlebot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"Googlebot","http_user_agents":[{"value":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36","kind":"documented_example"}],"ip_list_urls":["https://developers.google.com/static/crawling/ipranges/common-crawlers.json"],"authentication_note":{"fr":"Le nom peut être usurpé. Vérifier les adresses avec la méthode officielle avant toute attribution.","en":"The name can be spoofed. Verify addresses using the official method before attributing traffic."},"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null,"related_records":["search-console","google-extended"]},"display_name":null},{"id":"bingbot","name":"Bingbot","scope":{"fr":"Refuse l’exploration de Bingbot ; les règles IA de la page ne peuvent pas être lues si son accès est bloqué.","en":"Disallows Bingbot crawling; page-level AI settings cannot be read if access is blocked."},"scope_verified":true,"source_url":"https://blogs.bing.com/webmaster/2022/4/Announcing-user-agent-change-for-Bing-crawler-bingbot/","group":"search","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"documented","url":"https://blogs.bing.com/webmaster/2022/4/Announcing-user-agent-change-for-Bing-crawler-bingbot/","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T14:56:26+00:00","verified":"2026-11-12T02:16:51+00:00","raw":"2f5806b31a9569994fff9d3563745fbb25db2fc447e4ead985ed274efd52834f","passage":"be8b106e6f51822d6d44c2f552906821ed119e7fc4a23bcc2cc94abdbe9df415","diff":null}},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"bing-crawlers":"be8b106e6f51822d6d44c2f552906821ed119e7fc4a23bcc2cc94abdbe9df415","bing-preferences":"a577becb8222f398914b1cb231901636213618d580bd70cd7f2819777165d28c"},"uses":["search"],"effect":{"fr":"Refuse l’exploration de Bingbot ; les règles IA de la page ne peuvent pas être lues si son accès est bloqué.","en":"Disallows Bingbot crawling; page-level AI settings cannot be read if access is blocked."},"limits":{"fr":"Pour refuser seulement un usage IA, consulter ai-training et ai-grounding. L’en-tête User-Agent seul ne prouve pas l’identité du robot.","en":"For an AI-use-only opt-out, see ai-training and ai-grounding. A User-Agent header alone does not establish crawler identity."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: bingbot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"bingbot","http_user_agents":[{"value":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36","kind":"documented_example"}],"ip_list_urls":[],"authentication_note":{"fr":"Le nom peut être usurpé. Vérifier les adresses avec la méthode officielle avant toute attribution.","en":"The name can be spoofed. Verify addresses using the official method before attributing traffic."},"http_user_agent_status":"documented","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"duckassistbot","name":"DuckAssistBot","scope":{"fr":"Le refus arrête la collecte pour les réponses IA de DuckDuckGo après le délai documenté.","en":"Opt-out stops crawling for DuckDuckGo AI answers after the documented delay."},"scope_verified":true,"source_url":"https://duckduckgo.com/duckduckgo-help-pages/results/duckassistbot","group":"grounding","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"documented","url":"https://duckduckgo.com/duckduckgo-help-pages/results/duckassistbot","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T15:01:24+00:00","verified":"2026-11-11T04:16:34+00:00","raw":"7f3a9244de52b91080adc8476e2c30567a78473099136aa3a046b2a49e197f87","passage":"48b084201543c4b6afd4ab2b7969e92d24ad51f88686821c70da9807e1035d3a","diff":null}},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"duckassistbot":"48b084201543c4b6afd4ab2b7969e92d24ad51f88686821c70da9807e1035d3a"},"uses":["grounding"],"effect":{"fr":"Le refus arrête la collecte pour les réponses IA de DuckDuckGo après le délai documenté.","en":"Opt-out stops crawling for DuckDuckGo AI answers after the documented delay."},"limits":{"fr":"Sans impact annoncé sur le classement ou la présence dans les résultats organiques. Les données ne servent pas à entraîner les modèles.","en":"No stated impact on organic ranking or inclusion. The data is not used to train models."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: DuckAssistBot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":{"hours":72,"approximate":false,"note":{"fr":"72 h après la modification de robots.txt.","en":"72 hours after updating robots.txt."}},"observed_behavior":null,"identity":{"robots_token":"DuckAssistBot","http_user_agents":[{"value":"DuckAssistBot/1.2; (+http://duckduckgo.com/duckassistbot.html)","kind":"documented_example"}],"ip_list_urls":["https://duckduckgo.com/duckassistbot.json"],"authentication_note":{"fr":"Le nom peut être usurpé. Vérifier les adresses avec la méthode officielle avant toute attribution.","en":"The name can be spoofed. Verify addresses using the official method before attributing traffic."},"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"oai-adsbot","name":"OAI-AdsBot","scope":{"fr":"Examine la sécurité et la pertinence des pages soumises comme publicités ChatGPT.","en":"Checks the safety and relevance of pages submitted as ChatGPT ads."},"scope_verified":true,"source_url":"https://developers.openai.com/api/docs/bots","group":"user","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"documented","url":"https://developers.openai.com/api/docs/bots","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T14:55:39+00:00","verified":"2026-11-12T02:16:04+00:00","raw":"b63a02a9eb2ec848efc5dbeb16e63c04cf6d425fb79423bc534267a456c14cca","passage":"6d11f6beab02ffe889ac8bfac323d0c69d4e7e5040b7bcc4406a2c49b0239818","diff":null}},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"openai-bots-complete":"6d11f6beab02ffe889ac8bfac323d0c69d4e7e5040b7bcc4406a2c49b0239818"},"uses":["user"],"effect":{"fr":"Examine la sécurité et la pertinence des pages soumises comme publicités ChatGPT.","en":"Checks the safety and relevance of pages submitted as ChatGPT ads."},"limits":{"fr":"Pas d’entraînement des modèles de fondation génératifs. La source ne décrit pas précisément l’effet d’un blocage sur l’approbation d’une publicité.","en":"No generative foundation-model training. The source does not precisely define how blocking affects ad approval."},"examples":[],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"OAI-AdsBot","http_user_agents":[{"value":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-AdsBot/1.0; +https://openai.com/adsbot","kind":"documented_example"}],"ip_list_urls":["https://openai.com/adsbot.json"],"authentication_note":{"fr":"Le nom peut être usurpé. Vérifier les adresses avec la méthode officielle avant toute attribution.","en":"The name can be spoofed. Verify addresses using the official method before attributing traffic."},"http_user_agent_status":"documented","ip_list_status":"documented_link"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"google-cloudvertexbot","name":"Google-CloudVertexBot","scope":{"fr":"Contrôle les explorations pour les agents Vertex AI demandées par le propriétaire du site.","en":"Controls site-owner-requested crawling for Vertex AI agents."},"scope_verified":true,"source_url":"https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers","group":"user","kind":"crawler","related_controls":["TS42","TS43"],"cells":{"Google":{"status":"documented","url":"https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T14:55:43+00:00","verified":"2026-11-12T02:16:08+00:00","raw":"03b62207ae01bfa409db09177986f4df4b9574d74e6af9fbc0ad5a75bc00481e","passage":"d8c7efdef95daf256d2a6889b886443324243ef4d2068e587e0deebe69ef5030","diff":null}},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"google-common-crawlers":"d8c7efdef95daf256d2a6889b886443324243ef4d2068e587e0deebe69ef5030"},"uses":["user"],"effect":{"fr":"Contrôle les explorations pour les agents Vertex AI demandées par le propriétaire du site.","en":"Controls site-owner-requested crawling for Vertex AI agents."},"limits":{"fr":"La documentation accepte Google-CloudVertexBot ou Googlebot comme jeton ; une règle dédiée évite d’élargir le choix au robot Search.","en":"The documentation accepts Google-CloudVertexBot or Googlebot as a token; a dedicated rule avoids extending the choice to the Search crawler."},"examples":[{"label":{"fr":"Refuser l’accès à ce robot","en":"Disallow this crawler"},"format":"robots.txt","code":"User-agent: Google-CloudVertexBot\nDisallow: /"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":"Google-CloudVertexBot","http_user_agents":[{"value":"Google-CloudVertexBot","kind":"documented_substring"}],"ip_list_urls":[],"http_user_agent_status":"documented","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"amazon-noarchive","name":"noarchive · Amazon","scope":{"fr":"Demande à Amazon de ne pas utiliser la page pour l’entraînement.","en":"Asks Amazon not to use the page for training."},"scope_verified":true,"source_url":"https://developer.amazon.com/docs/amazonbot/amazonbot.html","group":"training","kind":"meta","related_controls":["TS42"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"documented","url":"https://developer.amazon.com/docs/amazonbot/amazonbot.html","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T09:56:24+00:00","verified":"2026-11-12T02:16:25+00:00","raw":"ba11a19e5f9b6ae39ea2595b26c6e98fd84144f69cc1f7f443a29f4ac8cca1b6","passage":"215416ad07464eaaecefb14a0782ff38c98aedd2037e7553e940f92a5f88e7a4","diff":null}},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"amazon-bots":"215416ad07464eaaecefb14a0782ff38c98aedd2037e7553e940f92a5f88e7a4"},"uses":["training"],"effect":{"fr":"Demande à Amazon de ne pas utiliser la page pour l’entraînement.","en":"Asks Amazon not to use the page for training."},"limits":{"fr":"La page doit rester accessible pour que la balise soit lue. La balise robots peut aussi être interprétée par d’autres moteurs selon leurs propres règles.","en":"The page must remain accessible for the tag to be read. Other engines may also interpret the robots tag under their own rules."},"examples":[{"label":{"fr":"Balise de page documentée","en":"Documented page-level tag"},"format":"HTML","code":"<meta name=\"robots\" content=\"noarchive\">"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"apple-nosnippet","name":"nosnippet · Apple","scope":{"fr":"Exclut le contenu des réponses IA de connaissances générales d’Apple.","en":"Excludes content from Apple’s AI broad world knowledge answers."},"scope_verified":true,"source_url":"https://support.apple.com/en-us/119829","group":"grounding","kind":"meta","related_controls":["TS42"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"documented","url":"https://support.apple.com/en-us/119829","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-05T17:05:18+00:00","verified":"2026-11-12T02:16:21+00:00","raw":"30c9ef308e140287d2a6310879414df7f87a65314234b51d00bd971d6f4daad3","passage":"58cfc33eeebcef38f90dd04942c45862a15e4038451adfad5e4f7950709463cd","diff":null}},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"outside_scope"}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"applebot":"58cfc33eeebcef38f90dd04942c45862a15e4038451adfad5e4f7950709463cd"},"uses":["grounding"],"effect":{"fr":"Exclut le contenu des réponses IA de connaissances générales d’Apple.","en":"Excludes content from Apple’s AI broad world knowledge answers."},"limits":{"fr":"Ne bloque pas à lui seul Applebot ni l’entraînement. Les résultats de recherche classiques restent possibles ; les extraits sont supprimés.","en":"Does not by itself block Applebot or training. Traditional search results remain possible; snippets are suppressed."},"examples":[{"label":{"fr":"Balise ciblant Applebot","en":"Applebot-specific tag"},"format":"HTML","code":"<meta name=\"applebot\" content=\"nosnippet\">"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null},{"id":"content-usage","name":"Content-Usage","scope":{"fr":"Le brouillon transporte une préférence de refus d’entraînement, associée au contenu récupéré.","en":"The draft conveys a training opt-out preference associated with retrieved content."},"scope_verified":true,"source_url":"https://www.ietf.org/archive/id/draft-ietf-aipref-attach-05.html","group":"policy","kind":"draft","related_controls":["TS42"],"cells":{"Google":{"status":"outside_scope"},"Microsoft · Bing":{"status":"outside_scope"},"OpenAI":{"status":"outside_scope"},"Anthropic":{"status":"outside_scope"},"Apple":{"status":"outside_scope"},"Mistral":{"status":"outside_scope"},"Meta":{"status":"outside_scope"},"Amazon":{"status":"outside_scope"},"Perplexity":{"status":"outside_scope"},"Common Crawl":{"status":"outside_scope"},"Cloudflare":{"status":"outside_scope"},"RSL":{"status":"outside_scope"},"ByteDance":{"status":"outside_scope"},"DuckDuckGo":{"status":"outside_scope"},"IETF AIPREF":{"status":"documented","url":"https://www.ietf.org/archive/id/draft-ietf-aipref-attach-05.html","reviewed":"2026-11-06","evidence":{"seq":1,"observed":"2026-11-06T14:56:27+00:00","verified":"2026-11-12T02:16:52+00:00","raw":"cf419c0e2ffd975e3f2f3f029e29efb3b9025a8feae6fb5fb4fed6c7998104a9","passage":"54cd443ca845405c924c4d430c8da6ce82d98c483c168085b065bdfeca5a1cef","diff":null}}},"reading_verified":true,"reading":{"reviewed":"2026-11-06","pins":{"ietf-attach":"54cd443ca845405c924c4d430c8da6ce82d98c483c168085b065bdfeca5a1cef"},"uses":["policy"],"effect":{"fr":"Le brouillon transporte une préférence de refus d’entraînement, associée au contenu récupéré.","en":"The draft conveys a training opt-out preference associated with retrieved content."},"limits":{"fr":"Version -05 publiée le 19 août 2026, expiration le 20 février 2027. Travail du groupe AIPREF, pas un RFC. La préférence ne s’applique qu’aux chemins explorables et n’est pas rétroactive. Sa présence ne prouve pas la prise en charge par un acteur. Les exemples avec Allow: / doivent être conciliés avec vos exclusions existantes.","en":"Version -05 published 19 August 2026, expires 20 February 2027. AIPREF working-group draft, not an RFC. Preferences apply only to crawlable paths and are not retroactive. Presence does not establish provider support. Examples containing Allow: / must be reconciled with existing exclusions."},"examples":[{"label":{"fr":"Exemple HTTP du brouillon","en":"Draft HTTP example"},"format":"HTTP","code":"Content-Usage: train-ai=n"},{"label":{"fr":"Exemple robots.txt du brouillon","en":"Draft robots.txt example"},"format":"robots.txt","code":"User-agent: *\nAllow: /\nContent-Usage: train-ai=n"}],"effective_date":null,"effective_date_precision":null,"implementation_delay":null,"observed_behavior":null,"identity":{"robots_token":null,"http_user_agents":[],"ip_list_urls":[],"http_user_agent_status":"not_established","ip_list_status":"not_established"},"evidence_level":"documented","human_review":null},"display_name":null}]}