Google says Cloudflare's Content Signals lines in robots.txt do nothing. Here is what that means for your site.
If you added Cloudflare's "content signals" lines to your robots.txt file hoping to control how Google and AI tools use your pages, Google just told you plainly: those lines change nothing.
Google's John Mueller, answering a question on Reddit, said the Content Signals robots.txt directive that Cloudflare introduced has "no effects whatsoever for any crawler or LLM," and that using it "just adds bloat and future maintenance to your robots.txt file" (seroundtable.com). As far as he knows, none of the crawlers or LLMs use the content-signal directives (seroundtable.com).
He went further in the same reply: Google does not use llms.txt or llms-author.txt either, and he does not know of any other crawler or LLM confirming they use those files, other than SEO tools (seroundtable.com). His broader point was that you can put arbitrary things in robots.txt, and crawlers simply use the directives they support and ignore the rest (seroundtable.com).
The part Cloudflare users should actually check
The same article reports that Cloudflare set a September 15, 2026 deadline for new defaults on its three content-signal classifications: for new domains onboarding to Cloudflare, Training and Agent will be blocked by default on pages that display ads, while Search stays allowed by default (seroundtable.com). The article also notes Cloudflare is used by approximately 21.3% of all websites as of January 2026, and its author, Barry Schwartz, says he already checked his own Cloudflare settings ahead of that deadline (seroundtable.com).
Schwartz's read is that Mueller is clearly saying Google has not respected the Content Signals directive so far, and it sounds like Google has no plans to (seroundtable.com).
Our take
We build AuditLamp to tell owners the truth about what search and AI engines actually read, and this is a clean example of the gap between what feels like control and what works. Lines in robots.txt only matter if a crawler honors them. Per this report, the content-signal lines are not honored by Google, so they are decoration, not protection.
Two practical steps from the AuditLamp team:
- Do not treat content-signal lines or llms.txt as proof your site is protected from, or visible to, AI engines. Per Mueller's reply, Google uses neither (seroundtable.com).
- If your site runs through Cloudflare, review your dashboard settings before the September 15, 2026 default change described in the article, so blocking decisions are ones you actually made (seroundtable.com).
Source: Search Engine Roundtable, "Google: Cloudflare Content Signals Robots.txt Directive Has No Effects" by Barry Schwartz, July 6, 2026 (seroundtable.com).