Why it matters
OpenAI: sites opted out of OAI-SearchBot aren't shown in ChatGPT search answers. The same applies to Claude-SearchBot and PerplexityBot. Blocking user fetchers (ChatGPT-User, Claude-User) stops assistants opening pages a user asks about (warning).
How to fix it
Allow OAI-SearchBot, Claude-SearchBot and PerplexityBot (and the user fetchers) in their own robots group. Block training bots separately if you want. Set geo.intent = "block-all" in config if blocking is deliberate.
References
More ai search rules
void geo reports 41 rules in this category. Generative-engine optimisation: whether AI crawlers that don't run JavaScript see the same content, valid and visible JSON-LD, an explicit AI robots policy, llms.txt, Markdown mirrors and answer-first writing.
llms-txt-missingNo /llms.txtllms-txt-error/llms.txt returns a server errorllms-txt-invalid/llms.txt doesn't follow the llms.txt formatllms-txt-broken-links/llms.txt links to URLs that failllms-txt-not-linkedllms.txt exists but isn't linked from the home pagerobots-ai-policyAI crawler policy (allow/deny matrix from robots.txt)training-bots-blockedrobots.txt blocks AI training crawlerscontent-signalNo Content-Signal usage preferences