Does llms.txt actually help? What the data says in 2026

Google says it ignores llms.txt, two large studies found no effect on AI citations, and a third of the files we found on small-business sites were broken. Here's when it's still worth having.

llms.txt is the most-asked-about file in AI search this year, and the most oversold. Plugins add it with one click and audit tools flag its absence in red. So it's fair to ask whether it does anything. We looked at what Google says, what two large studies measured, and what we found on real small-business sites.

Short answer

For getting cited by ChatGPT, Perplexity or Google's AI Overviews: no measurable effect. For AI coding tools and agents that are told to read it: sometimes. For a typical small business it's optional. If you do publish one, make sure it works, because a lot of them don't.

What Google says

Google's May 2026 guide to optimising for generative AI features has a section literally called “mythbusting”. It says you don't need llms.txt or any other AI text file to appear in Google Search, including AI Overviews and AI Mode, because Google Search doesn't use them. It adds that keeping one for other services will “neither harm nor help” your visibility in Google.

Before that, Google's John Mueller had compared llms.txt to the old keywords meta tag: a site owner's claim about what the site is about, which a system could just check by reading the site.

What the large studies found

SE Ranking, about 300,000 domains. Only 10% had an llms.txt. Statistical tests and a machine-learning model found no link between having the file and how often a domain was cited by AI models. The model got more accurate when the llms.txt variable was removed.
Ahrefs, 137,000 sites with server-log data. 28% published an llms.txt, but 97% of those files got zero requests in May 2026. Of the requests that did arrive, AI search bots like OAI-SearchBot and PerplexityBot made about 1%. GPTBot and Claude Code were the most frequent AI readers, and no AI bot ever asked for a file that didn't exist.

Put together: the AI search products that send customers your way are not, as far as anyone can measure, reading the file.

What we found on small-business sites

When we scanned 101 US small-business sites (dentists, law firms and home-service companies), 69 had no llms.txt. Of the 32 that served something at /llms.txt, 10 were broken:

4 returned an HTML web page instead of a text file
3 were files with no links at all
3 failed the format's one hard rule, which is to start with an H1 title

Dentists were worst: 5 of their 9 files were broken. And 8 of the 28 real files were made automatically by Wix, Yoast or Rank Math, which is how a lot of owners end up with one they've never read.

A broken file probably does no harm in Google, which ignores it. But it does tell you something: if nobody noticed their llms.txt was an HTML page, nobody was checking whether it did anything.

When it's still worth having

You have documentation, an API or a product that developers use with AI coding tools. This is the one place the Ahrefs data shows real reading, and it's the use Mueller described as a “temporary crutch” for those tools.
Your platform makes it for free. If Wix or your SEO plugin generates it, leave it on. Just open it once to check it's a text file with your business name at the top and real links.
You want a single page of plain facts about your business. Writing one forces you to state what you do, where, and which pages matter. That text belongs on your homepage anyway.

If you publish one, treat it like code

Ahrefs found a research bot called prompt-injection-survey crawling llms.txt files. Agents are built to trust these files, so a stale or tampered one misleads every agent that reads it. Keep it to plain links and descriptions, with nothing that reads like an instruction, and only link to pages you control.

What to do instead, if you have one hour

Check your robots.txt and firewall let the AI answer bots in. AI Crawler Checker, two minutes.
Add Organization or LocalBusiness schema to your homepage. 30 of the 93 homepages we read had none. Schema Generator, ten minutes.
Rewrite your homepage's first paragraph to say what you do, where, and for whom.
If you keep an llms.txt, run it through the llms.txt Validator so at least it isn't broken. Our template takes twenty minutes.

Sources

How to show up in each AI assistant

All engine guides →

Rather not do this yourself? We'll do the whole thing and send you the receipts.

About the audit