What is llms.txt and do I need one?

Yes, and it’s a cheap yes. llms.txt (large language models dot txt) is a small text file at the root of your site that lists your pages in plain language, written for AI engines instead of search crawlers. The biggest study done on it found that the file barely moves how often AI engines name you. Add it anyway. It takes about ten minutes and can’t hurt, but treat it as documentation, not as the thing that does the thing.

What llms.txt actually is

You write llms.txt by hand, or a plugin writes it for you. Either way, it sits at yourdomain.com/llms.txt and lists your site’s key pages, often with a short summary of each. The idea is simple: let an AI engine read your whole site’s shape in one file instead of crawling page by page.

Here’s the catch. It isn’t an official standard. No AI company requires it, and none have confirmed they even read it. It’s a proposal that spread faster than the proof behind it. But it’s cheap, so you should do it.

What a nearly 14,000-domain study found

The largest test of llms.txt so far comes from Search Atlas. Researchers crawled 18,621 live domains, matched 13,911 of them against visibility records across six AI platforms (Copilot, Gemini, Google AI Mode, Grok, OpenAI, and Perplexity), and checked who got cited. About 32 percent of sites already had the file, more than three times the roughly 10 percent smaller studies had found. Then they checked whether the file did anything.

Sites with llms.txt scored a median of just 0.42 points higher on a 100-point visibility scale than sites without it. That’s close to no gap at all, and it wasn’t even stable. When researchers reran the comparison on a smaller, more recent slice of sites, the gap flipped direction on five of the six AI platforms. A real signal holds its direction. This one didn’t.

Why the quality pattern was a mirage

At first, file quality looked like it mattered. Researchers scored each file from 0 to 10 based on structure: clear headings, real summaries, healthy link density, and more. The best files, the top tier, beat sites with no file at all on every metric that counts. More mentions. More visibility. More share of voice.

But those top files also sat on stronger sites, sites with a median authority score of 45 versus 42 for everyone else. Once researchers compared only sites with matching authority, almost all of that advantage vanished. The well-written files weren’t making sites stronger. The stronger sites were simply the ones writing better files. Even the split between plugin-made files and handwritten ones didn’t matter once authority was factored in.

This isn’t a one-off finding either. The same team ran a similar test on schema markup and landed on the same pattern: structure with nothing behind it doesn’t lift visibility. We should know. Every page on this site carries a full schema graph, and building them is part of our paid work. Here’s why we still do it. Schema was never a visibility lever. It’s a translator. It tells an engine, in machine language, exactly who you are and what your pages claim, so the substance you have can be understood, quoted, and named with confidence. Markup on a thin site translates nothing. The lesson of both findings is the same: structure doesn’t replace substance. It translates it.

So why add it anyway?

None of this makes llms.txt useless. It just isn’t the shortcut it gets sold as. Treat it the way we treat our own: cheap reinforcement on top of the real work, but not a driver of the work. Documentation, not a ranking lever. It costs almost nothing to add. It can’t hurt. And it gives you one more place to state your site’s shape in a format a machine can skim in seconds.

What it won’t do is stand in for the things that actually earn a citation: real content, clean structure, and a site an engine already has reason to trust. Add the file, but don’t expect it to carry weight the rest of your site hasn’t earned yet.

A two-minute check

Type yourdomain.com/llms.txt into your browser right now. Real content? You already have one, and now you know it isn’t doing the heavy lifting alone. A 404? That’s fine too, since the study says a missing file barely matters either way. Here, the better question isn’t whether you have this file. It’s whether your site has anything worth citing yet. Your content is still what matters most.

What to do about it

Adding llms.txt is a ten-minute task. You should add one if you don’t have it.

List it. Your key pages, nothing more.
Summarize it. One clear sentence per page, no plugin-default filler.
Skip the extras. Badges, disclaimers, anything meant to impress a reader instead of a machine.

Then spend your real time where it counts. Ask an AI engine the questions your customers actually ask and see who gets named instead of you. Run your homepage through our free single-page scan to see where the real gaps sit. Start with whether your SEO is already carrying the weight, then let an AI Visibility Audit test the rest: the questions your customers ask, across engines, benchmarked against whoever is beating you to the answer.

The file takes ten minutes. Earning the citation takes the other things.