Does Your Website Need llms.txt? Google Ignores It, Lighthouse Checks It
Google Search ignores llms.txt, yet Lighthouse now audits it. Here's what changed in 2026, what the data shows, and whether your site needs one.
On this page
You run Lighthouse on your site and spot a category that wasn't there before: Agentic Browsing. One of its checks is llms.txt. Yet a few weeks later, Google tells everyone that Search doesn't use the file. So which is it?
If you've been following the llms.txt debate, the mixed signals are fair to be confused by. We first covered this in August 2026. Enough has shifted since then that we've rewritten this guide with the latest evidence.
llms.txt does nothing for Google Search, AI Overviews or AI Mode. Lighthouse checks the file's format if you have one, but not having one isn't a failure.
If you run developer docs, a SaaS product or an API.
For most business websites. Your time is better spent on quotable content, third-party mentions and a clean, accessible site.
What Is llms.txt, and What Changed in 2026?
What llms.txt is
llms.txt is a proposed standard: a Markdown file at your domain root (yoursite.com/llms.txt) that gives AI systems a short summary of your site with links to your most important pages. Here's a simple llms.txt example:
# Digital Roof
> Founder-led digital marketing studio offering SEO, website development and content creation.
## Services
- [Website Development](https://digitalroof.net/website-development/): Custom business websites
- [SEO Services](https://digitalroof.net/service-seo/): Technical and content SEOAn H1 with your name, a one-line summary, then sections of Markdown links.
The 2026 timeline
- May 7Lighthouse 13.3.0 ships an Agentic Browsing category, on by default, which includes an llms.txt audit.
- June 15Google adds a note to its AI optimization guide, logged in its changelog as "Clarifying guidance on llms.txt files".
- AugustThe llms.txt specification gets a major update.
Google Search vs Lighthouse: Why the Mixed Signals?
What Google Search says
Google has been consistent on llms.txt. Gary Illyes said in July 2025 that Google doesn't support the file and has no plans to. In June 2026, Google's AI optimization guidance made it official: you don't need special AI text files to appear in Search, including AI Overviews and AI Mode. John Mueller has compared llms.txt to the old meta keywords tag, a self-description that search engines would rather verify by reading the site itself.
What Lighthouse actually checks
Lighthouse is a developer tool, not a ranking system. Its Agentic Browsing audit asks whether an AI agent can read and use your page, and looks at llms.txt, WebMCP, your accessibility tree and layout shift. The llms.txt check only validates the llms.txt format if the file exists: an H1 heading, Markdown links and enough content. If you don't have one, you don't fail. BBC News has no llms.txt and still passes.
Do AI crawlers fetch it?
Some do. Tracking data from Profound, cited by Mintlify, showed crawlers from Microsoft and OpenAI requesting llms.txt files. But fetching isn't citing. SE Ranking's research found that having an llms.txt file didn't predict AI citations, and as of early 2026, no major AI company had confirmed its answer systems act on the file (summary of the evidence).
Who Should Add llms.txt? A Quick Decision Framework
| Your site | Verdict | Why |
|---|---|---|
| Developer docs or API reference | Add it | Users feed docs to coding assistants like Cursor and Claude Code |
| SaaS product | Add it | Agents may need to find docs, pricing or setup steps |
| Ecommerce or booking site | Optional | Fix the accessibility tree first; agents need working forms |
| Local service business | Skip or 10 minutes max | No search benefit, and customers find you through Google and maps |
| Blog or brochure site | Skip or 10 minutes max | Content quality and mentions matter far more |
The 10-minute rule
If adding llms.txt takes ten minutes and a developer is already in the codebase, go ahead. It's harmless. If it takes hours, needs ongoing upkeep, or shows up as a line on an agency invoice, that's a bad trade.
If you're on WordPress
Several SEO plugins and llms.txt generators create the file in a click. That's fine. Just check the output passes Lighthouse's format check, and don't pay extra for it or treat it as an AI SEO strategy.
What Actually Moves AI Visibility
Content worth quoting
AI systems extract passages. Answer-first, self-contained sections with clear facts get pulled into AI answers. Vague, rambling ones don't. This is content strategy work, not a file. Our guide on how to get cited by AI shows what that looks like in practice.
Mentions and consistent entity information
Being cited on authoritative third-party sites matters far more than anything in your root directory. Describe your business the same way everywhere: name, services and location. Schema.org structured data helps here, and unlike llms.txt, it's documented and actively used by Google.
Clean rendering and a solid accessibility tree
Key content shouldn't depend on heavy JavaScript to appear. Semantic HTML and proper labels help AI agents and screen readers alike. Here's the neat part: that's also most of Lighthouse's agentic audit, with or without llms.txt. It's ordinary technical site quality and SEO fundamentals, and it was already worth fixing. For the wider checklist, see what agentic SEO means for your website.
Check Your Own Server Logs
You can run this check yourself in five minutes. Open your raw access logs and search for "llms.txt". It's more persuasive than any blog post, including this one.
What to look for
- Total requests to /llms.txt over the last 90 days
- Which bots made them, such as GPTBot, ClaudeBot or Bingbot
- Visits referred by AI tools like ChatGPT, Perplexity and Copilot
- Whether those visits landed on the pages listed in your llms.txt
If bots fetch the file but AI referrals don't land on the pages it lists, the file isn't doing the work. To see which numbers are worth tracking, read what to track for AI visibility.
Not Sure Where Your Site Stands in AI Search?
Checklists say to add llms.txt. Your server logs tell the real story. Book a free AI visibility check with Digital Roof. We'll review your logs and your Lighthouse agentic audit, and tell you honestly what's worth fixing and what isn't.
Book My Free AI Visibility CheckFrequently Asked Questions
Does Google use llms.txt?
No. Google's AI optimization guidance, clarified in June 2026, says Google Search doesn't use llms.txt or other AI text files, including for AI Overviews and AI Mode.
Why does Lighthouse check for llms.txt if Google ignores it?
Lighthouse measures whether AI agents can use your page, not how you rank. It only checks that the file follows the format if you have one. Not having one isn't a failure.
Will an llms.txt file hurt my SEO?
No. Search engines ignore it, so there's no ranking risk. The only cost is the time to create and maintain it.
Does llms.txt work for ChatGPT?
OpenAI's crawlers have been seen fetching llms.txt files, but OpenAI hasn't confirmed that ChatGPT uses them in answers, and research hasn't linked the file to more AI citations.
What's the difference between llms.txt and robots.txt?
robots.txt is an established standard that controls which crawlers can access your site, and major crawlers obey it. llms.txt only suggests content to AI systems. It controls nothing.
Keep Reading
Ajay Hooda is the co-founder of Digital Roof, a founder-led digital marketing studio specializing in SEO, website development and content. He holds a PG Diploma in Digital Marketing and Communication from MICA, is Google-certified, and has worked with businesses in India and international markets since 2019.