How to write a useful llms.txt
- Start with an H1 and a one-line summary. These are the only required parts of the format.
- Link to your best pages, not every page. Guides, tools, pricing, documentation and about pages help AI answer questions about you.
- Describe each link in a few words so the model knows when to use it.
- Keep it current. Update the file when you add important pages, and keep your XML sitemap for search engines.
- Check AI crawler access. llms.txt is pointless if robots.txt blocks AI search bots; test it with the robots.txt tester and the SEO audit.
Frequently asked questions
What is llms.txt?
llms.txt is a proposed standard (llmstxt.org, 2024) for a Markdown file at the root of a website that gives large language models a short summary of the site and a curated list of its most useful pages, so AI tools can understand it without crawling everything.
Does Google use llms.txt?
Google has said it does not use llms.txt for search rankings, and no major AI company has confirmed it as a ranking signal. It is a low-effort, low-risk file that some AI tools and coding assistants do read, so many sites add it alongside robots.txt and a sitemap.
Where do I upload llms.txt?
To the root of your domain so it opens at https://yourdomain.com/llms.txt, exactly like robots.txt. Serve it as plain text (text/plain or text/markdown).
Is llms.txt the same as robots.txt?
No. robots.txt tells crawlers what they may not fetch; llms.txt tells AI tools what is worth reading. To block or allow AI crawlers, use the robots.txt generator.
More free SEO tools
- SEO Audit ToolCrawl up to 25 pages and find broken links, title, description, heading, canonical, HTTPS and speed problems.
- SERP Snippet & Meta Tag CheckerPreview your Google result and check title and meta description length in characters and pixels.
- Word Counter & Keyword Density CheckerCount words, characters and sentences, find keyword and phrase density, and score readability.
- Robots.txt Generator & TesterBuild a robots.txt from CMS templates, validate it and test URLs for Google, Bing and AI crawlers.
- Meta Tag GeneratorCreate title, description, robots, canonical, Open Graph and Twitter tags ready to paste.
- Schema Markup GeneratorGenerate JSON-LD for Article, FAQ, Product, Local Business, Organization, Breadcrumb and more.
- Redirect & HTTP Status CheckerCheck status codes and full redirect chains for up to 10 URLs at once.
- Open Graph & Social Preview CheckerSee how a link looks on Facebook, X, LinkedIn and WhatsApp and find missing social tags.
- Heading Structure CheckerView any page’s H1–H6 outline and find skipped levels, missing or duplicate H1s.
- All SEO toolsEvery free webmaster tool on pakmath.com in one place.