What Is llms.txt? The New Standard for AI Crawlers

llms.txt is a plain-text (Markdown) file you host at the root of your domain — yoursite.com/llms.txt — that gives large language models a concise, curated summary of what your site is about and which pages matter most. Think of it as a sitemap written for AI instead of search crawlers. It's a practical piece of LLMO.

Why llms.txt exists

A normal webpage is full of navigation, scripts, and boilerplate that make it harder for a model to extract the signal. llms.txt cuts through that noise: it states, in clean language, who you are, what you offer, and where the important content lives — so a model can understand your business quickly and accurately.

What goes in an llms.txt file

• An H1 with your site or business name.
• A blockquote summary — one or two sentences describing what you do.
• Short sections with links to your key pages, each with a brief description.
• Optional: definitions, pricing, and contact details stated plainly.

How to create one

Write the file in Markdown, keep it short and factual, and upload it to your site root so it's reachable at /llms.txt. State facts consistently with the rest of your site — contradictions lower a model's confidence. Pair it with an AI-friendly robots.txt so the crawlers that read llms.txt are actually allowed in.

Is llms.txt required?

Not yet — it's an emerging convention, not a mandate, and adoption is still growing. But it's low-effort and low-risk, and it puts a clean, accurate description of your business directly in front of AI systems. For a business trying to get cited in AI answers, that's worth doing. See where it fits in the complete SEO/GEO/AEO/LLMO guide.

See how your site scores

SiteScoreNow audits any website across SEO, GEO, AEO, and LLMO and gives you a prioritized, plain-English action plan. Get a free instant score, or order the full report to see exactly what to fix first.