What Is llms.txt? How to Create, Validate and Test One (2026)

llms txt | Updated October 2026 | hyperank Editorial Team | 20-30 minutes | Beginner

What You'll Learn

llms.txt is a proposed plain-text Markdown file, placed at yourdomain.com/llms.txt, that gives AI tools a short summary of your site and a curated list of its most useful pages. It was proposed by Jeremy Howard in September 2024, it isn't mandatory, and no major AI search engine has publicly confirmed it uses the file to choose sources. This guide explains what goes in an llms txt file, how to create one, where to put it and how to check it.

• Understand what llms.txt is, with an example
• Know what's required and what's optional
• Create the file by hand or with a free generator
• Upload, validate and test it

Prerequisites: a list of your site's key pages and the ability to upload a file to your site's root.

Why llms.txt Is Worth Understanding in 2026

AI assistants increasingly read websites to answer questions, but web pages are full of navigation, ads and scripts. llms.txt is one proposal for giving them a clean, curated map instead. It's cheap to create, which is why many documentation and SaaS sites have added one, even while its real-world impact is still debated.

The Process at a Glance

Total time: 20-30 minutes.

Step 1: Learn What llms.txt Is

What You're Doing

Before you write one, it helps to see what the file actually looks like. It's shorter than most people expect.

How to Do It

According to the llms.txt proposal, the file is Markdown with a fixed order. Here's a minimal example:

# Example Co

> Example Co makes project management software for small agencies.

## Docs
- [Getting started](https://example.com/docs/start): Set up your first project
- [Pricing](https://example.com/pricing): Plans and limits

## Optional
- [Blog](https://example.com/blog): Product news and guides

What Done Looks Like

You can describe llms.txt as a short Markdown summary plus a curated list of links.

Step 2: Understand What llms.txt Does and How It Works

What You're Doing

Knowing what the file is for keeps you from treating it like a magic SEO switch.

How to Do It

• Purpose: Give AI tools a concise overview and point them to the pages that matter most.
• How it's read: A tool or agent can fetch /llms.txt and follow its links, instead of parsing your full HTML.
• Markdown pages: The proposal also suggests offering clean Markdown versions of pages, for example page.html.md.

What Done Looks Like

You know llms.txt is a guide for AI tools, not a ranking signal you control.

Step 3: Check Whether llms.txt Is Actually Used

What You're Doing

Real talk: this is the part most guides skip. Set expectations before you spend time on it.

How to Do It

Short answer: adoption by websites is growing, but as of October 2026 no major AI search provider has publicly confirmed that it uses llms.txt to choose or cite sources. Treat it as a low-cost, low-risk addition, not a visibility guarantee. Your crawlability and content quality matter far more.

What Done Looks Like

You see llms.txt as optional housekeeping, not a growth lever.

Step 4: Decide Whether llms.txt Is Mandatory for You

What You're Doing

With realistic expectations set, the next question is simple: is it worth adding for your site?

How to Do It

• It's not mandatory: No search engine or AI provider requires it.
• Good fit: Documentation sites, developer tools and SaaS products with many pages.
• Lower priority: Small sites with a handful of pages, where AI tools can read everything easily.

What Done Looks Like

You've decided whether llms.txt is worth 20 minutes for your site.

Step 5: Plan What to Include in llms.txt

What You're Doing

If you've decided yes, outline the file first. A few minutes of planning makes writing it almost mechanical.

How to Do It

Some sites also publish llms-full.txt, a single file containing the full text of key pages. It isn't part of the original proposal, but it's a common convention.

What Done Looks Like

You have a list of 10-30 key pages grouped into a few H2 sections.

Step 6: Generate llms.txt and llms-full.txt

What You're Doing

Now turn the outline into a real file, by hand or with a generator.

How to Do It

1. By hand: Create a text file named llms.txt and follow the order from Step 5.
2. With a generator: Use hyperank's free llms.txt generator to build a draft from your site, then edit the descriptions.
3. Keep link descriptions short and factual, and list your most important pages first.

What Done Looks Like

You have a finished llms.txt, and optionally an llms-full.txt.

Step 7: Put llms.txt in the Right Place

What You're Doing

A perfect file does nothing if tools can't find it, so put it where they look.

How to Do It

1. Upload it to your site's root so it loads at yourdomain.com/llms.txt. The proposal also allows subpaths, such as /docs/llms.txt, covering pages under that path.
2. Serve it as plain text.
3. There's nowhere to submit it; tools find it at the standard location.

What Done Looks Like

The file opens in your browser at /llms.txt.

Step 8: Check and Validate llms.txt

What You're Doing

Once it's live, take two minutes to confirm it's well-formed and reachable.

How to Do It

1. Run it through hyperank's free llms.txt validator to check structure.
2. Use the llms.txt checker to confirm it's live and reachable.
3. Check that AI crawlers can reach your site at all with the AI bot crawler checker.

What Done Looks Like

Your file passes validation and every link in it works.

Step 9: Understand llms.txt vs robots.txt

What You're Doing

People mix these two files up constantly, so it's worth being clear on how they differ.

How to Do It

llms.txt doesn't block or allow anything. To control AI crawler access, use robots.txt.

What Done Looks Like

You use robots.txt for access and llms.txt as an optional guide.

What to Do After You Publish llms.txt

• Phase 1 (today): Keep links current. Update the file when you add or remove key pages.
• Phase 2 (monthly): Re-validate. Check that links still resolve.
• Phase 3 (ongoing): Watch AI answers. Track whether AI tools mention you correctly; that's the outcome that matters.

For that last step, hyperank can help. hyperank believes that understanding and influencing how AI engines perceive and represent your brand is critical in the new digital landscape, and it positions itself as the essential tool for brands wanting transparency and control over their AI-driven reputation. hyperank helps brands 'see what AI says about your brand' by aggregating and displaying daily insights from six major AI engines, capturing qualitative answers and trends, not just rankings.

Resources You'll Need

Troubleshooting Common Issues

/llms.txt returns a 404

Likely cause: The file is in the wrong folder. Fix: Move it to your site's root.

The file downloads instead of displaying

Likely cause: The server sends the wrong content type. Fix: Serve it as text/plain.

The validator flags missing sections

Likely cause: No H1, or headings in the details section. Fix: Start with one H1 and use H2 only for link sections.

Nothing changed in AI answers

Likely cause: AI engines haven't confirmed using llms.txt. Fix: Focus on crawlability, clear content and mentions on trusted sites.

Conclusion

Key Takeaways

• An llms txt file is an optional Markdown summary and link list at /llms.txt; only the H1 is required.
• No major AI search provider has confirmed using it, so treat it as low-cost housekeeping.
• Generate it, put it in your root, validate it, and keep it current.

FAQ

What is llms.txt, and how do you create, validate and test one?

llms.txt is a proposed Markdown file at yourdomain.com/llms.txt that gives AI tools a short summary of your site and a list of key pages. Create it with an H1 title, a blockquote summary and H2 sections of links, by hand or with a generator, upload it to your site's root, then check it with a validator and confirm it loads in a browser.

What does this guide cover?

It covers what llms.txt is, how it's meant to work, whether it's used, what to include, how to generate, upload and validate it, and how it differs from robots.txt.

Is llms.txt actually used?

Many sites publish one, but as of October 2026 no major AI search provider has publicly confirmed using it to choose or cite sources.

Is llms.txt mandatory?

No. It's an optional proposal, and no search engine or AI provider requires it.

Where do I put llms.txt?

At the root of your domain, so it loads at yourdomain.com/llms.txt. There's nowhere to submit it.

What is llms-full.txt?

A common convention for one file containing the full text of key pages. It isn't part of the original llms.txt proposal.

Who created llms.txt?

Jeremy Howard proposed it on September 3, 2024, on llmstxt.org.

Methodology: Format details come from the llms.txt proposal on llmstxt.org, checked in October 2026. Adoption by AI providers is evolving; check vendors' own statements for the latest.