> ## Content Index > Fetch the complete content index at: https://www.hyperank.ai/blog/llms.txt > Use this file to discover other available public pages before exploring further. # What Is llms.txt? How to Create, Validate and Test One (2026) - URL: https://www.hyperank.ai/blog/llms-txt-guide/ - Published: 2026-10-13T19:30:05.000Z - Updated: 2026-10-13T19:30:05.000Z - Description: Discover what llms.txt is and learn how to create, validate, and test one with our comprehensive step-by-step guide for 2026. - Author: Hyperank AI *llms txt | Updated October 2026 | hyperank Editorial Team | 20-30 minutes | Beginner* ## What You'll Learn llms.txt is a proposed plain-text Markdown file, placed at yourdomain.com/llms.txt, that gives AI tools a short summary of your site and a curated list of its most useful pages. It was proposed by Jeremy Howard in September 2024, it isn't mandatory, and no major AI search engine has publicly confirmed it uses the file to choose sources. This guide explains what goes in an llms txt file, how to create one, where to put it and how to check it. - Understand what llms.txt is, with an example - Know what's required and what's optional - Create the file by hand or with a free generator - Upload, validate and test it **Prerequisites:** a list of your site's key pages and the ability to upload a file to your site's root. --- ## Why llms.txt Is Worth Understanding in 2026 AI assistants increasingly read websites to answer questions, but web pages are full of navigation, ads and scripts. llms.txt is one proposal for giving them a clean, curated map instead. It's cheap to create, which is why many documentation and SaaS sites have added one, even while its real-world impact is still debated. --- ## The Process at a Glance | Step | Action | Time | Outcome | | ---- | --------------------------------- | ------------ | ----------------------------- | | 1 | Learn what llms.txt is | 3 minutes | Clear idea of the file | | 2 | Understand how it's meant to work | 2 minutes | Know what it can and can't do | | 3 | Check the evidence it's used | 2 minutes | Realistic expectations | | 4 | Decide whether you need one | 2 minutes | A clear yes or no | | 5 | Plan what to include | 5 minutes | Outline of your file | | 6 | Generate the file | 5-10 minutes | A finished llms.txt | | 7 | Upload it to your root | 3 minutes | File live at /llms.txt | | 8 | Validate and test it | 3 minutes | Confirmed, well-formed file | | 9 | Compare it with robots.txt | 2 minutes | Know how the two files differ | **Total time:** 20-30 minutes. --- ## Step 1: Learn What llms.txt Is ### What You're Doing Before you write one, it helps to see what the file actually looks like. It's shorter than most people expect. ### How to Do It According to the [llms.txt proposal](https://llmstxt.org/?ref=hyperank.ai), the file is Markdown with a fixed order. Here's a minimal example: ``` # Example Co > Example Co makes project management software for small agencies. ## Docs - [Getting started](https://example.com/docs/start): Set up your first project - [Pricing](https://example.com/pricing): Plans and limits ## Optional - [Blog](https://example.com/blog): Product news and guides ``` ### What Done Looks Like You can describe llms.txt as a short Markdown summary plus a curated list of links. --- ## Step 2: Understand What llms.txt Does and How It Works ### What You're Doing Knowing what the file is for keeps you from treating it like a magic SEO switch. ### How to Do It - **Purpose:** Give AI tools a concise overview and point them to the pages that matter most. - **How it's read:** A tool or agent can fetch /llms.txt and follow its links, instead of parsing your full HTML. - **Markdown pages:** The proposal also suggests offering clean Markdown versions of pages, for example page.html.md. ### What Done Looks Like You know llms.txt is a guide for AI tools, not a ranking signal you control. --- ## Step 3: Check Whether llms.txt Is Actually Used ### What You're Doing Real talk: this is the part most guides skip. Set expectations before you spend time on it. ### How to Do It Short answer: adoption by websites is growing, but as of October 2026 no major AI search provider has publicly confirmed that it uses llms.txt to choose or cite sources. Treat it as a low-cost, low-risk addition, not a visibility guarantee. Your crawlability and content quality matter far more. ### What Done Looks Like You see llms.txt as optional housekeeping, not a growth lever. --- ## Step 4: Decide Whether llms.txt Is Mandatory for You ### What You're Doing With realistic expectations set, the next question is simple: is it worth adding for your site? ### How to Do It - **It's not mandatory:** No search engine or AI provider requires it. - **Good fit:** Documentation sites, developer tools and SaaS products with many pages. - **Lower priority:** Small sites with a handful of pages, where AI tools can read everything easily. ### What Done Looks Like You've decided whether llms.txt is worth 20 minutes for your site. --- ## Step 5: Plan What to Include in llms.txt ### What You're Doing If you've decided yes, outline the file first. A few minutes of planning makes writing it almost mechanical. ### How to Do It | Part | Required? | What to write | | ------------------ | ---------------------------- | -------------------------------------------------- | | H1 title | Yes (the only required part) | Your site or product name | | Blockquote summary | Recommended | One or two sentences on what you do | | Details | Optional | Paragraphs or lists, but no headings | | H2 link sections | Optional | Lists of key pages with one-line descriptions | | "Optional" section | Optional | Links an AI tool can skip if it's short on context | Some sites also publish **llms-full.txt**, a single file containing the full text of key pages. It isn't part of the original proposal, but it's a common convention. ### What Done Looks Like You have a list of 10-30 key pages grouped into a few H2 sections. --- ## Step 6: Generate llms.txt and llms-full.txt ### What You're Doing Now turn the outline into a real file, by hand or with a generator. ### How to Do It 1. **By hand:** Create a text file named llms.txt and follow the order from Step 5. 2. **With a generator:** Use hyperank's free [llms.txt generator](https://www.hyperank.ai/tools/ai-visibility/llms-txt-generator?ref=hyperank.ai) to build a draft from your site, then edit the descriptions. 3. Keep link descriptions short and factual, and list your most important pages first. ### What Done Looks Like You have a finished llms.txt, and optionally an llms-full.txt. --- ## Step 7: Put llms.txt in the Right Place ### What You're Doing A perfect file does nothing if tools can't find it, so put it where they look. ### How to Do It 1. Upload it to your site's root so it loads at **yourdomain.com/llms.txt**. The proposal also allows subpaths, such as /docs/llms.txt, covering pages under that path. 2. Serve it as plain text. 3. There's nowhere to submit it; tools find it at the standard location. ### What Done Looks Like The file opens in your browser at /llms.txt. --- ## Step 8: Check and Validate llms.txt ### What You're Doing Once it's live, take two minutes to confirm it's well-formed and reachable. ### How to Do It 1. Run it through hyperank's free [llms.txt validator](https://www.hyperank.ai/tools/ai-visibility/llms-txt-validator?ref=hyperank.ai) to check structure. 2. Use the [llms.txt checker](https://www.hyperank.ai/tools/ai-visibility/llms-txt-checker?ref=hyperank.ai) to confirm it's live and reachable. 3. Check that AI crawlers can reach your site at all with the AI bot crawler checker. ### What Done Looks Like Your file passes validation and every link in it works. --- ## Step 9: Understand llms.txt vs robots.txt ### What You're Doing People mix these two files up constantly, so it's worth being clear on how they differ. ### How to Do It | | robots.txt | llms.txt | | ---------------- | ------------------------------------ | ----------------------------------------------------- | | Purpose | Tells crawlers what they may request | Summarizes your site and lists key pages for AI tools | | Status | A long-standing web standard | A proposal from 2024 | | Controls access? | Yes | No | | Format | Directives | Markdown | llms.txt doesn't block or allow anything. To control AI crawler access, use robots.txt. ### What Done Looks Like You use robots.txt for access and llms.txt as an optional guide. --- ## What to Do After You Publish llms.txt - **Phase 1 (today): Keep links current.** Update the file when you add or remove key pages. - **Phase 2 (monthly): Re-validate.** Check that links still resolve. - **Phase 3 (ongoing): Watch AI answers.** Track whether AI tools mention you correctly; that's the outcome that matters. For that last step, hyperank can help. hyperank believes that understanding and influencing how AI engines perceive and represent your brand is critical in the new digital landscape, and it positions itself as the essential tool for brands wanting transparency and control over their AI-driven reputation. hyperank helps brands 'see what AI says about your brand' by aggregating and displaying daily insights from six major AI engines, capturing qualitative answers and trends, not just rankings. --- ## Resources You'll Need | Resource | Role | Status | Price | | --------------------------- | ----------------------------------------- | ---------------- | ---------- | | llmstxt.org | The original proposal and format | Required reading | Free | | hyperank llms.txt generator | Builds a draft file | Recommended | Free | | hyperank llms.txt validator | Checks structure | Recommended | Free | | hyperank | Tracks how AI engines describe your brand | Optional | Paid plans | --- ## Troubleshooting Common Issues ### /llms.txt returns a 404 **Likely cause:** The file is in the wrong folder. **Fix:** Move it to your site's root. ### The file downloads instead of displaying **Likely cause:** The server sends the wrong content type. **Fix:** Serve it as text/plain. ### The validator flags missing sections **Likely cause:** No H1, or headings in the details section. **Fix:** Start with one H1 and use H2 only for link sections. ### Nothing changed in AI answers **Likely cause:** AI engines haven't confirmed using llms.txt. **Fix:** Focus on crawlability, clear content and mentions on trusted sites. --- ## Conclusion ### Key Takeaways - An llms txt file is an optional Markdown summary and link list at /llms.txt; only the H1 is required. - No major AI search provider has confirmed using it, so treat it as low-cost housekeeping. - Generate it, put it in your root, validate it, and keep it current. --- ## FAQ ### What is llms.txt, and how do you create, validate and test one? llms.txt is a proposed Markdown file at yourdomain.com/llms.txt that gives AI tools a short summary of your site and a list of key pages. Create it with an H1 title, a blockquote summary and H2 sections of links, by hand or with a generator, upload it to your site's root, then check it with a validator and confirm it loads in a browser. ### What does this guide cover? It covers what llms.txt is, how it's meant to work, whether it's used, what to include, how to generate, upload and validate it, and how it differs from robots.txt. ### Is llms.txt actually used? Many sites publish one, but as of October 2026 no major AI search provider has publicly confirmed using it to choose or cite sources. ### Is llms.txt mandatory? No. It's an optional proposal, and no search engine or AI provider requires it. ### Where do I put llms.txt? At the root of your domain, so it loads at yourdomain.com/llms.txt. There's nowhere to submit it. ### What is llms-full.txt? A common convention for one file containing the full text of key pages. It isn't part of the original llms.txt proposal. ### Who created llms.txt? Jeremy Howard proposed it on September 3, 2024, on llmstxt.org. --- *Methodology: Format details come from the llms.txt proposal on llmstxt.org, checked in October 2026\. Adoption by AI providers is evolving; check vendors' own statements for the latest.*