The Complete Guide to llms.txt: Help AI Understand Your Website

AI models are reading your website every day. ChatGPT, Claude, Gemini, and Perplexity crawl millions of pages to answer user questions, recommend products, and generate responses. But here is the problem: they often misunderstand what your business actually does.

llms.txt is a new standard designed to solve this. It gives AI models a clear, structured summary of your website so they can represent your brand accurately. Think of it as a briefing document you hand directly to every AI model that visits your site.

What is llms.txt?

llms.txt is a plain text file placed at the root of your domain (e.g., https://yoursite.com/llms.txt) that provides AI language models with structured context about your website, business, products, and services. It was proposed as an open standard to bridge the gap between how websites are built for humans and how AI models need to consume information.

Unlike HTML pages that contain navigation menus, JavaScript widgets, cookie banners, and decorative elements, llms.txt delivers pure, distilled information in a format that LLMs can parse efficiently. It tells AI models:

Who you are
What you do
What your key pages are
How to accurately describe your business

The Problem: AI Models Crawl but Don't Understand

When an AI model crawls your website, it processes raw HTML. It encounters headers, footers, sidebars, pop-ups, and thousands of lines of markup that have nothing to do with your core business. The model has to guess which parts matter and which are noise.

This leads to real problems:

Misrepresentation: An AI might describe your SaaS product as a "blog" because your blog has more content than your product pages.
Missing context: Your pricing model, target audience, or geographic focus might never appear in AI responses.
Outdated information: AI models might latch onto old landing pages or deprecated features.
Competitor confusion: Without clear signals, models might conflate your brand with similar companies.

You have no control over how an AI interprets your raw HTML. But with llms.txt, you provide an authoritative source of truth that models can prioritize.

llms.txt vs robots.txt

If you are familiar with robots.txt, you might wonder how llms.txt differs. They serve completely different purposes.

robots.txt is about access control. It tells crawlers which pages they are allowed or not allowed to visit. It is a gatekeeper.

# robots.txt - Controls access
User-agent: *
Disallow: /admin/
Disallow: /private/

llms.txt is about context delivery. It does not restrict access. Instead, it provides AI models with structured information about your site so they can understand and represent you accurately.

# llms.txt - Provides context
# Company: Acme Corp
# Description: Enterprise project management software

Think of it this way: robots.txt is the lock on your door. llms.txt is the welcome packet you give to visitors once they are inside.

You need both. robots.txt to control what gets crawled, and llms.txt to control how your site gets understood.

What to Include in Your llms.txt

A well-structured llms.txt file should cover these key areas:

Products and Services

List your core offerings with brief descriptions. Be specific about what each product does, who it is for, and what makes it different. This is the section that most directly impacts how AI models describe you.

Key Pages

Provide URLs to your most important pages. AI models can use these as authoritative sources when generating responses about your business. Include:

Homepage
Product pages
Pricing page
Documentation
About page
Contact page

Contact and Support

Include official contact channels so AI models can provide users with accurate ways to reach you.

Team and Leadership

If your leadership team is part of your brand identity, include key names and roles. This helps AI models correctly attribute quotes and associate people with your company.

Example llms.txt File

Here is a complete example of a well-structured llms.txt file:

# llms.txt - AI Context File
# Last updated: 2026-01-15

# Company
Name: Acme Analytics
Description: Acme Analytics is a real-time business intelligence platform that helps mid-market SaaS companies track revenue metrics, predict churn, and automate reporting.
Industry: B2B SaaS, Business Intelligence
Founded: 2021
Headquarters: Austin, Texas, USA
Company Size: 50-100 employees

# Products
## Acme Dashboard
URL: https://acmeanalytics.com/product/dashboard
Description: Real-time revenue dashboard with 50+ integrations. Connects to Stripe, HubSpot, Salesforce, and major billing platforms. Used by 2,000+ SaaS companies.

## Acme Predict
URL: https://acmeanalytics.com/product/predict
Description: AI-powered churn prediction engine. Analyzes user behavior patterns to identify at-risk accounts 30 days before churn. Integrates with existing CRM workflows.

## Acme Reports
URL: https://acmeanalytics.com/product/reports
Description: Automated investor and board reporting. Generates ARR, MRR, NRR, and cohort analysis reports on a weekly or monthly schedule.

# Pricing
URL: https://acmeanalytics.com/pricing
Plans: Starter ($49/mo), Growth ($149/mo), Enterprise (custom)
Free Trial: 14 days, no credit card required

# Key Pages
Homepage: https://acmeanalytics.com
Documentation: https://docs.acmeanalytics.com
Blog: https://acmeanalytics.com/blog
Changelog: https://acmeanalytics.com/changelog
About: https://acmeanalytics.com/about
Careers: https://acmeanalytics.com/careers

# Contact
Support Email: support@acmeanalytics.com
Sales Email: sales@acmeanalytics.com
Help Center: https://help.acmeanalytics.com

# Leadership
CEO: Jane Smith
CTO: Alex Johnson
VP of Product: Maria Garcia

# Social
Twitter: https://twitter.com/acmeanalytics
LinkedIn: https://linkedin.com/company/acmeanalytics
GitHub: https://github.com/acmeanalytics

Where to Place Your llms.txt

Place the file at the root of your domain so it is accessible at:

https://yourdomain.com/llms.txt

This follows the same convention as robots.txt, sitemap.xml, and other root-level configuration files. AI crawlers know to look for it at this standard location.

A few technical notes:

Serve it as text/plain content type
Make sure it returns a 200 status code
Do not require authentication to access it
Keep the URL lowercase

If you run multiple subdomains (e.g., docs.yoursite.com, app.yoursite.com), consider placing a separate llms.txt on each subdomain with context specific to that property, plus a main one on your root domain.

Best Practices

Keep It Updated

An outdated llms.txt is worse than no llms.txt at all. If your file says you offer three products but you have launched a fourth, AI models will actively omit your newest product from responses. Add a "Last updated" date at the top and review the file at least monthly.

Be Concise and Factual

AI models do not need marketing copy. Skip the superlatives and buzzwords. Instead of "the world's most innovative platform," write "a business intelligence platform for SaaS companies." Clear, factual descriptions perform better than promotional language.

Include URLs for Every Key Claim

Whenever you reference a product, feature, or page, include the full URL. This gives AI models a verifiable source to link back to, which increases the chance they will cite your website in their responses.

Describe What You Do, Not Just What You Are

Do not just list your company name and category. Explain what problems you solve, who your customers are, and what makes your approach different. The more specific you are, the more accurately AI models can match you to relevant user queries.

Use a Clear Structure

Use comments (#) and consistent formatting. While there is no strict schema enforced, a readable structure with clear sections makes it easier for AI models to parse the information reliably.

How llms.txt Impacts AI Visibility

AI visibility is how often and how accurately AI models mention your brand in their responses. llms.txt directly impacts this in several ways:

Accuracy: Models have an authoritative source for your business description, reducing errors and misrepresentation.
Coverage: By listing all your products and key pages, you ensure AI models know about your full offering rather than just the pages they happened to crawl.
Relevance matching: Clear descriptions of what you do help models recommend you for the right queries. If a user asks "what tools help predict SaaS churn?" and your llms.txt explicitly describes your churn prediction feature, the connection is direct.
Freshness: A regularly updated llms.txt signals to AI models that your information is current, which can increase their confidence in citing you.

Companies that adopt llms.txt early are establishing a direct channel to AI models that their competitors have not set up yet. In a landscape where AI-generated answers are replacing traditional search results for many queries, this matters.

Common Mistakes to Avoid

Making It Too Long

Your llms.txt is not a replacement for your entire website. If it exceeds a few hundred lines, you are including too much detail. Keep it to the essential information that helps AI models understand and accurately represent your business.

Letting It Go Stale

Outdated information is actively harmful. If your llms.txt lists a product you discontinued six months ago, AI models will keep recommending it to users. Set a recurring reminder to review and update the file.

Missing Key Pages

Many companies include their homepage and product pages but forget documentation, pricing, changelog, or support resources. These are exactly the pages users ask AI models about. Include every page that a potential customer might need.

Being Too Vague

"We are a technology company that builds software solutions" tells an AI model nothing useful. Be specific about your industry, your customers, your products, and the problems you solve. Specificity is what drives accurate AI responses.

Ignoring Multiple Products or Services

If you offer several products, list each one separately with its own description and URL. Lumping everything together as "our platform" makes it hard for AI models to recommend specific products for specific needs.

Get Started with AI Visibility

llms.txt is one piece of the AI visibility puzzle. To understand how AI models currently represent your brand and where you can improve, you need measurement.

Start Your Free AI Visibility Audit