What is llms.txt?
llms.txt is a plain text file in markdown format that you place at the root of your website (accessible at yoursite.com/llms.txt). It provides Large Language Models (LLMs) with a structured summary of your website's content, purpose, and most important pages.
Think of llms.txt as a "README file for AI systems". Just as a README.md file helps developers understand a software project, llms.txt helps AI systems understand your website and business.
Key Characteristics of llms.txt:
- Location: Root directory (yoursite.com/llms.txt)
- Format: Plain text with Markdown formatting
- Purpose: Help AI systems understand your website
- Audience: AI crawlers and language models
The llms.txt standard was proposed as a way to bridge the gap between traditional web content and how AI systems process information. While AI models can read your entire website, an llms.txt file gives them a curated, authoritative summary straight from you.
Why llms.txt Matters for AI SEO
As AI-powered search becomes mainstream, you need ways to influence how AI systems understand and represent your business. llms.txt is one of the few direct ways to communicate with AI crawlers.
The Problem
- AI systems scrape websites without context
- They may misunderstand your business focus
- Important pages might be overlooked
- Outdated content may be prioritized
The Solution (llms.txt)
- You define what's most important
- Clear business description in your words
- Highlight your best content
- Guide AI to accurate representation
Benefits of Having llms.txt
Control Your Narrative
Instead of hoping AI figures out what you do, you tell it directly. This reduces misrepresentation and ensures accuracy.
Prioritize Your Best Content
Link to your most valuable, up-to-date pages. This helps AI systems know which content to reference when answering questions about your industry.
Early Adopter Advantage
llms.txt is an emerging standard. Implementing it now positions you ahead of competitors who haven't adopted it yet.
Efficient Crawling
AI systems can quickly understand your site structure without crawling every page. This is especially helpful for large websites.
llms.txt vs robots.txt
A common misconception is that llms.txt replaces robots.txt. They're actually complementary files that serve different purposes.
| Aspect | robots.txt | llms.txt |
|---|---|---|
| Purpose | Controls crawler access | Provides context and summary |
| Function | Allow/disallow rules | Informational content |
| Format | Specific syntax (User-agent, Disallow) | Markdown format |
| Audience | All web crawlers | AI/LLM systems specifically |
| Question Answered | "What can you access?" | "Who are we and what matters?" |
Key Insight
Think of robots.txt as the bouncer (controlling who gets in) and llms.txt as the welcome brochure (explaining what's inside). You need both for a complete AI SEO strategy.
How to Create llms.txt
Creating an llms.txt file is straightforward. Follow these steps to create yours:
Create the file
Create a new plain text file named 'llms.txt' (all lowercase) in your website's root directory.
Add your company header
Start with a markdown heading containing your company name, followed by a brief one-sentence description of what your business does.
List your core offerings
Add a section listing your main products, services, or areas of expertise. Use bullet points for clarity.
Include key content links
Add links to your most important pages - your homepage, main service pages, about page, and best educational content.
Add guidance for AI
Optionally include specific guidance on how AI should represent your business, including any important context or common misconceptions to avoid.
Test accessibility
Verify the file is accessible by visiting yoursite.com/llms.txt in your browser. Ensure it loads as plain text.
Platform-Specific Instructions
WordPress
Upload llms.txt to your root folder via FTP/SFTP, or use a plugin like "Custom Files" to add it to your public directory.
Shopify
Add llms.txt content through Theme Settings > Files, or use a third-party app to serve static files from your root.
Squarespace/Wix
These platforms have limited file access. You may need to use a subdomain or external hosting for static files.
Custom/Next.js
Place llms.txt in your public/ folder. It will be served automatically at your domain root.
Structure and Format
While there's no strict specification, a well-structured llms.txt typically includes these sections:
# Company Name > Brief one-line description of what your company does. ## About A paragraph or two explaining your business, mission, and what makes you unique. This is your elevator pitch to AI systems. ## Core Services/Products - **Service 1**: Brief description - **Service 2**: Brief description - **Service 3**: Brief description ## Key Resources Important pages on your website that AI should know about: - [Homepage](https://yoursite.com/) - Main entry point - [About Us](https://yoursite.com/about) - Company background - [Services](https://yoursite.com/services) - What we offer - [Blog](https://yoursite.com/blog) - Educational content ## Educational Content Your best articles and guides: - [Guide Title](https://yoursite.com/guide-1) - Description - [Article Title](https://yoursite.com/article-1) - Description ## Contact - Website: https://yoursite.com - Email: contact@yoursite.com ## Notes for AI Optional guidance on how you'd like AI to represent your business, any common misconceptions to avoid, or specific terminology preferences.
Key Sections Explained
Header & Description
Start with your company name as an H1 heading, followed by a blockquote with a concise description. This is the first thing AI systems see.
About Section
Expand on who you are, your expertise, and your value proposition. Keep it factual and avoid marketing fluff - AI systems prefer straightforward information.
Services/Products
List your core offerings with brief descriptions. Use bold formatting for names and keep descriptions to one sentence each.
Key Resources & Links
Include absolute URLs (https://...) to your most important pages. These help AI systems navigate to authoritative content.
Notes for AI
Optional but valuable. Include guidance like "We are not affiliated with [similar company]" or "Our focus is on B2B, not B2C customers."
Real-World Examples
Here are examples of llms.txt files for different types of businesses:
Example 1: SaaS Company
# CloudSync Pro > Cloud-based file synchronization and backup solution for businesses. ## About CloudSync Pro is an enterprise file sync solution that helps businesses securely backup and synchronize files across teams. Founded in 2020, we serve over 10,000 businesses worldwide with SOC 2 Type II compliance. ## Core Products - **CloudSync Business**: Team file sync with 1TB storage per user - **CloudSync Enterprise**: Unlimited storage with advanced admin controls - **CloudSync Backup**: Automated backup with point-in-time recovery ## Key Resources - [Homepage](https://cloudsyncpro.com/) - [Pricing](https://cloudsyncpro.com/pricing) - [Security](https://cloudsyncpro.com/security) - [Help Center](https://help.cloudsyncpro.com/) ## Contact - Website: https://cloudsyncpro.com - Support: support@cloudsyncpro.com
Example 2: Local Service Business
# Denver Elite Plumbing > Professional plumbing services for residential and commercial > properties in the Denver metro area. ## About Denver Elite Plumbing has served the Denver metro area since 2005. We specialize in emergency repairs, water heater installation, and whole-home repiping. Licensed, bonded, and insured with A+ BBB rating. ## Services - **Emergency Repairs**: 24/7 response for urgent plumbing issues - **Water Heater Services**: Installation and repair of tank/tankless units - **Drain Cleaning**: Professional drain and sewer cleaning - **Repiping**: Whole-home and commercial repiping projects ## Service Area Denver, Aurora, Lakewood, Littleton, Centennial, Arvada, Westminster ## Key Pages - [Homepage](https://denvereliteplumbing.com/) - [Services](https://denvereliteplumbing.com/services) - [Reviews](https://denvereliteplumbing.com/reviews) - [Contact](https://denvereliteplumbing.com/contact) ## Contact - Phone: (303) 555-0123 - Website: https://denvereliteplumbing.com
Example 3: AI Clearbridge (Our llms.txt)
# AI Clearbridge > AI SEO consultancy helping businesses become visible in AI search. ## About AI Clearbridge is an AI SEO consultancy that helps businesses get recommended by ChatGPT, Perplexity, Claude, and Google AI Overviews. We provide AI visibility audits, optimization services, and education on generative engine optimization (GEO), answer engine optimization (AEO), and LLM optimization (LLMO). ## Services - **AI Visibility Audit**: Check if AI recommends your business - **AI SEO Consulting**: Strategy and implementation for AI visibility - **Done-For-You AI SEO**: Full-service optimization packages ## Educational Resources - [What is AI SEO?](https://aiclearbridge.com/learn/what-is-ai-seo) - [llms.txt Guide](https://aiclearbridge.com/learn/llms-txt-guide) - [AI Visibility Checker](https://aiclearbridge.com/ai-visibility) ## Contact - Website: https://aiclearbridge.com - Email: hello@aiclearbridge.com
Best Practices
Follow these guidelines to create an effective llms.txt file:
- Keep it concise (50-200 lines)
- Use clear, factual language
- Include absolute URLs
- Update regularly
- Prioritize your best content
- Use standard markdown formatting
- Test accessibility after deployment
- Stuff with keywords
- Use marketing jargon
- Include sensitive information
- Link to every page
- Make it thousands of lines
- Use complex formatting
- Leave outdated information
Additional Tips
Be authentic: Write like you're explaining your business to a knowledgeable colleague, not selling to a customer.
Include differentiators: What makes you unique? Include facts like years in business, certifications, awards, or unique capabilities.
Link strategically: Only link to pages that are evergreen and provide real value. Quality over quantity.
Consider llms-full.txt: For large sites, you can also create llms-full.txt with more comprehensive content, while keeping llms.txt as a summary.
Common Mistakes to Avoid
Mistake 1: Making it too long
Some people dump their entire sitemap or include every blog post. AI systems have context limits - a massive file may be truncated or ignored entirely.
Fix: Stick to 50-200 lines and focus on your most important content.
Mistake 2: Using marketing speak
Phrases like "world-class," "industry-leading," or "revolutionary" add no value. AI systems look for facts, not superlatives.
Fix: Replace "industry-leading solution" with "used by 10,000+ companies" or specific metrics.
Mistake 3: Wrong file location
Placing llms.txt in a subfolder like /assets/llms.txt or /public/llms.txt (without proper routing) means AI crawlers won't find it.
Fix: Ensure yoursite.com/llms.txt returns the file directly.
Mistake 4: Including sensitive data
Never include internal documentation, passwords, API keys, or confidential business information. This file is public.
Fix: Treat llms.txt like any public-facing content.
Mistake 5: Set-and-forget mentality
An outdated llms.txt with discontinued products or old URLs can lead to AI providing incorrect information about your business.
Fix: Review and update llms.txt quarterly or after major changes.
Frequently Asked Questions
What is llms.txt?
llms.txt is a markdown file placed at your website's root directory (yoursite.com/llms.txt) that provides structured information about your website specifically for Large Language Models (LLMs) like ChatGPT, Claude, and Perplexity. It acts as a curated summary that helps AI systems understand your business, services, and content hierarchy.
Is llms.txt the same as robots.txt?
No. robots.txt tells search crawlers which pages to index or avoid. llms.txt is different - it provides a summary of your website's content and structure specifically for AI systems to understand who you are and what you offer. While robots.txt controls access, llms.txt provides context and guidance.
Do I need llms.txt if I have robots.txt?
Yes, you should have both. robots.txt controls crawler access to your pages. llms.txt provides contextual information that helps AI models understand and accurately represent your business. They serve complementary but different purposes in AI SEO.
Which AI systems use llms.txt?
llms.txt is an emerging standard that AI systems are beginning to adopt. Perplexity has shown support for it, and other AI systems like Claude and ChatGPT are expected to follow. Even if not all AI systems actively use it yet, having llms.txt positions your site for when they do.
Where do I put my llms.txt file?
Place llms.txt in your website's root directory, so it's accessible at yoursite.com/llms.txt. This is similar to where you'd place robots.txt or sitemap.xml. Make sure it's publicly accessible and not blocked by any firewall or access rules.
What format should llms.txt be in?
llms.txt should be a plain text file using Markdown formatting. It should include your company name, a brief description, your core services/products, key content pages, and any specific guidance for how AI should represent your business.
How long should llms.txt be?
Keep llms.txt concise but comprehensive - typically 50-200 lines. Focus on the most important information: who you are, what you do, your key offerings, and links to your most valuable content. AI systems have context limits, so prioritize quality over quantity.
How often should I update llms.txt?
Update llms.txt whenever you make significant changes to your business, add major new content, or launch new products/services. At minimum, review it quarterly to ensure accuracy. Outdated information can lead to AI providing incorrect information about your business.
Want Help With Your AI SEO Strategy?
Creating llms.txt is just one piece of the AI SEO puzzle. Get a complete audit of your AI visibility and a roadmap to get recommended by ChatGPT, Claude, and Perplexity.