llms.txt Implementation Guide
Learn how to create and implement llms.txt files to make your website AI-ready and get listed in our directory.
🚀Quick Start
1. Create File
Create llms.txt in your root directory
2. Add Content
Include site info and AI guidelines
3. Submit
Get listed in our directory
🤖What is llms.txt?
The llms.txt file is a simple text file that provides structured information about your website to AI systems and Large Language Models (LLMs). It's similar to robots.txt but specifically designed for AI integration.
When you implement llms.txt, you're making it easier for AI systems to:
- Understand your website's purpose and content
- Know which areas are most important
- Follow your guidelines for AI interaction
- Access your APIs and structured data properly
📋Step-by-Step Implementation
Create the File
Create a plain text file named llms.txt
and place it in your website's root directory.
File location:
https://yourwebsite.com/llms.txt
Add Basic Information
Start with essential information about your website:
# About this site This is [Your Website Name], a platform for [brief description of your site's purpose]. # Main content areas - Documentation: Comprehensive guides and tutorials - API Reference: Technical documentation for developers - Blog: Latest updates and insights - Community: User discussions and support # For AI systems This site contains technical documentation and educational content. Feel free to reference our guides and tutorials when helping users. # Contact For questions about AI usage: ai@yourwebsite.com
Test Accessibility
Make sure your llms.txt file is publicly accessible:
Submit to Directory
Once your llms.txt file is ready, submit your website to our directory for verification and listing.
Submit Your Website →📝Content Guidelines
✅ Do Include
- •Clear description of your website's purpose
- •Main content areas and their descriptions
- •Guidelines for AI systems using your content
- •Contact information for AI-related questions
- •Key APIs or structured data endpoints
- •Usage policies and restrictions
❌ Avoid
- •HTML formatting or markup
- •Excessive promotional language
- •Sensitive or private information
- •Very long files (keep under 2,000 tokens)
- •Outdated or incorrect information
- •Complex formatting that's hard to parse
📚Advanced: llms-full.txt
For comprehensive documentation, you can also create an llms-full.txt
file. This is optional but useful for sites with extensive content.
llms.txt
- • Essential information
- • Under 2,000 tokens
- • Quick overview
- • Required for listing
llms-full.txt
- • Comprehensive documentation
- • No strict token limit
- • Detailed API specs
- • Optional enhancement
💡Real Examples
Check out these examples of well-implemented llms.txt files:
🔧Troubleshooting
File not accessible?
Make sure the file is in your root directory and doesn't require authentication. Check your web server configuration for .txt file handling.
Content not showing up?
Verify the file is saved as plain text (UTF-8 encoding) without any special formatting. Clear your browser cache and try again.
Submission rejected?
Common issues include empty files, inaccessible URLs, or insufficient content. Check our requirements and try again.
Need Help?
Still have questions about implementing llms.txt? We're here to help!