About llms.txt Directory
The definitive directory of 1,300+ verified websites implementing the llms.txt standard for AI search optimization. Updated daily.
🤖What is llms.txt?
llms.txt is a plain text file placed in a website's root directory that tells AI language models how to use and cite the site's content. Similar to how robots.txt guides web crawlers, llms.txt is specifically designed for AI systems like ChatGPT, Perplexity, Claude, and Gemini.
When a website implements llms.txt, it creates a machine-readable file (accessible at yoursite.com/llms.txt) that contains:
- A clear description of the website's purpose and content
- Key content areas and their descriptions
- Usage guidelines and permissions for AI systems
- Contact information for AI-related inquiries
The llms.txt standard was created to bridge the gap between traditional web content and AI systems that need to understand, reference, and cite websites accurately. It complements robots.txt (which controls crawling) and sitemap.xml (which lists pages) by providing context and usage guidelines specifically for AI language models.
🎯Our Mission
We believe in making AI integration accessible and standardized. Our directory serves as the central hub for discovering websites that have embraced the llms.txt standard, making it easier for:
🔍 AI Developers
Find AI-ready websites with proper documentation and integration guidelines.
🌐 Website Owners
Increase visibility and enable better AI interactions with their content.
🤖 LLM Systems
Access structured information for better understanding and integration.
📚 Researchers
Study the adoption and implementation of AI integration standards.
⚙️How Our Directory Works
Our automated system continuously monitors and verifies llms.txt implementations across the web:
Discovery & Submission
Websites are added through submissions or discovered through web crawling.
Verification
We verify that llms.txt files are accessible, valid, and contain meaningful content.
Monitoring
Continuous monitoring tracks token counts, availability, and content changes.
Organization
Sites are categorized and made searchable through our intuitive interface.
📊By the Numbers
🤝Get Involved
The llms.txt ecosystem thrives on community participation. Here's how you can contribute: