About llms.txt Directory
We track 1,478+ websites that publish an llms.txt file so AI search engines can actually find and cite them. Updated daily.
🤖What is llms.txt?
llms.txt is a plain text file placed in a website's root directory that tells AI language models how to use and cite the site's content. Similar to how robots.txt guides web crawlers, llms.txt is specifically designed for AI systems like ChatGPT, Perplexity, Claude, and Gemini.
When a website implements llms.txt, it creates a machine-readable file (accessible at yoursite.com/llms.txt) that contains:
- A clear description of the website's purpose and content
- Key content areas and their descriptions
- Usage guidelines and permissions for AI systems
- Contact information for AI-related inquiries
The llms.txt standard was created to bridge the gap between traditional web content and AI systems that need to understand, reference, and cite websites accurately. It complements robots.txt (which controls crawling) and sitemap.xml (which lists pages) by providing context and usage guidelines specifically for AI language models.
🎯Our Mission
We built this directory because finding websites with llms.txt was harder than it should be. Now it's one place that helps:
🔍 AI Developers
Find AI-ready websites with proper documentation and integration guidelines.
🌐 Website Owners
Increase visibility and enable better AI interactions with their content.
🤖 LLM Systems
Access structured information for better understanding and integration.
📚 Researchers
Study the adoption and implementation of AI integration standards.
⚙️How Our Directory Works
Every listing goes through the same process before it shows up in the directory:
Discovery & Submission
Sites come in via our submit form or we find them during crawls.
Verification
We check the file loads without a login and has real content, not just a placeholder.
Monitoring
We re-check listings regularly for token counts, availability, and content changes.
Organization
Sites get tagged by category so you can search and filter by what you actually need.
📊By the Numbers
🤝Get Involved
The directory grows because people add their sites and share what they learn. Here's how to be part of it: