Frequently Asked Questions
Everything you need to know about the llms.txt directory, website submissions, and implementation.
Submit Your Site
Get your website listed
Implementation Guide
Learn to create llms.txt
Contact Us
Get personalized help
🏠General
What is the llms.txt directory?
The llms.txt directory is a comprehensive catalog of websites that implement the llms.txt standard. We list over 13,000 sites that provide structured information for AI systems and Large Language Models (LLMs) through llms.txt and llms-full.txt files.
What is the llms.txt standard?
The llms.txt standard is a simple protocol that allows websites to provide structured information about themselves to AI systems. Similar to robots.txt for web crawlers, llms.txt helps AI understand your website's content, purpose, and how it should be used.
Is the directory free to use?
Yes, our directory is completely free to browse and search. Website listings are also free for sites that properly implement the llms.txt standard.
📝Website Submission
How do I submit my website to the directory?
Use our submission form on the Submit page. You'll need to provide your website URL, title, category, description, and contact email. We'll verify your llms.txt implementation and add your site within 24-48 hours if approved.
What are the requirements for submission?
Your website must have a publicly accessible /llms.txt file with meaningful content about your site. The website should be active, appropriate, and follow our content guidelines. An optional /llms-full.txt file is also supported for comprehensive documentation.
How long does the review process take?
Most submissions are reviewed within 24-48 hours. We verify that your llms.txt file is accessible, contains valid content, and meets our quality standards. You'll receive an email confirmation once your site goes live.
Can I update my listing after submission?
Yes! Our system automatically monitors your llms.txt file and updates token counts and content changes. For major updates to your listing details, you can contact us through our contact page.
What if my submission is rejected?
If your submission doesn't meet our requirements, we'll email you with specific feedback on what needs to be fixed. Common issues include inaccessible llms.txt files, insufficient content, or technical problems with the implementation.
⚙️Implementation
How do I create an llms.txt file?
Create a plain text file named 'llms.txt' in your website's root directory (accessible at yoursite.com/llms.txt). Include information about your site's purpose, key content areas, and how AI systems should interact with your content. Check our implementation guide for detailed instructions.
What should I include in my llms.txt file?
Include your site's purpose, main content areas, key pages or APIs, usage guidelines for AI systems, and any specific instructions for LLMs. Keep it informative but concise - aim for clear, structured information that helps AI understand your site.
What's the difference between llms.txt and llms-full.txt?
llms.txt should contain essential information about your site (typically under 2,000 tokens). llms-full.txt is optional and can contain comprehensive documentation, detailed API specs, or extensive content that might be useful for AI systems but too lengthy for the main file.
Do I need technical knowledge to implement llms.txt?
No advanced technical knowledge is required. Creating an llms.txt file is as simple as creating a text file and uploading it to your website's root directory. Most website builders and hosting platforms make this straightforward.
Can I use HTML or formatting in my llms.txt file?
llms.txt files should be plain text without HTML formatting. Use simple text formatting like line breaks, headers with dashes or equals signs, and bullet points with dashes or asterisks for structure.
🔍Directory Features
How often is the directory updated?
We update the directory daily. Our automated system continuously monitors listed websites for changes to their llms.txt files, updates token counts, and checks for availability.
How do you calculate token counts?
Token counts are calculated using standard tokenization methods compatible with most LLMs. We monitor both llms.txt and llms-full.txt files and update counts automatically when content changes.
Can I search and filter the directory?
Yes! You can search by website name, description, or domain, and filter by categories like AI platforms, documentation, tools, websites, and research. The directory includes over 50 different categories.
What categories are available?
We organize sites into categories including AI platforms, development tools, documentation sites, research organizations, websites/blogs, and many specialized subcategories. The category list grows as we add more diverse sites.
💻Technical
What happens if my llms.txt file becomes inaccessible?
Our monitoring system will detect if your llms.txt file becomes inaccessible. We'll mark it as temporarily unavailable in the directory and attempt to re-verify it over several days before potentially removing the listing.
Do you support HTTPS only?
We support both HTTP and HTTPS, but we strongly recommend HTTPS for security. Most modern websites should use HTTPS, and some AI systems may prefer secure connections.
Can I use redirects for my llms.txt file?
Basic redirects (301/302) are supported, but we recommend serving llms.txt directly from the root path (/llms.txt) for best compatibility with AI systems and our monitoring.
Is there a file size limit for llms.txt?
While there's no strict limit, we recommend keeping llms.txt files under 2,000 tokens (roughly 1,500 words) for optimal AI processing. Use llms-full.txt for longer content.
Still Have Questions?
Can't find what you're looking for? We're here to help!