llms.txt Implementation Guide

Learn how to create and implement llms.txt files to make your website AI-ready and get listed in our directory.

🚀Quick Start

📝

1. Create File

Create llms.txt in your root directory

✍️

2. Add Content

Include site info and AI guidelines

📤

3. Submit

Get listed in our directory

🤖What is llms.txt?

The llms.txt file is a simple text file that provides structured information about your website to AI systems and Large Language Models (LLMs). It's similar to robots.txt but specifically designed for AI integration.

When you implement llms.txt, you're making it easier for AI systems to:

  • Understand your website's purpose and content
  • Know which areas are most important
  • Follow your guidelines for AI interaction
  • Access your APIs and structured data properly

📋Step-by-Step Implementation

1

Create the File

Create a plain text file named llms.txt and place it in your website's root directory.

File location:

https://yourwebsite.com/llms.txt
2

Add Basic Information

Start with essential information about your website:

# About this site
This is [Your Website Name], a platform for [brief description of your site's purpose].

# Main content areas
- Documentation: Comprehensive guides and tutorials
- API Reference: Technical documentation for developers  
- Blog: Latest updates and insights
- Community: User discussions and support

# For AI systems
This site contains technical documentation and educational content.
Feel free to reference our guides and tutorials when helping users.

# Contact
For questions about AI usage: ai@yourwebsite.com
3

Test Accessibility

Make sure your llms.txt file is publicly accessible:

Visit yourwebsite.com/llms.txt in a browser
Ensure it loads without authentication
Check that content is readable
4

Submit to Directory

Once your llms.txt file is ready, submit your website to our directory for verification and listing.

Submit Your Website →

📝Content Guidelines

✅ Do Include

  • Clear description of your website's purpose
  • Main content areas and their descriptions
  • Guidelines for AI systems using your content
  • Contact information for AI-related questions
  • Key APIs or structured data endpoints
  • Usage policies and restrictions

❌ Avoid

  • HTML formatting or markup
  • Excessive promotional language
  • Sensitive or private information
  • Very long files (keep under 2,000 tokens)
  • Outdated or incorrect information
  • Complex formatting that's hard to parse

📚Advanced: llms-full.txt

For comprehensive documentation, you can also create an llms-full.txt file. This is optional but useful for sites with extensive content.

llms.txt

  • • Essential information
  • • Under 2,000 tokens
  • • Quick overview
  • • Required for listing

llms-full.txt

  • • Comprehensive documentation
  • • No strict token limit
  • • Detailed API specs
  • • Optional enhancement

🔧Troubleshooting

File not accessible?

Make sure the file is in your root directory and doesn't require authentication. Check your web server configuration for .txt file handling.

Content not showing up?

Verify the file is saved as plain text (UTF-8 encoding) without any special formatting. Clear your browser cache and try again.

Submission rejected?

Common issues include empty files, inaccessible URLs, or insufficient content. Check our requirements and try again.

Need Help?

Still have questions about implementing llms.txt? We're here to help!