# llms.txt Directory - Comprehensive Documentation

This is the complete documentation for the llms.txt Directory, the most comprehensive catalog of websites implementing the llms.txt standard for seamless AI integration.

## Mission & Vision

### Our Mission
We believe AI integration should be accessible and standardized. Our directory serves as the central hub for discovering websites that embrace the llms.txt standard, making it easier for AI developers to find AI-ready content and for website owners to increase their visibility in the AI ecosystem.

### Our Vision
To become the definitive resource for llms.txt implementations, fostering a community where websites and AI systems can interact seamlessly through standardized protocols.

## Comprehensive Site Structure

### Homepage (https://llmtxt.app/)
**Primary Function**: Searchable directory of llms.txt implementations

**Key Features**:
- Real-time search across 1,300+ verified websites
- Category filtering: AI platforms, documentation, development tools, websites/blogs, research organizations
- Live token count monitoring for both llms.txt and llms-full.txt files
- Pagination with 24 results per page
- Responsive grid layout optimized for all devices

**Data Displayed Per Listing**:
- Website title and description
- Primary domain and direct llms.txt link
- Token counts with formatting (e.g., "15,391 tokens")
- Category classification
- Verification status indicators

**Search Capabilities**:
- Full-text search across titles, descriptions, domains, and categories
- Category-based filtering with "All Categories" option
- URL parameter support for bookmarkable searches
- SEO-optimized URLs for search results

### Implementation Guide (https://llmtxt.app/guide)
**Purpose**: Complete tutorial for implementing llms.txt on any website

**Content Sections**:

1. **Quick Start Guide**
   - 3-step process: Create File → Add Content → Submit
   - Visual step indicators with icons
   - Direct link to submission form

2. **What is llms.txt?**
   - Explanation of the standard and its benefits
   - Comparison to robots.txt
   - Use cases for AI integration

3. **Step-by-Step Implementation**
   - Detailed instructions for file creation
   - Code examples with proper formatting
   - File location requirements (yoursite.com/llms.txt)
   - Content structure recommendations

4. **Content Guidelines**
   - Do's and Don'ts with visual indicators
   - Best practices for token optimization
   - Semantic meaning preservation
   - Accessibility considerations

5. **Advanced Features**
   - llms-full.txt implementation
   - Comparison table between llms.txt and llms-full.txt
   - Token limits and recommendations

6. **Real Examples**
   - Live examples from Anthropic (15,391 tokens)
   - Perplexity implementation (1,173 tokens)
   - llms.txt.org specification (318 tokens)
   - Link to browse 1,300+ more examples

7. **Troubleshooting**
   - Common implementation issues
   - File accessibility problems
   - Content formatting errors
   - Submission rejection reasons

### Website Submission System (https://llmtxt.app/submit)
**Purpose**: Free submission portal for website owners

**Submission Process**:

1. **Requirements Verification**
   - Public llms.txt file accessibility check
   - Content quality assessment
   - Website activity verification
   - Guideline compliance review

2. **Submission Form Fields**:
   - Website URL (with automatic llms.txt verification)
   - Website title and category selection
   - Detailed description (required)
   - Contact email (private, for communication only)
   - Confirmation of website ownership/permission

3. **Review Process**:
   - Automated accessibility testing
   - Manual content quality review
   - Category classification verification
   - 24-48 hour processing timeline

4. **Benefits Highlighted**:
   - Increased visibility to AI developers and researchers
   - Enhanced LLM discoverability
   - Free listing with live monitoring
   - Community participation in growing ecosystem
   - Automatic updates when content changes

### Support & Resources

#### FAQ Section (https://llmtxt.app/faq)
**Comprehensive Q&A covering**:

- **General Questions**: Directory purpose, free usage, llms.txt standard explanation
- **Submission Process**: Requirements, timeline, updates, rejection handling
- **Implementation Help**: File creation, content guidelines, technical requirements
- **Directory Features**: Update frequency, search capabilities, categorization
- **Technical Support**: Troubleshooting, accessibility issues, file formatting

#### About Page (https://llmtxt.app/about)
**Detailed Information**:

- **Standard Explanation**: What llms.txt is and why it matters
- **Directory Mission**: Community building and standardization
- **Process Transparency**: How sites are discovered, verified, and monitored
- **Statistics**: 1,300+ websites, 50+ categories, daily updates
- **Community Involvement**: Ways to contribute and participate

#### Contact System (https://llmtxt.app/contact)
**Support Categories**:

- Technical support (24-48 hour response)
- Submission questions (12-24 hour response)
- Implementation help with detailed guidance
- Listing updates and modifications
- Feedback and feature suggestions
- Partnership inquiries

**Response Time Commitments**:
- Technical Support: 24-48 hours
- Submission Questions: 12-24 hours
- General Inquiries: 1-3 business days

## Technical Architecture

### Frontend Technology Stack
- **Framework**: Next.js 14 with App Router
- **Language**: TypeScript for type safety
- **Styling**: CSS Custom Properties with responsive design
- **Components**: Modular React components with proper semantic HTML
- **Accessibility**: WCAG compliant with proper ARIA labels
- **Performance**: Optimized images, lazy loading, code splitting

### Data Management
- **Storage**: Static data files with TypeScript interfaces
- **Processing**: Server-side filtering and pagination
- **Search**: Client-side search with URL state management
- **Updates**: Daily automated verification and monitoring
- **Backup**: Version-controlled data with change tracking

### SEO & Metadata
- **Dynamic Metadata**: Page-specific titles and descriptions
- **Open Graph**: Complete social media integration
- **Twitter Cards**: Optimized for social sharing
- **Structured Data**: Schema.org markup for search engines
- **Canonical URLs**: Proper URL canonicalization
- **Sitemap**: Automated XML sitemap generation

### Monitoring & Analytics
- **Uptime Monitoring**: Automated checks of listed websites
- **Token Counting**: Live token count updates
- **Accessibility Verification**: Regular llms.txt file accessibility checks
- **Performance Tracking**: Site speed and user experience metrics
- **Error Handling**: Graceful degradation and error recovery

## Data Structure & Standards

### Website Listing Schema
interface LlmSiteData {
    url: string;
    urlFull?: string | null;
    title?: string;
    category?: string;
    description?: string | null;
    mainDomain?: string;
    "llms-txt-tokens"?: number;
    "llms-full-txt-tokens"?: number;
    skipCheck?: boolean;
    down?: boolean;
    checkFull?: boolean;
}

### Category Classifications
- **AI Platforms**: OpenAI, Anthropic, Google AI, etc.
- **Documentation**: Technical docs, API references, guides
- **Development Tools**: IDEs, frameworks, libraries
- **Websites & Blogs**: Personal sites, company blogs, news sites
- **Research Organizations**: Universities, labs, think tanks
- **Specialized Categories**: 45+ additional classifications

### Quality Standards
- **Content Requirements**: Minimum 50 tokens, meaningful information
- **Accessibility**: Must be publicly accessible without authentication
- **Format Standards**: Plain text, UTF-8 encoding, no HTML markup
- **Update Frequency**: Sites monitored daily for changes
- **Verification Process**: Multi-step validation before listing

## Community & Ecosystem

### For AI Developers
- **Discovery**: Find websites with proper AI integration
- **Integration**: Access structured information for better AI responses
- **Research**: Study implementation patterns across different sites
- **Development**: Use as examples for AI system training

### For Website Owners
- **Visibility**: Get discovered by AI systems and developers
- **Education**: Learn proper implementation techniques
- **Community**: Join a growing ecosystem of AI-ready websites
- **Support**: Access help and guidance throughout implementation

### For Researchers
- **Data Access**: Study adoption patterns of AI integration standards
- **Analysis**: Research the evolution of human-AI interaction protocols
- **Documentation**: Access comprehensive implementation examples
- **Trends**: Track growth and development of the llms.txt ecosystem

## Future Development

### Planned Features
- **API Access**: RESTful API for programmatic directory access
- **Advanced Filtering**: More granular search and filter options
- **Community Features**: User ratings and reviews of implementations
- **Analytics Dashboard**: Detailed statistics and trends
- **Integration Tools**: Automated llms.txt generation tools

### Community Growth
- **Educational Content**: Expanded guides and tutorials
- **Case Studies**: Detailed implementation success stories
- **Webinars**: Live training sessions for website owners
- **Partnerships**: Collaborations with AI platforms and tools

## Data Usage & API Information

### Current Access Methods
- **Web Interface**: Full-featured browsing and search at https://llmtxt.app/
- **Direct Links**: Access to individual llms.txt files
- **Bulk Browsing**: Paginated access to all listings
- **Category Filtering**: Targeted access by classification

### Planned API Features
- **RESTful Endpoints**: Programmatic access to directory data
- **Authentication**: API key management for developers
- **Rate Limiting**: Fair usage policies and limits
- **Documentation**: Comprehensive API documentation
- **SDKs**: Client libraries for popular programming languages

### Usage Guidelines
- **Attribution**: Please credit "llms.txt Directory" when using our data
- **Respect**: Follow individual websites' llms.txt usage policies
- **Responsibility**: Use data ethically and responsibly
- **Updates**: Check for data freshness and accuracy

## Contact & Support

### Primary Contact Methods
- **Web Form**: https://llmtxt.app/contact with categorized support options
- **Response Times**: Committed response timeframes by category
- **Documentation**: Comprehensive self-service resources

### Community Channels
- **GitHub**: Open source contributions and issue tracking
- **Educational Resources**: Guides, tutorials, and best practices
- **Feedback**: Continuous improvement based on user input

### Business Inquiries
- **Partnerships**: Collaboration opportunities with AI platforms
- **Integration**: Custom integration and consultation services
- **Enterprise**: Bulk data access and custom solutions

---

This comprehensive documentation reflects our commitment to transparency, education, and community building in the AI integration ecosystem. The llms.txt Directory serves as both a practical resource and an educational platform, helping bridge the gap between human-created content and AI understanding.

Website: https://llmtxt.app
Last Updated: 2025-08-21
Total Websites: 1,300+ (growing daily)
Categories: 50+ classifications
Update Frequency: Daily monitoring and verification