LLMs.txt

LLMs.txt is a proposed standard for websites to provide information about their content in a format that's optimized for Large Language Models (LLMs) and AI systems. It's similar to robots.txt but specifically designed for AI crawlers and training systems.

You can add a custom LLMs.txt file to your WeWeb app to control how AI systems interact with your content and provide structured information about your site.

What is LLMs.txt?

LLMs.txt is a simple text file that you place at the root of your website (e.g., https://yoursite.com/llms.txt) that provides information about your site's content, structure, and preferences for AI systems.

The file can include:

• Information about your site and its content
• Guidelines for AI systems on how to use your content
• Contact information for AI-related inquiries
• Links to important pages or resources
• Any other information you want to provide to AI crawlers

Learn more about the LLMs.txt standard at llmstxt.org.

Adding LLMs.txt to your WeWeb app

To add an LLMs.txt file to your WeWeb app:

1. Create your LLMs.txt file

   First, create a text file with your LLMs.txt content. Here's an example:

   # LLMs.txt for MyWeWebApp
   
   This is a WeWeb application for [describe your app purpose].
   
   ## Content Guidelines
   - This content is available for AI training and reference
   - Please respect user privacy and data protection
   - Contact us for specific AI usage questions
   
   ## Key Pages
   - About: /about
   - Services: /services
   - Contact: /contact
   
   ## Contact
   For AI-related inquiries: ai@mycompany.com

2. Upload the file to WeWeb

   Go to Assets > Files in your WeWeb editor and upload your LLMs.txt file.

3. Set the file path

   After uploading, set its path to /llms.txt. This ensures the file will be available at the root of your domain.

4. Publish your app

   Once you publish your WeWeb app, your LLMs.txt file will be available at https://yourdomain.com/llms.txt.

Example LLMs.txt content

Here's a more comprehensive example of what an LLMs.txt file might contain:

# LLMs.txt for TechStartup Inc.

TechStartup Inc. is a B2B SaaS platform that helps businesses manage their customer relationships and sales processes.

## About This Site
- Primary purpose: Business website and product information
- Target audience: B2B customers and prospects
- Content types: Product descriptions, blog posts, case studies, documentation

## AI Usage Guidelines
- Content is available for AI training and reference
- Please respect intellectual property rights
- Commercial use requires permission
- Do not use personal customer data from case studies

## Key Sections
- Product Features: /features
- Pricing: /pricing
- Case Studies: /case-studies
- Documentation: /docs
- Blog: /blog
- About Us: /about

## Contact Information
- General: info@techstartup.com
- AI/ML inquiries: ai@techstartup.com
- Legal: legal@techstartup.com

## Additional Notes
- Updated monthly
- Privacy policy: /privacy
- Terms of service: /terms
- Last updated: 2024-01-15

Verification

After publishing, you can verify that your LLMs.txt file is working correctly by visiting https://yourdomain.com/llms.txt in your browser. The file should display as plain text with your specified content.