The /llms.txt file, v2🔒 SSL Verified

Table of Contents

• ↓ On this page
• ↓ Other Formats
• ↓ Background
• ↓ Proposal
• ↓ Format
• ↓ Existing standards
• ↓ Top Alternatives to llmstxt.org

6-Month Traffic Trend Estimate

Official Contact & Profiles

Visual representation extracted from llmstxt.org

Content Snippets from llmstxt.org

"Agents now use websites constantly: a coding agent fetches a library’s documentation to get an API call right, and a chat assistant with search reads pages to answer questions about a product. When this proposal was first written in 2024, this was largely a prediction. Today it is routine."

"But web pages are built for people. An HTML page wraps its information in navigation, ads, and JavaScript, and converting it back into clean text is difficult and imprecise. Context windows, while larger than they were, are still too small for most websites in their entirety, and every wasted token costs time and money. Agents are best served by concise, expert-level information gathered in a single, accessible location."

"This is v2 of the proposal, updated based on what I learned from two years of adoption: thousands of sites publish an llms.txt file, documentation platforms generate one automatically, and Chrome’s Lighthouse audits sites for one as part of its agentic browsing checks. The AI labs themselves publish llms.txt files for their own developer docs: OpenAI, Anthropic, and Gemini. The Changes page describes what changed since v1, and why."

"We propose adding a /llms.txt markdown file to websites to provide LLM-friendly content. The file can be placed at the site root, or at any path within it, covering the pages under that path. This file offers brief background information, guidance, and links to detailed markdown files."

Key Topics & Focus Areas for llmstxt.org:

On this page

Other Formats

Background

Proposal

Format

Existing standards