What is the llms.txt file?

The llms.txt file is an emerging standard proposed by Jeremy Howard (fast.ai) and progressively adopted by the AI community. It's a text file placed at a website's root (https://yoursite.com/llms.txt) that provides AI agents and LLM training crawlers with a structured summary of the site's content.

Unlike robots.txt which tells crawlers what they shouldn't explore, llms.txt positively guides AIs toward what they should read as a priority.

For a UCP-compatible e-commerce merchant, llms.txt also serves to explicitly declare your agentic endpoints, allowing AI agents to automatically discover your agentic commerce capabilities.

Structure and syntax of llms.txt

The file uses lightweight Markdown syntax. Here is the recommended structure for an e-commerce site:

# [Your Store Name]

> [One-sentence description of your store and what it sells]

## About
[More detailed description in 2-3 sentences: who you are, what you sell, your values]

## Catalog and Categories
- [Category 1 URL](https://yoursite.com/category-1/): [Short description]
- [Category 2 URL](https://yoursite.com/category-2/): [Short description]

## Featured Products
- [Product 1 URL](https://yoursite.com/products/product-1/): [Name, price, key feature]
- [Product 2 URL](https://yoursite.com/products/product-2/): [Name, price, key feature]

## Merchant Information
- Return policy: [URL], free returns within [X] days
- Shipping: [URL], free shipping over $[threshold]
- Customer service: [email or URL]
- Shipping zones: USA, Canada, UK

## UCP Endpoints (Universal Commerce Protocol)
- Catalog: https://yoursite.com/ucp/v1/catalog
- Inventory: https://yoursite.com/ucp/v1/inventory/{sku}
- Checkout: https://yoursite.com/ucp/v1/checkout
- Orders: https://yoursite.com/ucp/v1/orders/{order_id}

Key sections for an e-commerce merchant

"About" section

Write a factual, precise description of your store. Avoid marketing jargon. AI agents use this section to understand whether your store matches a user's query. For a gardening supply store: "Specialist in professional and amateur gardening equipment. We sell tools, irrigation systems, greenhouses, and garden accessories. Shipping across the US and Canada."

"UCP Endpoints" section

This is the agentic commerce-specific section. It allows UCP-supporting AI agents to automatically discover your endpoints without having to guess or search for them. Only include endpoints that are actually operational.

"Merchant Information" section

AI agents actively compare return policies, delivery times, and coverage areas. Make this information directly accessible via llms.txt to avoid agents having to crawl your T&C pages.

llms.txt vs robots.txt: the differences

Aspect	robots.txt	llms.txt
Audience	SEO crawlers (Googlebot, etc.)	AI agents and LLM training crawlers
Main function	Block or allow crawling	Positively guide toward key content
Format	Structured text directives	Free Markdown
Standard	Official, universally respected	Emerging, voluntary adoption
Immediate impact	Yes (Google indexing)	Progressive (per agent adoption)

Where to submit your llms.txt

directory.llmstxt.cloud, main registry of referenced llms.txt files
llmstxt.org, official standard site with list of participating sites

Best practices and mistakes to avoid

Update llms.txt regularly. A file with broken links or outdated information is counterproductive. Plan a minimum quarterly review.

Don't list non-operational endpoints. If you declare UCP endpoints that aren't working yet, AI agents will flag your store as unreliable.

Be factual, not marketing. "Best headphones in America" tells an AI agent nothing. "Bluetooth headphones $50-400, Sony, Bose, Jabra, US shipping" is actionable.

llms.txt for e-commerce: the complete guide to being read by AI agents