llms.txt is a proposed standard for a text file located at /llms.txt, which helps language models understand a page’s structure more quickly and identify its most important resources. It usually takes the form of a simple Markdown file with a title, a short description, and a list of key links grouped into sections, so that the AI does not have to analyze the entire HTML code, scripts, and ancillary elements.
Table of Contents
How llms.txt Works
In practice, llms.txt acts as a map of the most important content for AI systems. Instead of relying solely on the model to correctly interpret the page’s structure on its own, the website owner provides an organized version of the information: what the site is about, what sections it has, which subpages are most important, and which content can be considered optional.
A typical llms.txt file is written in plain Markdown. It usually includes an H1 heading with the site’s name, a short description in the form of a quote, H2 sections with lists of links, and an optional “Optional” section for less important resources.
What Should Be Included in the File
At a minimum, the llms.txt file should include the website’s name as an H1 heading and a brief description of what the site is about. Next, it’s a good idea to add sections linking to the most important subpages, such as the service offering, documentation, FAQs, terms of service, privacy policy, contact page, or key how-to articles.
A good llms.txt file is not a copy of sitemap.xml or a list of all URLs on the site. Rather, it is a carefully curated list of the most important resources with a brief description of their significance, designed to help language models more quickly understand which content is key.
Example of an llms.txt file
Below is a simple example of an llms.txt file for a company website:
# Sample Company
> A website for a company offering web design, SEO optimization, and digital consulting services to small and medium-sized businesses.
## About the Company
- [Home](https://your-domain.com/) - Key information about the company and its services.
- [About Us](https://your-domain.com/about-us/) - Information about the team, experience, and areas of expertise.
- [Contact](https://your-domain.com/contact/) - Contact information and an inquiry form.
## Services
- [Web Design](https://your-domain.com/website-development/) - Website development services.
- [SEO](https://your-domain.com/seo/) - Search engine optimization and ranking services.
- [Consulting](https://your-domain.com/consulting/) - Consulting on marketing and online growth.
## Resources
- [FAQ](https://your-domain.com/faq/) - Answers to customers’ most frequently asked questions.
- [Blog](https://your-domain.com/blog/) - How-to articles related to websites and SEO.
- [Privacy Policy](https://your-domain.com/policy/) - Information about data processing practices.
## Optional
- [Careers](https://your-domain.com/careers/) - Information about job openings.
- [News](https://your-domain.com/announcements/) - Less important company announcements.This file should be published at https://twojadomena.pl/llms.txt as a publicly accessible text file. It is usually prepared manually or generated based on the website’s most important sections, and then updated whenever major changes are made to the site.
Does llms.txt replace robots.txt or sitemap.xml
llms.txt does not replace either robots.txt or sitemap.xml, as it serves a completely different purpose. Robots.txt tells bots what they can crawl, sitemap.xml helps search engines find URLs, and llms.txt is designed to help language models better understand the website’s content and priorities.
In practice, it’s best to treat these files as complementary elements of a single technical strategy. A website can have a valid robots.txt file, an up-to-date XML sitemap, and, in addition, a well-prepared llms.txt file that indicates to AI where the most important context is located.
Is it worth implementing llms.txt right now?
Although llms.txt is still an evolving standard, its implementation is quick and relatively simple. Even if not all models actively use it, the process of preparing the file itself helps organize the website’s most important resources and better determine which content should represent the brand in AI responses.
For companies that publish documentation, FAQs, guides, or detailed service descriptions, llms.txt can be a particularly valuable addition. It’s a simple way to signal to language models which pages are truly the most important and which can be treated as secondary.