Guide · updated 2026-10-11
What is llms.txt and do you need one?
llms.txt is a small Markdown file at the root of your site that tells AI tools what your site is and which pages matter. It is easy to add. It is not a ranking trick. Here is what it is and when it is worth it.
What it is
The llms.txt proposal was published in September 2024. The idea: web pages are full of menus, scripts and ads, and AI tools work better with a short, clean summary. So you put a Markdown file at /llms.txt with your site's name, a one-line summary and links to your most useful pages.
It does not block or allow anything. That is still the job of robots.txt.
The format
- A title. One line starting with
#and your site or product name. - A summary. One line starting with
>that says what you do. - Details (optional). A few plain sentences: who it is for, what makes it different.
- Sections of links. Headings starting with
##, each with a list of Markdown links to your pages, every link followed by a colon and a few words on what the page covers. A section called "Optional" marks links a tool can skip.
Our free llms.txt generator writes the file for you from a few fields, in your browser.
Is it worth it?
For most sites it is a five-minute job with a small, uncertain benefit. Worth doing, but only after the things that clearly matter:
- AI crawlers can reach your site. If robots.txt blocks the crawlers AI search tools use, llms.txt changes nothing.
- Your pages say plainly what you do. A clear title, description and headings, and the text in the HTML rather than only loaded by scripts.
- Other sites mention you. AI answers lean on sources such as directories, reviews and articles. Being listed and talked about there is what gets you named.
The free AI SEO checker tests all of this, including whether you have an llms.txt.
Questions
Do AI search tools use llms.txt?
llms.txt is a proposal, not an official standard. When we wrote this, the big AI search providers had not said that they use it to choose sources or rank pages. Some AI coding tools and agents read it when they are pointed at a site.
Will llms.txt help my SEO?
Not directly. Search engines rank pages, not this file. It costs a few minutes, so it is cheap to add, but crawler access, clear pages and links from other sites matter far more.
What is llms-full.txt?
An optional second file from the same proposal that puts the full text of your key pages into one Markdown file, so a tool can read everything at once. It is mostly used by documentation sites.
Where does the file go?
At the root of your domain, like robots.txt: yourdomain.com/llms.txt. Serve it as plain text.
Submit to 100+ places, not one
Dirproof Pro gives you a hand-checked list of 100+ places to get your AI tool, SaaS or website listed, with price, dofollow or nofollow, DR and the check date for each one. Describe your product once and get a ready text for every site, cut to its limits; an autopilot opens each site in order and records your submissions with reminders. Link checks and an SEO and AI search check show what counts.