llms.txt generator that only links pages it could fetch
Paste your homepage, get a Markdown draft whose every link is a public page the run retrieved, then check it before you publish.
By ClaudeGPT Si Newsroom, Editorial team··3 min read
An llms.txt generator turns your website into a short Markdown file that tells AI agents what your site is and which pages to read first. The llms.txt Generator on seogeoaeo.ai builds that draft from your homepage and only links to public pages it actually fetched during the run, so you never publish a file that points agents at dead or made-up URLs.
What you put in
The tool asks for two things:
- Site URL. Required. Any public http or https address. Private, local and non-web addresses are rejected before a request is made.
- Site name. Optional. If you set it, it becomes the H1 of the draft. If you leave it empty, the generator uses your page title.
That is the whole form. There is no crawl setup and no list of pages to paste.
What you get back
A Markdown draft that follows the shape the llms.txt proposal describes: a title, a short summary and sections of links to the pages a language model should read. You copy it, edit it and publish it.
| Part of the file | What the generator does |
|---|---|
| H1 title | Uses your site name, or the page title |
| Summary | Drafts it from your homepage |
| Link sections | Lists only public URLs the run fetched |
| Everything else | Left to you to review and edit |
The key rule is in the third row. Every link in the draft is a page the run retrieved. The generator does not guess at a /docs path or a pricing page that might exist. If it could not load it, it is not in the file.
Why "only fetched pages" matters
An llms.txt file is a promise to an agent: these are the pages worth reading. A broken link wastes the agent's time and can push it toward a worse source. A draft built only from verified URLs may be shorter, but every line leads somewhere real.
The trade-off is that pages built only with JavaScript may be missing, because the run does not render the page in a browser. Read the draft, add any key pages that were left out, and remove anything you would not want an agent to start from.
After you publish
Put the file at the root of your site, at /llms.txt, and serve it as plain text. Then check it. The generator does not validate a published file; that is a separate job for the AI Agent Readiness Checker, which checks llms.txt syntax and links along with other agent signals. You can also paste the draft into that checker before it goes live.
What the generator does not do
- Validate an llms.txt that is already on your site
- Map which AI crawlers your robots.txt allows
- Render JavaScript pages
- Promise rankings or mentions in AI answers
That last point is worth stating plainly. llms.txt is optional. It is not a Google search requirement, and publishing one does not guarantee that any AI assistant will name you. It gives agents that do look for it a clean starting point.
If your site runs on WordPress with Yoast SEO, its built-in llms.txt feature keeps a file updated for you, which may suit you better than a one-off draft.
Cost and access
Each run costs 15 credits, and the price shows before you start. You can run it in the browser, or let an AI agent call the same tool over MCP or the REST API with a workspace API key. Plans and top-ups are on the seogeoaeo.ai pricing page.