But hear me out: if you want it just in case, or if you would like to add your sites to some llms.txt directories, you can use this endpoint. That way, you do not need to keep updating your own llms.txt, especially as I improve the API.

Here is how it works:

Enter any domain:

https://get.llms.page/{example.com}/llms.txt

The API will parse your homepage (if allowed in robots). Using internal links, descriptions, and other metadata, it will generate an Markdown llms.txt file.

It does not rely on AI, because I want it to be fast and free. The API is open, free, runs on a CDN, and is powered by Cloudflare Workers for speed.

I plan to open source the no-AI llms.txt generator later, since there is still a lot to improve.

If you want to try it out or see some usage examples, visit:

https://llms.page

Let me know what you think!