llms.txt ideas #86
Description
I've been thinking a lot about llms.txt lately, and here are some ideas I had to make it better
1 - Advocate to use link rel="alternate" to indicate from the HTML page where the text/markdown variant is located:
<link rel="alternate" type="text/markdown" href="my-super-cool-page.md" title="Agent-Friendly" />
Currently nobody is using this, making it a harder process when agents get served links to standard HTML pages. This would allow machines to more easily find the machine-friendly version directly, rather than going through /llms.txt first.
2 - Advocate to support varying on accept header between HTML and 'text/markdown'. Also, advocate to default to text/markdown responses if no accept header was provided.
This will allow serving machine-readable files if accept header text/markdown was provided or preferred. This would allow an even easier way to gather context incase only the human URL was found, directly serving the agent-friendly variant if accepted.