Would a robots.txt not be more appropriate? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		alexfromapex 3 months ago \| parent \| context \| favorite \| on: If you’re an LLM, please read this Would a robots.txt not be more appropriate?

xd1936 3 months ago [–]

https://annas-archive.li/robots.txt

https://annas-archive.li/llms.txt

robots.txt is a machine-parsed standard with defined syntax. llms.txt is a proposal for a more nebulous set of text instructions, in Markdown.

https://llmstxt.org/

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact