robots.txt
ai.robots.txt
https://github.com/ai-robots-txt/ai.robots.txt?ref=geeek.org
A list of AI agents and robots to block.
This list contains AI-related crawlers of all types, regardless of purpose. We encourage you to contribute to and implement this list on your own site. See information about the listed crawlers and the FAQ.
Related contents:
Added 3 weeks ago
Really Simple Licensing (RSL)
https://rslstandard.org/
The open content licensing standard for the AI-first Internet
Really Simple Licensing (RSL) is an evolution of the early ideas behind the widely adopted RSS standard, which provided a machine-readable framework for publishers to syndicate content to third-party clients and crawlers in exchange for traffic.
Related contents:
Added 1 month ago