Just noticed that Cloudflare has a new option (new to me, might have been there for a while) to block AI bots. Enabled on all websites. All open source data is available in git repos, no need for bots to crawl pages

2 likes 0 replies