AlaskanBeard - Zack @alaskanbeard.com · Jun 17

Anthropic is nice enough to have their email and a custom name for their browser in the user agent. The screenshot is from my Nginx logs. If your page is behind Cloudflare you can see metrics and choose which crawlers to block under AI Crawl Control > Overview and Security respectively.

1 likes 1 replies

?

Replies

@shonen-otaku.bsky.social · Jun 17

What is a user agent and what is Nginx logs?