Paste a domain and see which AI crawlers its robots.txt blocks, across training, search and user-fetch bots from OpenAI, Anthropic, Perplexity and Google. The check runs on a Cloudflare Worker, nothing is stored, and results are cached for 24 hours.
P.S. This isn’t the final version, just a mockup of what’s to come in a few days.
A robots.txt file is a request, not enforcement. Your CDN and firewall rules decide who actually gets in.