Am I Crawlable

Can AI crawlers reach your site?

Check whether GPTBot, ClaudeBot, PerplexityBot and search crawlers are allowed — by robots.txt AND by your server, in one pass.

Only check sites you own or are authorized to test. We fetch the target's robots.txt and homepage a few times; the URL is not stored.

How it works

  1. Enter a URL you own; our server fetches its robots.txt and homepage.
  2. Each crawler's robots.txt verdict is computed against its verified user-agent token.
  3. Each crawler's user-agent is then used to probe the homepage — surfacing server/CDN blocks that robots.txt checkers miss.
  4. Probes are unverified look-alikes (our server, not the crawler's real IPs); the report says so where it matters.

Need the exact published limit for a specific portal? See the requirements directory — every entry cites its official source and verification date.

Can AI crawlers reach your site? · Am I Crawlable