Find out which AI assistants are allowed to read your site.

We read your robots.txt the way each assistant reads it, and tell you which ones you are letting in and which ones you are turning away.

Every AI assistant crawls with its own named agent, and your robots.txt can allow one while blocking another. Most owners have never checked, and a single stray rule can remove you from an assistant entirely.

What this checks

Eight named agents, read individually

GPTBot, ClaudeBot, PerplexityBot, Google-Extended, meta-externalagent, Amazonbot, Applebot-Extended and Microsoft. Each one is matched against your rules the way that engine matches them, including wildcard fallthrough.

The rule that decided it

For every engine we show which line matched and what it says, so a block is something you can go and fix rather than a verdict you have to trust.

Whether you have an llms.txt

A newer convention for telling assistants what your site is about. We report whether yours exists, not whether you should have one.

What it cannot tell you

Whether an assistant actually reads you

robots.txt is permission, not traffic. Being allowed in is not the same as being visited, and no robots file can make an assistant care.

Whether you will be cited

Being readable is the entry requirement. What gets quoted depends on whether your pages answer the question someone asked.

The other free tools

Each one answers a different question about the same site.

  • llms.txt Generator - We read your site and write the file, using your real titles, descriptions and structure. Nothing is invented and nothing is a template.
  • Schema Markup Checker - We read every JSON-LD block on the page, name the types you have declared, and list the required properties that are not there.
  • AI Overview Readiness - Assistants lift short, direct answers that sit under a clear question. We score how easy your page makes that, and show every point.

Every free tool we run