Free tool
AI Crawler Checker
Enter your site and we read its live robots.txt, then show which AI crawlers it lets in. If an assistant cannot crawl you, it cannot cite you.
Enter a site to see which AI crawlers its robots.txt allows.
Get this written up for your developer
The result is on the page already. Add your email and we will send the fix in plain language, plus the next checks worth running.
What this means
AI assistants read your site with named crawlers, and your robots.txt decides whether they are allowed in. Block GPTBot and OpenAI cannot use your pages. Block Google-Extended and you opt out of Gemini. Most sites block these by accident, copied from a template.
A missing robots.txt is not a problem here. No file means nothing is disallowed, so every crawler is welcome. A problem looks like an explicit Disallow: / under an AI user-agent.
Being crawlable is step one, not the whole job. Once assistants can read you, the work is making your pages easy to quote: clean facts, plain sentences, and consistent entities.
See what is broken on your website
Get a free technical SEO audit. Real checks on your real site, with fixes your developer can act on. No sales call required.
This checked one thing. The full audit checks forty.