Free tool
Can ChatGPT, Claude and Perplexity read your website?
Enter your address. We read your robots.txt the way each AI crawler does and tell you which of 13 bots can get in, and whether you publish llms.txt.
Questions
Showing up in AI answers starts with letting the right bots in. Answering your own visitors is the other half.
Should I block GPTBot?
GPTBot collects pages to train OpenAI's models. Blocking it is a business choice and does not remove you from ChatGPT search, which uses OAI-SearchBot. If you want to show up as a source in ChatGPT answers, keep OAI-SearchBot and ChatGPT-User allowed.
Does blocking Google-Extended hurt my Google ranking?
No. Google-Extended only controls whether Gemini and Google's AI models can use your content. Google Search crawling is done by Googlebot, which is not affected.
What is llms.txt?
A plain-text file at /llms.txt that lists your most useful pages with short descriptions, so AI assistants can understand your site without parsing every page. It is a proposed standard, not a ranking factor, but it is cheap to publish.
What does this tool check?
It downloads your robots.txt and llms.txt (nothing else), applies the standard robots.txt matching rules to each AI crawler's user-agent token for your homepage, and flags bots that are blocked or partly blocked. It doesn't see firewall or CDN bot rules, which can block crawlers even when robots.txt allows them.
Answer your visitors as well as the bots.
Replied trains an AI agent on your pages in about a minute, cites its sources and hands tricky chats to your team.