Free AI readiness checker: can ChatGPT, Claude and Perplexity read your site?
Paste a URL. We fetch the page as a normal browser and as each AI crawler (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot), then read your robots.txt, structured data and sitemap. You get concrete findings and fixes, not a made-up "AI visibility score". Free, no sign-up.
What to fix
Each AI crawler, fetched for real
| Bot | Used for | Fetch | robots.txt |
|---|
What a crawler sees without JavaScript
Readable by AI is step one. The page still has to convert. PageCritic audits the page itself (headline, CTA, proof, mobile, speed) and gives you a score and your top 3 fixes, free.
What this checks
- Blocked AI crawlers: we request your page with each bot's published user agent and compare the answer with a normal browser's. A 403 or a "Just a moment..." challenge page means that bot can't read you. Cloudflare and other CDNs can block AI bots with one setting, and many sites have it on without knowing.
- robots.txt rules for GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended and CCBot. Training bots and search bots are different: blocking GPTBot or ClaudeBot keeps your pages out of training data, but blocking OAI-SearchBot, Claude-SearchBot or PerplexityBot keeps you out of AI search answers.
- Content without JavaScript: most AI crawlers don't run JavaScript. If your page is a client-rendered app shell, they see an empty page. We count the readable words in the raw HTML.
- Structured data: JSON-LD such as Organization, SoftwareApplication or Product, Offer with a price, and FAQPage tells machines what you sell and for how much.
- Sitemap, canonical URL and lang: the basics that help any crawler find the right page.
- Markdown and llms.txt: some sites serve a Markdown version (
Accept: text/markdown) or an/llms.txtfile. These are optional and unproven: no major AI search engine has said it uses llms.txt, and Google says you don't need it. We show them for information only.
We fetch your page, robots.txt, sitemap.xml and llms.txt about 11 times in total, from a server in a datacenter, like the real bots. Some sites treat all datacenter traffic differently, so a block here can also mean "blocks servers", which hits AI crawlers just the same. Only the URL is kept, in our usage log.
More free tools: meta tag checker, OG image checker, headline analyzer, CTA checker.