Dirproof

Free tool

AI SEO checker

Can ChatGPT, Claude, Perplexity and Google read your site, and do they get a clear picture of it? Enter your address to check AI search readiness and the SEO basics in one go.

We read that page, your robots.txt, llms.txt, sitemap and up to 5 internal links once. We respect robots.txt, do not crawl and do not store the address. A few checks a day per visitor.

What it checks

AI search readiness

  • Which AI crawlers your robots.txt lets in: search crawlers (ChatGPT search, Claude, Perplexity, Bing, Google) and training crawlers
  • Whether your main text is in the HTML or only appears after JavaScript runs
  • Structured data (schema.org JSON-LD)
  • llms.txt, snippet settings and clear sections

Search engines (SEO)

  • Title and meta description length
  • One clear H1, canonical address, language, mobile viewport
  • noindex, sitemap, robots.txt, HTTPS
  • Social preview, favicon, image alt text, response time and broken internal links

AI crawlers in robots.txt, in one minute

AI companies use different crawlers for different jobs. Blocking the wrong one can take you out of AI answers without you noticing.

robots.txt nameWhat it doesIf you block it
OAI-SearchBot, ChatGPT-UserChatGPT search and pages people open from ChatGPTChatGPT cannot read your page to cite it
Claude-SearchBot, Claude-UserClaude's search and pages people ask Claude to readClaude cannot read your page for answers
PerplexityBot, Perplexity-UserPerplexity searchPerplexity cannot cite your page
Googlebot, BingbotGoogle Search, AI Overviews, Bing and CopilotYou disappear from normal search too
GPTBot, ClaudeBot, Google-Extended, CCBotCollect data to train modelsYour content is not used for training; AI search answers are not affected

robots.txt is only part of the picture: some hosts block AI crawlers at the firewall (for example Cloudflare's "Block AI bots" setting). Check that setting in your host's dashboard too.

Questions

What is AI SEO?

AI SEO (also called GEO or AEO) means making your site easy for AI search tools such as ChatGPT search, Claude, Perplexity, Copilot and Google AI Overviews to read, understand and cite. The basics are the same as classic SEO: let the crawlers in, put your main text in the HTML, describe your page clearly and add structured data.

Should I block GPTBot and other AI crawlers?

It depends on which ones. Crawlers like GPTBot, ClaudeBot and Google-Extended collect data to train models; blocking them is a choice and does not remove you from AI search answers. Crawlers like OAI-SearchBot, Claude-SearchBot and PerplexityBot fetch pages for search answers; if you block them, those tools cannot read your page to cite or recommend it.

Does llms.txt help?

llms.txt is a proposed standard: a short Markdown file at /llms.txt that summarises your site for AI tools. Few tools read it today, so it will not move rankings on its own, but it is quick to add and does no harm. Our free llms.txt generator writes one for you.

Is the checker free?

Yes. You can run a few checks a day without signing up. It reads only the page you enter, your robots.txt, llms.txt, sitemap and a few internal links, respects robots.txt and does not crawl your site. We do not store the address.

Being readable is step one. Being mentioned is step two.

AI tools and search engines recommend sites that other sites talk about. Dirproof Pro gives you a hand-checked list of places to get listed with a ready text for each, this site check without the daily limit, copy-paste structured data, and an AI-written title and description.

Want to know if AI assistants already mention you? Try the free AI visibility checker. New to backlinks? Read how to increase Domain Rating (DR): what works and what to avoid.

See Dirproof Pro Free dofollow checker