Free tool

Can AI assistants read your site?

When someone asks ChatGPT, Claude, or Perplexity for a recommendation, their crawlers have to be able to read your site — or you can't be part of the answer. Check 14 AI crawlers in one scan. Free, no signup.

What this checks

AI assistants send crawlers to read websites for two reasons: to answer questions live (like OAI-SearchBot and PerplexityBot) and to train future models (like GPTBot and ClaudeBot). Your robots.txt file decides which ones get in. Many sites block AI crawlers without realizing it — often from a copied robots.txt or an overzealous plugin — and silently disappear from AI answers.

This tool reads your live robots.txt and reports the access status of 14 crawlers run by ChatGPT, Claude, Perplexity, Gemini, Apple Intelligence, Meta AI, and others. It also checks for an llms.txt file and structured data — the things that help assistants understand and cite your site once they can read it. Curious what AI traffic looks like across the web? See our live AI Traffic Report.