See what ChatGPT, Claude and Perplexity can read on your site, fix what they can't, and track whether they mention you.

The exact fix for whatever blocks them, plus the rest of the all-in-one AI GEO toolkit.

No login required. Checks 50+ AI crawlers.

The bigger question · Free to start, no card

Are AI systems actually mentioning you?

The readiness check answers “can AI read my site?” That's the pre-flight. The LLM Monitor answers the question that actually pays: “does ChatGPT, Claude, Perplexity, and Google AI mention my brand when customers ask?” — with competitor share-of-voice tracked over time.

Two kinds of measurement, labelled on every result: live search (Perplexity and Google AI Overviews search the web for each prompt) and model knowledge (what ChatGPT and Claude answer from training, via their APIs). How the Monitor works →

Trend card from a sample Monitor project: share of voice goes from 38% to 70% over 8 weekly runs, Aug 10 to Sep 28, with a line each for ChatGPT, Claude, Perplexity and Google AI Overviews.Latest run card from the same sample project. For the prompt “Best light roast coffee subscription?”, ChatGPT mentioned the brand in 3 of 3 answers and Google AI Overviews did not mention it. The first answer is open, showing its text, the competitors it named and the date of the run.
A project's page with sample data (a made-up coffee brand and competitors). Each result is labelled by how it was measured: Live search (Perplexity, Google AI Overviews) or Model knowledge (ChatGPT, Claude).
1
Ask what your customers ask

Add the real prompts your buyers might type into ChatGPT or Claude — 3 on the free tier, 15 on Pro.

2
We run them against the AI systems

Free covers Claude and ChatGPT (model knowledge), run whenever you like. Pro adds Perplexity and Google AI Overviews (live search) and runs them for you, weekly or daily.

3
See share of voice trend

A chart of how often each AI system mentions you, run over run, plus a count of which competitors the answers named.

$29/mo
Pro
Everything in Pro:
  • All four engines — Claude, ChatGPT, Perplexity & Google AI
  • Competitor share-of-voice, tracked over time
  • A real free tier — start without a card
A fraction of the $95–99/mo alternatives.
Try free (3 prompts included) →
Get the Crawl Readiness ExtensionCheck any site's AI readiness in one click — free on the Chrome Web Store

What you can do

  • Check — free, no signup. AI-readiness score (0–100), per-crawler allow/deny status, robots.txt / llms.txt / structured-data analysis, a ranked fix list, and a free embeddable badge.
  • Fix — free account. Auto-generate the files you're missing — llms.txt, an AI-crawler robots.txt policy, and JSON-LD schema. The ready-to-ship file, not just a to-do list. (Higher volume on Pro.)
  • Monitor — free to start. Track whether AI assistants mention your brand for your customers' questions — share-of-voice, position, and trends. Free covers 1 brand, 3 prompts and 4 runs a month against Claude & ChatGPT.(Perplexity, Google AI Overviews, automatic weekly or daily runs and more projects on Pro/Agency.)
  • Run it from your IDE. The Crawl Readiness MCP server puts checks, generators & monitoring inside Claude Desktop, Cursor, Cline & Windsurf.

Why AI readiness matters

As AI chat and answer engines replace traditional search, your website's visibility depends on whether AI systems can actually access and understand your content. If GPTBot, ClaudeBot, or PerplexityBot are blocked or can't parse your pages, users asking those AI tools about your business will get nothing — or worse, your competitor's answer.

What Crawl Readiness checks

  • 50+ AI crawlers — robots.txt access per bot across OpenAI, Anthropic, Google, Perplexity, xAI, Microsoft, Meta, Mistral, and every other major provider
  • llms.txt and llms-full.txt — the emerging AI-native content standard
  • Structured data — JSON-LD schema so AI can extract clean facts
  • Meta robots and X-Robots-Tag — page-level and header-level indexing directives
  • Open Graph tags — supporting signals AI systems use to cite your content
  • Sitemap directives and RSS/Atom feeds — content discovery signals
  • agents.json — an emerging standard for describing AI-friendly endpoints

How Crawl Readiness works

  1. Paste any URL into the box above (no signup required)
  2. We fetch your robots.txt, llms.txt, agents.json and homepage, then evaluate the robots rules for each of 50+ AI crawler user-agents
  3. You get a 0-100 AI readiness score with per-crawler status and specific fixes ranked by impact

Frequently asked questions

What is AI readiness?

AI readiness measures how easily AI systems like ChatGPT, Claude, and Perplexity can access, read, and understand a website. It looks at robots.txt, llms.txt, structured data, meta tags, and other signals that let AI crawlers index your content.

Which AI crawlers does Crawl Readiness check?

50+ AI crawlers across every major provider — including GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, Google-Extended, PerplexityBot, GrokBot, Copilot, Meta-ExternalAgent, Bytespider, Applebot, DeepSeekBot, MistralAI-User, CCBot, DuckAssistBot, and more.

Is Crawl Readiness free?

Yes — you can check any website with no signup, subject to fair-use rate limits. Free accounts get 50 checks per month with detailed reports. Paid Pro ($29/mo) and Agency ($99/mo) plans cover higher volumes.

How do I make my website AI-ready?

Allow AI crawlers in robots.txt, add an llms.txt file describing your site, use JSON-LD structured data, set Open Graph tags, and make sure key content is server-rendered so crawlers that don't execute JavaScript can still read it. Run a check above to see exactly what to fix on any site.

What is llms.txt?

llms.txt is an emerging web standard — a Markdown file at the root of your site that summarizes what your site is about in a format AI systems can efficiently read. It complements robots.txt by describing your content rather than restricting it.