# Crawl Readiness

> Check whether AI crawlers can read a website, generate the files that fix what's blocked, and monitor whether AI assistants actually mention a brand.

Crawl Readiness is an AI-SEO / GEO (generative engine optimization) toolkit. The free readiness check evaluates a site's robots.txt against 50+ AI crawler user-agents (ChatGPT, Claude, Perplexity, Google AI, Grok, Copilot, Meta AI, Apple Intelligence and more), looks for llms.txt, agents.json, JSON-LD structured data, meta and X-Robots-Tag directives, Open Graph tags and Content-Signal directives, then returns a 0-100 score with fixes ranked by impact. No signup is needed for the check.

Operated by Tundrastone, an Ontario, Canada business.

## What it does

- [AI readiness check](https://www.crawlreadiness.com/): free, no signup. Score, per-crawler allow/block status, ranked fixes, shareable report card, embeddable badge. Single URL or a batch of up to 10.
- [LLM Monitor](https://www.crawlreadiness.com/dashboard/monitor): runs your customers' questions against AI assistants and tracks brand mentions, position, sentiment and competitor share of voice over time. Free tier: 1 brand, 3 prompts, 4 runs a month on Claude and ChatGPT. Pro and Agency add Perplexity, Google AI Overviews and automatic weekly or daily runs.
- [MCP server](https://www.crawlreadiness.com/mcp): the same checks, generators and monitor data inside Claude Desktop, Cursor, Cline and Windsurf. npm package `crawl-readiness-mcp`.
- [Chrome extension](https://chromewebstore.google.com/detail/jcmhfmdgkkjjjfngbkoonaidbonhhhho): check the site in the current tab.

## Tools

- [llms.txt Generator](https://www.crawlreadiness.com/tools/llms-txt): builds an llms.txt from a site's pages (free account)
- [Schema Wizard](https://www.crawlreadiness.com/tools/schema-wizard): generates JSON-LD structured data (free account)
- [robots.txt Generator](https://www.crawlreadiness.com/tools/robots-txt): builds an AI-crawler policy and merges it into an existing robots.txt (free account)
- [Schema Validator](https://www.crawlreadiness.com/tools/schema-validator): validates JSON-LD on a page (no signup)
- [robots.txt Validator](https://www.crawlreadiness.com/tools/robots-validator): checks robots.txt syntax and AI-crawler rules (no signup)
- [Content Parity Checker](https://www.crawlreadiness.com/tools/parity): compares what browsers and AI crawlers are served (no signup)

## Docs

- [Methodology](https://www.crawlreadiness.com/methodology): every check, its exact point weight, what each grade means, and what the score deliberately does not measure
- [What is generative engine optimization (GEO)?](https://www.crawlreadiness.com/generative-engine-optimization)
- [Is my website AI ready?](https://www.crawlreadiness.com/is-my-website-ai-ready)
- [Blog](https://www.crawlreadiness.com/blog): guides on llms.txt, robots.txt for AI crawlers, and GEO vs SEO
- [Leaderboard](https://www.crawlreadiness.com/leaderboard): public ranking of checked sites
- [About](https://www.crawlreadiness.com/about): who runs it, data handling, security contact

## API

- Endpoint: `GET https://www.crawlreadiness.com/api/check?url=example.com`
- Returns JSON: score, per-crawler results, detected files and signals, ranked fixes, and a shareable report id
- Anonymous use is rate limited. A free account provides an API key (`x-api-key` header) with 50 checks a month; Pro ($29/mo) has 1,000 and Agency ($99/mo) has 5,000.

## Optional

- [Full documentation for LLMs](https://www.crawlreadiness.com/llms-full.txt)
- [Privacy policy](https://www.crawlreadiness.com/privacy)
- [Terms of service](https://www.crawlreadiness.com/terms)