Free beta · No account required

Make your website
readable by AI agents

Enter a URL. Get your Agent Readiness Score, a custom llms.txt, and a live MCP endpoint — in under 90 seconds.

Results sent to your email · Takes 30–90 seconds

How it works

Three steps to agent-ready.

1

Crawl

IndexedAI scrapes up to 6 pages, reads robots.txt and sitemap.xml, detects API endpoints and documentation links.

2

Score & Generate

Your Agent Readiness Score is calculated across 5 axes. Claude then generates a tailored llms.txt and llms-full.txt.

3

Get your MCP endpoint

Your site gets a live MCP server. Connect Claude Desktop, Cursor, or any AI client with a single JSON config — no extra setup.

~60s
Average analysis time
MCP
Endpoint per site
5
Readiness axes scored

What you get

Your site, measured.

Every report breaks down readiness across 5 axes that matter to AI agents, LLM pipelines, and search assistants.

Agent Readiness Report — stripe.com

Score

69
/ 100
Partially Ready
Discoverability15/20
robots.txt foundsitemap.xml found4 pages crawledNo llms.txt yet
Parsability18/20
Title presentMeta description > 50 charsH1 structure clearHomepage > 500 words
Token Efficiency12/20
Content < 50k wordsNavigation < 20 linksPossible duplicate content
Capability Signaling10/20
API endpoints detectedPricing page foundNo /docs detected
Access Control14/20
All pages publicly accessibleNo AI bot rules in robots.txt

MCP endpoint

Your site, ready for any AI agent.

Connect Claude Desktop, Cursor, GPT, or any MCP client in seconds. No custom integrations, no API keys to manage.

MCP Configuration — Claude Desktop

Built-in MCP tools

get_index

Get the structured llms.txt index of this site. Call this first — shows site purpose, sections, and important pages.

fetch_pageurl: string

Fetch the full text content of any page on this site. Returns clean readable text, no HTML.

get_full_context

Extended context: all major sections, API endpoints, pricing, capabilities, and FAQ.

Pro plans also get site-specific dynamic tools — auto-generated from your crawl data.

Paste into Claude Desktop config

{
  "mcpServers": {
    "your-domain.com": {
      "url": "https://indexedai.tech/api/mcp/{id}",
      "transport": "streamable-http"
    }
  }
}

Works with any MCP-compatible client: Claude Desktop, Cursor, Continue, Cline and more.

Analytics

Know which AI agents visit your site.

Every MCP tool call is logged. See how AI traffic trends over time and which models are reading your content.

AI visits

Last 30 days

284

+34% vs prev period

AI agents

AgentVisitsLast seen
Claude/3.7-Sonnet1422025-06-05
GPT-4o (OpenAI)872025-06-04
PerplexityBot/1.0342025-06-03
Cursor/0.48.0212025-06-01

284 AI visits total

Upgrade to Pro to see agent breakdown

See plans
/

Claude Code skill

Query any IndexedAI site directly from Claude Code

/indexedai domain.com your question — fetches structured MCP data instead of raw HTML. Zero context overhead: MCP loads only when invoked.

View on GitHub

Sample output

This is what lands in your inbox.

Score breakdown + two ready-to-deploy files: llms.txt and llms-full.txt.

Your Agent Readiness Report — stripe.com

From: IndexedAI <results@indexedai.tech>

Score breakdown

Total69/100
Discoverability15/20
Parsability18/20
Token Efficiency12/20
Capability Signaling10/20
Access Control14/20
Your site is well-structured but missing llms.txt and AI bot rules in robots.txt. Deploy the attached files to boost agent discoverability.

llms.txt preview

# Stripe
> Online payment infrastructure for the internet.
> Millions of companies use Stripe to accept payments,
> send payouts, and manage their businesses online.
## Core Products
- [Payments](https://stripe.com/payments): Accept and optimize payments globally
- [Billing](https://stripe.com/billing): Subscriptions and recurring revenue
- [Connect](https://stripe.com/connect): Payments for platforms and marketplaces
## API & Docs
- [API Reference](https://stripe.com/docs/api): Complete REST API documentation
- [Quickstart](https://stripe.com/docs/quickstart): Integrate in minutes

Pricing

Simple, transparent pricing.

Start free. Upgrade when you need more sites or analytics.

Free

$0/month
  • 1 site
  • MCP endpoint
  • Agent Readiness Score
  • llms.txt generation
Get started free
Most popular

Pro

/month
  • 5 sites
  • MCP endpoint per site
  • Agent Readiness Score
  • llms.txt + llms-full.txt
  • Priority processing
  • Analytics dashboard
Get started

Agency

/month
  • 10 sites
  • MCP endpoint per site
  • Agent Readiness Score
  • llms.txt + llms-full.txt
  • Priority processing
  • Analytics dashboard
Coming soon

Payments processed securely by Stripe. Cancel anytime.

FAQ

Questions

What is llms.txt?

llms.txt is a plain-text file at the root of your website (/llms.txt) that tells AI agents what your site is about, what pages matter, and how to navigate your content efficiently. Think robots.txt — but for LLMs.

What is an MCP endpoint?

MCP (Model Context Protocol) is an open standard for connecting AI agents to external data sources. IndexedAI generates a unique MCP server URL for each site — paste it into Claude Desktop, Cursor, or any MCP client and your AI agent can instantly read and navigate your site.

Why can't AI agents read most websites?

Modern websites are built for browsers: heavy JavaScript, nav menus, cookie banners, marketing noise. AI agents parse raw content and get lost in structure that wasn't designed for machine reading. llms.txt gives them a clean, structured entry point.

How does AI visit tracking work?

Every time an AI agent calls your MCP endpoint, IndexedAI logs the tool name, timestamp, and user-agent. Free users see total visit counts. Pro users unlock the full agent breakdown — see exactly which AI systems (Claude, GPT, Perplexity) are accessing your site and how often.

How long does the analysis take?

Usually 30–90 seconds. We crawl up to 6 pages, score across 5 axes, then generate a tailored llms.txt using AI. Results land in your inbox the moment it's done — no waiting around.

Is it free?

Yes — the Free plan includes 1 site, an MCP endpoint, Agent Readiness Score, and llms.txt generation at no cost. Pro ($9.99/mo) unlocks up to 5 sites, analytics, and priority processing.

Ready to get indexed?

Free during beta. No account. No credit card.

Or view pricing plans