Generate, validate, and deep-crawl /llms.txt and /llms-full.txt files for AI agents.
Maintain this server? Claim it
Call this server's tools from your browser. Nothing to install.
Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.
Tool list from our last check. Connect live to refresh it.
Deep-crawl up to 50 pages of a website to generate a comprehensive /llms-full.txt content index with full body markdown for AI agents. Powered by Agentic Commerce ($9 USD one-time). Returns instant Stripe Checkout link for authorization, or generates full bundle immediately if a payment_session_id is provided.
The website URL to deep-crawl and generate llms-full.txt for (e.g. https://example.com)
Customer/developer email for Stripe invoice and delivery receipt
Optional explicit sitemap.xml URL
Optional paths to exclude
Stripe Payment Intent ID (pi_...) if payment was already completed
Stripe Checkout session ID (cs_...) if payment was already completed
This tool isn't marked read-only, so it may change something on the server or in an account you connected.
Pick your client. Values in capitals, like YOUR_TOKEN, are yours to fill in.
Run in a terminal
claude mcp add --transport http llms-text https://www.llms-text.com/mcp
Deep-crawl up to 50 pages of a website to generate a comprehensive /llms-full.txt content index with full body markdown for AI agents. Powered by Agentic Commerce ($9 USD one-time). Returns instant Stripe Checkout link for authorization, or generates full bundle immediately if a payment_session_id is provided.
| Argument | Type | Description |
|---|---|---|
| url* | string | The website URL to deep-crawl and generate llms-full.txt for (e.g. https://example.com) |
| string | Customer/developer email for Stripe invoice and delivery receipt | |
| sitemapUrl | string | Optional explicit sitemap.xml URL |
| excludePaths | array | Optional paths to exclude |
| payment_intent_id | string | Stripe Payment Intent ID (pi_...) if payment was already completed |
| payment_session_id | string | Stripe Checkout session ID (cs_...) if payment was already completed |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "The website URL to deep-crawl and generate llms-full.txt for (e.g. https://example.com)"
},
"email": {
"type": "string",
"description": "Customer/developer email for Stripe invoice and delivery receipt"
},
"sitemapUrl": {
"type": "string",
"description": "Optional explicit sitemap.xml URL"
},
"excludePaths": {
"type": "array",
"items": {
"type": "string"
},
"description": "Optional paths to exclude"
},
"payment_intent_id": {
"type": "string",
"description": "Stripe Payment Intent ID (pi_...) if payment was already completed"
},
"payment_session_id": {
"type": "string",
"description": "Stripe Checkout session ID (cs_...) if payment was already completed"
}
}
}Automatically crawl any public website URL and generate a standard, token-efficient index-level /llms.txt file for AI agent context. 100% free with core page categorization, descriptions, and clean markdown.
| Argument | Type | Description |
|---|---|---|
| url* | string | The website URL to crawl and generate llms.txt for (e.g. https://example.com) |
| excludePaths | array | Optional URL path keywords to exclude |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "The website URL to crawl and generate llms.txt for (e.g. https://example.com)"
},
"excludePaths": {
"type": "array",
"items": {
"type": "string"
},
"description": "Optional URL path keywords to exclude"
}
}
}Validate any public llms.txt or llms-full.txt file URL for standard compliance, missing H1, broken links, structure errors, and token count.
| Argument | Type | Description |
|---|---|---|
| url* | string | The llms.txt or llms-full.txt file URL to validate (e.g. https://example.com/llms.txt) |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "The llms.txt or llms-full.txt file URL to validate (e.g. https://example.com/llms.txt)"
}
}
}We read every tool's name, description and inputs the way the model will, looking for instructions hidden from you. A clean result means no warning signs, not a guarantee. Scanned Nov 11, 2026.
No readOnlyHint / destructiveHint annotations, so clients can't tell a read from a write without asking.
Fix: Add annotations to each tool, e.g. { readOnlyHint: true } for tools that only read.