AI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.
Maintain this server? Claim it
Call this server's tools from your browser. Nothing to install.
Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.
Tool list from our last check. Connect live to refresh it.
Check a site's AI search visibility: which AI crawlers (OAI-SearchBot, PerplexityBot, GPTBot, ClaudeBot and more) robots.txt allows, whether the homepage ships readable text without JavaScript, and whether an llms.txt exists.
A site to check, e.g. example.com or https://example.com
This tool isn't marked read-only, so it may change something on the server or in an account you connected.
Check a site's AI search visibility: which AI crawlers (OAI-SearchBot, PerplexityBot, GPTBot, ClaudeBot and more) robots.txt allows, whether the homepage ships readable text without JavaScript, and whether an llms.txt exists.
| Argument | Type |
|---|
| Description |
|---|
| url* | string | A site to check, e.g. example.com or https://example.com |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "A site to check, e.g. example.com or https://example.com"
}
}
}Generate an llms.txt file from a site's real pages and sitemap.
| Argument | Type | Description |
|---|---|---|
| url* | string | A site to generate an llms.txt for |
| credit | boolean | Include a one-line attribution back to this tool. Default true. |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "A site to generate an llms.txt for"
},
"credit": {
"type": "boolean",
"description": "Include a one-line attribution back to this tool. Default true."
}
}
}Lint a robots.txt for AI-crawler-specific mistakes. Pass url to fetch it live, or robots_txt to lint pasted text directly.
| Argument | Type | Description |
|---|---|---|
| url | string | A site whose /robots.txt should be fetched and linted |
| robots_txt | string | Raw robots.txt text to lint directly, instead of fetching url |
{
"type": "object",
"properties": {
"url": {
"type": "string",
"description": "A site whose /robots.txt should be fetched and linted"
},
"robots_txt": {
"type": "string",
"description": "Raw robots.txt text to lint directly, instead of fetching url"
}
}
}Validate an existing llms.txt against the spec.
| Argument | Type | Description |
|---|---|---|
| url* | string | A site whose /llms.txt should be fetched and validated |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "A site whose /llms.txt should be fetched and validated"
}
}
}