Check declared robots.txt permissions for six AI crawlers at URL paths
Maintain this server? Claim it
Call this server's tools from your browser. Nothing to install.
Optional: 'Bearer <your Apify API token>'. MCP clients that support OAuth can sign in to Apify instead. Runs are billed to your Apify account at the pay-per-event prices on the Actor's store page.
Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.
Pick your client. Values in capitals, like YOUR_TOKEN, are yours to fill in.
claude mcp add --transport http ai-crawler-access-check 'https://mcp.apify.com/?tools=hermeskd/ai-crawler-access-check'
Headers
Authorization (optional, not in the config above): Optional: 'Bearer <your Apify API token>'. MCP clients that support OAuth can sign in to Apify instead. Runs are billed to your Apify account at the pay-per-event prices on the Actor's store page.We haven't seen a tool list from this server yet.