check_ai_crawlers

Reads a website's robots.txt and reports, for 11 AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended, Meta-ExternalAgent, CCBot, Bytespider), whether each may reach the given page. Separates AI search crawlers (decide if the site appears in ChatGPT, Claude and Perplexity answers) from training crawlers. Also reports llms.txt and declared sitemaps.

read-only

Argument	Type	Description
url*	string	Website or page address, e.g. example.com or https://example.com/pricing

Input schema (JSON)

{
  "type": "object",
  "required": [
    "url"
  ],
  "properties": {
    "url": {
      "type": "string",
      "description": "Website or page address, e.g. example.com or https://example.com/pricing"
    }
  },
  "additionalProperties": false
}

explain_ai_crawler

Explains what an AI crawler user agent does (operator, purpose, and what blocking it in robots.txt changes). Pass a name such as GPTBot or OAI-SearchBot, or omit it to list all crawlers Siteiz tracks.

read-only

Argument	Type	Description
name	string	Crawler user agent, e.g. GPTBot. Omit to list all.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "name": {
      "type": "string",
      "description": "Crawler user agent, e.g. GPTBot. Omit to list all."
    }
  },
  "additionalProperties": false
}

get_ai_visibility_report

Returns a published, dated Siteiz AI visibility report for a well-known company's homepage (score, grade, pillar scores, top issues). Omit the company to list all published reports.

read-only

Argument	Type	Description
company	string	Company name, e.g. Notion. Omit to list all reports.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "company": {
      "type": "string",
      "description": "Company name, e.g. Notion. Omit to list all reports."
    }
  },
  "additionalProperties": false
}

view_page_as_ai_crawler

Fetches one page the way most AI crawlers do (plain HTTP, no JavaScript) and reports what they actually receive: title, meta description, canonical, H1, heading count, structured data types, visible word count, token reading cost, and a text preview. Use it to check whether content is visible to AI without JavaScript.

read-only

Argument	Type	Description
url*	string	Website or page address, e.g. example.com or https://example.com/pricing

Input schema (JSON)

{
  "type": "object",
  "required": [
    "url"
  ],
  "properties": {
    "url": {
      "type": "string",
      "description": "Website or page address, e.g. example.com or https://example.com/pricing"
    }
  },
  "additionalProperties": false
}

Siteiz

Try it

check_ai_crawlers Read-only

Tools

Siteiz

Try it

check_ai_crawlers Read-only

Tools