Agent security: prompt injection, PII & secret scans, TLS/header/CORS audits, MCP checks. Free.
Maintain this server? Claim it
Call this server's tools from your browser. Nothing to install.
Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.
Tool list from our last check. Connect live to refresh it.
Analyse a set of LLM responses generated from the same prompt template but with different demographic variants (gender, origin, age, tone). Returns a bias score (0-100), sentiment analysis per variant, pairwise Jaccard similarity, and a human-readable verdict. No API key needed — runs entirely locally.
Array of variant responses to compare for bias
Analyse a set of LLM responses generated from the same prompt template but with different demographic variants (gender, origin, age, tone). Returns a bias score (0-100), sentiment analysis per variant, pairwise Jaccard similarity, and a human-readable verdict. No API key needed — runs entirely locally.
| Argument | Type | Description |
|---|---|---|
| responses* | array | Array of variant responses to compare for bias |
{
"type": "object",
"required": [
"responses"
],
"properties": {
"responses": {
"type": "array",
"items": {
"type": "object",
"required": [
"variantId",
"answer"
],
"properties": {
"answer": {
"type": "string",
"description": "The LLM response text for this variant"
},
"variantId": {
"type": "string",
"description": "Identifier for the demographic variant (e.g. \"male\", \"female\", \"western\", \"young\")"
}
}
},
"minItems": 2,
"description": "Array of variant responses to compare for bias"
}
}
}Audit the security attributes of cookies set by any URL. Fetches the URL and inspects all Set-Cookie headers for: HttpOnly, Secure, SameSite, Domain scope, Path scope, Max-Age/Expires, __Host-/__Secure- prefixes. Flags insecure patterns: missing HttpOnly on session cookies, missing Secure flag, SameSite=None without Secure, overly broad Domain, and excessive TTL. Returns per-cookie grades and an overall security score (0–100) — the score is the WEAKEST cookie, not the average, so one leaking session cookie cannot be averaged into a green result (average_score is reported separately).
| Argument | Type | Description |
|---|---|---|
| url* | string | Full URL to audit (e.g. https://example.com/login) |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "Full URL to audit (e.g. https://example.com/login)"
}
}
}Check the CORS configuration of a URL the same way a browser would. Returns the main response status, all Access-Control-* headers, the tested origin, and the preflight OPTIONS response. Use this for direct CORS debugging, not just security auditing.
| Argument | Type | Description |
|---|---|---|
| url* | string | Full URL to test, e.g. https://api.example.com/resource |
| method | string | HTTP method to simulate (default: GET) |
| origin | string | Origin header to simulate (default: https://yourdomain.com) |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "Full URL to test, e.g. https://api.example.com/resource"
},
"method": {
"type": "string",
"description": "HTTP method to simulate (default: GET)"
},
"origin": {
"type": "string",
"description": "Origin header to simulate (default: https://yourdomain.com)"
}
}
}Test a URL for CORS misconfigurations. Sends preflight (OPTIONS) requests with various Origin headers to detect: wildcard origins with credentials, origin reflection (echoing any origin), null origin acceptance, subdomain wildcard bypass, and missing Vary headers. Returns risk level (safe/low/medium/high/critical) plus per-origin results. "unknown" means nothing was actually tested — every origin either failed to connect or answered 5xx, so the target returned no CORS decision; never read it as "safe". A 4xx preflight IS a real result (the server refused it and a browser would fail closed).
| Argument | Type | Description |
|---|---|---|
| url* | string | Full URL to test (e.g. https://api.example.com/endpoint) |
| origin | string | Custom Origin header to test (default: tests multiple origins automatically) |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "Full URL to test (e.g. https://api.example.com/endpoint)"
},
"origin": {
"type": "string",
"description": "Custom Origin header to test (default: tests multiple origins automatically)"
}
}
}Decode a JWT (JSON Web Token) and return its header and payload without verifying the signature. Also reports whether the token is expired and the exact expiry date. Use to inspect claims (sub, iss, exp, roles) during debugging or when integrating with an auth provider.
| Argument | Type | Description |
|---|---|---|
| token* | string | The JWT string to decode (header.payload.signature) |
{
"type": "object",
"required": [
"token"
],
"properties": {
"token": {
"type": "string",
"description": "The JWT string to decode (header.payload.signature)"
}
}
}Scan code or config files for hardcoded secrets: AWS keys, GitHub tokens, OpenAI/Anthropic API keys, Stripe secrets, JWTs, database connection strings, and generic passwords. Returns findings with severity. Run before every commit.
| Argument | Type | Description |
|---|---|---|
| input* | string | Code or config content to scan (max 500KB) |
| filename | string | Optional filename for context (e.g. ".env", "config.js") |
{
"type": "object",
"required": [
"input"
],
"properties": {
"input": {
"type": "string",
"description": "Code or config content to scan (max 500KB)"
},
"filename": {
"type": "string",
"description": "Optional filename for context (e.g. \".env\", \"config.js\")"
}
}
}Search available MCP tools by keyword or category before calling them. Returns matching tool names, descriptions, and optionally their inputSchemas. Call this when you are unsure which tool to use or want to explore the catalogue. Categories: data, encoding, text, llm, qa, rag, dev, security, web.
| Argument | Type | Description |
|---|---|---|
| query* | string | Keyword(s) to search in tool name and description (e.g. "cors", "token", "vector", "json") |
| category | string | Optional: filter by category — data | encoding | text | llm | qa | rag | dev | security | web |
| max_results | number | Maximum tools to return (default 10, max 50). Results are ranked by IDF-weighted relevance, so common words like "test" do not inflate the list. |
| with_schema | boolean | Set true to include inputSchema in results (default: false) |
{
"type": "object",
"required": [
"query"
],
"properties": {
"query": {
"type": "string",
"description": "Keyword(s) to search in tool name and description (e.g. \"cors\", \"token\", \"vector\", \"json\")"
},
"category": {
"type": "string",
"description": "Optional: filter by category — data | encoding | text | llm | qa | rag | dev | security | web"
},
"max_results": {
"type": "number",
"description": "Maximum tools to return (default 10, max 50). Results are ranked by IDF-weighted relevance, so common words like \"test\" do not inflate the list."
},
"with_schema": {
"type": "boolean",
"description": "Set true to include inputSchema in results (default: false)"
}
}
}Validate an LLM function call / tool_use output: check that function name is in allowed list, arguments match expected schema, no extra/missing args. For OpenAI function calling & MCP tool_use testing.
| Argument | Type | Description |
|---|---|---|
| function_call* | object | The function call object from LLM (e.g. { "name": "get_weather", "arguments": {"city":"Paris"} }) |
| allowed_functions* | array | List of allowed function definitions |
{
"type": "object",
"required": [
"function_call",
"allowed_functions"
],
"properties": {
"function_call": {
"type": "object",
"description": "The function call object from LLM (e.g. { \"name\": \"get_weather\", \"arguments\": {\"city\":\"Paris\"} })",
"additionalProperties": true
},
"allowed_functions": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": {
"type": "string"
},
"optional_args": {
"type": "array",
"items": {
"type": "string"
}
},
"required_args": {
"type": "array",
"items": {
"type": "string"
}
}
}
},
"description": "List of allowed function definitions"
}
}
}Compute an HMAC signature for a message using a secret key. Supports SHA-256 (default), SHA-512, SHA-1, and MD5. Used for API request signing, webhook verification (GitHub, Stripe, Twilio), and JWT validation.
| Argument | Type | Description |
|---|---|---|
| secret* | string | Secret key |
| message* | string | Message to sign |
| encoding | string | Output encoding (default: hex) |
| algorithm | string | Hash algorithm: sha256 (default), sha512, sha1, md5 |
{
"type": "object",
"required": [
"message",
"secret"
],
"properties": {
"secret": {
"type": "string",
"description": "Secret key"
},
"message": {
"type": "string",
"description": "Message to sign"
},
"encoding": {
"enum": [
"hex",
"base64",
"base64url"
],
"type": "string",
"description": "Output encoding (default: hex)"
},
"algorithm": {
"type": "string",
"description": "Hash algorithm: sha256 (default), sha512, sha1, md5"
}
}
}Generate a cryptographically secure random password using crypto.randomBytes. Configurable length (4–128), uppercase letters, digits, and symbols. Use when resetting user passwords, seeding test accounts, or generating API secrets.
| Argument | Type | Description |
|---|---|---|
| length | number | Password length (4–128, default: 16) |
| numbers | boolean | Include digits (default: true) |
| symbols | boolean | Include symbols like !@#$ (default: false) |
| uppercase | boolean | Include uppercase letters (default: true) |
{
"type": "object",
"properties": {
"length": {
"type": "number",
"description": "Password length (4–128, default: 16)"
},
"numbers": {
"type": "boolean",
"description": "Include digits (default: true)"
},
"symbols": {
"type": "boolean",
"description": "Include symbols like !@#$ (default: false)"
},
"uppercase": {
"type": "boolean",
"description": "Include uppercase letters (default: true)"
}
}
}Test an LLM response against a set of guardrail rules: must-include, must-not-include, max length, required format, language, forbidden patterns, and custom regex. Returns pass/fail per rule.
| Argument | Type | Description |
|---|---|---|
| rules* | array | Array of guardrail rules to check |
| response* | string | The LLM response to test |
{
"type": "object",
"required": [
"response",
"rules"
],
"properties": {
"rules": {
"type": "array",
"items": {
"type": "object",
"properties": {
"type": {
"enum": [
"must_include",
"must_not_include",
"max_length",
"min_length",
"format",
"regex_match",
"regex_not_match",
"starts_with",
"ends_with",
"word_count_max",
"word_count_min"
],
"type": "string"
},
"label": {
"type": "string",
"description": "Optional human-readable label"
},
"value": {
"type": "string",
"description": "Value for the rule (text, number as string, regex, or format name)"
}
}
},
"description": "Array of guardrail rules to check"
},
"response": {
"type": "string",
"description": "The LLM response to test"
}
}
}Compute a cryptographic hash of a text string. Use when you need to verify data integrity, generate content fingerprints, hash passwords (prefer SHA-256+), or produce a fixed-length digest of any input. Supports SHA-256 (default), SHA-512, SHA-1, and MD5.
| Argument | Type | Description |
|---|---|---|
| input* | string | Text to hash |
| algorithm | string | Hash algorithm: sha256 (default), sha512, sha1, md5 |
{
"type": "object",
"required": [
"input"
],
"properties": {
"input": {
"type": "string",
"description": "Text to hash"
},
"algorithm": {
"type": "string",
"description": "Hash algorithm: sha256 (default), sha512, sha1, md5"
}
}
}Look up detailed information about any HTTP status code: class, name, description, cacheability, typical causes, and handling best practices. Covers every code in the IANA HTTP Status Code Registry (1xx-5xx, including 226, 425, 451, 508, 511 and the WebDAV codes) with its defining RFC; anything outside the registry is reported as `registered: false` rather than described. `cacheable` means heuristically cacheable by default per RFC 9110 §15.1.
| Argument | Type | Description |
|---|---|---|
| code* | number | HTTP status code (e.g. 200, 404, 429, 503) |
{
"type": "object",
"required": [
"code"
],
"properties": {
"code": {
"type": "number",
"description": "HTTP status code (e.g. 200, 404, 429, 503)"
}
}
}Measure response time of one or more HTTP endpoints (GET/POST). Runs N iterations and returns min/max/avg/p95 latency. Useful for API and MCP server benchmarking.
| Argument | Type | Description |
|---|---|---|
| endpoints* | string | array | Endpoints to benchmark. Accepts a single URL string, an array of URL strings, or an array of {url, method?, body?, headers?, label?} objects. |
| iterations | number | Number of iterations per endpoint (default: 3, max: 10) |
{
"type": "object",
"required": [
"endpoints"
],
"properties": {
"endpoints": {
"type": [
"string",
"array"
],
"items": {
"type": "object",
"properties": {
"url": {
"type": "string",
"description": "Full URL to test"
},
"body": {
"type": "object",
"description": "Request body for POST",
"additionalProperties": true
},
"label": {
"type": "string",
"description": "Optional label for this endpoint"
},
"method": {
"enum": [
"GET",
"POST"
],
"type": "string",
"description": "HTTP method (default: GET)"
},
"headers": {
"type": "object",
"description": "Custom headers",
"additionalProperties": true
}
}
},
"description": "Endpoints to benchmark. Accepts a single URL string, an array of URL strings, or an array of {url, method?, body?, headers?, label?} objects."
},
"iterations": {
"type": "number",
"description": "Number of iterations per endpoint (default: 3, max: 10)"
}
}
}Lint an MCP tool definition for best practices: naming conventions, description quality, schema completeness, required fields consistency, description length. Returns actionable warnings.
| Argument | Type | Description |
|---|---|---|
| tool_definition* | object | MCP tool definition object with name, description, inputSchema |
{
"type": "object",
"required": [
"tool_definition"
],
"properties": {
"tool_definition": {
"type": "object",
"description": "MCP tool definition object with name, description, inputSchema",
"additionalProperties": true
}
}
}Run a compliance evaluation against a live MCP server over Streamable HTTP, the way a client meets it. Checks: initialize (protocol version, serverInfo, Mcp-Session-Id carried afterwards), notifications/initialized (202), tools/list with pagination, the spec's tool-definition rules, ping, an unknown method (-32601), one tools/call, GET on the endpoint (SSE or 405), and P50/P95 latency over pings. JSON and SSE answers are both read. Only a tool you name in test_tool_name, or one the server annotates readOnlyHint: true, is called — otherwise the call is skipped and not scored. Returns PASS/FIX/BLOCK with a 0-100 score and per-check details; INCONCLUSIVE (score null) when the server requires authorization, since no credentials are sent. A 301/302 on POST caps the verdict at FIX. The call runs from ia-qa.com: private and local addresses are refused, and stdio servers cannot be reached — for those, paste their tools/list answer into mcp_server_health_check. structuredContent is checked for presence, not validated against outputSchema.
| Argument | Type | Description |
|---|---|---|
| url* | string | Public URL of the MCP endpoint (e.g. https://mcp.example.com/mcp). An origin alone (https://www.ia-qa.com) tries /mcp, then /. |
| test_tool_name | string | Tool to call in the tools/call step. Without it, the first tool annotated readOnlyHint: true is called, or none. |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "Public URL of the MCP endpoint (e.g. https://mcp.example.com/mcp). An origin alone (https://www.ia-qa.com) tries /mcp, then /."
},
"test_tool_name": {
"type": "string",
"description": "Tool to call in the tools/call step. Without it, the first tool annotated readOnlyHint: true is called, or none."
}
}
}Check an MCP server's tool definitions without contacting it — for a server not deployed yet, a stdio server, or a CI gate. Paste the answer to tools/list (raw JSON-RPC or its result), a bare array of tools, one tool definition, or a manifest carrying name/description; input_shape says which one was read. Validates every tool against the MCP spec (name 1-128 chars of A-Z a-z 0-9 _ - .; camelCase and a tool with no parameters are valid; inputSchema of type object; required fields listed in properties) and, with strict, documentation (description ≥ 20 chars, every parameter with a description and a type). verdict: FAIL when a tool breaks a rule or no tool is found, WARN when only a manifest's server name/description is missing, PASS otherwise. A tools/list carries no server name, so those two checks are not scored on it (the name comes from initialize). Gate on verdict or on checks[tool_quality].pass.
| Argument | Type | Description |
|---|---|---|
| strict | boolean | Also require documentation: every description ≥ 20 characters, every parameter with a description and a type. |
| manifest* | string | JSON text: the answer to tools/list (raw JSON-RPC or its result), an array of tools, one tool definition, or a manifest with name/description/tools. |
{
"type": "object",
"required": [
"manifest"
],
"properties": {
"strict": {
"type": "boolean",
"description": "Also require documentation: every description ≥ 20 characters, every parameter with a description and a type."
},
"manifest": {
"type": "string",
"description": "JSON text: the answer to tools/list (raw JSON-RPC or its result), an array of tools, one tool definition, or a manifest with name/description/tools."
}
}
}Parse a raw HTTP headers block into a structured JSON object. Detects multi-value headers, masks Authorization values, and optionally audits for missing security headers (HSTS, CSP, X-Frame-Options, etc.).
| Argument | Type | Description |
|---|---|---|
| headers* | string | Raw HTTP headers (one "Name: Value" per line) |
| analyze_security | boolean | Audit for missing security headers (default: true) |
{
"type": "object",
"required": [
"headers"
],
"properties": {
"headers": {
"type": "string",
"description": "Raw HTTP headers (one \"Name: Value\" per line)"
},
"analyze_security": {
"type": "boolean",
"description": "Audit for missing security headers (default: true)"
}
}
}Scan user input or prompts for common prompt injection patterns. Detects system prompt overrides, jailbreak attempts, role manipulation, encoding tricks, delimiter attacks (chat-template tags `<|im_start|>`/`[INST]`/`<<SYS>>` AND fake role headers imitating markdown or chat separators: "### System:", "--- SYSTEM ---", "---BEGIN SYSTEM OVERRIDE---", "--- SYSTEM:"), template/interpolation injection ({{...}}, ${...}), and context-exfiltration attempts ("repeat everything above"). A match inside quoted or fenced text (documentation citing a payload) is reported one severity level lower and marked `quoted` — never suppressed, since an LLM reading the document as data can still follow a quoted instruction. A quote preceded by a live imperative ("output the following: ...") keeps its full severity.
| Argument | Type | Description |
|---|---|---|
| input* | string | The user input or prompt to scan for injection patterns |
| sensitivity | string | Detection sensitivity (default: medium) |
{
"type": "object",
"required": [
"input"
],
"properties": {
"input": {
"type": "string",
"description": "The user input or prompt to scan for injection patterns"
},
"sensitivity": {
"enum": [
"low",
"medium",
"high"
],
"type": "string",
"description": "Detection sensitivity (default: medium)"
}
}
}Give honest usage feedback on an IA-QA MCP tool. Provide a score (1-5) and a comment. Rate low (1-2) if the tool was wrong, irrelevant, or a poor fit; rate high (4-5) only if it genuinely solved your need. Ratings are aggregated on a public dashboard at /devtools/mcp-ratings. Skip rating routine successes — we want signal, not praise. Example: rate_tool({ tool_name: "format_json", score: 2, comment: "Tried to pretty-print a JSON5 file, it rejected trailing commas — not usable for my case." })
| Argument | Type | Description |
|---|---|---|
| score* | number | Rating from 1 (poor) to 5 (excellent) |
| comment | string | Strongly encouraged — explain what you were trying to do and whether the tool got you there. Be specific about what was missing, wrong, or a poor fit. This is the most valuable part of the rating. Up to 2000 chars are stored; go over and the response says so (truncated: true) — send the remainder as a second call rather than assuming it landed. |
| tool_name* | string | Name of the MCP tool to rate (e.g. "format_json", "shield_analyze") |
{
"type": "object",
"required": [
"tool_name",
"score"
],
"properties": {
"score": {
"type": "number",
"maximum": 5,
"minimum": 1,
"description": "Rating from 1 (poor) to 5 (excellent)"
},
"comment": {
"type": "string",
"description": "Strongly encouraged — explain what you were trying to do and whether the tool got you there. Be specific about what was missing, wrong, or a poor fit. This is the most valuable part of the rating. Up to 2000 chars are stored; go over and the response says so (truncated: true) — send the remainder as a second call rather than assuming it landed."
},
"tool_name": {
"type": "string",
"description": "Name of the MCP tool to rate (e.g. \"format_json\", \"shield_analyze\")"
}
}
}Automatically detect and redact Personally Identifiable Information (PII) from text. Replaces emails, phone numbers, SSNs, credit cards, IP addresses, and JWT tokens with [REDACTED_TYPE] placeholders. Safe to use before logging or sending to an LLM.
| Argument | Type | Description |
|---|---|---|
| input* | string | Text to redact PII from |
| types | string | Comma-separated types to redact (default: all). Options: email, phone, ssn, credit_card, ip_address, jwt |
| marker | string | Custom replacement marker (default: "REDACTED"). Result: [REDACTED_EMAIL] |
{
"type": "object",
"required": [
"input"
],
"properties": {
"input": {
"type": "string",
"description": "Text to redact PII from"
},
"types": {
"type": "string",
"description": "Comma-separated types to redact (default: all). Options: email, phone, ssn, credit_card, ip_address, jwt"
},
"marker": {
"type": "string",
"description": "Custom replacement marker (default: \"REDACTED\"). Result: [REDACTED_EMAIL]"
}
}
}Scan text or code for leaked secrets: API keys (AWS, GCP, Azure, OpenAI, Anthropic, Stripe, GitHub, GitLab, Slack, Twilio, SendGrid, HuggingFace), private keys (RSA/EC/PGP), JWTs, database connection strings, Bearer tokens, and Basic auth headers. Returns a list of findings with type, severity, line number, and a redacted preview. Use before committing code, sharing logs, or sending text to an LLM. 100% regex-based, zero network calls.
| Argument | Type | Description |
|---|---|---|
| input* | string | Text or code to scan for secrets |
| types | string | Comma-separated families to scan (default: all): aws, gcp, azure, openai, anthropic, huggingface, github, gitlab, stripe, slack, twilio, sendgrid, jwt, private_key, connection_string, bearer, basic_auth, generic. Individual pattern names (e.g. "aws_access_key", "github_fine") are also accepted. An unknown value is rejected with an error — a scoped scan never silently returns "clean". |
{
"type": "object",
"required": [
"input"
],
"properties": {
"input": {
"type": "string",
"description": "Text or code to scan for secrets"
},
"types": {
"type": "string",
"description": "Comma-separated families to scan (default: all): aws, gcp, azure, openai, anthropic, huggingface, github, gitlab, stripe, slack, twilio, sendgrid, jwt, private_key, connection_string, bearer, basic_auth, generic. Individual pattern names (e.g. \"aws_access_key\", \"github_fine\") are also accepted. An unknown value is rejected with an error — a scoped scan never silently returns \"clean\"."
}
}
}Analyse the HTTP security headers of a public URL OR of raw response headers you paste in. Grades each header (A–F) for: Strict-Transport-Security, Content-Security-Policy, X-Frame-Options, X-Content-Type-Options, Referrer-Policy, Permissions-Policy, X-XSS-Protection, Cross-Origin-Opener-Policy, Cross-Origin-Resource-Policy, and Cross-Origin-Embedder-Policy. Returns an overall score (0–100), per-header grades, missing headers, and fix snippets for Express, Nginx, and Apache. For localhost/private targets the remote server cannot reach, pass the `headers` parameter instead of `url`.
| Argument | Type | Description |
|---|---|---|
| url | string | Optional. Full public URL to check (e.g. https://example.com). Omit it entirely when using `headers`. The server cannot reach localhost/private IPs. |
| headers | any | Optional, and sufficient on its own (no url needed). The response headers to grade, either as an object {"strict-transport-security": "max-age=...", ...} or as the raw header block pasted as a string (e.g. `curl -sI` output). Use this to audit a local server the remote MCP cannot reach. |
{
"type": "object",
"properties": {
"url": {
"type": "string",
"description": "Optional. Full public URL to check (e.g. https://example.com). Omit it entirely when using `headers`. The server cannot reach localhost/private IPs."
},
"headers": {
"description": "Optional, and sufficient on its own (no url needed). The response headers to grade, either as an object {\"strict-transport-security\": \"max-age=...\", ...} or as the raw header block pasted as a string (e.g. `curl -sI` output). Use this to audit a local server the remote MCP cannot reach."
}
}
}Run a comprehensive AI guardrail analysis on an LLM response. Orchestrates 7 deterministic safety checks plus an optional LLM-powered deep analysis in parallel: hallucination detection (grounding score), prompt injection scan on BOTH the response and the original prompt (reported separately as checks.injection / checks.injection_prompt, scored once at the worse of the two), toxicity scan, output validation (PII/safety), guardrail rules, response quality scoring, and AI verdict (via Qwen, Gemma, Llama, etc.). Returns a unified PASS/FIX/BLOCK verdict with a 0-100 safety score, per-check results, and actionable fix recommendations. PII gates the verdict: an SSN or credit card in the response forces BLOCK, an email forces FIX, phone/IP matches are flagged only (their regexes also match dates and version strings). Use this as a single-call safety gate before surfacing any LLM output to users.
| Argument | Type | Description |
|---|---|---|
| model | string | LLM model for AI-powered deep analysis (default: "openai/gpt-oss-20b"). Set to "none" to skip LLM check. Supports any model from list_llm_models. |
| rules | array | Optional guardrail rules array (same format as guardrail_test tool) |
| prompt | string | Optional original prompt. Used for quality scoring AND scanned for prompt injection in its own right (checks.injection_prompt) — pass it whenever you have it, it is where the attack actually lands. |
| source | string | Optional reference/source text for hallucination grounding check |
| response* |
Analyse the SSL/TLS certificate of any HTTPS host. Returns certificate subject, issuer, validity dates, days until expiry, protocol version, cipher suite, key exchange info, and an overall grade (A+, A, B, C, F). Detects expired, self-signed, and weak certificates. Use this to audit TLS posture before production deployment or during security reviews.
| Argument | Type | Description |
|---|---|---|
| host* | string | Hostname to check (e.g. example.com). Do not include https:// prefix. |
| port | number | Port number (default: 443) |
{
"type": "object",
"required": [
"host"
],
"properties": {
"host": {
"type": "string",
"description": "Hostname to check (e.g. example.com). Do not include https:// prefix."
},
"port": {
"type": "number",
"description": "Port number (default: 443)"
}
}
}Scan text for toxic language, hate speech, bias/stereotype framing, violence, sexual and self-harm content. Lexical + structural pattern matching (identity term + predicate), not a semantic classifier — returns per-category risk plus the named rules that fired, so every finding can be checked. Useful for LLM safety guardrail testing and triage; signal-only, not a calibrated CI gate.
| Argument | Type | Description |
|---|---|---|
| text* | string | Text to scan |
| categories | array | Categories to check (default: all) |
{
"type": "object",
"required": [
"text"
],
"properties": {
"text": {
"type": "string",
"description": "Text to scan"
},
"categories": {
"type": "array",
"items": {
"enum": [
"profanity",
"hate_speech",
"violence",
"sexual",
"self_harm",
"bias"
],
"type": "string"
},
"description": "Categories to check (default: all)"
}
}
}Run declarative assertions on an agent trace (OpenAI tool-call messages, Anthropic tool_use/tool_result blocks, LangChain run trees, or plain text ReAct logs). No LLM call — deterministic. Assertion types: order (tool A before B), must_call, must_not_call, max_calls, min_calls, no_error, recovery (agent completes a successful step after its last error). A step counts as errored when the trace says so — is_error/isError, status/state in {error,failed,exception,…}, an error field, a JSON body with error/success:false — or when its text payload STARTS with an error marker (Error:, Traceback, TypeError:). Model prose is never scanned for keywords, and every errored step reports error_signal naming what flagged it. Returns per-assertion PASS/FAIL, parsed steps, warnings (a trace parsing to 0 steps is flagged — assertions passing on emptiness prove nothing), and an overall verdict. Use this to gate CI/CD on agent behavior correctness.
| Argument | Type | Description |
|---|---|---|
| trace* | any | Agent execution trace as JSON (OpenAI messages array, LangChain run tree) or plain text log (Thought/Action/Observation format). |
| format | string | Trace format. auto (default) detects automatically. |
| assertions* | array | List of assertions to validate against the trace. |
{
"type": "object",
"required": [
"trace",
"assertions"
],
"properties": {
"trace": {
"oneOf": [
{
"type": "string"
},
{
"type": "object",
"additionalProperties": true
},
{
"type": "array",
"items": {}
}
],
"description": "Agent execution trace as JSON (OpenAI messages array, LangChain run tree) or plain text log (Thought/Action/Observation format)."
},
"format": {
"enum": [
"auto",
"openai",
"langchain"
],
"type": "string",
"description": "Trace format. auto (default) detects automatically."
},
"assertions": {
"type": "array",
"items": {
"type": "object",
"required": [
"type"
],
"properties": {
"id": {
"type": "string",
"description": "Optional assertion identifier."
},
"max": {
"type": "number",
"description": "[max_calls] Maximum number of allowed calls."
},
"min": {
"type": "number",
"description": "[min_calls] Minimum number of required calls."
},
"tool": {
"type": "string",
"description": "Tool name to check (for must_call, must_not_call, max_calls, min_calls)."
},
"type": {
"enum": [
"order",
"must_call",
"must_not_call",
"max_calls",
"min_calls",
"no_error",
"recovery",
"no_injection",
"no_pii"
],
"type": "string",
"description": "Assertion type. no_injection runs prompt_injection_scan on every tool result (indirect injection: text a third party wrote that the agent then reads); no_pii runs redact_pii on the final answer (a leak to the user). Both report types and counts, never the matched values."
},
"after": {
"type": "string",
"description": "[order] Tool that must be called after."
},
"types": {
"type": "string",
"description": "[no_pii] Comma-separated PII types (email, phone, ssn, credit_card, ip_address, jwt). Default: all."
},
"where": {
"enum": [
"tool_results",
"answer"
],
"type": "string",
"description": "[no_injection, no_pii] What to scan. Defaults: no_injection → tool_results, no_pii → answer (PII in a tool result is often legitimate — an order carries the customer email)."
},
"before": {
"type": "string",
"description": "[order] Tool that must be called first."
},
"sensitivity": {
"enum": [
"low",
"medium",
"high"
],
"type": "string",
"description": "[no_injection] Default low = critical patterns only (override, jailbreak, fake role delimiters). Higher catches more and fires on ordinary text (\"act as\", {{templates}}) — pattern matching, not a classifier."
}
}
},
"maxItems": 30,
"description": "List of assertions to validate against the trace."
}
}
}Validate that an MCP tool response conforms to expected format, schema, and content rules. Use this to QA-test any MCP server tool. Supply the tool's actual JSON result and a set of checks to perform.
| Argument | Type | Description |
|---|---|---|
| response* | string | The MCP tool result as a JSON string to validate |
| min_items | number | If response is an array, minimum number of items expected |
| expected_type | string | Expected top-level type: "object", "array", "string", "number" |
| required_keys | string | Comma-separated list of keys that MUST exist in the response (dot-notation for nested: "data.id, data.name") |
| actual_latency | number | Actual measured latency in ms (from the call) |
| forbidden_keys | string | Comma-separated list of keys that MUST NOT exist (e.g. "password, secret, token") |
| max_size_bytes | number | Maximum acceptable response size in bytes |
| max_response_ms | number |
Parse and validate a URL. Returns decomposed components: protocol, hostname, port, path, query parameters, hash, and origin.
| Argument | Type | Description |
|---|---|---|
| input* | string | URL to validate and parse |
{
"type": "object",
"required": [
"input"
],
"properties": {
"input": {
"type": "string",
"description": "URL to validate and parse"
}
}
}Run a comprehensive web security audit combining headers, SSL, CORS, and cookies checks — then use an LLM to produce a prioritised remediation plan. Orchestrates security_headers_check + ssl_certificate_check + cors_test + cookie_security_audit in parallel, merges all findings, then asks an AI model to: (1) rank vulnerabilities by real-world exploitability, (2) generate a remediation roadmap, (3) produce fix code snippets for the detected stack. Returns both raw audit data and the AI analysis. Use this as a one-click security posture assessment.
| Argument | Type | Description |
|---|---|---|
| url* | string | Full URL to audit (e.g. https://example.com) |
| model | string | LLM model for AI analysis (default: "openai/gpt-oss-20b"). Set to "none" to skip AI analysis. |
| api_key | string | Your Groq or HuggingFace API key. Required to enable AI analysis. |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "Full URL to audit (e.g. https://example.com)"
},
"model": {
"type": "string",
"description": "LLM model for AI analysis (default: \"openai/gpt-oss-20b\"). Set to \"none\" to skip AI analysis."
},
"api_key": {
"type": "string",
"description": "Your Groq or HuggingFace API key. Required to enable AI analysis."
}
}
}| string |
| The LLM-generated response to analyze |
{
"type": "object",
"required": [
"response"
],
"properties": {
"model": {
"type": "string",
"description": "LLM model for AI-powered deep analysis (default: \"openai/gpt-oss-20b\"). Set to \"none\" to skip LLM check. Supports any model from list_llm_models."
},
"rules": {
"type": "array",
"items": {
"type": "object",
"properties": {
"type": {
"type": "string"
},
"label": {
"type": "string"
},
"value": {
"type": "string"
}
}
},
"description": "Optional guardrail rules array (same format as guardrail_test tool)"
},
"prompt": {
"type": "string",
"description": "Optional original prompt. Used for quality scoring AND scanned for prompt injection in its own right (checks.injection_prompt) — pass it whenever you have it, it is where the attack actually lands."
},
"source": {
"type": "string",
"description": "Optional reference/source text for hallucination grounding check"
},
"response": {
"type": "string",
"description": "The LLM-generated response to analyze"
}
}
}| Maximum acceptable latency in ms (will be compared if provided) |
{
"type": "object",
"required": [
"response"
],
"properties": {
"response": {
"type": "string",
"description": "The MCP tool result as a JSON string to validate"
},
"min_items": {
"type": "number",
"description": "If response is an array, minimum number of items expected"
},
"expected_type": {
"enum": [
"object",
"array",
"string",
"number"
],
"type": "string",
"description": "Expected top-level type: \"object\", \"array\", \"string\", \"number\""
},
"required_keys": {
"type": "string",
"description": "Comma-separated list of keys that MUST exist in the response (dot-notation for nested: \"data.id, data.name\")"
},
"actual_latency": {
"type": "number",
"description": "Actual measured latency in ms (from the call)"
},
"forbidden_keys": {
"type": "string",
"description": "Comma-separated list of keys that MUST NOT exist (e.g. \"password, secret, token\")"
},
"max_size_bytes": {
"type": "number",
"description": "Maximum acceptable response size in bytes"
},
"max_response_ms": {
"type": "number",
"description": "Maximum acceptable latency in ms (will be compared if provided)"
}
}
}