Servers Playground How we check Add a server Log in

Llm Output Quality Monitor

Working · 182 ms

io.github.lazymac2x/llm-output-quality-monitorv1.0.0

Cloudflare Workers MCP server: llm-output-quality-monitor

AI & Agents

Source Registry entry

Maintain this server? Claim it

Try it

Call this server's tools from your browser. Nothing to install.

https://api.lazy-mac.com/llm-output-quality-monitor/mcp

Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.

Tool list from our last check. Connect live to refresh it.

consistency_check

Check consistency across multiple LLM responses

responsesarray, required

Array of responses to compare

This tool isn't marked read-only, so it may change something on the server or in an account you connected.

I understand, run it anyway

Tools (5)

consistency_check

Check consistency across multiple LLM responses

Llm Output Quality Monitor MCP server | mcptry

drift_detector

Detect quality drift between current and previous LLM responses

Argument	Type	Description
threshold	number	Drift threshold (0-1, default: 0.15)
currentResponse*	string	Current LLM response
previousResponse*	string	Previous LLM response

Input schema (JSON)

{
  "type": "object",
  "required": [
    "currentResponse",
    "previousResponse"
  ],
  "properties": {
    "threshold": {
      "type": "number",
      "description": "Drift threshold (0-1, default: 0.15)"
    },
    "currentResponse": {
      "type": "string",
      "description": "Current LLM response"
    },
    "previousResponse": {
      "type": "string",
      "description": "Previous LLM response"
    }
  }
}

hallucination_scorer

Pattern-based heuristic risk scoring for LLM responses (0-100). Detects linguistic signals such as contradictory assertions, unsourced claims, and uncertainty markers. Not a semantic hallucination detector.

Argument	Type	Description
context	string	Reference context for grounding
response*	string	LLM response to analyze

Input schema (JSON)

{
  "type": "object",
  "required": [
    "response"
  ],
  "properties": {
    "context": {
      "type": "string",
      "description": "Reference context for grounding"
    },
    "response": {
      "type": "string",
      "description": "LLM response to analyze"
    }
  }
}

quality_validator

Validate LLM response quality based on length, format, and structure

Argument	Type	Description
response*	string	LLM response to validate
maxLength	number	Maximum response length (default: 10000)
minLength	number	Minimum response length (default: 10)
strictFormat	boolean	Enforce punctuation and capitalization

Input schema (JSON)

{
  "type": "object",
  "required": [
    "response"
  ],
  "properties": {
    "response": {
      "type": "string",
      "description": "LLM response to validate"
    },
    "maxLength": {
      "type": "number",
      "description": "Maximum response length (default: 10000)"
    },
    "minLength": {
      "type": "number",
      "description": "Minimum response length (default: 10)"
    },
    "strictFormat": {
      "type": "boolean",
      "description": "Enforce punctuation and capitalization"
    }
  }
}

schema_enforcer

Validate JSON response against schema

Argument	Type	Description
schema*	object	JSON schema definition
response*	string	JSON response to validate

Input schema (JSON)

{
  "type": "object",
  "required": [
    "response",
    "schema"
  ],
  "properties": {
    "schema": {
      "type": "object",
      "description": "JSON schema definition"
    },
    "response": {
      "type": "string",
      "description": "JSON response to validate"
    }
  }
}