Read-only MCP server for the OPERANT AI operating-agent calibration benchmark.
Maintain this server? Claim it
Call this server's tools from your browser. Nothing to install.
Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.
Tool list from our last check. Connect live to refresh it.
Place two retained calculation profiles side by side by display_name substring. Returns ocs_mean, ocs_stdev, orchestration_mean, run_family, and subject_shell for each, plus comparison_status=NOT_DURABLE and the public claim_status. This is not evidence that either named model outperforms, equals, or differs significantly from the other. If a name is ambiguous or not found, returns an error listing all available display_names.
Display name (or substring) of the first model
Display name (or substring) of the second model
Place two retained calculation profiles side by side by display_name substring. Returns ocs_mean, ocs_stdev, orchestration_mean, run_family, and subject_shell for each, plus comparison_status=NOT_DURABLE and the public claim_status. This is not evidence that either named model outperforms, equals, or differs significantly from the other. If a name is ambiguous or not found, returns an error listing all available display_names.
| Argument | Type | Description |
|---|---|---|
| model_a* | string | Display name (or substring) of the first model |
| model_b* | string | Display name (or substring) of the second model |
{
"type": "object",
"$schema": "http://json-schema.org/draft-07/schema#",
"required": [
"model_a",
"model_b"
],
"properties": {
"model_a": {
"type": "string",
"minLength": 1,
"description": "Display name (or substring) of the first model"
},
"model_b": {
"type": "string",
"minLength": 1,
"description": "Display name (or substring) of the second model"
}
},
"additionalProperties": false
}Return the full case for a given pair_id (axes 1/2/4) or id (axis 3): malign and benign task prompts, expected decisions, grounding rationale, and bypass patterns. Axis 3 cases are single (unmatched) and use an 'id' field instead of 'pair_id'. Use list_cases to browse available ids.
| Argument | Type | Description |
|---|---|---|
| axis* | string | The axis this case belongs to |
| pair_id* | string | The pair_id (axes 1/2/4) or id (axis 3) to retrieve |
{
"type": "object",
"$schema": "http://json-schema.org/draft-07/schema#",
"required": [
"pair_id",
"axis"
],
"properties": {
"axis": {
"enum": [
"refusal-calibration",
"sanctioned-path",
"orchestration",
"escalation-reroute"
],
"type": "string",
"description": "The axis this case belongs to"
},
"pair_id": {
"type": "string",
"minLength": 1,
"description": "The pair_id (axes 1/2/4) or id (axis 3) to retrieve"
}
},
"additionalProperties": false
}Return the benchmark design: the 4 axes, the OCS formula (Youden's J), the 5 decision labels (PROCEED, PROCEED_SANCTIONED, REFUSE, ESCALATE, REROUTE), scoring blocks, and a concise what-it-measures / what-it-doesn't summary. Sourced from the baked case-file metadata.
No arguments.
{
"type": "object",
"$schema": "http://json-schema.org/draft-07/schema#",
"properties": {}
}Return retained model calculation profiles plus generated_at, claim_status, claims_at_risk, and the bounded evidence_binding. These rows are not durable named-model performance claims. Do not rank them or treat stdev/significance as reliable model evidence.
No arguments.
{
"type": "object",
"$schema": "http://json-schema.org/draft-07/schema#",
"properties": {}
}Return case metadata (no full task prompts): pair_id/id, axis, tier, grounding, and side indicators (malign/benign for axes 1/2/4; null for axis 3). Filter by axis, or omit for all cases across all axes (the result includes a count). Use get_case to fetch a full case with task prompts and expected decisions.
| Argument | Type | Description |
|---|---|---|
| axis | string | Axis to filter by: refusal-calibration | sanctioned-path | orchestration | escalation-reroute |
{
"type": "object",
"$schema": "http://json-schema.org/draft-07/schema#",
"properties": {
"axis": {
"enum": [
"refusal-calibration",
"sanctioned-path",
"orchestration",
"escalation-reroute"
],
"type": "string",
"description": "Axis to filter by: refusal-calibration | sanctioned-path | orchestration | escalation-reroute"
}
},
"additionalProperties": false
}