Servers Playground How we check Add a server Log in

Nonobench

Working · 1.5 s

io.github.mauricekleine/nonobenchv1.1.0

An open-source benchmark of how well LLMs solve nonogram puzzles, from 5x5 to 20x20.

Entertainment & Games

Source Website Registry entry

Maintain this server? Claim it

Try it

Call this server's tools from your browser. Nothing to install.

https://www.nonobench.com/mcp

Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.

Tool list from our last check. Connect live to refresh it.

check_solution Read-only

Check a grid against a puzzle's clues, using the same rule as the benchmark grader. Reports which rows and columns do not match.

idstring, required

Puzzle id from list_puzzles

gridstring, required

Row-major string of 0 (empty) and 1 (filled), width × height characters

Nonobench MCP server | mcptry

Tools (11)

check_solution

Check a grid against a puzzle's clues, using the same rule as the benchmark grader. Reports which rows and columns do not match.

read-only

Argument	Type	Description
id*	string	Puzzle id from list_puzzles
grid*	string	Row-major string of 0 (empty) and 1 (filled), width × height characters

Input schema (JSON)

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "required": [
    "id",
    "grid"
  ],
  "properties": {
    "id": {
      "type": "string",
      "description": "Puzzle id from list_puzzles"
    },
    "grid": {
      "type": "string",
      "description": "Row-major string of 0 (empty) and 1 (filled), width × height characters"
    }
  }
}

compare_models

Side-by-side core overall and per-size accuracy, cost, latency and token results for model or family names.

read-only

Argument	Type	Description
models*	array	2 to 20 model variant ids or family names, e.g. claude-opus-5.5 or gpt-6-astra-xhigh

Input schema (JSON)

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "required": [
    "models"
  ],
  "properties": {
    "models": {
      "type": "array",
      "items": {
        "type": "string"
      },
      "maxItems": 20,
      "minItems": 2,
      "description": "2 to 20 model variant ids or family names, e.g. claude-opus-5.5 or gpt-6-astra-xhigh"
    }
  }
}

get_leaderboard

Models ranked by accuracy; defaults to all effort levels for compatibility.

read-only

Argument	Type	Description
size	string	Grid size to filter on
effort	string	best, all (default), or one effort level; empty means all
family	string	Comma-separated family ids; empty means no filter
version	string	Comma-separated benchmark versions: 1.0, 1.1, 1.2; empty means all
provider	string	Comma-separated provider ids; empty means no filter
reasoning	boolean	Only reasoning (true) or non-reasoning (false) variants
min_correct	integer	Minimum puzzles solved in the selected tier; default 0 includes unsolved variants
open_weights	boolean	Only open-weight (true) or closed (false) models

Input schema (JSON)

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "properties": {
    "size": {
      "enum": [
        "5x5",
        "10x10",
        "15x15",
        "20x20"
      ],
      "type": "string",
      "description": "Grid size to filter on"
    },
    "effort": {
      "type": "string",
      "description": "best, all (default), or one effort level; empty means all"
    },
    "family": {
      "type": "string",
      "description": "Comma-separated family ids; empty means no filter"
    },
    "version": {
      "type": "string",
      "description": "Comma-separated benchmark versions: 1.0, 1.1, 1.2; empty means all"
    },
    "provider": {
      "type": "string",
      "description": "Comma-separated provider ids; empty means no filter"
    },
    "reasoning": {
      "type": "boolean",
      "description": "Only reasoning (true) or non-reasoning (false) variants"
    },
    "min_correct": {
      "type": "integer",
      "maximum": 9007199254740991,
      "minimum": 0,
      "description": "Minimum puzzles solved in the selected tier; default 0 includes unsolved variants"
    },
    "open_weights": {
      "type": "boolean",
      "description": "Only open-weight (true) or closed (false) models"
    }
  }
}

get_model_puzzles

Which puzzles one model solved, missed, timed out on, or has not run.

read-only

Argument	Type	Description
model*	string	Model variant id as listed on the leaderboard, e.g. claude-opus-5.5-high

Input schema (JSON)

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "required": [
    "model"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model variant id as listed on the leaderboard, e.g. claude-opus-5.5-high"
    }
  }
}

get_model_results

Accuracy, cost, latency and token use for one model, broken down by grid size.

read-only

Argument	Type	Description
model*	string	Model name as listed on the leaderboard, e.g. gpt-5.4-xhigh

Input schema (JSON)

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "required": [
    "model"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model name as listed on the leaderboard, e.g. gpt-5.4-xhigh"
    }
  }
}

get_puzzle

One puzzle, including the clue text models were prompted with. The reference solution is only included on request; some puzzles have several valid solutions.

read-only

Argument	Type	Description
id*	string	Puzzle id from list_puzzles
include_solution	boolean	Include a reference solution

Input schema (JSON)

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "required": [
    "id"
  ],
  "properties": {
    "id": {
      "type": "string",
      "description": "Puzzle id from list_puzzles"
    },
    "include_solution": {
      "type": "boolean",
      "description": "Include a reference solution"
    }
  }
}

get_puzzle_results

Per-model outcomes for one puzzle. Answers are omitted unless requested.

read-only

Argument	Type	Description
id*	string	Puzzle id from list_puzzles
effort	string	best, all (default), or one effort level
family	string	Comma-separated family ids; empty means no filter
provider	string	Comma-separated provider ids; empty means no filter
reasoning	boolean	Only reasoning (true) or non-reasoning (false) variants
open_weights	boolean	Only open-weight (true) or closed (false) models
include_answers	boolean	Include each model's answer grid

Input schema (JSON)

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "required": [
    "id"
  ],
  "properties": {
    "id": {
      "type": "string",
      "description": "Puzzle id from list_puzzles"
    },
    "effort": {
      "type": "string",
      "description": "best, all (default), or one effort level"
    },
    "family": {
      "type": "string",
      "description": "Comma-separated family ids; empty means no filter"
    },
    "provider": {
      "type": "string",
      "description": "Comma-separated provider ids; empty means no filter"
    },
    "reasoning": {
      "type": "boolean",
      "description": "Only reasoning (true) or non-reasoning (false) variants"
    },
    "open_weights": {
      "type": "boolean",
      "description": "Only open-weight (true) or closed (false) models"
    },
    "include_answers": {
      "type": "boolean",
      "description": "Include each model's answer grid"
    }
  }
}

list_families

Model families, available efforts and best variants.

read-only

No arguments.

Input schema (JSON)

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "properties": {}
}

list_providers

Provider ids, names, families and variant counts.

read-only

No arguments.

Input schema (JSON)

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "properties": {}
}

list_puzzles

The benchmark puzzles with their ids and row/column clues.

read-only

Argument	Type	Description
size	string	Grid size to filter on

Input schema (JSON)

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "properties": {
    "size": {
      "enum": [
        "5x5",
        "10x10",
        "15x15",
        "20x20"
      ],
      "type": "string",
      "description": "Grid size to filter on"
    }
  }
}

list_runs

Individual benchmark runs (one model on one puzzle), optionally with the raw prompt and model output.

read-only

Argument	Type	Description
size	string	Grid size to filter on
limit	integer	Default 100
model	string	Only runs of this model variant id
offset	integer	Runs to skip, for paging; default 0
puzzle_id	string	Only runs on this puzzle id from list_puzzles
include_output	boolean	Include raw prompt and model output (large)

Input schema (JSON)

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "properties": {
    "size": {
      "enum": [
        "5x5",
        "10x10",
        "15x15",
        "20x20"
      ],
      "type": "string",
      "description": "Grid size to filter on"
    },
    "limit": {
      "type": "integer",
      "maximum": 500,
      "minimum": 1,
      "description": "Default 100"
    },
    "model": {
      "type": "string",
      "description": "Only runs of this model variant id"
    },
    "offset": {
      "type": "integer",
      "maximum": 9007199254740991,
      "minimum": 0,
      "description": "Runs to skip, for paging; default 0"
    },
    "puzzle_id": {
      "type": "string",
      "description": "Only runs on this puzzle id from list_puzzles"
    },
    "include_output": {
      "type": "boolean",
      "description": "Include raw prompt and model output (large)"
    }
  }
}