Run data annotation and evaluation tasks with vetted domain experts: create, publish, get results.
Maintain this server? Claim it
Call this server's tools from your browser. Nothing to install.
Pathwize API key as 'Bearer pw_live_...' (business dashboard, Developers)
Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.
Tool list from our last check. Connect live to refresh it.
Add items by public URL; Pathwize copies the files into its own storage. reference: true adds them to the qualification set (optionally with gold_label for automatic scoring). Idempotent per id, up to 1000 per call.
This tool isn't marked read-only, so it may change something on the server or in an account you connected.
Add items by public URL; Pathwize copies the files into its own storage. reference: true adds them to the qualification set (optionally with gold_label for automatic scoring). Idempotent per id, up to 1000 per call.
| Argument | Type | Description |
|---|---|---|
| items* | array | |
| taskId* | string | |
| reference | boolean |
{
"type": "object",
"required": [
"taskId",
"items"
],
"properties": {
"items": {
"type": "array",
"items": {
"type": "object",
"required": [
"url"
],
"properties": {
"id": {
"type": "string",
"description": "Defaults to the file name in the URL"
},
"url": {
"type": "string",
"format": "uri"
},
"mime": {
"type": "string",
"description": "Defaults from the file extension"
},
"gold_label": {
"type": "string"
}
}
},
"maxItems": 1000,
"minItems": 1
},
"taskId": {
"type": "string",
"format": "uuid"
},
"reference": {
"type": "boolean"
}
}
}closed ends the task, draft pauses it. Experts are not emailed.
| Argument | Type | Description |
|---|---|---|
| status | string | |
| taskId* | string |
{
"type": "object",
"required": [
"taskId"
],
"properties": {
"status": {
"enum": [
"closed",
"draft"
],
"type": "string"
},
"taskId": {
"type": "string",
"format": "uuid"
}
}
}Create a labeling or evaluation task as a draft; nobody is notified until publish_task. Typical order: list_pools, create_task with instructions, classes, rate, pool_ids and one example image per class, add_items, then publish_task after the user confirms.
| Argument | Type | Description |
|---|---|---|
| rate | number | Hourly pay for the expert in EUR |
| type | string | Default data_labeling |
| title* | string | |
| domain | string | |
| classes | array | Class names experts choose from |
| deadline | string | |
| examples | array | Example images by public URL with the class they show. Labeling tasks need one per class before they can open. |
| language | string | Language of the instructions |
| pool_ids | array | Pools the task runs on (see list_pools) |
| expertise | string | What experts need to know, one line |
Finished items with final label, agreement, notes and flags. Page with starting_after (the last item id).
| Argument | Type | Description |
|---|---|---|
| limit | integer | |
| since | string | |
| taskId* | string | |
| starting_after | string |
{
"type": "object",
"required": [
"taskId"
],
"properties": {
"limit": {
"type": "integer",
"maximum": 1000,
"minimum": 1
},
"since": {
"type": "string"
},
"taskId": {
"type": "string",
"format": "uuid"
},
"starting_after": {
"type": "string"
}
}
}One task with settings, classes, examples, qualification, reference item count and item counts by status.
| Argument | Type | Description |
|---|---|---|
| taskId* | string |
{
"type": "object",
"required": [
"taskId"
],
"properties": {
"taskId": {
"type": "string",
"format": "uuid"
}
}
}Pools a task can run on: active curated pools plus your own, with member counts.
No arguments.
{
"type": "object",
"properties": {}
}Your AI tasks, newest first, with status and item counts.
No arguments.
{
"type": "object",
"properties": {}
}One-time link that opens the Pathwize business dashboard signed in as this business (optionally one task). Single use, one hour; give it only to the user.
| Argument | Type | Description |
|---|---|---|
| taskId | string |
{
"type": "object",
"properties": {
"taskId": {
"type": "string",
"format": "uuid"
}
}
}Open a task for experts. This emails every expert in the task's pools once and cannot be undone, so call it only after the user explicitly confirmed, with confirm: true. Fails with a list of anything missing.
| Argument | Type | Description |
|---|---|---|
| taskId* | string | |
| confirm* | boolean |
{
"type": "object",
"required": [
"taskId",
"confirm"
],
"properties": {
"taskId": {
"type": "string",
"format": "uuid"
},
"confirm": {
"type": "boolean",
"const": true
}
}
}Change a task's settings; only the fields you pass change, examples are added. Does not publish.
| Argument | Type | Description |
|---|---|---|
| rate | number | Hourly pay for the expert in EUR |
| title | string | |
| domain | string | |
| taskId* | string | |
| classes | array | Class names experts choose from |
| deadline | string | |
| examples | array | Example images by public URL with the class they show. Labeling tasks need one per class before they can open. |
| language | string | Language of the instructions |
| pool_ids | array | Pools the task runs on (see list_pools) |
| expertise | string | What experts need to know, one line |
| allow_note | boolean |
| allow_note | boolean |
| annotation | string | Default classification |
| instructions | string | Instructions for the experts in Markdown. A table whose first column names the classes becomes the per-class briefing. |
| members_only | boolean | Only members of these pools see the task, even on public pools |
| multi_select | boolean |
| qualification | object |
| allow_cant_tell | boolean | Let experts skip an item without a class (default true) |
| seconds_per_item | integer |
{
"type": "object",
"required": [
"title"
],
"properties": {
"rate": {
"type": "number",
"maximum": 500,
"minimum": 5,
"description": "Hourly pay for the expert in EUR"
},
"type": {
"enum": [
"data_labeling",
"preference",
"evaluation",
"red_team",
"domain"
],
"type": "string",
"description": "Default data_labeling"
},
"title": {
"type": "string",
"maxLength": 200,
"minLength": 1
},
"domain": {
"type": "string"
},
"classes": {
"type": "array",
"items": {
"type": "string"
},
"maxItems": 50,
"description": "Class names experts choose from"
},
"deadline": {
"type": "string",
"pattern": "^\\d{4}-\\d{2}-\\d{2}$"
},
"examples": {
"type": "array",
"items": {
"type": "object",
"required": [
"url",
"label"
],
"properties": {
"url": {
"type": "string",
"format": "uri"
},
"label": {
"type": "string"
}
}
},
"maxItems": 40,
"description": "Example images by public URL with the class they show. Labeling tasks need one per class before they can open."
},
"language": {
"enum": [
"en",
"de"
],
"type": "string",
"description": "Language of the instructions"
},
"pool_ids": {
"type": "array",
"items": {
"type": "string",
"format": "uuid"
},
"description": "Pools the task runs on (see list_pools)"
},
"expertise": {
"type": "string",
"description": "What experts need to know, one line"
},
"allow_note": {
"type": "boolean"
},
"annotation": {
"enum": [
"classification",
"bounding_box",
"segmentation",
"attributes"
],
"type": "string",
"description": "Default classification"
},
"instructions": {
"type": "string",
"description": "Instructions for the experts in Markdown. A table whose first column names the classes becomes the per-class briefing."
},
"members_only": {
"type": "boolean",
"description": "Only members of these pools see the task, even on public pools"
},
"multi_select": {
"type": "boolean"
},
"qualification": {
"type": "object",
"properties": {
"sample": {
"type": "integer",
"maximum": 1000,
"minimum": 5,
"description": "Test items per candidate (default 50)"
},
"enabled": {
"type": "boolean"
},
"scoring": {
"enum": [
"auto",
"customer"
],
"type": "string",
"description": "auto: scored against reference labels; customer: you approve each candidate"
},
"threshold": {
"type": "integer",
"maximum": 100,
"minimum": 50,
"description": "Pass mark in percent"
},
"days_to_complete": {
"type": "integer",
"maximum": 30,
"minimum": 1
}
}
},
"allow_cant_tell": {
"type": "boolean",
"description": "Let experts skip an item without a class (default true)"
},
"seconds_per_item": {
"type": "integer",
"maximum": 3600,
"minimum": 1
}
}
}| annotation | string | Default classification |
| instructions | string | Instructions for the experts in Markdown. A table whose first column names the classes becomes the per-class briefing. |
| members_only | boolean | Only members of these pools see the task, even on public pools |
| multi_select | boolean |
| qualification | object |
| allow_cant_tell | boolean | Let experts skip an item without a class (default true) |
| seconds_per_item | integer |
{
"type": "object",
"required": [
"taskId"
],
"properties": {
"rate": {
"type": "number",
"maximum": 500,
"minimum": 5,
"description": "Hourly pay for the expert in EUR"
},
"title": {
"type": "string"
},
"domain": {
"type": "string"
},
"taskId": {
"type": "string",
"format": "uuid"
},
"classes": {
"type": "array",
"items": {
"type": "string"
},
"maxItems": 50,
"description": "Class names experts choose from"
},
"deadline": {
"type": "string",
"pattern": "^\\d{4}-\\d{2}-\\d{2}$"
},
"examples": {
"type": "array",
"items": {
"type": "object",
"required": [
"url",
"label"
],
"properties": {
"url": {
"type": "string",
"format": "uri"
},
"label": {
"type": "string"
}
}
},
"maxItems": 40,
"description": "Example images by public URL with the class they show. Labeling tasks need one per class before they can open."
},
"language": {
"enum": [
"en",
"de"
],
"type": "string",
"description": "Language of the instructions"
},
"pool_ids": {
"type": "array",
"items": {
"type": "string",
"format": "uuid"
},
"description": "Pools the task runs on (see list_pools)"
},
"expertise": {
"type": "string",
"description": "What experts need to know, one line"
},
"allow_note": {
"type": "boolean"
},
"annotation": {
"enum": [
"classification",
"bounding_box",
"segmentation",
"attributes"
],
"type": "string",
"description": "Default classification"
},
"instructions": {
"type": "string",
"description": "Instructions for the experts in Markdown. A table whose first column names the classes becomes the per-class briefing."
},
"members_only": {
"type": "boolean",
"description": "Only members of these pools see the task, even on public pools"
},
"multi_select": {
"type": "boolean"
},
"qualification": {
"type": "object",
"properties": {
"sample": {
"type": "integer",
"maximum": 1000,
"minimum": 5,
"description": "Test items per candidate (default 50)"
},
"enabled": {
"type": "boolean"
},
"scoring": {
"enum": [
"auto",
"customer"
],
"type": "string",
"description": "auto: scored against reference labels; customer: you approve each candidate"
},
"threshold": {
"type": "integer",
"maximum": 100,
"minimum": 50,
"description": "Pass mark in percent"
},
"days_to_complete": {
"type": "integer",
"maximum": 30,
"minimum": 1
}
}
},
"allow_cant_tell": {
"type": "boolean",
"description": "Let experts skip an item without a class (default true)"
},
"seconds_per_item": {
"type": "integer",
"maximum": 3600,
"minimum": 1
}
}
}