Real-time, drift-verified LLM pricing across 26 providers with cost+quality model routing.
Maintain this server? Claim it
Call this server's tools from your browser. Nothing to install.
Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.
Tool list from our last check. Connect live to refresh it.
Analyze one specific session's actual recorded LLM usage (tagged via record_usage's session_id) on demand: total input/output tokens, total actual cost, and a per-model breakdown if more than one model was used. Also runs the session's own observed token pattern through the same routing engine behind recommend_model / POST /router/recommend to produce a grounded recommendation — or confirm the current choice is already optimal — with the estimated dollar savings or increase versus this session's actual cost. Returns has_data: false with no recommendation if the session_id has no recorded usage. Advisory only — never switches or reroutes anything.
The session_id previously used when calling record_usage
Optional organisation ID filter — scopes the lookup to usage events recorded under that org_id, same as get_usage_summary's org_id
This tool isn't marked read-only, so it may change something on the server or in an account you connected.
Analyze one specific session's actual recorded LLM usage (tagged via record_usage's session_id) on demand: total input/output tokens, total actual cost, and a per-model breakdown if more than one model was used. Also runs the session's own observed token pattern through the same routing engine behind recommend_model / POST /router/recommend to produce a grounded recommendation — or confirm the current choice is already optimal — with the estimated dollar savings or increase versus this session's actual cost. Returns has_data: false with no recommendation if the session_id has no recorded usage. Advisory only — never switches or reroutes anything.
| Argument | Type | Description |
|---|---|---|
| org_id | string | Optional organisation ID filter — scopes the lookup to usage events recorded under that org_id, same as get_usage_summary's org_id |
| session_id* | string | The session_id previously used when calling record_usage |
{
"type": "object",
"required": [
"session_id"
],
"properties": {
"org_id": {
"type": "string",
"description": "Optional organisation ID filter — scopes the lookup to usage events recorded under that org_id, same as get_usage_summary's org_id"
},
"session_id": {
"type": "string",
"description": "The session_id previously used when calling record_usage"
}
}
}Ask the LLM Pricing AI agent a question in natural language. Use for complex queries about pricing, model recommendations, cost optimisation advice, or anything that benefits from multi-step reasoning.
| Argument | Type | Description |
|---|---|---|
| message* | string | The question or task for the pricing agent |
| autonomous | boolean | Run in autonomous task mode (default: false) |
| conversation_id | string | Optional conversation ID to continue a previous session |
{
"type": "object",
"required": [
"message"
],
"properties": {
"message": {
"type": "string",
"description": "The question or task for the pricing agent"
},
"autonomous": {
"type": "boolean",
"default": false,
"description": "Run in autonomous task mode (default: false)"
},
"conversation_id": {
"type": "string",
"description": "Optional conversation ID to continue a previous session"
}
}
}Audit this server's own pricing data against an external reference registry. Prices here are hand-maintained and go stale silently; a price that disagrees with the registry by more than the threshold is automatically withheld from serving the moment it's detected, not just when this tool runs. This reports what's currently withheld and why. The price value itself is never overwritten by the registry. Use when the user asks whether the pricing data is accurate or up to date, or wants to audit a specific provider's rates.
| Argument | Type | Description |
|---|---|---|
| limit | integer | Maximum findings to return (default: 50, max: 200) |
| provider | string | Limit the audit to one provider (partial, case-insensitive) |
| threshold_pct | number | Minimum % difference to report (default: 5) |
{
"type": "object",
"required": [],
"properties": {
"limit": {
"type": "integer",
"default": 50,
"maximum": 200,
"minimum": 1,
"description": "Maximum findings to return (default: 50, max: 200)"
},
"provider": {
"type": "string",
"description": "Limit the audit to one provider (partial, case-insensitive)"
},
"threshold_pct": {
"type": "number",
"default": 5,
"minimum": 0,
"description": "Minimum % difference to report (default: 5)"
}
}
}Compare costs for multiple LLM models
| Argument | Type | Description |
|---|---|---|
| model_names* | array | List of model names to compare |
| input_tokens* | integer | Number of input tokens |
| output_tokens* | integer | Number of output tokens |
{
"type": "object",
"required": [
"model_names",
"input_tokens",
"output_tokens"
],
"properties": {
"model_names": {
"type": "array",
"items": {
"type": "string"
},
"description": "List of model names to compare"
},
"input_tokens": {
"type": "integer",
"minimum": 0,
"description": "Number of input tokens"
},
"output_tokens": {
"type": "integer",
"minimum": 0,
"description": "Number of output tokens"
}
}
}Delete a registered budget-spend alert by its ID.
| Argument | Type | Description |
|---|---|---|
| alert_id* | integer | The ID of the alert to delete (from list_budget_alerts or register_budget_alert) |
{
"type": "object",
"required": [
"alert_id"
],
"properties": {
"alert_id": {
"type": "integer",
"description": "The ID of the alert to delete (from list_budget_alerts or register_budget_alert)"
}
}
}Delete a specific chat conversation by its ID. Use when the user asks to delete, clear, or remove a past conversation. Use list_conversations first to find the conversation ID.
| Argument | Type | Description |
|---|---|---|
| conversation_id* | string | The ID of the conversation to delete |
{
"type": "object",
"required": [
"conversation_id"
],
"properties": {
"conversation_id": {
"type": "string",
"description": "The ID of the conversation to delete"
}
}
}Delete a registered price-change alert by its ID.
| Argument | Type | Description |
|---|---|---|
| alert_id* | integer | The ID of the alert to delete (from list_price_alerts or register_price_alert) |
{
"type": "object",
"required": [
"alert_id"
],
"properties": {
"alert_id": {
"type": "integer",
"description": "The ID of the alert to delete (from list_price_alerts or register_price_alert)"
}
}
}Estimate the cost of using a specific LLM model
| Argument | Type | Description |
|---|---|---|
| model_name* | string | Name of the LLM model (e.g., 'gpt-4', 'claude-3-opus') |
| input_tokens* | integer | Number of input tokens |
| output_tokens* | integer | Number of output tokens |
{
"type": "object",
"required": [
"model_name",
"input_tokens",
"output_tokens"
],
"properties": {
"model_name": {
"type": "string",
"description": "Name of the LLM model (e.g., 'gpt-4', 'claude-3-opus')"
},
"input_tokens": {
"type": "integer",
"minimum": 0,
"description": "Number of input tokens"
},
"output_tokens": {
"type": "integer",
"minimum": 0,
"description": "Number of output tokens"
}
}
}Get current pricing for all LLM models from all providers
No arguments.
{
"type": "object",
"required": [],
"properties": {}
}Report process-lifetime hit/miss counts, total lookups, and hit rate for the ~5-minute recommendation cache, separately for the recommend_model tool and POST /router/recommend (never combined). Server-operations introspection for confirming the cache is reducing recomputation in production, not a pricing question. Counts reset on process restart; reading them never changes them.
No arguments.
{
"type": "object",
"required": [],
"properties": {}
}Report an aggregate accuracy summary for the pricing catalogue: what percentage of models have a confirmed, fresh price, how many are currently withheld due to price drift, how many are newly discovered and not yet priced, and how many confirmed prices are over 90 days old. A single trust signal, distinct from check_price_drift which lists individual disputes. Use when the user asks how accurate or trustworthy the pricing data is, overall.
No arguments.
{
"type": "object",
"required": [],
"properties": {}
}Get subscription pricing for AI coding IDE tools: GitHub Copilot, Cursor, Windsurf, Claude.ai, JetBrains AI, Amazon Q Developer, and Tabnine. Returns monthly subscription cost, inline completion support, context window, and per-tool strengths. Use this when the user asks to compare IDE AI tools, subscription-based coding assistants, or wants to know which IDE AI fits their budget.
| Argument | Type | Description |
|---|---|---|
| provider | string | Filter by provider name (partial match, case-insensitive). Examples: 'GitHub Copilot', 'Cursor', 'Windsurf', 'JetBrains', 'Amazon Q', 'Tabnine' |
| inline_only | boolean | If true, only return tools that support real-time inline code completion |
| max_monthly | number | Only return plans at or below this monthly USD price (e.g. 20 for $20/mo) |
{
"type": "object",
"required": [],
"properties": {
"provider": {
"type": "string",
"description": "Filter by provider name (partial match, case-insensitive). Examples: 'GitHub Copilot', 'Cursor', 'Windsurf', 'JetBrains', 'Amazon Q', 'Tabnine'"
},
"inline_only": {
"type": "boolean",
"default": false,
"description": "If true, only return tools that support real-time inline code completion"
},
"max_monthly": {
"type": "number",
"minimum": 0,
"description": "Only return plans at or below this monthly USD price (e.g. 20 for $20/mo)"
}
}
}Get performance metrics (throughput, latency, context window) for models
| Argument | Type | Description |
|---|---|---|
| provider | string | Optional provider filter (e.g., 'openai', 'anthropic') |
| include_cost | boolean | Include cost metrics in response (default: true) |
{
"type": "object",
"required": [],
"properties": {
"provider": {
"type": "string",
"description": "Optional provider filter (e.g., 'openai', 'anthropic')"
},
"include_cost": {
"type": "boolean",
"default": true,
"description": "Include cost metrics in response (default: true)"
}
}
}Generate a download URL for the pricing history export. Returns a URL the user can open in their browser to download snapshot history as CSV (for spreadsheets) or JSON (for code). Use this when the user asks to export, download, or save pricing data.
| Argument | Type | Description |
|---|---|---|
| days | integer | Look-back window in days (default: 30, max: 365) |
| limit | integer | Max rows to export (default: 10000, max: 100000) |
| format | string | Output format: 'csv' (default) or 'json' |
| provider | string | Filter by provider (optional) |
| model_name | string | Filter by model name (optional) |
{
"type": "object",
"required": [],
"properties": {
"days": {
"type": "integer",
"default": 30,
"maximum": 365,
"minimum": 1,
"description": "Look-back window in days (default: 30, max: 365)"
},
"limit": {
"type": "integer",
"default": 10000,
"maximum": 100000,
"minimum": 1,
"description": "Max rows to export (default: 10000, max: 100000)"
},
"format": {
"enum": [
"csv",
"json"
],
"type": "string",
"default": "csv",
"description": "Output format: 'csv' (default) or 'json'"
},
"provider": {
"type": "string",
"description": "Filter by provider (optional)"
},
"model_name": {
"type": "string",
"description": "Filter by model name (optional)"
}
}
}Query historical pricing snapshots recorded over time. Use this to look up past prices for a model or provider, or to see how prices have changed over a given number of days.
| Argument | Type | Description |
|---|---|---|
| days | integer | Look-back window in days (default: 30, max: 365) |
| limit | integer | Maximum number of snapshot rows to return (default: 50, max: 500) |
| provider | string | Filter by provider (e.g. 'openai'). Omit for all providers. |
| model_name | string | Filter by model name (e.g. 'gpt-4o'). Omit for all models. |
{
"type": "object",
"required": [],
"properties": {
"days": {
"type": "integer",
"default": 30,
"maximum": 365,
"minimum": 1,
"description": "Look-back window in days (default: 30, max: 365)"
},
"limit": {
"type": "integer",
"default": 50,
"maximum": 500,
"minimum": 1,
"description": "Maximum number of snapshot rows to return (default: 50, max: 500)"
},
"provider": {
"type": "string",
"description": "Filter by provider (e.g. 'openai'). Omit for all providers."
},
"model_name": {
"type": "string",
"description": "Filter by model name (e.g. 'gpt-4o'). Omit for all models."
}
}
}Find models whose prices changed the most over a given period. Returns models sorted by absolute percentage price change with a direction label ('increased', 'decreased', or 'unchanged'). Use this to answer questions like 'which models got cheaper this month?' or 'which providers raised prices recently?'
| Argument | Type | Description |
|---|---|---|
| days | integer | Look-back window in days (default: 30, max: 365) |
| limit | integer | Maximum models to return (default: 20, max: 100) |
{
"type": "object",
"required": [],
"properties": {
"days": {
"type": "integer",
"default": 30,
"maximum": 365,
"minimum": 1,
"description": "Look-back window in days (default: 30, max: 365)"
},
"limit": {
"type": "integer",
"default": 20,
"maximum": 100,
"minimum": 1,
"description": "Maximum models to return (default: 20, max: 100)"
}
}
}Get MCP server telemetry and usage statistics including tool usage, response times, and error rates
| Argument | Type | Description |
|---|---|---|
| limit | integer | Maximum items per category (default: 10, max: 50) |
| include_details | boolean | Include detailed statistics (default: true) |
{
"type": "object",
"required": [],
"properties": {
"limit": {
"type": "integer",
"default": 10,
"maximum": 50,
"minimum": 1,
"description": "Maximum items per category (default: 10, max: 50)"
},
"include_details": {
"type": "boolean",
"default": true,
"description": "Include detailed statistics (default: true)"
}
}
}Get a summary of actual recorded LLM spend: total cost, request count, and breakdowns by model and provider, from usage events previously logged via record_usage. Use when the user asks what they've actually spent, as opposed to a hypothetical cost estimate.
| Argument | Type | Description |
|---|---|---|
| days | integer | Look-back window in days (default: 30, max: 365) |
| org_id | string | Optional organisation ID filter |
{
"type": "object",
"required": [],
"properties": {
"days": {
"type": "integer",
"default": 30,
"maximum": 365,
"minimum": 1,
"description": "Look-back window in days (default: 30, max: 365)"
},
"org_id": {
"type": "string",
"description": "Optional organisation ID filter"
}
}
}Get recommended use cases and strengths for LLM models
| Argument | Type | Description |
|---|---|---|
| provider | string | Optional provider filter |
{
"type": "object",
"required": [],
"properties": {
"provider": {
"type": "string",
"description": "Optional provider filter"
}
}
}Bulk-import a completed session's usage in a single call — the retroactive counterpart to record_usage, for when a session wasn't instrumented live. Use when a calling agent (e.g. VS Code Copilot Chat) already has a session's turn-by-turn history in its own local store and wants this server to report on it exactly as if it had been tracked live. Accepts a list of entries under one shared session_id; each entry resolves its input and output tokens independently, either from exact counts when known or by estimating from raw turn text using this server's existing token counter. Cost is always computed server-side from current pricing, never trusted from the caller. A malformed entry (no usable tokens/text on one side, or an unresolvable model_name) is reported as its own per-entry failure and does not fail the rest of the batch. Idempotent like record_usage — resubmitting the same entries (same request_id, or the same session_id/model/occurred_at/token-or-text when request_id is omitted) is a no-op. Recorded usage is then readable via analyze_session_usage and GET /usage/session/{session_id}.
| Argument | Type | Description |
|---|---|---|
| org_id | string | Optional organisation ID to attribute this usage to |
| entries* | array | Usage entries to import, one per turn/call in the session |
| session_id* | string | Shared session ID to tag every entry in this batch with |
{
"type": "object",
"required": [
"session_id",
"entries"
],
"properties": {
"org_id": {
"type": "string",
"description": "Optional organisation ID to attribute this usage to"
},
"entries": {
"type": "array",
"items": {
"type": "object",
"required": [
"model_name"
],
"properties": {
"input_text": {
"type": "string",
"description": "Raw input/prompt text — used to estimate input_tokens via this server's token counter when input_tokens isn't known"
},
"model_name": {
"type": "string",
"description": "Name of the LLM model used for this entry"
},
"request_id": {
"type": "string",
"description": "Optional idempotency key. When omitted, a deterministic one is derived from session_id/model_name/occurred_at/token-or-text source so resubmitting the same entry is safely a no-op"
},
"occurred_at": {
"type": "number",
"description": "Unix timestamp when this call happened (default: now)"
},
"output_text": {
"type": "string",
"description": "Raw output/response text — used to estimate output_tokens via this server's token counter when output_tokens isn't known"
},
"input_tokens": {
"type": "integer",
"minimum": 0,
"description": "Exact input token count, if known"
},
"output_tokens": {
"type": "integer",
"minimum": 0,
"description": "Exact output token count, if known"
}
}
},
"maxItems": 500,
"minItems": 1,
"description": "Usage entries to import, one per turn/call in the session"
},
"session_id": {
"type": "string",
"description": "Shared session ID to tag every entry in this batch with"
}
}
}List all registered budget-spend webhook alerts with their IDs and settings.
No arguments.
{
"type": "object",
"required": [],
"properties": {}
}List stored chat conversation sessions with their IDs, last-updated timestamp, turn count, and a preview of the most recent user message. Use this when the user asks to see their past conversations or chat history.
| Argument | Type | Description |
|---|---|---|
| limit | integer | Maximum number of conversations to return (default: 20, max: 100) |
{
"type": "object",
"required": [],
"properties": {
"limit": {
"type": "integer",
"default": 20,
"maximum": 100,
"minimum": 1,
"description": "Maximum number of conversations to return (default: 20, max: 100)"
}
}
}List all registered price-change webhook alerts with their IDs and settings.
No arguments.
{
"type": "object",
"required": [],
"properties": {}
}Optimise a multi-task LLM workload by assigning the cheapest qualifying model to each task instead of running everything through one model. Takes a list of workloads (task type + monthly volume + optional quality floor and capability requirements) and returns a per-task model allocation, the total monthly cost, and the saving versus the best single-model deployment. If a monthly budget is given, leftover headroom is spent on the most cost-efficient quality upgrades. Use when the user asks how to cut LLM spend across several task types, or whether tiered model routing is worth it.
| Argument | Type | Description |
|---|---|---|
| workloads* | array | One entry per task type in the workload mix |
| min_quality_score | number | Global quality floor (0-100) applied to every workload |
| monthly_budget_usd | number | Total monthly budget in USD. Leftover headroom is spent on the most cost-efficient quality upgrades. |
{
"type": "object",
"required": [
"workloads"
],
"properties": {
"workloads": {
"type": "array",
"items": {
"type": "object",
"required": [
"task_type",
"monthly_requests"
],
"properties": {
"label": {
"type": "string",
"description": "Friendly name for this workload in the output"
},
"task_type": {
"enum": [
"classification",
"extraction",
"summarization",
"qa",
"code_generation",
"translation",
"chat",
"content_generation",
"reasoning",
"function_calling",
"data_analysis",
"rewrite"
],
"type": "string",
"description": "Task category driving the input/output token ratio"
},
"require_vision": {
"type": "boolean",
"default": false,
"description": "Task needs image input (default: false)"
},
"avg_input_tokens": {
"type": "integer",
"default": 500,
"minimum": 1,
"description": "Average prompt size in tokens (default: 500)"
},
"monthly_requests": {
"type": "integer",
"minimum": 0,
"description": "Expected requests per month for this task"
},
"avg_output_tokens": {
"type": "integer",
"minimum": 1,
"description": "Average completion size in tokens. Derived from the task profile when omitted."
},
"min_quality_score": {
"type": "number",
"maximum": 100,
"minimum": 0,
"description": "Quality floor (0-100) for this task specifically"
},
"min_context_tokens": {
"type": "integer",
"minimum": 1,
"description": "Minimum context window required for this task"
},
"require_function_calling": {
"type": "boolean",
"default": false,
"description": "Task needs tool/function calling (default: false)"
}
}
},
"minItems": 1,
"description": "One entry per task type in the workload mix"
},
"min_quality_score": {
"type": "number",
"maximum": 100,
"minimum": 0,
"description": "Global quality floor (0-100) applied to every workload"
},
"monthly_budget_usd": {
"type": "number",
"description": "Total monthly budget in USD. Leftover headroom is spent on the most cost-efficient quality upgrades.",
"exclusiveMinimum": 0
}
}
}Predict the real cost of an LLM call from your actual prompt text — no need to know token counts in advance. Counts tokens locally, infers the task type (or accepts one explicitly), estimates output length from empirical I/O profiles, and returns all models ranked cheapest-first with effective cost after prompt-cache savings. Also surfaces the best quality-per-dollar pick. Use this before making any LLM API call to avoid surprise bills.
| Argument | Type | Description |
|---|---|---|
| top_n | integer | Number of models to return, ranked cheapest-first (default: 10, max: 50) |
| prompt* | string | The actual prompt text to cost-estimate (required) |
| task_type | string | Task type for output-length estimation. Auto-inferred from prompt if omitted. Options: classification, extraction, summarization, qa, code_generation, translation, chat, content_generation, reasoning, function_calling, data_analysis, rewrite |
| require_vision | boolean | Only include models that support image/vision input (default: false) |
| cache_hit_ratio | number | Fraction of calls that hit the prompt cache (0–1). Set this if you have a large reusable system prompt. Supported providers: Anthropic (10% cache rate), OpenAI (50%), Google (25%). Default: 0 |
| min_context_tokens | integer | Minimum context window size required in tokens (optional) |
Recommend the optimal LLM model from a free-text description of your use case — no need to already know the routing engine's task_type vocabulary. Classifies the description into a task type, then runs it through the same routing engine behind /router/recommend (live pricing + benchmark quality, hard filters for cost/quality/context window, scored by quality-per-dollar). Returns the best match plus up to 3 alternatives. Read-only — use predict_cost first if you also want per-model cost estimates for an actual prompt, and optimize_workload if you have several distinct task types to route at once.
| Argument | Type | Description |
|---|---|---|
| task_type | string | Optional explicit task type, bypassing auto-classification of the description. Options: classification, extraction, summarization, qa, code_generation, translation, chat, content_generation, reasoning, function_calling, data_analysis, rewrite |
| description* | string | Free-text description of the use case, e.g. 'summarize long customer support tickets' or 'generate Python unit tests' |
| ide_context | string | IDE context hint — boosts IDE-native tools: 'copilot' | 'cursor' | 'windsurf' | 'claude_code' | 'jetbrains' | 'amazon_q' |
| avg_input_tokens | integer | Average input tokens per request (default: 500) |
| avg_output_tokens | integer | Average output tokens per request (default: 200) |
| min_quality_score | number |
Record actual token usage for a completed LLM call. Cost is computed server-side from current pricing, never trusted from the caller — this is the 'actual spend' counterpart to estimate_cost's hypothetical numbers. Optionally scope to an org_id for per-org spend tracking. Resubmitting the same request_id for the same org is a no-op. Use when the user wants to log or track real LLM spend, not just estimate it.
| Argument | Type | Description |
|---|---|---|
| org_id | string | Optional organisation ID to attribute this usage to |
| model_name* | string | Name of the LLM model that was called |
| request_id | string | Optional idempotency key — resubmitting the same value is a no-op |
| session_id | string | Optional session ID to tag this event with, so it can later be grouped and retrieved via analyze_session_usage — e.g. a bounded burst of calls like a coding-agent run or a chat session |
| occurred_at | number | Unix timestamp when the call happened (default: now) |
| input_tokens* | integer | Number of input tokens actually used |
| output_tokens* | integer | Number of output tokens actually used |
Register a webhook URL to receive notifications when actual recorded spend (from record_usage) crosses a USD threshold within a rolling window. Optionally scope to a specific org_id (omit for total spend across all orgs). Fires at most once per period_days while spend stays over threshold. Returns the alert ID.
| Argument | Type | Description |
|---|---|---|
| url* | string | Webhook URL to POST when the alert fires |
| org_id | string | Organisation to monitor. Omit for total spend across all orgs. |
| period_days | integer | Rolling look-back window for the spend check, in days (default: 30) |
| threshold_usd* | number | Spend level in USD that triggers the alert |
{
"type": "object",
"required": [
"url",
"threshold_usd"
],
"properties": {
"url": {
"type": "string",
"description": "Webhook URL to POST when the alert fires"
},
"org_id": {
"type": "string",
"description": "Organisation to monitor. Omit for total spend across all orgs."
},
"period_days": {
"type": "integer",
"default": 30,
"description": "Rolling look-back window for the spend check, in days (default: 30)"
},
"threshold_usd": {
"type": "number",
"description": "Spend level in USD that triggers the alert"
}
}
}Register a webhook URL to receive notifications when a model's price changes by more than a specified percentage. Optionally scope the alert to a specific provider or model. Returns the alert ID.
| Argument | Type | Description |
|---|---|---|
| url* | string | Webhook URL to POST when the alert fires |
| provider | string | Limit to a specific provider (e.g. 'openai'). Omit for all. |
| model_name | string | Limit to a specific model name. Omit for all models. |
| threshold_pct | number | Minimum absolute % price change to trigger the alert (default: 5.0) |
{
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "Webhook URL to POST when the alert fires"
},
"provider": {
"type": "string",
"description": "Limit to a specific provider (e.g. 'openai'). Omit for all."
},
"model_name": {
"type": "string",
"description": "Limit to a specific model name. Omit for all models."
},
"threshold_pct": {
"type": "number",
"default": 5,
"description": "Minimum absolute % price change to trigger the alert (default: 5.0)"
}
}
}| require_function_calling |
| boolean |
| Only include models that support function/tool calling (default: false) |
{
"type": "object",
"required": [
"prompt"
],
"properties": {
"top_n": {
"type": "integer",
"default": 10,
"maximum": 50,
"minimum": 1,
"description": "Number of models to return, ranked cheapest-first (default: 10, max: 50)"
},
"prompt": {
"type": "string",
"description": "The actual prompt text to cost-estimate (required)"
},
"task_type": {
"enum": [
"classification",
"extraction",
"summarization",
"qa",
"code_generation",
"translation",
"chat",
"content_generation",
"reasoning",
"function_calling",
"data_analysis",
"rewrite"
],
"type": "string",
"description": "Task type for output-length estimation. Auto-inferred from prompt if omitted. Options: classification, extraction, summarization, qa, code_generation, translation, chat, content_generation, reasoning, function_calling, data_analysis, rewrite"
},
"require_vision": {
"type": "boolean",
"default": false,
"description": "Only include models that support image/vision input (default: false)"
},
"cache_hit_ratio": {
"type": "number",
"default": 0,
"maximum": 1,
"minimum": 0,
"description": "Fraction of calls that hit the prompt cache (0–1). Set this if you have a large reusable system prompt. Supported providers: Anthropic (10% cache rate), OpenAI (50%), Google (25%). Default: 0"
},
"min_context_tokens": {
"type": "integer",
"minimum": 1,
"description": "Minimum context window size required in tokens (optional)"
},
"require_function_calling": {
"type": "boolean",
"default": false,
"description": "Only include models that support function/tool calling (default: false)"
}
}
}| Minimum required quality score (0-100) |
| min_context_window | integer | Minimum required context window size (tokens) |
| monthly_budget_usd | number | Monthly spend ceiling in USD. Combined with estimated_monthly_requests, avg_input_tokens, and avg_output_tokens to hard-filter models that would exceed it. |
| prefer_low_latency | boolean | Prioritise lower-latency models (default: false) |
| preferred_provider | string | Preferred provider name (10% score boost applied) |
| max_cost_per_1m_tokens | number | Maximum acceptable average cost per 1M tokens (USD) |
| exclude_reasoning_models | boolean | Exclude slow thinking/reasoning models (default: false) |
| estimated_monthly_requests | integer | Estimated requests per month (default: 1000) |
{
"type": "object",
"required": [
"description"
],
"properties": {
"task_type": {
"enum": [
"classification",
"extraction",
"summarization",
"qa",
"code_generation",
"translation",
"chat",
"content_generation",
"reasoning",
"function_calling",
"data_analysis",
"rewrite"
],
"type": "string",
"description": "Optional explicit task type, bypassing auto-classification of the description. Options: classification, extraction, summarization, qa, code_generation, translation, chat, content_generation, reasoning, function_calling, data_analysis, rewrite"
},
"description": {
"type": "string",
"description": "Free-text description of the use case, e.g. 'summarize long customer support tickets' or 'generate Python unit tests'"
},
"ide_context": {
"type": "string",
"description": "IDE context hint — boosts IDE-native tools: 'copilot' | 'cursor' | 'windsurf' | 'claude_code' | 'jetbrains' | 'amazon_q'"
},
"avg_input_tokens": {
"type": "integer",
"default": 500,
"minimum": 1,
"description": "Average input tokens per request (default: 500)"
},
"avg_output_tokens": {
"type": "integer",
"default": 200,
"minimum": 1,
"description": "Average output tokens per request (default: 200)"
},
"min_quality_score": {
"type": "number",
"maximum": 100,
"minimum": 0,
"description": "Minimum required quality score (0-100)"
},
"min_context_window": {
"type": "integer",
"minimum": 0,
"description": "Minimum required context window size (tokens)"
},
"monthly_budget_usd": {
"type": "number",
"description": "Monthly spend ceiling in USD. Combined with estimated_monthly_requests, avg_input_tokens, and avg_output_tokens to hard-filter models that would exceed it.",
"exclusiveMinimum": 0
},
"prefer_low_latency": {
"type": "boolean",
"default": false,
"description": "Prioritise lower-latency models (default: false)"
},
"preferred_provider": {
"type": "string",
"description": "Preferred provider name (10% score boost applied)"
},
"max_cost_per_1m_tokens": {
"type": "number",
"minimum": 0,
"description": "Maximum acceptable average cost per 1M tokens (USD)"
},
"exclude_reasoning_models": {
"type": "boolean",
"default": false,
"description": "Exclude slow thinking/reasoning models (default: false)"
},
"estimated_monthly_requests": {
"type": "integer",
"default": 1000,
"minimum": 1,
"description": "Estimated requests per month (default: 1000)"
}
}
}{
"type": "object",
"required": [
"model_name",
"input_tokens",
"output_tokens"
],
"properties": {
"org_id": {
"type": "string",
"description": "Optional organisation ID to attribute this usage to"
},
"model_name": {
"type": "string",
"description": "Name of the LLM model that was called"
},
"request_id": {
"type": "string",
"description": "Optional idempotency key — resubmitting the same value is a no-op"
},
"session_id": {
"type": "string",
"description": "Optional session ID to tag this event with, so it can later be grouped and retrieved via analyze_session_usage — e.g. a bounded burst of calls like a coding-agent run or a chat session"
},
"occurred_at": {
"type": "number",
"description": "Unix timestamp when the call happened (default: now)"
},
"input_tokens": {
"type": "integer",
"minimum": 0,
"description": "Number of input tokens actually used"
},
"output_tokens": {
"type": "integer",
"minimum": 0,
"description": "Number of output tokens actually used"
}
}
}