Run DeepInfra inference, list models and read account rate limits.
Maintain this server? Claim it
Call this server's tools from your browser. Nothing to install.
Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.
Tool list from our last check. Connect live to refresh it.
Get the current DeepInfra account / user details (identity, email, quotas). DeepInfra REST: GET /v1/me.
Include the onboarding checklist state in the response.
Get the current DeepInfra account / user details (identity, email, quotas). DeepInfra REST: GET /v1/me.
| Argument | Type | Description |
|---|---|---|
| checklist | boolean | Include the onboarding checklist state in the response. |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"checklist": {
"type": "boolean",
"description": "Include the onboarding checklist state in the response."
}
}
}Get one dedicated deployment by id (config + current status). DeepInfra REST: GET /deploy/{deploy_id}.
| Argument | Type | Description |
|---|---|---|
| deploy_id* | string | The deployment id (required). |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"deploy_id"
],
"properties": {
"deploy_id": {
"type": "string",
"minLength": 1,
"description": "The deployment id (required)."
}
}
}Get time-series stats (throughput / latency / replicas) for a dedicated deployment. DeepInfra REST: GET /deploy/{deploy_id}/stats2.
| Argument | Type | Description |
|---|---|---|
| to | string | Range end — unix timestamp or relative expression; defaults to now. |
| from* | string | Range start (required) — a unix timestamp or a relative expression like 'now-5h' (units: s, m, h, d, w). |
| deploy_id* | string | The deployment id (required). |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"deploy_id",
"from"
],
"properties": {
"to": {
"type": "string",
"description": "Range end — unix timestamp or relative expression; defaults to now."
},
"from": {
"type": "string",
"minLength": 1,
"description": "Range start (required) — a unix timestamp or a relative expression like 'now-5h' (units: s, m, h, d, w)."
},
"deploy_id": {
"type": "string",
"minLength": 1,
"description": "The deployment id (required)."
}
}
}Get GPU availability for LLM deployments (which hardware can currently be provisioned). DeepInfra REST: GET /deploy/llm/gpu_availability.
| Argument | Type | Description |
|---|---|---|
| source | string | Filter by source. |
| base_model | string | Filter by base model. |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"source": {
"type": "string",
"description": "Filter by source."
},
"base_model": {
"type": "string",
"description": "Filter by base model."
}
}
}Get the hardware options / GPU configuration available for a given model. DeepInfra REST: GET /v2/hardware.
| Argument | Type | Description |
|---|---|---|
| model* | string | The model name to query hardware for (required). |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"model"
],
"properties": {
"model": {
"type": "string",
"minLength": 1,
"description": "The model name to query hardware for (required)."
}
}
}Get global live inference metrics across the account (real-time throughput / activity). DeepInfra REST: GET /v1/metrics/live.
No arguments.
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {}
}Get one model's catalog entry (pricing, context length, capabilities). DeepInfra REST: GET /models/{model_name}.
| Argument | Type | Description |
|---|---|---|
| version | string | A specific model version (defaults to latest). |
| model_name* | string | The model name (required). May contain a slash, e.g. 'meta-llama/Meta-Llama-3-8B' — the slash is preserved in the path. |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"model_name"
],
"properties": {
"version": {
"type": "string",
"description": "A specific model version (defaults to latest)."
},
"model_name": {
"type": "string",
"minLength": 1,
"description": "The model name (required). May contain a slash, e.g. 'meta-llama/Meta-Llama-3-8B' — the slash is preserved in the path."
}
}
}Get the account's current rate limits (per-model / per-endpoint request and token limits). DeepInfra REST: GET /v1/me/rate_limit.
No arguments.
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {}
}Get spend / usage for a billing period. DeepInfra REST: GET /payment/usage.
| Argument | Type | Description |
|---|---|---|
| to | string | Period end (same format as `from`); defaults to the current period. |
| from* | string | Period start (required). Format 'YYYY.MM', or 'current', or 'current(-N)' for N months back, or a unix timestamp in seconds. |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"from"
],
"properties": {
"to": {
"type": "string",
"description": "Period end (same format as `from`); defaults to the current period."
},
"from": {
"type": "string",
"minLength": 1,
"description": "Period start (required). Format 'YYYY.MM', or 'current', or 'current(-N)' for N months back, or a unix timestamp in seconds."
}
}
}Get GPU rental (dedicated hardware) usage for a time range. DeepInfra REST: GET /payment/usage/rent.
| Argument | Type | Description |
|---|---|---|
| to | integer | Range end as a unix timestamp in seconds; defaults to now. |
| from* | integer | Range start as a unix timestamp in seconds (required). |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"from"
],
"properties": {
"to": {
"type": "integer",
"maximum": 9007199254740991,
"minimum": -9007199254740991,
"description": "Range end as a unix timestamp in seconds; defaults to now."
},
"from": {
"type": "integer",
"maximum": 9007199254740991,
"minimum": -9007199254740991,
"description": "Range start as a unix timestamp in seconds (required)."
}
}
}Get per-model token usage for a period. DeepInfra REST: GET /payment/usage/tokens.
| Argument | Type | Description |
|---|---|---|
| to | string | Period end (same format as `from`); defaults to the current period. |
| from* | string | Period start (required). Format 'YYYY.MM', or 'current', or 'current(-N)' for N months back, or a unix timestamp in seconds. |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"from"
],
"properties": {
"to": {
"type": "string",
"description": "Period end (same format as `from`); defaults to the current period."
},
"from": {
"type": "string",
"minLength": 1,
"description": "Period start (required). Format 'YYYY.MM', or 'current', or 'current(-N)' for N months back, or a unix timestamp in seconds."
}
}
}List the account's API tokens (metadata only, not secret values). DeepInfra REST: GET /v1/api-tokens.
No arguments.
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {}
}List the account's dedicated deployments. DeepInfra REST: GET /deploy/list.
| Argument | Type | Description |
|---|---|---|
| status | string | Comma-separated statuses to filter by, e.g. 'running,initializing'. |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"status": {
"type": "string",
"description": "Comma-separated statuses to filter by, e.g. 'running,initializing'."
}
}
}List billing invoices for the account. DeepInfra REST: GET /payment/invoices.
| Argument | Type | Description |
|---|---|---|
| limit | integer | Max number of invoices to return. |
| invoice_type | string | Filter by invoice type. |
| starting_after | string | Cursor — return invoices after this invoice id (pagination). |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"limit": {
"type": "integer",
"maximum": 9007199254740991,
"minimum": 1,
"description": "Max number of invoices to return."
},
"invoice_type": {
"type": "string",
"description": "Filter by invoice type."
},
"starting_after": {
"type": "string",
"description": "Cursor — return invoices after this invoice id (pagination)."
}
}
}List the DeepInfra model catalog (all available models). DeepInfra REST: GET /models/list.
No arguments.
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {}
}Query inference request logs for a dedicated deployment over a time window. DeepInfra REST: GET /v1/logs/query.
| Argument | Type | Description |
|---|---|---|
| to | string | Window end — fractional-seconds unix timestamp, exclusive. |
| from | string | Window start — fractional-seconds unix timestamp, inclusive. |
| limit | integer | Max log lines to return (default 100, range 1..1000). |
| deploy_id* | string | The deployment id to query logs for (required). |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"deploy_id"
],
"properties": {
"to": {
"type": "string",
"description": "Window end — fractional-seconds unix timestamp, exclusive."
},
"from": {
"type": "string",
"description": "Window start — fractional-seconds unix timestamp, inclusive."
},
"limit": {
"type": "integer",
"maximum": 1000,
"minimum": 1,
"description": "Max log lines to return (default 100, range 1..1000)."
},
"deploy_id": {
"type": "string",
"minLength": 1,
"description": "The deployment id to query logs for (required)."
}
}
}Start (resume) a dedicated deployment. WARNING: this resumes a dedicated deployment and may incur GPU charges while it runs. DeepInfra REST: POST /deploy/{deploy_id}/start.
| Argument | Type | Description |
|---|---|---|
| deploy_id* | string | The deployment id to start (required). |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"deploy_id"
],
"properties": {
"deploy_id": {
"type": "string",
"minLength": 1,
"description": "The deployment id to start (required)."
}
}
}Stop (pause) a running dedicated deployment. This halts inference and stops accruing GPU charges for it. DeepInfra REST: POST /deploy/{deploy_id}/stop.
| Argument | Type | Description |
|---|---|---|
| deploy_id* | string | The deployment id to stop (required). |
{
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"deploy_id"
],
"properties": {
"deploy_id": {
"type": "string",
"minLength": 1,
"description": "The deployment id to stop (required)."
}
}
}