Servers Playground How we check Add a server Log in

Terradev

Working · 808 ms

io.github.theoddden/terradevv6.2.20

Cross-cloud GPU orchestration CLI.

Cloud & DevOps AI & Agents

Source Registry entry

Maintain this server? Claim it

Try it

Call this server's tools from your browser. Nothing to install.

https://terradev-mcp.terradev.cloud/sse

Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.

Tool list from our last check. Connect live to refresh it.

active_context

Get current Terradev state: running training jobs, active instances, spend-to-date, alerts. Call this on session start to resume context from previous sessions.

credentialsobject

BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

This tool isn't marked read-only, so it may change something on the server or in an account you connected.

I understand, run it anyway

Terradev MCP server | mcptry

Terradev

Working · 808 ms

io.github.theoddden/terradevv6.2.20

Cross-cloud GPU orchestration CLI.

Cloud & DevOps AI & Agents

Source Registry entry

Maintain this server? Claim it

Try it

Call this server's tools from your browser. Nothing to install.

https://terradev-mcp.terradev.cloud/sse

Requests go through mcptry because browsers can't call most MCP servers directly. Header values are sent to the server for that request only and are never stored or logged.

Tool list from our last check. Connect live to refresh it.

active_context

Get current Terradev state: running training jobs, active instances, spend-to-date, alerts. Call this on session start to resume context from previous sessions.

credentialsobject

This tool isn't marked read-only, so it may change something on the server or in an account you connected.

I understand, run it anyway

Tools (277)

active_context

Get current Terradev state: running training jobs, active instances, spend-to-date, alerts. Call this on session start to resume context from previous sessions.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_agentic_serving_configure

Configure agentic inference serving settings.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_agentic_serving_helm_values

Print Helm values for agentic inference deployment.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_agentic_serving_k8s

Print K8s deployment manifests for agentic inference.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_agentic_serving_launch_args

Print engine launch arguments for copy-paste.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_agentic_serving_lmcache_env

Print LMCache environment variables.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_agentic_serving_show_config

Show current agentic serving configuration.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_cost

Show real-time cost breakdown for a fleet by tier.

Argument	Type	Description
fleet_id*	string	Fleet ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "fleet_id"
  ],
  "properties": {
    "fleet_id": {
      "type": "string",
      "description": "Fleet ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_deploy

Provision a heterogeneous agent fleet across all tiers simultaneously.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_langchain_create_langgraph

Create a LangGraph workflow.

Argument	Type	Description
graph_name*	string	graph_name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "graph_name"
  ],
  "properties": {
    "graph_name": {
      "type": "string",
      "description": "graph_name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_langchain_create_pipeline

Create an SGLang pipeline.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
pipeline_name*	string	pipeline_name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "pipeline_name"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "pipeline_name": {
      "type": "string",
      "description": "pipeline_name"
    }
  }
}

agent_langchain_create_workflow

Create a LangChain workflow.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
workflow_name*	string	workflow_name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "workflow_name"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "workflow_name": {
      "type": "string",
      "description": "workflow_name"
    }
  }
}

agent_langchain_test

Test connection to LangChain service.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_langgraph_create_workflow

Create a LangGraph workflow.

Argument	Type	Description
type*	string	Workflow type
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
workflow_name*	string	workflow_name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "workflow_name",
    "type"
  ],
  "properties": {
    "type": {
      "enum": [
        "orchestrator-worker",
        "evaluator-optimizer"
      ],
      "type": "string",
      "description": "Workflow type"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "workflow_name": {
      "type": "string",
      "description": "workflow_name"
    }
  }
}

agent_langgraph_deploy

Deploy a workflow.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
workflow_name*	string	workflow_name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "workflow_name"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "workflow_name": {
      "type": "string",
      "description": "workflow_name"
    }
  }
}

agent_langgraph_status

Get workflow status.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
workflow_id*	string	workflow_id

Input schema (JSON)

{
  "type": "object",
  "required": [
    "workflow_id"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "workflow_id": {
      "type": "string",
      "description": "workflow_id"
    }
  }
}

agent_langgraph_test

Test connection to LangGraph service.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_letta_chat

Send a message to a Letta agent.

Argument	Type	Description
message*	string	Message to send
agent_id*	string	Agent ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "agent_id",
    "message"
  ],
  "properties": {
    "message": {
      "type": "string",
      "description": "Message to send"
    },
    "agent_id": {
      "type": "string",
      "description": "Agent ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_letta_create

Create a new stateful Letta agent.

Argument	Type	Description
name*	string	Agent name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "name"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Agent name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_letta_delete

Delete a Letta agent.

Argument	Type	Description
agent_id*	string	Agent ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "agent_id"
  ],
  "properties": {
    "agent_id": {
      "type": "string",
      "description": "Agent ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_letta_list

List Letta agents.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_letta_remember

Teach a Letta agent a durable fact.

Argument	Type	Description
text*	string	Fact to remember
agent_id*	string	Agent ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "agent_id",
    "text"
  ],
  "properties": {
    "text": {
      "type": "string",
      "description": "Fact to remember"
    },
    "agent_id": {
      "type": "string",
      "description": "Agent ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_letta_status

Show the state of a Letta agent.

Argument	Type	Description
agent_id*	string	Agent ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "agent_id"
  ],
  "properties": {
    "agent_id": {
      "type": "string",
      "description": "Agent ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_list

List all known agent fleets.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_mem0_add

Store a memory in Mem0 for an agent or user.

Argument	Type	Description
text*	string	Text to remember
user_id*	string	User ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "text",
    "user_id"
  ],
  "properties": {
    "text": {
      "type": "string",
      "description": "Text to remember"
    },
    "user_id": {
      "type": "string",
      "description": "User ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_mem0_configure

Configure Mem0 credentials and defaults.

Argument	Type	Description
api_key*	string	Mem0 API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "Mem0 API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_mem0_delete

Delete a memory by ID.

Argument	Type	Description
memory_id*	string	Memory ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "memory_id"
  ],
  "properties": {
    "memory_id": {
      "type": "string",
      "description": "Memory ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_mem0_forget

Delete all memories matching an entity scope.

Argument	Type	Description
user_id*	string	User ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "user_id"
  ],
  "properties": {
    "user_id": {
      "type": "string",
      "description": "User ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_mem0_get

Get a single memory by ID.

Argument	Type	Description
memory_id*	string	Memory ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "memory_id"
  ],
  "properties": {
    "memory_id": {
      "type": "string",
      "description": "Memory ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_mem0_list

List memories for an entity scope.

Argument	Type	Description
user_id*	string	User ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "user_id"
  ],
  "properties": {
    "user_id": {
      "type": "string",
      "description": "User ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_mem0_search

Search agent/user memories.

Argument	Type	Description
query*	string	Search query
user_id*	string	User ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "query",
    "user_id"
  ],
  "properties": {
    "query": {
      "type": "string",
      "description": "Search query"
    },
    "user_id": {
      "type": "string",
      "description": "User ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_mem0_test

Test connection to Mem0.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_mem0_update

Update a memory by ID.

Argument	Type	Description
memory_id*	string	Memory ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "memory_id"
  ],
  "properties": {
    "memory_id": {
      "type": "string",
      "description": "Memory ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_plan

Plan a heterogeneous agent fleet without provisioning.

Argument	Type	Description
agents*	integer	Number of concurrent agent loops to provision for
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "agents"
  ],
  "properties": {
    "agents": {
      "type": "integer",
      "description": "Number of concurrent agent loops to provision for"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_scale

Scale a single fleet tier up or down without affecting other tiers.

Argument	Type	Description
tier*	string	Tier to scale
count*	integer	New instance count for this tier
fleet_id*	string	Fleet ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "fleet_id",
    "tier",
    "count"
  ],
  "properties": {
    "tier": {
      "enum": [
        "reasoning",
        "decode",
        "cpu_tools"
      ],
      "type": "string",
      "description": "Tier to scale"
    },
    "count": {
      "type": "integer",
      "description": "New instance count for this tier"
    },
    "fleet_id": {
      "type": "string",
      "description": "Fleet ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_skill_attach

Attach a skill.md to a Letta agent as a durable memory block.

Argument	Type	Description
skill*	string	Path to skill.md
agent_id*	string	Letta agent ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "agent_id",
    "skill"
  ],
  "properties": {
    "skill": {
      "type": "string",
      "description": "Path to skill.md"
    },
    "agent_id": {
      "type": "string",
      "description": "Letta agent ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_skill_init

Create a skill.md template for an agent.

Argument	Type	Description
name*	string	Skill name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "name"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Skill name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_status

Show live status of a fleet — tier health, KV hit rate, queue depth, cost.

Argument	Type	Description
fleet_id*	string	Fleet ID returned by 'terradev agent deploy'
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "fleet_id"
  ],
  "properties": {
    "fleet_id": {
      "type": "string",
      "description": "Fleet ID returned by 'terradev agent deploy'"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_teardown

Terminate all fleet instances and remove fleet state.

Argument	Type	Description
fleet_id*	string	Fleet ID to destroy
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "fleet_id"
  ],
  "properties": {
    "fleet_id": {
      "type": "string",
      "description": "Fleet ID to destroy"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_vector_db_down

Teardown a vector database provisioned for an agent fleet.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

agent_vector_db_up

Provision a vector database for an agent fleet.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

analytics

Get cost analytics

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

checkpoint_delete

Delete a checkpoint.

Argument	Type	Description
job_id*	string	Job ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
checkpoint_id*	string	Checkpoint ID to delete

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job_id",
    "checkpoint_id"
  ],
  "properties": {
    "job_id": {
      "type": "string",
      "description": "Job ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "checkpoint_id": {
      "type": "string",
      "description": "Checkpoint ID to delete"
    }
  }
}

checkpoint_list

List all checkpoints for a training job.

Argument	Type	Description
job_id*	string	Job ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job_id"
  ],
  "properties": {
    "job_id": {
      "type": "string",
      "description": "Job ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

checkpoint_promote

Promote a checkpoint to a final model path for serving.

Argument	Type	Description
dest*	string	Destination path (e.g., /models/final)
job_id*	string	Job ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
checkpoint_id*	string	Checkpoint ID to promote

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job_id",
    "checkpoint_id",
    "dest"
  ],
  "properties": {
    "dest": {
      "type": "string",
      "description": "Destination path (e.g., /models/final)"
    },
    "job_id": {
      "type": "string",
      "description": "Job ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "checkpoint_id": {
      "type": "string",
      "description": "Checkpoint ID to promote"
    }
  }
}

checkpoint_restore

Restore a specific checkpoint for a training job.

Argument	Type	Description
job_id*	string	Job ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job_id"
  ],
  "properties": {
    "job_id": {
      "type": "string",
      "description": "Job ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

checkpoint_save

Manually trigger a checkpoint save for a running training job.

Argument	Type	Description
job_id*	string	Job ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job_id"
  ],
  "properties": {
    "job_id": {
      "type": "string",
      "description": "Job ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

configure_provider

Configure provider credentials

Argument	Type	Description
provider*	string	Provider to configure
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "provider"
  ],
  "properties": {
    "provider": {
      "enum": [
        "runpod",
        "vastai",
        "aws",
        "gcp",
        "azure",
        "tensordock",
        "crusoe",
        "digitalocean",
        "hyperstack",
        "siliconflow",
        "latitude",
        "huggingface",
        "baseten",
        "inferx",
        "yottalabs",
        "e2enetworks",
        "gcore"
      ],
      "type": "string",
      "description": "Provider to configure"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

cost_analyze

Deep cost analysis of current GPU infrastructure: per-provider breakdown, utilization efficiency, waste identification, and optimization potential.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

cost_optimize_recommend

Generate actionable cost optimization recommendations: spot migration, GPU right-sizing, provider arbitrage, idle shutdown, and density packing.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

cost_simulate

Simulate cost optimization scenarios with ROI projections. Compare current vs optimized infrastructure costs.

Argument	Type	Description
scenario*	object	Scenario config (gpu_type, provider, count, spot, hours)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "scenario"
  ],
  "properties": {
    "scenario": {
      "type": "object",
      "description": "Scenario config (gpu_type, provider, count, spot, hours)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

create_postgresql_connection

Create a PostgreSQL database connection with auto-table creation. Returns a connection ID for subsequent operations.

Argument	Type	Description
host*	string	PostgreSQL host address
user*	string	Database user
database*	string	Database name
password*	string	Database password
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "host",
    "database",
    "user",
    "password"
  ],
  "properties": {
    "host": {
      "type": "string",
      "description": "PostgreSQL host address"
    },
    "user": {
      "type": "string",
      "description": "Database user"
    },
    "database": {
      "type": "string",
      "description": "Database name"
    },
    "password": {
      "type": "string",
      "description": "Database password"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

create_sqlite_connection

Create a SQLite database connection with auto-table creation. Returns a connection ID for subsequent operations.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

database_weaviate_create_collection

Create a Weaviate collection.

Argument	Type	Description
name*	string	Collection name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "name"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Collection name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

database_weaviate_delete_collection

Delete a Weaviate collection.

Argument	Type	Description
name*	string	Collection name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "name"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Collection name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

database_weaviate_hybrid_search

Hybrid vector + BM25 search in a Weaviate collection.

Argument	Type	Description
query*	string	Text query
collection*	string	collection
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "collection",
    "query"
  ],
  "properties": {
    "query": {
      "type": "string",
      "description": "Text query"
    },
    "collection": {
      "type": "string",
      "description": "collection"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

database_weaviate_insert

Insert objects into a Weaviate collection.

Argument	Type	Description
objects*	string	JSON list of objects [{properties: {...}, vector: [...]}]
collection*	string	collection
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "collection",
    "objects"
  ],
  "properties": {
    "objects": {
      "type": "string",
      "description": "JSON list of objects [{properties: {...}, vector: [...]}]"
    },
    "collection": {
      "type": "string",
      "description": "collection"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

database_weaviate_list_collections

List Weaviate collections.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

database_weaviate_query

Vector similarity search in a Weaviate collection.

Argument	Type	Description
vector*	string	JSON array of floats
collection*	string	collection
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "collection",
    "vector"
  ],
  "properties": {
    "vector": {
      "type": "string",
      "description": "JSON array of floats"
    },
    "collection": {
      "type": "string",
      "description": "collection"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

database_weaviate_up

Initialize a Weaviate connection.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

deepeval_evaluate

Evaluate a single LLM output with a DeepEval metric (AnswerRelevancy, Faithfulness, Hallucination, etc.).

Argument	Type	Description
input*	string	Test input/prompt
metric*	string	DeepEval metric name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
actual_output*	string	Actual LLM output

Input schema (JSON)

{
  "type": "object",
  "required": [
    "input",
    "actual_output",
    "metric"
  ],
  "properties": {
    "input": {
      "type": "string",
      "description": "Test input/prompt"
    },
    "metric": {
      "enum": [
        "AnswerRelevancyMetric",
        "FaithfulnessMetric",
        "ContextualRelevancyMetric",
        "ContextualPrecisionMetric",
        "ContextualRecallMetric",
        "HallucinationMetric",
        "BiasMetric",
        "ToxicityMetric",
        "SummarizationMetric",
        "RagasMetric"
      ],
      "type": "string",
      "description": "DeepEval metric name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "actual_output": {
      "type": "string",
      "description": "Actual LLM output"
    }
  }
}

deepeval_init

Generate a starter DeepEval test file.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

deepeval_metrics

List available DeepEval metrics for LLM evaluation.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

deepeval_run

Run a DeepEval test suite from a Python test file.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

dvc_diff

Show DVC diff between two revisions (e.g. training checkpoints). Shows added, modified, deleted files.

Argument	Type	Description
repo_path*	string	Path to the DVC repository
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "repo_path"
  ],
  "properties": {
    "repo_path": {
      "type": "string",
      "description": "Path to the DVC repository"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

dvc_push

Push DVC-tracked data to the configured remote storage.

Argument	Type	Description
repo_path*	string	Path to the DVC repository
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "repo_path"
  ],
  "properties": {
    "repo_path": {
      "type": "string",
      "description": "Path to the DVC repository"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

dvc_stage_checkpoint

Atomic checkpoint staging: DVC add + push + git commit in one operation. Promotes a training checkpoint to versioned storage.

Argument	Type	Description
repo_path*	string	Path to the DVC repository
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
checkpoint_path*	string	Path to the checkpoint file/directory to stage

Input schema (JSON)

{
  "type": "object",
  "required": [
    "repo_path",
    "checkpoint_path"
  ],
  "properties": {
    "repo_path": {
      "type": "string",
      "description": "Path to the DVC repository"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "checkpoint_path": {
      "type": "string",
      "description": "Path to the checkpoint file/directory to stage"
    }
  }
}

dvc_status

Get DVC repository status: tracked files, remotes, and changes since last commit.

Argument	Type	Description
repo_path*	string	Path to the DVC repository
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "repo_path"
  ],
  "properties": {
    "repo_path": {
      "type": "string",
      "description": "Path to the DVC repository"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

egress_cheapest_route

Find the cheapest egress route between cloud providers/regions for model weights or dataset transfer. Supports multi-hop routing.

Argument	Type	Description
size_gb*	number	Transfer size in GB
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
dest_region*	string	Destination region
dest_provider*	string	Destination cloud provider
source_region*	string	Source region (e.g. us-east-1)
source_provider*	string	Source cloud provider (e.g. aws, gcp, azure)

Input schema (JSON)

{
  "type": "object",
  "required": [
    "source_provider",
    "source_region",
    "dest_provider",
    "dest_region",
    "size_gb"
  ],
  "properties": {
    "size_gb": {
      "type": "number",
      "description": "Transfer size in GB"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "dest_region": {
      "type": "string",
      "description": "Destination region"
    },
    "dest_provider": {
      "type": "string",
      "description": "Destination cloud provider"
    },
    "source_region": {
      "type": "string",
      "description": "Source region (e.g. us-east-1)"
    },
    "source_provider": {
      "type": "string",
      "description": "Source cloud provider (e.g. aws, gcp, azure)"
    }
  }
}

egress_optimize_staging

Optimize dataset or model staging across regions by finding the cheapest transfer plan. Integrates with the dataset stager for parallel uploads.

Argument	Type	Description
size_gb*	number	Approximate data size in GB
source_uri*	string	Source data URI (s3://, gs://, local path, or HF dataset ID)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
target_regions*	array	Target regions as provider:region strings

Input schema (JSON)

{
  "type": "object",
  "required": [
    "source_uri",
    "target_regions",
    "size_gb"
  ],
  "properties": {
    "size_gb": {
      "type": "number",
      "description": "Approximate data size in GB"
    },
    "source_uri": {
      "type": "string",
      "description": "Source data URI (s3://, gs://, local path, or HF dataset ID)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "target_regions": {
      "type": "array",
      "items": {
        "type": "string"
      },
      "description": "Target regions as provider:region strings"
    }
  }
}

environments_approve

Approve a pending environment promotion.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

environments_create

Create a named deployment environment (dev/staging/prod) with config.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

environments_history

Show promotion/change history for an environment.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

environments_list

List deployment environments.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

environments_promote

Promote a workload or config between environments.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

get_database_connection

Get information about a database connection including type, status, and configuration.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
connection_id*	string	Database connection ID

Input schema (JSON)

{
  "type": "object",
  "required": [
    "connection_id"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "connection_id": {
      "type": "string",
      "description": "Database connection ID"
    }
  }
}

governance_compliance_report

Generate comprehensive compliance report: consent stats, policy evaluations, data movements, violations. For GDPR/SOC2/HIPAA audits.

Argument	Type	Description
end_date*	string	End date (ISO format, e.g. 2025-12-31)
start_date*	string	Start date (ISO format, e.g. 2025-01-01)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "start_date",
    "end_date"
  ],
  "properties": {
    "end_date": {
      "type": "string",
      "description": "End date (ISO format, e.g. 2025-12-31)"
    },
    "start_date": {
      "type": "string",
      "description": "Start date (ISO format, e.g. 2025-01-01)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

governance_evaluate_opa

Evaluate OPA (Open Policy Agent) policies for data access. Checks region restrictions, classification rules, and compliance requirements.

Argument	Type	Description
action*	string	Action to evaluate
user_id*	string	User ID to evaluate
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
dataset_name*	string	Dataset name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "user_id",
    "dataset_name",
    "action"
  ],
  "properties": {
    "action": {
      "enum": [
        "read",
        "write",
        "move",
        "delete",
        "train"
      ],
      "type": "string",
      "description": "Action to evaluate"
    },
    "user_id": {
      "type": "string",
      "description": "User ID to evaluate"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "dataset_name": {
      "type": "string",
      "description": "Dataset name"
    }
  }
}

governance_move_data

Move data with full governance audit trail. Requires prior consent and OPA policy approval. Tracks integrity, encryption, and compliance.

Argument	Type	Description
user_id*	string	User ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
dataset_name*	string	Dataset to move
source_location*	string	Source location
target_location*	string	Target location
consent_request_id*	string	Approved consent request ID

Input schema (JSON)

{
  "type": "object",
  "required": [
    "user_id",
    "consent_request_id",
    "dataset_name",
    "source_location",
    "target_location"
  ],
  "properties": {
    "user_id": {
      "type": "string",
      "description": "User ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "dataset_name": {
      "type": "string",
      "description": "Dataset to move"
    },
    "source_location": {
      "type": "string",
      "description": "Source location"
    },
    "target_location": {
      "type": "string",
      "description": "Target location"
    },
    "consent_request_id": {
      "type": "string",
      "description": "Approved consent request ID"
    }
  }
}

governance_movement_history

Get data movement audit log. Filter by user, dataset, or time range.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

governance_record_consent

Record a consent response (granted or denied) for a pending consent request.

Argument	Type	Description
granted*	boolean	Whether consent was granted
user_id*	string	User ID
request_id*	string	Consent request ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "request_id",
    "user_id",
    "granted"
  ],
  "properties": {
    "granted": {
      "type": "boolean",
      "description": "Whether consent was granted"
    },
    "user_id": {
      "type": "string",
      "description": "User ID"
    },
    "request_id": {
      "type": "string",
      "description": "Consent request ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

governance_request_consent

Request user consent for data movement across cloud regions. GDPR/SOC2 compliant consent tracking with audit trail.

Argument	Type	Description
purpose*	string	Purpose of data movement
user_id*	string	User ID requesting consent
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
consent_type*	string	Consent type
dataset_name*	string	Dataset being moved

Input schema (JSON)

{
  "type": "object",
  "required": [
    "user_id",
    "consent_type",
    "dataset_name",
    "purpose"
  ],
  "properties": {
    "purpose": {
      "type": "string",
      "description": "Purpose of data movement"
    },
    "user_id": {
      "type": "string",
      "description": "User ID requesting consent"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "consent_type": {
      "enum": [
        "data_staging",
        "cross_region",
        "third_party",
        "model_training"
      ],
      "type": "string",
      "description": "Consent type"
    },
    "dataset_name": {
      "type": "string",
      "description": "Dataset being moved"
    }
  }
}

gpu_topology

GPU NUMA topology report with intra-GPU XCD (Accelerated Compute Die) awareness. Models MI300X (8 XCDs, 192GB HBM3), MI300A (6 XCDs, 128GB), H200 (unified 141GB HBM3e), H100 (80GB). Reports PCIe locality (PIX/PXB/PHB/SYS), GPU-NIC pairing, SR-IOV VF status, and generates XCD-aware NCCL/AITER environment variables.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

guardrails_chat

Send a message through NeMo Guardrails and return the safety-filtered response. Applies topical, jailbreak, PII, and factcheck rails.

Argument	Type	Description
message*	string	Message to send through guardrails
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "message"
  ],
  "properties": {
    "message": {
      "type": "string",
      "description": "Message to send through guardrails"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

guardrails_generate_config

Generate default Colang 2.x guardrails configuration files (topical, jailbreak, PII, factcheck rails).

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

guardrails_k8s

Generate Kubernetes deployment manifest for NeMo Guardrails server (standalone or sidecar mode).

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

guardrails_test

Test connection to NeMo Guardrails server.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

helm_generate

Generate Helm charts from workload specifications.

Argument	Type	Description
image*	string	Container image
workload*	string	Workload type
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "workload",
    "image"
  ],
  "properties": {
    "image": {
      "type": "string",
      "description": "Container image"
    },
    "workload": {
      "enum": [
        "training",
        "inference",
        "batch"
      ],
      "type": "string",
      "description": "Workload type"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

hf_create_endpoint

Create a HuggingFace Inference Endpoint (paid GPU endpoint). Supports custom GPU types, regions, and scaling.

Argument	Type	Description
api_key*	string	HuggingFace API token
model_id*	string	HuggingFace model ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
endpoint_name*	string	Endpoint name
instance_type*	string	Instance type (e.g. nvidia-a100, nvidia-l4)

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id",
    "endpoint_name",
    "instance_type",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "HuggingFace API token"
    },
    "model_id": {
      "type": "string",
      "description": "HuggingFace model ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "endpoint_name": {
      "type": "string",
      "description": "Endpoint name"
    },
    "instance_type": {
      "type": "string",
      "description": "Instance type (e.g. nvidia-a100, nvidia-l4)"
    }
  }
}

hf_delete_endpoint

Delete a HuggingFace Inference Endpoint.

Argument	Type	Description
api_key*	string	HuggingFace API token
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
endpoint_name*	string	Endpoint name to delete

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint_name",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "HuggingFace API token"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "endpoint_name": {
      "type": "string",
      "description": "Endpoint name to delete"
    }
  }
}

hf_endpoint_infer

Run inference on a HuggingFace Inference Endpoint. Supports text generation, embeddings, and custom inputs.

Argument	Type	Description
inputs*	string	Input text or prompt
api_key*	string	HuggingFace API token
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
endpoint_name*	string	Endpoint name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint_name",
    "inputs",
    "api_key"
  ],
  "properties": {
    "inputs": {
      "type": "string",
      "description": "Input text or prompt"
    },
    "api_key": {
      "type": "string",
      "description": "HuggingFace API token"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "endpoint_name": {
      "type": "string",
      "description": "Endpoint name"
    }
  }
}

hf_endpoint_info

Get detailed info about a specific HuggingFace Inference Endpoint: status, URL, scaling config, cost.

Argument	Type	Description
api_key*	string	HuggingFace API token
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
endpoint_name*	string	Endpoint name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint_name",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "HuggingFace API token"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "endpoint_name": {
      "type": "string",
      "description": "Endpoint name"
    }
  }
}

hf_hardware_compare

Compare all hardware options for a HuggingFace model. Returns side-by-side cost, performance, and compatibility analysis.

Argument	Type	Description
model_id*	string	HuggingFace model ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "HuggingFace model ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

hf_hardware_recommend

Get hardware recommendation with cost breakdown for any HuggingFace model. Returns optimal GPU type, estimated cost, and performance score.

Argument	Type	Description
model_id*	string	HuggingFace model ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "HuggingFace model ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

hf_list_datasets

Search and browse HuggingFace Hub datasets. Filter by author and search query.

Argument	Type	Description
api_key*	string	HuggingFace API token
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "HuggingFace API token"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

hf_list_endpoints

List all active HuggingFace Inference Endpoints with status, URL, and cost.

Argument	Type	Description
api_key*	string	HuggingFace API token
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "HuggingFace API token"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

hf_list_models

Search and browse HuggingFace Hub models. Filter by author, task, library. Returns model ID, downloads, likes, and tags.

Argument	Type	Description
api_key*	string	HuggingFace API token
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "HuggingFace API token"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

hf_model_info

Get detailed model info: architecture, size, downloads, license, tags, pipeline_tag, and model card.

Argument	Type	Description
api_key*	string	HuggingFace API token
model_id*	string	HuggingFace model ID (e.g. meta-llama/Llama-3.3-70B-Instruct)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "HuggingFace API token"
    },
    "model_id": {
      "type": "string",
      "description": "HuggingFace model ID (e.g. meta-llama/Llama-3.3-70B-Instruct)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

hf_smart_template

Auto-generate an optimized deployment template for any HuggingFace model. Analyzes model size, architecture, and quantization to select optimal hardware and generate ready-to-deploy configs.

Argument	Type	Description
model_id*	string	HuggingFace model ID (e.g. meta-llama/Llama-3.3-70B-Instruct)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "HuggingFace model ID (e.g. meta-llama/Llama-3.3-70B-Instruct)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

hf_space_deploy

Deploy model to HuggingFace Spaces

Argument	Type	Description
model_id*	string	HuggingFace model ID
template*	string	Template type
space_name*	string	Name of the Space
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "space_name",
    "model_id",
    "template"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "HuggingFace model ID"
    },
    "template": {
      "enum": [
        "llm",
        "embedding",
        "image"
      ],
      "type": "string",
      "description": "Template type"
    },
    "space_name": {
      "type": "string",
      "description": "Name of the Space"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

hf_space_status

Get HuggingFace Space deployment status.

Argument	Type	Description
space_name*	string	Space name to check
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "space_name"
  ],
  "properties": {
    "space_name": {
      "type": "string",
      "description": "Space name to check"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

infer_failover

Run health checks and auto-failover for inference endpoints. If a primary endpoint is unhealthy and has a backup configured, traffic automatically shifts to the backup provider.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

infer_route

Semantic-aware inference routing. Analyzes query content across 6 signal dimensions (modality, complexity, domain, language, safety, keywords), applies NUMA-aware endpoint scoring, and selects the optimal inference endpoint. Uses DAG parallel execution for signal extraction.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

infer_route_disagg

Disaggregated Prefill/Decode routing (DistServe architecture). Splits LLM inference into compute-bound prefill phase (routed to FLOPS-optimized GPUs like H100 SXM) and memory-bound decode phase (routed to bandwidth-optimized GPUs like MI300X). Tracks KV cache handoffs between endpoint pairs.

Argument	Type	Description
model*	string	Model name for disaggregated pair selection (e.g., llama-3-70b)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model name for disaggregated pair selection (e.g., llama-3-70b)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

inferx_configure

Configure InferX serverless platform credentials.

Argument	Type	Description
api_key*	string	InferX API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "InferX API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

inferx_delete

Delete an InferX model deployment.

Argument	Type	Description
model_id*	string	Model deployment ID to delete
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "Model deployment ID to delete"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

inferx_deploy

Deploy model to InferX serverless platform

Argument	Type	Description
model*	string	Model ID (e.g., meta-llama/Llama-2-7b-hf)
gpu_type*	string	GPU type for inference
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model",
    "gpu_type"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model ID (e.g., meta-llama/Llama-2-7b-hf)"
    },
    "gpu_type": {
      "enum": [
        "H100",
        "A100",
        "A10G",
        "L40S",
        "L4",
        "T4",
        "RTX4090",
        "RTX3090",
        "V100"
      ],
      "type": "string",
      "description": "GPU type for inference"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

inferx_list

List deployed InferX models

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

inferx_optimize

Get cost analysis for inference endpoints

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

inferx_quote

Get InferX pricing quotes for a GPU type.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

inferx_status

Check InferX endpoint status

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

inferx_usage

Get InferX account usage statistics: requests, cost, GPU hours, latency.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

k8s_create

Create Kubernetes cluster with GPU nodes for optimal multi-cloud deployment

Argument	Type	Description
gpu_type*	string	GPU type for nodes
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
cluster_name*	string	Name of the cluster

Input schema (JSON)

{
  "type": "object",
  "required": [
    "cluster_name",
    "gpu_type"
  ],
  "properties": {
    "gpu_type": {
      "enum": [
        "H100",
        "A100",
        "A10G",
        "L40S",
        "L4",
        "T4",
        "RTX4090",
        "RTX3090",
        "V100"
      ],
      "type": "string",
      "description": "GPU type for nodes"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "cluster_name": {
      "type": "string",
      "description": "Name of the cluster"
    }
  }
}

k8s_destroy

Destroy a Kubernetes cluster

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
cluster_name*	string	Name of the cluster to destroy

Input schema (JSON)

{
  "type": "object",
  "required": [
    "cluster_name"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "cluster_name": {
      "type": "string",
      "description": "Name of the cluster to destroy"
    }
  }
}

k8s_device_plugin

Configure Kubernetes GPU device plugin settings: time-slicing, MIG strategy, and resource naming.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
cluster_name*	string	Target cluster name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "cluster_name"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "cluster_name": {
      "type": "string",
      "description": "Target cluster name"
    }
  }
}

k8s_gpu_operator_install

Install NVIDIA GPU Operator on a Kubernetes cluster. Configures driver containers, device plugin, DCGM exporter, and GPU Feature Discovery.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
cluster_name*	string	Target cluster name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "cluster_name"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "cluster_name": {
      "type": "string",
      "description": "Target cluster name"
    }
  }
}

k8s_info

Get information about a specific cluster

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
cluster_name*	string	Name of the cluster

Input schema (JSON)

{
  "type": "object",
  "required": [
    "cluster_name"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "cluster_name": {
      "type": "string",
      "description": "Name of the cluster"
    }
  }
}

k8s_list

List Kubernetes clusters

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

k8s_mig_configure

Configure Multi-Instance GPU (MIG) partitioning on A100/H100 GPUs. Splits a single GPU into isolated instances for multi-tenant workloads.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
mig_profile*	string	MIG profile
cluster_name*	string	Target cluster name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "cluster_name",
    "mig_profile"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "mig_profile": {
      "enum": [
        "1g.5gb",
        "1g.10gb",
        "2g.10gb",
        "3g.20gb",
        "4g.20gb",
        "7g.40gb",
        "7g.80gb"
      ],
      "type": "string",
      "description": "MIG profile"
    },
    "cluster_name": {
      "type": "string",
      "description": "Target cluster name"
    }
  }
}

k8s_time_slicing

Configure GPU time-slicing for Kubernetes. Allows multiple pods to share a single GPU with configurable oversubscription.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
cluster_name*	string	Target cluster name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "cluster_name"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "cluster_name": {
      "type": "string",
      "description": "Target cluster name"
    }
  }
}

karpenter_create_nodepool

Create a Karpenter GPU NodePool.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

karpenter_delete_nodepool

Delete a Karpenter NodePool.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

karpenter_events

Show recent Karpenter scaling events.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

karpenter_gpu_nodes

List GPU nodes provisioned by Karpenter.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

karpenter_install

Install Karpenter on an EKS cluster for GPU node autoscaling.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

karpenter_logs

Show Karpenter controller logs.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

karpenter_nodepools

List Karpenter NodePools.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

karpenter_resources

Show Karpenter resource usage and capacity.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

karpenter_status

Show Karpenter installation/controller status.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

kserve_generate_yaml

Generate a GPU-aware KServe InferenceService YAML manifest with NUMA pinning, resource limits derived from model size and VRAM, and topology hints.

Argument	Type	Description
gpu_type*	string	GPU type (e.g. A100, H100)
model_uri*	string	Model storage URI (e.g. s3://bucket/model or gs://bucket/model)
model_name*	string	Model name for the InferenceService
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_name",
    "model_uri",
    "gpu_type"
  ],
  "properties": {
    "gpu_type": {
      "type": "string",
      "description": "GPU type (e.g. A100, H100)"
    },
    "model_uri": {
      "type": "string",
      "description": "Model storage URI (e.g. s3://bucket/model or gs://bucket/model)"
    },
    "model_name": {
      "type": "string",
      "description": "Model name for the InferenceService"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

kserve_list

List KServe InferenceServices in a Kubernetes namespace.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

kserve_status

Get detailed status of a KServe InferenceService including readiness, traffic split, and URL.

Argument	Type	Description
name*	string	InferenceService name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "name"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "InferenceService name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

kv_cache_efficiency

Analyze KV cache efficiency across serving endpoints.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langchain_create_sglang_pipeline

Create an SGLang model-serving pipeline via LangChain. Connects LangChain agents to SGLang inference endpoints.

Argument	Type	Description
api_key*	string	LangChain API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
pipeline_config*	object	Pipeline config (model, endpoint, temperature, max_tokens)

Input schema (JSON)

{
  "type": "object",
  "required": [
    "pipeline_config",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "LangChain API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "pipeline_config": {
      "type": "object",
      "description": "Pipeline config (model, endpoint, temperature, max_tokens)"
    }
  }
}

langchain_create_workflow

Create a LangChain workflow.

Argument	Type	Description
api_key*	string	LangChain API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
workflow_config*	object	Workflow configuration (name, steps, model, tools)

Input schema (JSON)

{
  "type": "object",
  "required": [
    "workflow_config",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "LangChain API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "workflow_config": {
      "type": "object",
      "description": "Workflow configuration (name, steps, model, tools)"
    }
  }
}

langfuse_configure

Configure Langfuse credentials (public key, secret key, host URL).

Argument	Type	Description
public_key*	string	Langfuse public key (pk-lf-...)
secret_key*	string	Langfuse secret key (sk-lf-...)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "public_key",
    "secret_key"
  ],
  "properties": {
    "public_key": {
      "type": "string",
      "description": "Langfuse public key (pk-lf-...)"
    },
    "secret_key": {
      "type": "string",
      "description": "Langfuse secret key (sk-lf-...)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langfuse_datasets

List Langfuse datasets for evaluation and fine-tuning.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langfuse_export_training_data

Export Langfuse traces as instruction/response pairs for LoRA fine-tuning. Filters by quality score.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langfuse_k8s

Generate Kubernetes deployment manifest for self-hosted Langfuse.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langfuse_otel_env

Print OTEL environment variables for instrumenting LLM apps to send traces to Langfuse.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langfuse_quality

Get aggregated quality metrics from Langfuse scores for drift detection.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langfuse_score

Create an evaluation score for a Langfuse trace (e.g. quality, accuracy, relevance).

Argument	Type	Description
name*	string	Score name (e.g. quality, accuracy)
value*	number	Numeric score value
trace_id*	string	Trace ID to score
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "trace_id",
    "name",
    "value"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Score name (e.g. quality, accuracy)"
    },
    "value": {
      "type": "number",
      "description": "Numeric score value"
    },
    "trace_id": {
      "type": "string",
      "description": "Trace ID to score"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langfuse_scores

List evaluation scores from Langfuse, optionally filtered by trace or score name.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langfuse_test

Test Langfuse connectivity and list accessible projects.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langfuse_trace

Get a single Langfuse trace with all observations/spans.

Argument	Type	Description
trace_id*	string	Trace ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "trace_id"
  ],
  "properties": {
    "trace_id": {
      "type": "string",
      "description": "Trace ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langfuse_traces

List recent LLM traces from Langfuse.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

langgraph_create_workflow

Create a LangGraph stateful workflow with monitoring. Supports agent graphs, tool calling, and state persistence.

Argument	Type	Description
api_key*	string	LangChain API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
graph_config*	object	Graph configuration (nodes, edges, state_schema)

Input schema (JSON)

{
  "type": "object",
  "required": [
    "graph_config",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "LangChain API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "graph_config": {
      "type": "object",
      "description": "Graph configuration (nodes, edges, state_schema)"
    }
  }
}

langgraph_evaluation_workflow

Create an evaluator-optimizer workflow in LangGraph. Generates outputs, evaluates quality, and iteratively improves.

Argument	Type	Description
api_key*	string	LangChain API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
evaluation_config*	object	Evaluation config (generator_prompt, evaluator_criteria, max_iterations)

Input schema (JSON)

{
  "type": "object",
  "required": [
    "evaluation_config",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "LangChain API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "evaluation_config": {
      "type": "object",
      "description": "Evaluation config (generator_prompt, evaluator_criteria, max_iterations)"
    }
  }
}

langgraph_orchestrator_worker

Create an orchestrator-worker pattern workflow in LangGraph. The orchestrator delegates tasks to specialized worker agents.

Argument	Type	Description
api_key*	string	LangChain API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
workflow_config*	object	Orchestrator-worker config (orchestrator_prompt, workers, routing_strategy)

Input schema (JSON)

{
  "type": "object",
  "required": [
    "workflow_config",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "LangChain API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "workflow_config": {
      "type": "object",
      "description": "Orchestrator-worker config (orchestrator_prompt, workers, routing_strategy)"
    }
  }
}

langgraph_workflow_status

Get the status and metrics of a LangGraph workflow execution.

Argument	Type	Description
api_key*	string	LangChain API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
workflow_id*	string	Workflow ID to check

Input schema (JSON)

{
  "type": "object",
  "required": [
    "workflow_id",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "LangChain API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "workflow_id": {
      "type": "string",
      "description": "Workflow ID to check"
    }
  }
}

lineage_checkpoint

Record a data/model lineage checkpoint.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

lineage_diff

Diff lineage between two artifacts or checkpoints.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

lineage_export

Export lineage data (JSON/graph) for an artifact.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

lineage_graph

Render the lineage graph for an artifact.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

lineage_trace

Trace the lineage of a dataset or model artifact.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

local_scan

Scan local machine and network for available GPU devices. Returns total VRAM pool for local-first provisioning.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

lora_add

Hot-load a LoRA adapter onto a running vLLM endpoint. The adapter becomes immediately available as a model name for inference requests. Uses vLLM's fused_moe_lora kernel for 454% higher output tokens/sec on MoE models.

Argument	Type	Description
name*	string	Adapter name (becomes the model name in API requests)
path*	string	Path to adapter weights (local path or HuggingFace ID)
endpoint*	string	vLLM endpoint URL (e.g. http://10.0.0.1:8000)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint",
    "name",
    "path"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Adapter name (becomes the model name in API requests)"
    },
    "path": {
      "type": "string",
      "description": "Path to adapter weights (local path or HuggingFace ID)"
    },
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint URL (e.g. http://10.0.0.1:8000)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

lora_list

List LoRA adapters loaded on a running vLLM endpoint. Shows base models and hot-loaded fine-tuned adapters.

Argument	Type	Description
endpoint*	string	vLLM endpoint URL (e.g. http://10.0.0.1:8000)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint"
  ],
  "properties": {
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint URL (e.g. http://10.0.0.1:8000)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

lora_remove

Hot-unload a LoRA adapter from a running vLLM endpoint. Frees GPU memory for other adapters.

Argument	Type	Description
name*	string	Adapter name to unload
endpoint*	string	vLLM endpoint URL (e.g. http://10.0.0.1:8000)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint",
    "name"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Adapter name to unload"
    },
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint URL (e.g. http://10.0.0.1:8000)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

manage_instance

Manage GPU instances (stop/start/terminate)

Argument	Type	Description
action*	string	Action to perform
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
instance_id*	string	Instance ID

Input schema (JSON)

{
  "type": "object",
  "required": [
    "instance_id",
    "action"
  ],
  "properties": {
    "action": {
      "enum": [
        "stop",
        "start",
        "terminate"
      ],
      "type": "string",
      "description": "Action to perform"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "instance_id": {
      "type": "string",
      "description": "Instance ID"
    }
  }
}

manifests

List cached manifests and versions for jobs.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

migrate_compare

Compare migration target providers by cost/compatibility.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

migrate_execute

Execute a previously-planned workload migration.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

migrate_plan

Plan a workload migration between providers with cost analysis.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

migrate_rollback

Roll back a migration to the source provider.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

migrate_status

Show status of running/completed migrations.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ml_vllm_lora_link

Load the active registry version of an adapter onto a vLLM server.

Argument	Type	Description
name*	string	Registered adapter name
endpoint*	string	vLLM endpoint
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint",
    "name"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Registered adapter name"
    },
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ml_vllm_lora_list

List LoRA adapters currently loaded on a vLLM server.

Argument	Type	Description
endpoint*	string	vLLM endpoint
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint"
  ],
  "properties": {
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ml_vllm_lora_load

Hot-load a LoRA adapter onto a running vLLM server.

Argument	Type	Description
name*	string	Adapter name
path*	string	Local path to adapter weights
endpoint*	string	vLLM endpoint
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint",
    "name",
    "path"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Adapter name"
    },
    "path": {
      "type": "string",
      "description": "Local path to adapter weights"
    },
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ml_vllm_lora_sync

Synchronize an adapter from the registry across multiple vLLM replicas.

Argument	Type	Description
name*	string	Registered adapter name
replicas*	string	Comma-separated host:port list
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "name",
    "replicas"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Registered adapter name"
    },
    "replicas": {
      "type": "string",
      "description": "Comma-separated host:port list"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ml_vllm_lora_unload

Hot-unload a LoRA adapter from a running vLLM server.

Argument	Type	Description
name*	string	Adapter name to unload
endpoint*	string	vLLM endpoint
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint",
    "name"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Adapter name to unload"
    },
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

mlflow_list_experiments

List MLflow experiments on the configured tracking server.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
tracking_uri*	string	MLflow tracking server URI

Input schema (JSON)

{
  "type": "object",
  "required": [
    "tracking_uri"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "tracking_uri": {
      "type": "string",
      "description": "MLflow tracking server URI"
    }
  }
}

mlflow_log_run

Log a Terradev training run to MLflow with auto-injected GPU type, provider, cost/hr, and duration as params.

Argument	Type	Description
run_name*	string	Run display name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
tracking_uri*	string	MLflow tracking server URI
experiment_name*	string	MLflow experiment name

Input schema (JSON)

{
  "type": "object",
  "required": [
    "tracking_uri",
    "experiment_name",
    "run_name"
  ],
  "properties": {
    "run_name": {
      "type": "string",
      "description": "Run display name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "tracking_uri": {
      "type": "string",
      "description": "MLflow tracking server URI"
    },
    "experiment_name": {
      "type": "string",
      "description": "MLflow experiment name"
    }
  }
}

mlflow_register_model

Argument	Type	Description
run_id*	string	MLflow run ID that produced the model
model_name*	string	Model registry name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
tracking_uri*	string	MLflow tracking server URI

Input schema (JSON)

{
  "type": "object",
  "required": [
    "tracking_uri",
    "model_name",
    "run_id"
  ],
  "properties": {
    "run_id": {
      "type": "string",
      "description": "MLflow run ID that produced the model"
    },
    "model_name": {
      "type": "string",
      "description": "Model registry name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "tracking_uri": {
      "type": "string",
      "description": "MLflow tracking server URI"
    }
  }
}

moe_deploy

Deploy Mixture-of-Experts models with production-ready cluster templates. Auto-applies vLLM cost optimizations (KV cache offloading for up to 9x throughput, MTP speculative decoding for up to 2.8x speed, sleep mode for 18-200x faster restarts). Supports GLM-5, Qwen 3.5, Mistral Large 3, DeepSeek V4, Llama 5. Configures NVLink topology, tensor parallelism, FP8 quantization, vLLM/SGLang backends, and GPU-aware HPA autoscaling.

Argument	Type	Description
gpu_type*	string	GPU type for MoE serving
model_id*	string	HuggingFace model ID (e.g., zai-org/GLM-5-FP8, Qwen/Qwen3.5-397B-A17B)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id",
    "gpu_type"
  ],
  "properties": {
    "gpu_type": {
      "enum": [
        "H100",
        "H200",
        "H800",
        "A100",
        "MI300X"
      ],
      "type": "string",
      "description": "GPU type for MoE serving"
    },
    "model_id": {
      "type": "string",
      "description": "HuggingFace model ID (e.g., zai-org/GLM-5-FP8, Qwen/Qwen3.5-397B-A17B)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ollama_chat

Chat with an Ollama model using the chat/completions API.

Argument	Type	Description
model*	string	Model name
messages*	array	Chat messages [{role, content}]
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model",
    "messages"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model name"
    },
    "messages": {
      "type": "array",
      "items": {
        "type": "object"
      },
      "description": "Chat messages [{role, content}]"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ollama_generate

Generate text using an Ollama model (non-chat completions).

Argument	Type	Description
model*	string	Model name
prompt*	string	Prompt text
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model",
    "prompt"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model name"
    },
    "prompt": {
      "type": "string",
      "description": "Prompt text"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ollama_list

List models available on an Ollama server.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ollama_model_info

Get detailed information about an Ollama model (parameters, template, license).

Argument	Type	Description
model*	string	Model name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ollama_ps

List currently running Ollama models.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ollama_pull

Pull a model to an Ollama server on a remote instance.

Argument	Type	Description
model*	string	Model name (e.g. llama3.2, deepseek-r1, codellama)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
instance_ip*	string	Target instance IP

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model",
    "instance_ip"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model name (e.g. llama3.2, deepseek-r1, codellama)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "instance_ip": {
      "type": "string",
      "description": "Target instance IP"
    }
  }
}

optimize

Find cheaper alternatives for running instances

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

orchestrator_evict

Evict a model from GPU memory.

Argument	Type	Description
model_id*	string	Model to evict
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "Model to evict"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

orchestrator_infer

Test inference with a model via the orchestrator.

Argument	Type	Description
model_id*	string	Model to run inference on
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "Model to run inference on"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

orchestrator_load

Load a model into GPU memory.

Argument	Type	Description
model_id*	string	Model to load
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "Model to load"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

orchestrator_register

Argument	Type	Description
model_id*	string	Model identifier
model_path*	string	Path to model weights
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id",
    "model_path"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "Model identifier"
    },
    "model_path": {
      "type": "string",
      "description": "Path to model weights"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

orchestrator_start

Start the model orchestrator for multi-model GPU sharing with eviction policies.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

orchestrator_status

Get orchestrator and model status including GPU memory utilization.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

phoenix_k8s

Generate Kubernetes deployment manifest for self-hosted Arize Phoenix server.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

phoenix_otel_env

Generate OpenTelemetry environment variables for instrumenting serving pods with Phoenix tracing.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

phoenix_projects

List Phoenix projects (trace namespaces).

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

phoenix_snippet

Generate Python instrumentation snippet for adding Phoenix tracing to LLM applications.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

phoenix_spans

List recent spans for a Phoenix project. Supports SpanQuery DSL filters like "span_kind == 'RETRIEVER'" or "status_code == 'ERROR'".

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

phoenix_test

Test connection to Arize Phoenix server. Returns collector endpoint and project count.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

phoenix_trace

View full execution tree for a specific trace ID. Shows span hierarchy, latencies, and token counts.

Argument	Type	Description
trace_id*	string	Trace ID to inspect
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "trace_id"
  ],
  "properties": {
    "trace_id": {
      "type": "string",
      "description": "Trace ID to inspect"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

preflight

Pre-training validation: GPU availability, NCCL, RDMA, drivers across all nodes.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

preflight_gpu_check

GPU-specific preflight validation: NVIDIA drivers, CUDA version, GPU count, NCCL, NVLink topology, NCU stall-signature profiling, and adversarial config verification (V1-V3).

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

preflight_network_check

Network-specific preflight validation: RDMA availability, InfiniBand status, inter-node bandwidth, latency matrix, firewall rules.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

preflight_provision

Run preflight validation before provisioning GPU instances.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

preflight_report

Generate full preflight validation report with pass/warn/fail per check. Covers GPU drivers, CUDA, NCCL, RDMA, network, disk, and Docker.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

price_intel

GPU price intelligence with quantitative analytics. Computes delta (rate of change), gamma (acceleration), and annualized realized volatility on GPU spot/on-demand prices across 21+ providers. Identifies cheapest time windows and provider arbitrage opportunities.

Argument	Type	Description
gpu_type*	string	GPU type to analyze
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "gpu_type"
  ],
  "properties": {
    "gpu_type": {
      "enum": [
        "H100",
        "H200",
        "H800",
        "A100",
        "A10G",
        "L40S",
        "L4",
        "T4",
        "RTX4090",
        "RTX3090",
        "V100",
        "V100S",
        "A6000",
        "MI300X"
      ],
      "type": "string",
      "description": "GPU type to analyze"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

price_spot_risk

Spot instance risk assessment per provider. Returns interruption probability, mean time to interruption, and recommended mitigation.

Argument	Type	Description
gpu_type*	string	GPU type
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "gpu_type"
  ],
  "properties": {
    "gpu_type": {
      "type": "string",
      "description": "GPU type"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

price_trends

Get GPU price trend analysis with delta (rate of change), gamma (acceleration), and annualized volatility. Identifies cheapest time windows.

Argument	Type	Description
gpu_type*	string	GPU type
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "gpu_type"
  ],
  "properties": {
    "gpu_type": {
      "enum": [
        "H100",
        "H200",
        "H800",
        "A100",
        "A10G",
        "L40S",
        "L4",
        "T4",
        "RTX4090",
        "V100S",
        "A6000",
        "MI300X"
      ],
      "type": "string",
      "description": "GPU type"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

provision_gpu

Provision GPU instances for optimal parallel efficiency

Argument	Type	Description
gpu_type*	string	GPU type to provision
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "gpu_type"
  ],
  "properties": {
    "gpu_type": {
      "enum": [
        "H100",
        "A100",
        "A10G",
        "L40S",
        "L4",
        "T4",
        "RTX4090",
        "RTX3090",
        "V100"
      ],
      "type": "string",
      "description": "GPU type to provision"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

qdrant_collections

List all Qdrant vector collections with their point counts and configurations.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

qdrant_count

Count points (vectors) in a Qdrant collection.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

qdrant_create_collection

Create a Qdrant vector collection. Auto-configures vector dimensions from embedding model name.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

qdrant_info

Get detailed info and stats for a Qdrant collection.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

qdrant_k8s

Generate Kubernetes StatefulSet manifest for self-hosted Qdrant vector database.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

qdrant_test

Test connection to Qdrant vector database. Returns cluster info and collection count.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

query_database

Execute a SELECT query on a database connection. Returns query results as a list of dictionaries.

Argument	Type	Description
sql*	string	SQL SELECT query to execute
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
connection_id*	string	Database connection ID

Input schema (JSON)

{
  "type": "object",
  "required": [
    "connection_id",
    "sql"
  ],
  "properties": {
    "sql": {
      "type": "string",
      "description": "SQL SELECT query to execute"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "connection_id": {
      "type": "string",
      "description": "Database connection ID"
    }
  }
}

quote_gpu

Get a GPU price quote across providers.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ray_disagg_pd_deploy

Generate a Ray Serve LLM disaggregated Prefill/Decode deployment. Splits inference into compute-bound prefill and memory-bound decode phases with KV cache transfer via NIXL.

Argument	Type	Description
model_id*	string	HuggingFace model ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "HuggingFace model ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ray_list_jobs

List all running Ray jobs and tasks.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ray_parallelism_strategy

Compute optimal TP/DP/EP parallelism strategy for a given MoE model and GPU count. Returns recommended configuration with rationale.

Argument	Type	Description
model_id*	string	HuggingFace model ID (e.g. zai-org/GLM-5-FP8)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "HuggingFace model ID (e.g. zai-org/GLM-5-FP8)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ray_start

Start a Ray cluster (head node or worker). For distributed ML training and inference.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ray_status

Get Ray cluster status including node count, resources, memory, and running jobs.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ray_stop

Stop the Ray cluster on the current node.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ray_submit_job

Submit a job script to the Ray cluster for distributed execution.

Argument	Type	Description
script*	string	Path to the Python script to submit
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "script"
  ],
  "properties": {
    "script": {
      "type": "string",
      "description": "Path to the Python script to submit"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

ray_wide_ep_deploy

Generate a Ray Serve LLM Wide-EP (Expert Parallel) deployment for MoE models. Returns Python script and config for distributed MoE serving with EPLB and DeepEP.

Argument	Type	Description
model_id*	string	HuggingFace model ID (e.g. zai-org/GLM-5-FP8, deepseek-ai/DeepSeek-V3)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model_id"
  ],
  "properties": {
    "model_id": {
      "type": "string",
      "description": "HuggingFace model ID (e.g. zai-org/GLM-5-FP8, deepseek-ai/DeepSeek-V3)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

rollback

Explicit versioned rollback. Format: job@version (e.g., llama3@v3).

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
job_version*	string	Job@version string (e.g., llama3@v3)

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job_version"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "job_version": {
      "type": "string",
      "description": "Job@version string (e.g., llama3@v3)"
    }
  }
}

run_workflow

Run a declarative YAML workflow that chains multiple Terradev commands (provision → preflight → train → monitor → checkpoint). Returns step-by-step execution status with cost estimates and confirmation gates for expensive operations.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

secrets_env

Print environment-style export lines for a provider. By default values are masked.

Argument	Type	Description
provider*	string	Provider name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "provider"
  ],
  "properties": {
    "provider": {
      "type": "string",
      "description": "Provider name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

secrets_get

Retrieve a stored secret. By default the value is masked.

Argument	Type	Description
key*	string	Credential key name
provider*	string	Provider name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "provider",
    "key"
  ],
  "properties": {
    "key": {
      "type": "string",
      "description": "Credential key name"
    },
    "provider": {
      "type": "string",
      "description": "Provider name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

secrets_list

List stored provider and key names. Values are never shown.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

secrets_remove

Remove a provider or a single key from the secret store.

Argument	Type	Description
provider*	string	Provider name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "provider"
  ],
  "properties": {
    "provider": {
      "type": "string",
      "description": "Provider name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

secrets_run

Run a shell command with secrets injected into the environment.

Argument	Type	Description
command*	string	Shell command to execute (will be split into arguments)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "command"
  ],
  "properties": {
    "command": {
      "type": "string",
      "description": "Shell command to execute (will be split into arguments)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

secrets_set

Store a secret in the Terradev secrets store. Values are encrypted at rest.

Argument	Type	Description
key*	string	Credential key name (e.g. api_key, secret_key)
value*	string	Secret value to store
provider*	string	Cloud provider name (e.g. runpod, aws, vastai)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "provider",
    "key",
    "value"
  ],
  "properties": {
    "key": {
      "type": "string",
      "description": "Credential key name (e.g. api_key, secret_key)"
    },
    "value": {
      "type": "string",
      "description": "Secret value to store"
    },
    "provider": {
      "type": "string",
      "description": "Cloud provider name (e.g. runpod, aws, vastai)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

secrets_sync

Import TERRADEV_* environment variables into the secret store for supported cloud providers.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

secrets_verify

Check which providers are fully configured and which keys are missing.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

setup_provider

Get setup instructions for a provider

Argument	Type	Description
provider*	string	Provider name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "provider"
  ],
  "properties": {
    "provider": {
      "enum": [
        "runpod",
        "vastai",
        "aws",
        "gcp",
        "azure",
        "tensordock",
        "crusoe",
        "digitalocean",
        "hyperstack",
        "siliconflow",
        "latitude",
        "huggingface",
        "baseten",
        "inferx",
        "yottalabs",
        "e2enetworks",
        "gcore"
      ],
      "type": "string",
      "description": "Provider name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

sglang

Complete SGLang optimization stack with workload-specific auto-tuning for 7 workload types: agentic chat, batch inference, low latency, MoE models, PD disaggregated, structured output, and RAG.

Argument	Type	Description
action*	string	SGLang action to perform
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "action"
  ],
  "properties": {
    "action": {
      "enum": [
        "optimize",
        "detect",
        "router",
        "install",
        "start",
        "stop",
        "inference",
        "metrics",
        "test"
      ],
      "type": "string",
      "description": "SGLang action to perform"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

sglang_inference

[DEPRECATED] Use sglang action='inference' instead. Test inference against a running SGLang endpoint.

Argument	Type	Description
model*	string	Model name to use
endpoint*	string	SGLang endpoint URL (e.g. http://10.0.0.1:8000)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint",
    "model"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model name to use"
    },
    "endpoint": {
      "type": "string",
      "description": "SGLang endpoint URL (e.g. http://10.0.0.1:8000)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

sglang_start

[DEPRECATED] Use sglang action='start' instead. Start an SGLang inference server on a remote instance.

Argument	Type	Description
model*	string	HuggingFace model ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
instance_ip*	string	Target instance IP

Input schema (JSON)

{
  "type": "object",
  "required": [
    "instance_ip",
    "model"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "HuggingFace model ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "instance_ip": {
      "type": "string",
      "description": "Target instance IP"
    }
  }
}

sglang_stop

[DEPRECATED] Use sglang action='stop' instead. Stop an SGLang server on a remote instance.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
instance_ip*	string	Target instance IP

Input schema (JSON)

{
  "type": "object",
  "required": [
    "instance_ip"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "instance_ip": {
      "type": "string",
      "description": "Target instance IP"
    }
  }
}

stage

Compress, chunk, checksum, and position datasets near compute. Supports local paths, S3/GCS URIs, HTTP URLs, and HuggingFace dataset names. Returns staging plan with agent recommendations.

Argument	Type	Description
dataset*	string	Dataset path, S3 URI, GCS URI, HTTP URL, or HuggingFace name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "dataset"
  ],
  "properties": {
    "dataset": {
      "type": "string",
      "description": "Dataset path, S3 URI, GCS URI, HTTP URL, or HuggingFace name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

status

View all instances and costs with state optimization

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

train

Launch distributed training on provisioned GPU nodes. Supports torchrun, deepspeed, accelerate, and megatron. Use from_provision='latest' to auto-resolve node IPs from your last provision command.

Argument	Type	Description
script*	string	Training script path (e.g., train.py)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "script"
  ],
  "properties": {
    "script": {
      "type": "string",
      "description": "Training script path (e.g., train.py)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

train_detect_stragglers

Detect straggler nodes in distributed training. Identifies GPUs with significantly lower utilization that slow the whole job.

Argument	Type	Description
job_id*	string	Training job ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job_id"
  ],
  "properties": {
    "job_id": {
      "type": "string",
      "description": "Training job ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

train_monitor

Real-time GPU monitoring for training jobs. Shows utilization, memory, temperature, power, and cost.

Argument	Type	Description
job_id*	string	Job ID to monitor
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job_id"
  ],
  "properties": {
    "job_id": {
      "type": "string",
      "description": "Job ID to monitor"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

train_resume

Resume a training job from its latest checkpoint. Rebuilds config with topology revalidation.

Argument	Type	Description
job_id*	string	Job ID to resume
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job_id"
  ],
  "properties": {
    "job_id": {
      "type": "string",
      "description": "Job ID to resume"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

train_snapshot

Get complete training monitoring snapshot: GPU metrics (utilization, memory, temp, power), training metrics (loss, grad_norm, lr, throughput), straggler detection, and cost estimate.

Argument	Type	Description
job_id*	string	Training job ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job_id"
  ],
  "properties": {
    "job_id": {
      "type": "string",
      "description": "Training job ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

train_status

List all training jobs and their state (created, running, completed, failed).

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

train_stop

Stop a running training job. Kills training processes on all nodes in parallel.

Argument	Type	Description
job_id*	string	Job ID to stop
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job_id"
  ],
  "properties": {
    "job_id": {
      "type": "string",
      "description": "Job ID to stop"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

train_unsloth_run

Run an Unsloth local model server.

Argument	Type	Description
model*	string	Model to serve (e.g. unsloth/Llama-3.1-8B)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model to serve (e.g. unsloth/Llama-3.1-8B)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

train_unsloth_start

Start a coding agent backed by Unsloth's local model server.

Argument	Type	Description
agent*	string	agent
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "agent"
  ],
  "properties": {
    "agent": {
      "type": "string",
      "description": "agent"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

train_unsloth_stop

Stop a running Unsloth server started with `unsloth run`.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

training_config_generate

Generate a complete training configuration from a declarative spec. Auto-detects framework, sets optimal parallelism, and configures distributed training.

Argument	Type	Description
name*	string	Training job name
script*	string	Training script path
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "name",
    "script"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Training job name"
    },
    "script": {
      "type": "string",
      "description": "Training script path"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

training_launch_distributed

Full distributed training launch with framework auto-detection, topology validation, and monitoring. Combines preflight + train + monitor in one operation.

Argument	Type	Description
name*	string	Job name
script*	string	Training script
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "name",
    "script"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Job name"
    },
    "script": {
      "type": "string",
      "description": "Training script"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

triggers_create

Create an event trigger (schedule/webhook/metric).

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

triggers_enable

Enable or disable a trigger.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

triggers_execute

Manually execute a trigger now.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

triggers_history

Show trigger execution history.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

triggers_list

List configured triggers.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

CLI-native provisioning with manifest cache and drift detection. Use --fix-drift to detect and auto-fix drifted infrastructure.

Argument	Type	Description
job*	string	Job name for manifest tracking
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "job"
  ],
  "properties": {
    "job": {
      "type": "string",
      "description": "Job name for manifest tracking"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

upsert_database

Insert or update data in a database table. Performs upsert operation (insert or update on conflict).

Argument	Type	Description
data*	object	Data to insert/update as key-value pairs
table*	string	Table name (without prefix)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
connection_id*	string	Database connection ID

Input schema (JSON)

{
  "type": "object",
  "required": [
    "connection_id",
    "table",
    "data"
  ],
  "properties": {
    "data": {
      "type": "object",
      "description": "Data to insert/update as key-value pairs"
    },
    "table": {
      "type": "string",
      "description": "Table name (without prefix)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "connection_id": {
      "type": "string",
      "description": "Database connection ID"
    }
  }
}

vllm_analyze

Analyze a running vLLM server's workload and return specific optimization recommendations with before/after comparisons.

Argument	Type	Description
endpoint*	string	vLLM endpoint URL (e.g. http://localhost:8000)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint"
  ],
  "properties": {
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint URL (e.g. http://localhost:8000)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

vllm_auto_optimize

Automatically optimize vLLM configuration by analyzing workload patterns. Selects optimal settings for the 6 critical knobs based on live endpoint metrics or sample request files.

Argument	Type	Description
model*	string	Model name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "model"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

vllm_benchmark

Benchmark a vLLM endpoint with concurrent requests. Returns throughput (req/s), success rate, and total latency.

Argument	Type	Description
endpoint*	string	vLLM endpoint URL
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint"
  ],
  "properties": {
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint URL"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

vllm_inference

Test inference against a running vLLM endpoint (completions or chat).

Argument	Type	Description
model*	string	Model name to use
endpoint*	string	vLLM endpoint URL (e.g. http://10.0.0.1:8000)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint",
    "model"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "Model name to use"
    },
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint URL (e.g. http://10.0.0.1:8000)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

vllm_info

Get vLLM server info: loaded models, config, and health status.

Argument	Type	Description
endpoint*	string	vLLM endpoint URL (e.g. http://10.0.0.1:8000)
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint"
  ],
  "properties": {
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint URL (e.g. http://10.0.0.1:8000)"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

vllm_sleep

Put a vLLM server to sleep. Level 1: offload to CPU (fast wake). Level 2: discard weights (minimal RAM).

Argument	Type	Description
endpoint*	string	vLLM endpoint URL
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint"
  ],
  "properties": {
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint URL"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

vllm_start

Start a vLLM inference server on a remote instance via SSH/systemd. Supports Multi-LoRA, Sleep Mode, KV Offloading, Speculative Decoding.

Argument	Type	Description
model*	string	HuggingFace model ID
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
instance_ip*	string	Target instance IP

Input schema (JSON)

{
  "type": "object",
  "required": [
    "instance_ip",
    "model"
  ],
  "properties": {
    "model": {
      "type": "string",
      "description": "HuggingFace model ID"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "instance_ip": {
      "type": "string",
      "description": "Target instance IP"
    }
  }
}

vllm_stop

Stop a vLLM server on a remote instance.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
instance_ip*	string	Target instance IP

Input schema (JSON)

{
  "type": "object",
  "required": [
    "instance_ip"
  ],
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "instance_ip": {
      "type": "string",
      "description": "Target instance IP"
    }
  }
}

vllm_wake

Wake a sleeping vLLM server. For Level 2 sleep, also reloads weights and resets prefix cache.

Argument	Type	Description
endpoint*	string	vLLM endpoint URL
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "endpoint"
  ],
  "properties": {
    "endpoint": {
      "type": "string",
      "description": "vLLM endpoint URL"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

wandb_create_dashboard

Create a custom W&B dashboard with GPU metrics, training loss, and cost panels.

Argument	Type	Description
api_key*	string	W&B API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
dashboard_config*	object	Dashboard config (name, panels, metrics)

Input schema (JSON)

{
  "type": "object",
  "required": [
    "dashboard_config",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "W&B API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "dashboard_config": {
      "type": "object",
      "description": "Dashboard config (name, panels, metrics)"
    }
  }
}

wandb_create_report

Create a W&B report with custom sections, charts, and narrative text.

Argument	Type	Description
api_key*	string	W&B API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
report_config*	object	Report config (title, sections, metrics, description)

Input schema (JSON)

{
  "type": "object",
  "required": [
    "report_config",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "W&B API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "report_config": {
      "type": "object",
      "description": "Report config (title, sections, metrics, description)"
    }
  }
}

wandb_create_terradev_alerts

Auto-create standard Terradev alerts: GPU cost > budget, utilization < 50%, training loss spike, straggler detection.

Argument	Type	Description
api_key*	string	W&B API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "W&B API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

wandb_create_terradev_dashboard

Auto-create a Terradev-specific W&B dashboard with GPU utilization, cost tracking, training metrics, and infrastructure panels.

Argument	Type	Description
api_key*	string	W&B API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "W&B API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

wandb_create_terradev_report

Auto-generate a Terradev infrastructure report: GPU costs, provider comparison, training efficiency, and recommendations.

Argument	Type	Description
api_key*	string	W&B API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "W&B API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

wandb_dashboard_status

Get comprehensive W&B monitoring overview: dashboards, reports, alerts, active runs.

Argument	Type	Description
api_key*	string	W&B API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "W&B API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

wandb_list_projects

List all Weights & Biases projects for the configured entity.

Argument	Type	Description
api_key*	string	W&B API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "W&B API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

wandb_list_runs

List runs in a W&B project with status, metrics summary, and config.

Argument	Type	Description
api_key*	string	W&B API key
project*	string	W&B project name
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key",
    "project"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "W&B API key"
    },
    "project": {
      "type": "string",
      "description": "W&B project name"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

wandb_run_details

Get detailed info, metrics, and artifacts for a specific W&B run.

Argument	Type	Description
run_id*	string	W&B run ID
api_key*	string	W&B API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "required": [
    "api_key",
    "run_id"
  ],
  "properties": {
    "run_id": {
      "type": "string",
      "description": "W&B run ID"
    },
    "api_key": {
      "type": "string",
      "description": "W&B API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

wandb_setup_alerts

Set up custom W&B alerts for GPU metrics: cost thresholds, utilization drops, training anomalies.

Argument	Type	Description
api_key*	string	W&B API key
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.
alert_config*	object	Alert config (metric, threshold, condition, notification_channel)

Input schema (JSON)

{
  "type": "object",
  "required": [
    "alert_config",
    "api_key"
  ],
  "properties": {
    "api_key": {
      "type": "string",
      "description": "W&B API key"
    },
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    },
    "alert_config": {
      "type": "object",
      "description": "Alert config (metric, threshold, condition, notification_channel)"
    }
  }
}

warm_pool_start

Start the warm pool manager for intelligent model pre-warming. 5 strategies: traffic_based, time_based, priority_based, cost_optimized, latency_optimized.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}

warm_pool_status

Get warm pool status: hit rate, cold starts, memory saved, cost saved.

Argument	Type	Description
credentials	object	BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {"RUNPOD_API_KEY": "..."}, {"AWS_ACCESS_KEY_ID": "...", "AWS_SECRET_ACCESS_KEY": "..."}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.

Input schema (JSON)

{
  "type": "object",
  "properties": {
    "credentials": {
      "type": "object",
      "description": "BYOAPI — your own provider credentials as env vars for this call only (never stored). E.g. {\"RUNPOD_API_KEY\": \"...\"}, {\"AWS_ACCESS_KEY_ID\": \"...\", \"AWS_SECRET_ACCESS_KEY\": \"...\"}, or the TERRADEV_<PROVIDER>_<KEY> secrets form.",
      "additionalProperties": {
        "type": "string"
      }
    }
  }
}