Create a routed chat completion

curl --request POST \
  --url https://proxy.training.wandb.ai/v1/chat/completions \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "model": "ticket-classifier",
  "messages": [
    {
      "role": "user",
      "content": "Classify this support request."
    }
  ],
  "metadata": {
    "wandb.entity": "your-team",
    "wandb.thread_id": "conversation-4827"
  }
}
'

{
  "id": "<string>",
  "object": "<string>",
  "created": 0,
  "model": "<string>",
  "choices": [
    {
      "index": 0,
      "message": {},
      "finish_reason": "<string>"
    }
  ],
  "usage": {}
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

POST

chat

completions

curl --request POST \
  --url https://proxy.training.wandb.ai/v1/chat/completions \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "model": "ticket-classifier",
  "messages": [
    {
      "role": "user",
      "content": "Classify this support request."
    }
  ],
  "metadata": {
    "wandb.entity": "your-team",
    "wandb.thread_id": "conversation-4827"
  }
}
'

{
  "id": "<string>",
  "object": "<string>",
  "created": 0,
  "model": "<string>",
  "choices": [
    {
      "index": 0,
      "message": {},
      "finish_reason": "<string>"
    }
  ],
  "usage": {}
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "proxy_error"
  }
}

Authorizations

Authorization

string

header

required

W&B API key whose personal/default entity or teams own the selected task and providers.

Headers

wandb-cache-mode

enum<string>

Opt a non-streaming task-routed or direct provider/model request into exact-response caching. Cache identity includes the effective upstream request body and forwarded path/query parameters. Direct requests are additionally isolated by entity, provider configuration, model, passthrough user identity, and any forwarded W&B Inference project. readWrite reads and populates the cache, readOnly reads without populating it, and writeOnly populates without reading. Only successful responses up to 8 MiB are stored. Invalid values return HTTP 400. If op-cache is also supplied, both headers must select the same mode. Response caching is not supported for streaming requests.

Available options:

readWrite,

readOnly,

writeOnly

op-cache

enum<string>

OpenPipe-compatible alias for wandb-cache-mode. It accepts the same modes, and true is equivalent to readWrite. If both headers are supplied, they must select the same mode.

Available options:

readWrite,

readOnly,

writeOnly,

true

Body

application/json

model

string

required

Task alias, alias@vN, or {provider}/{model-id}.

Minimum string length: 1

messages

object[]

required

Minimum array length: 1

Show child attributes

metadata

object

Show child attributes

stream

boolean

default:false

temperature

number

tools

object[]

Show child attributes

tool_choice

any

response_format

object

Show child attributes

reasoning_effort

string

max_tokens

integer

Required range: 1 <= x <= 9007199254740991

max_completion_tokens

integer

Required range: 1 <= x <= 9007199254740991

{key}

any

Response

Provider response. Streaming requests return server-sent events and end with [DONE].

string

object

string

created

integer

Required range: -9007199254740991 <= x <= 9007199254740991

model

string

choices

object[]

Show child attributes

usage

object

Show child attributes

{key}

any

Last modified on September 4, 2026