Skip to main content
Put proxy controls and trace attributes in the standard Chat Completions metadata object.

Reserved metadata

wandb.* keys control routing and logging and are removed before provider dispatch. Other metadata is forwarded to the provider and projected into the trace when representable.

Conversation precedence

The proxy chooses the first available identifier:
  1. wandb.thread_id;
  2. gen_ai.conversation.id;
  3. Vapi call.id.
Use the same value for every provider call in one application conversation. This improves trace browsing, prevents dataset split leakage, and makes weighted routing stable.

What a task trace records

  • task UUID, alias, and version;
  • routing revision and selected provider/model;
  • exact provider-dispatched request and reconstructed response;
  • token usage, finish reason, timing, and error status;
  • conversation, user, scenario, and safe custom metadata;
  • a proxy request ID for support and write-surface comparison.
The canonical Agent Span carries a raw request/response dump for fidelity. Dataset reconstruction does not rely only on the normalized display columns.
Do not put credentials, secrets, or unnecessary personal data in messages or metadata. Trace data is intentionally durable training and debugging input.
Keep the same wandb.thread_id for every turn in one conversation:
The proxy removes reserved wandb.* values before provider dispatch. See Create a routed chat completion.
Last modified on August 25, 2026