model value to route production traffic through that task, or use a registered provider model reference for a direct request.
See Connect your application for Python, JavaScript, and cURL examples.
Inference proxy API
Send OpenAI-compatible Chat Completions requests through Model Distillation task routing.
The inference proxy exposes an OpenAI-compatible Chat Completions endpoint for task routing, provider credentials, parameter overrides, and training-grade traces.
Use a task alias as the request’s
Last modified on August 25, 2026