LLM Proxy

Route model requests through Archestra and manage provider access, model choices, and limits.

To inspect saved requests, see LLM Proxy Logs. Auto Routing has its own endpoint reference.

Authentication

For model requests, send a standard virtual key or an OAuth access token with llm:proxy scope as Authorization: Bearer <credential>. Provider inference routes also support a passthrough virtual key in X-Archestra-Virtual-Key alongside the provider credential, or a JWT from a configured identity provider. See LLM Proxy Authentication for setup and examples.

The Unified Model API accepts standard virtual keys and LLM OAuth tokens. Management routes under /api/* use the REST API authentication described on the API overview.