Configure model routing in LLM Proxy

Route model calls through one governed path

LLM Proxy gives model traffic a consistent route. That route can record provider, latency, token usage, cost, policy decisions, and refusal context before a response becomes part of an agent run.

Routing setup

Use LLM Proxy to review enabled providers and model routes, then decide which teams, agents, or environments can use each route. Fallback behavior should be explicit so provider failures do not create surprise paths.

Apply policies before requests leave the boundary. Sensitive data, disallowed destinations, and high-risk model use should be handled in the route instead of left to each agent. Use an LLM trace when you need to explain one call.