LLM Gateway changelog

API, routing, model access, and dashboard updates for LLM Gateway.

Smart Routing

A new `smart` model string: choose which models it may resolve to, and let a classifier rate each request so easy prompts go to a cheap model and hard ones go to a frontier model. Existing `auto` behaviour is unchanged. Available to every organization while in beta; not available on DevPass yet.

Read more about Smart Routing →
Three ascending glowing tiers on a circuit-board chip, surrounded by magnifier, sliders, coin and shield icons, representing the price bands of smart routing on LLM Gateway

Compliance Alerts

Watch models your compliance policy blocks today and get told the moment a provider that meets your requirements starts serving them — in-app, by email, or in Slack. Downgrade alerts fire when a provider stops meeting the policy. Available on the Enterprise plan.

Read more about Compliance Alerts →
A glowing bell on a circuit-board chip surrounded by shield and certificate icons, representing compliance alerts on LLM Gateway

Showing 10 of 98 updates

Load more