API, routing, model access, and dashboard updates for LLM Gateway.
Bring any OpenAI-compatible model under full cost tracking. Define pricing, context limits, and capabilities per custom provider key — so requests through custom providers get billed, enforced, and reported just like a built-in model. Available on Enterprise.
Read more about Custom Model Catalog for Custom Providers →
Restrict routing to providers that meet your compliance requirements — SOC 2, ISO 27001, GDPR, no prompt training, no prompt logging. Requests to non-compliant providers are blocked before any data leaves the gateway. Available on Enterprise.
Read more about Provider Compliance Policies →
Steer multi-provider routing with a new routing field — auto, price, throughput, or latency — per request or as a per-project default. Each strategy still falls back when the top pick has bad uptime.
Read more about Routing Strategies: Cheapest, Fastest & Defaults →
We've temporarily suspended access to Claude Fable 5 across all providers while we work through a usage-policy matter with Anthropic. Requests to the model now return a clear error, and routing automatically skips it.
Read more about Claude Fable 5 Access Suspended →
Text-to-speech is live: nine models from ElevenLabs, OpenAI, and Gemini behind the OpenAI-compatible /v1/audio/speech endpoint, plus a new Audio Studio in the Playground to compare voices side by side.
Read more about Speech Generation + Audio Studio →
Anthropic's next-generation Claude Fable 5 lands with 1M context, Reve joins as a new image provider, xAI's Grok Imagine Video 1.5 turns images into 15-second clips, and NVIDIA's Nemotron 3 Ultra 550B arrives.
Read more about Claude Fable 5, Reve Image Gen & More New Models →Monthly Chat subscriptions from $9, Flex and Priority service tiers, sandbox test keys for the LLM SDK, a no_training model filter, public DevPass profiles, and a stack of product polish.
Read more about Chat Plans, Service Tiers, SDK Sandbox & More →
Give any API key a time-to-live when you create it — minutes, hours, or days. Expired keys are disabled automatically, and you can bring them back online anytime with a fresh expiration.
Read more about API Key Expiration (TTL) →
Pin conversations to one provider for warm caches with x-session-id, route Bedrock by region, and reach Gemini via Google AI Studio plus Vertex embeddings.
Read more about Smarter Routing: Sticky Sessions, Bedrock Regions & More →
Share a referral link and reward new signups, toggle provider cache writes per project, see cache and audio costs in your logs, plus a faster Chat and more.
Read more about Referrals, Cache Controls & Product Updates →
Showing 10 of 98 updates
Load more