The latest features, improvements, and fixes across LLM Gateway, DevPass, Lounge, and Airside.
Group developers under one shared policy — a project ceiling, per-developer budgets, and IAM rules — instead of configuring each person by hand. Microsoft Entra groups map onto teams over SCIM, and a default team catches everyone who joins without one. Available on the Enterprise plan.
Read more about Organization Teams and Directory Sync →
DevPass subscribers can now restrict routing to providers that explicitly state API inputs are not used for training. Unknown policies fail closed, and retries or fallbacks never escape the setting. Available on every active DevPass tier.
Read more about No AI Training for DevPass →
DevPass subscribers can now remove their saved card after canceling, or whenever a subscription is inactive. The card details leave Stripe while a privacy-safe fingerprint remains to enforce the one-card-per-account rule.
Read more about Remove Your DevPass Payment Card →
Claude now routes through Microsoft Foundry under a new azure-anthropic provider. The models directory gained lifecycle status filters, model pages sort providers by price, speed, or context, and API key lists flag the keys that are near or at their limit.
Read more about Claude on Foundry, Model Status & More →
Gateway API keys are now stored only as keyed HMAC-SHA-256 fingerprints and provider credentials only as AES-256-GCM ciphertext. Every plaintext read path is gone, so a key's secret is visible exactly once per issuance — at creation or roll.
Read more about Hash-Only API Key Storage →
Provider keys now take a description that follows them through key lists and request drilldowns, the master API returns each key's creator and project by name, and the catalogue picks up Grok 4.6 on AWS Bedrock and Vertex AI plus GLM-5.2 Turbo and an Australian region on SCX.ai.
Read more about Provider Key Descriptions, Grok 4.6 & More →
Every organization now has a fleet-wide budget of concurrent in-flight requests that scales with your trust tier — bounding the long-running streams a per-minute limit can't see. Over-budget requests get a retryable 429, and a momentarily saturated gateway sheds load with a 529 instead of queueing until it degrades.
Read more about Concurrent Request Limits and Overload Protection →
Provider cache writes is now a three-way setting. The new Client-managed mode forwards the cache markers your client sends and never adds any of its own, so one API key can serve a coding agent that manages its own caching alongside traffic that should not pay the cache-write premium.
Read more about Client-Managed Prompt Caching →
Every organization now has transparent per-endpoint rate limits, daily/monthly spend caps, and top-up allowances that scale automatically with account age or lifetime usage — all visible on the new Settings → Limits page. Enterprise organizations have no limits at all.
Read more about Trust Tiers: Limits That Grow With Your Account →
LLM Gateway now speaks the AI SDK's own gateway protocol, so an app built on the Vercel AI Gateway runs here with one line changed. Bare model strings, provider-native web search with citations, and the model picker all keep working.
Read more about Drop-In For The Vercel AI Gateway →
Showing 10 of 106 updates
Load more