Fireworks AI

Introduced Fireworks Nexus, a platform for managing and routing AI workloads to optimize costs and maintain developer experience. Key components include: 1. Enterprise Controls & Cost Observability for budget setting, ROI tracking, and policy enforcement on a production inference platform with US-hosted endpoints and zero data retention. 2. Workflow Continuity via FireConnect, an open-sourced tool (Apache 2.0) that maps models based on harness configurations and provides OpenAI/Anthropic API compatibility. 3. Intelligent Traffic Management (FireRouter) using a custom-trained model to route requests to cost-effective open-weight models (like Kimi-K3, GLM-5.2) or existing providers based on request difficulty, aiming for 3-5x cost reduction. The post also highlights independent evaluations by Faros and Arize demonstrating cost savings and quality preservation.