Kimi K3 Model Deployment and API
Fireworks AI

Fireworks AI

7/26/2026

What this post added

Launched Fireworks Nexus, a product designed to provide engineering organizations with a managed layer of open-weight AI models. Key technical components include: 1. Enterprise Controls & Cost Observability: Centralized control over AI usage, budget tracking, ROI analysis, and policy enforcement, built on a production inference platform with US-hosted endpoints, zero data retention, and global data center presence. 2. Workflow Continuity: Introduced FireConnect, a one-line install tool that maps models based on harness configurations, ensuring compatibility with existing tools (e.g., Claude Code, Codex, OpenCode) and leveraging Fireworks Serverless APIs (Anthropic and OpenAI compatible). FireConnect is open-sourced under Apache 2.0. 3. Intelligent Traffic Management and Migration: Developed a custom routing endpoint (FireRouter) that uses a custom-trained model to score request difficulty. Routine tasks are routed to cost-effective open-weight models served by Fireworks, while difficult tasks are passed through to existing providers using the user's key. This aims for 3-5x cost reduction. Currently routes between Claude Opus 5 and GLM 5.2, or K3 and GLM 5.2.

Read the original post ↗