Phylo brings frontier AI to more scientists with open models on Fireworks

This post details Phylo's migration from proprietary models to serving open-weight frontier models on Fireworks AI for their agentic biology environment (Biomni Lab). Key technical contributions include: leveraging Fireworks' serverless fast path endpoints for day-zero access to SOTA open models, achieving a 24-hour cycle from model release to production; optimizing for long-horizon agentic inference (hours to days, hundreds of tool calls) with a focus on cost efficiency; and demonstrating significant cost reduction (60% lower cost) and performance improvements (halved time to first token) by shifting the majority of traffic to open models served via Fireworks. The post highlights the importance of model-agnostic design, automated evaluation pipelines (BiomniBench), and direct engineering collaboration for rapid deployment and production stability.