Fireworks AI

This post introduces DeepSeek V4 Pro 0813 as a new model available on the Fireworks AI platform. It details a rigorous evaluation of DeepSeek V4 Pro using the CyberGym benchmark, comparing its performance against Kimi K3, GPT-5.5, and Claude Opus 4.8. The analysis highlights DeepSeek V4 Pro's zero refusal rate on adversarial security tasks, its cost-effectiveness (half the cost per success of the highest-scoring model), and its ability to outperform closed-source models like GPT-5.5 in both accuracy and price for security agent workloads. The post emphasizes the importance of open models for high-volume security agents due to the 'refusal walls' of closed models and provides specific cost and reward metrics for each tested model.