AI Agents Decode F1® Radio in Near Real Time | CoreWeave Blog

This post details the application of AI agents on CoreWeave Cloud to process Formula 1® radio communications in near real-time. It describes the challenge of managing 40 high-fidelity audio streams with a sub-five-second reaction time, requiring infrastructure capable of handling this data orchestration. The solution involves a platform with two modes: one for competitor channels (transcription, categorization, searchable interface) and another for internal team channels. A natural language chat interface allows engineers to query synthesized answers from live audio. The engineering challenge highlights the need for robust infrastructure, with 75 model iterations, 7 hours of hand-annotated data, and 3,000 labeled samples built for race conditions. The system achieved full transcription, diarization, and topic categorization within five seconds of capture. CoreWeave Cloud's AI platform, leveraging Weights & Biases Serverless Inference on CoreWeave Kubernetes Service and TensorRT-LLM, provides the necessary compute foundation. Fine-tuning was managed by Weights & Biases for experiment tracking and dataset versioning.