Building Real Time Digital Twin with Cerebras at Tavus - Cerebras

Tavus integrated Cerebras's inference engine into their Conversational Video Interface (CVI) pipeline to reduce LLM latency. This resulted in a 66% reduction in Time to First Token (TTFT) from 300ms to 100ms and a 300% increase in Token Output Speed (TPS) from 1/30ms to 1/10ms for the Llama 3.1-8B model. These optimizations led to an overall LLM latency reduction of 100-1000%, enhancing the realism and responsiveness of their digital twin video experiences.