What’s Cooking

BasetenBlog25 Jun

Live draft model training for speculative decoding

ModalBlog24 Jun

Achieve state-of-the-art inference latencies with speculative decoding

NVIDIABlog23 Jun

Boost Inference Performance up to 15x on NVIDIA Blackwell Using DFlash Speculative Decoding

BasetenBlog23 Jun

How we built the world’s fastest API for GLM-5.2

ModalBlog23 Jun

Introducing Modal Auto Endpoints: Optimized inference you actually own

ModalBlog19 Jun

Speculation Is All You Need

BasetenBlog17 Jun

The best open-source large language models (LLMs)

You’re caught up

That’s every post that month in this feed.