What’s Cooking

CohereBlog30 Jul

Why MoE Models Get More From Speculative Decoding

ModalBlog27 Jul

Kimi K3 by Moonshot now available on Modal

BasetenBlog26 Jul

How we built the new fastest API for GLM-5.2

BasetenBlog23 Jul

How to optimize LLM inference speed and reduce costs in production

ModalBlog15 Jul

Inkling by Thinking Machines now available on Modal

CohereBlog10 Jul

Hardware-Aware, Dynamic Speculative Decoding (DSD)

ModalBlog1 Jul

Multi-token Residual Prediction

You’re caught up

That’s every post that month in this feed.