vLLM

20 posts · 12 sources

+4

AI EngineerYouTube5d

Is Speculative Decoding Worth It? Profiling vLLM on NVIDIA Blackwell — Akamai

AI EngineerYouTube6d

What Is an Inference Engine, Anyway? — Charles Frye, Modal

AI EngineerYouTube1w

Lessons from Generating 12 Trillion Synthetic Tokens — Bogdan Gaza, DatologyAI

AI EngineerYouTube3w

Two Bugs That Hid in Plain Sight: A vLLM Debugging Detective Story — Asaf Gardin & Yuval Belfer

CoreweaveBlog26 Aug

Deploy Kimi K3 Dedicated Inference on CoreWeave

GoogleBlog26 Aug

Enterprise-Grade Precision for Long-Context Multimodal Embedding Inference on Cloud TPU- Google Developers Blog

Two Minute PapersYouTube24 Aug

This Small AI Will Change Everything

NetflixBlog30 Jul

GenRec: Towards LLM-Native Recommendation at Netflix

CohereBlog30 Jul

Production-Ready W4A8: vLLM Integration Explained

NetflixBlog17 Jul

In-House LLM Serving at Netflix

CohereBlog10 Jul

Hardware-Aware, Dynamic Speculative Decoding (DSD)

Hugging FaceBlog8 Jul

Native-speed vLLM transformers modeling backend

Hugging FaceBlog26 Jun

Run a vLLM Server on HF Jobs in One Command

GitLabBlog21 May

More AI models for GitLab Duo Agent Platform Self-Hosted

Hugging FaceBlog6 May

vLLM V0 to V1: Correctness Before Corrections in RL

Mistral AIBlog21 Jan

Heaps do lie: debugging a memory leak in vLLM.

ModalBlog2 Dec

Modal + Mistral 3: 10x faster cold starts with GPU snapshotting

AtlassianBlog22 Jul

Atlassian’s Inference Engine, our self-hosted AI inference service

BasetenBlog5 Dec

Introducing Custom Servers: Deploy production-ready model servers from Docker images

GoogleBlog13 Nov

Inference with Gemma using Dataflow and vLLM- Google Developers Blog