What’s Cooking

BasetenBlog14 Mar

Benchmarking fast Mistral 7B inference

BasetenBlog14 Mar

33% faster LLM inference with FP8 quantization

CloudflareBlog14 Mar

Mitigating a token-length side-channel attack in our AI products

ModalBlog14 Mar

Lambda on hard mode: Inside Modal's web infrastructure

PineconeBlog14 Mar

RAG Brag with Shortwave CEO Andrew Lee

QdrantBlog12 Mar

Integrating Qdrant and LangChain for Advanced Vector Similarity Search

BasetenBlog12 Mar

High performance ML inference with NVIDIA TensorRT

You’re caught up

That’s every post that week.

4–10 Mar 2024