Model Quantization

9 posts · 5 sources

GoogleBlog6d

EmbeddingGemma 2: The Developer Guide- Google Developers Blog

NVIDIABlog1w

Build Local AI Apps with C++ and NVIDIA TensorRT RTX Samples

QdrantBlog1w

Constella Preview: Swap Query Models Without Re-Embedding

NVIDIABlog27 Jul

NVIDIA Ising Enables Fully Automated Quantum Computer Calibration with Enhanced In-Context Learning

RedisBlog5 Jul

Does Quantization Speed Up Inference? A Practical Guide

NVIDIABlog26 Jun

Creating the NVIDIA Nemotron 3 Ultra NVFP4 Checkpoint with NVIDIA Model Optimizer

NVIDIABlog9 Jun

Model Quantization: Turn FP8 Checkpoints into High-Performance Inference Engines with NVIDIA TensorRT

NVIDIABlog8 Jun

Train Models Faster with JAX and MaxText Using NVFP4 on NVIDIA Blackwell

BasetenBlog11 Feb

How we built the fastest Kimi K2.5 on Artificial Analysis