FP8 Quantization

7 posts · 4 sources

BasetenBlog14 Jul

Introducing Step 3.7 Flash: multimodal reasoning at scale

NVIDIABlog27 May

NVIDIA Blackwell Sets STAC-AI Record for LLM Inference in Finance

ShopifyBlog8 May

Evolution of Product Classification at Shopify: From Categories to Comprehensive Product Understanding (2025)

BasetenBlog9 Jan

Driving model performance optimization: 2024 highlights

ReplicateBlog26 Nov

FLUX fine-tunes are now fast

BasetenBlog28 Mar

Using fractional H100 GPUs for efficient model serving

BasetenBlog14 Mar

33% faster LLM inference with FP8 quantization