
10/2/2025
What this post added
This post introduces IBM's Granite 4.0 family of open-source small language models to Replicate. It details their hybrid architecture (Mamba-2 + Transformers) and MoE routing strategy, which enables efficient inference on consumer GPUs for tasks like document summarization, RAG, and AI agents. API usage examples for cURL, JavaScript, and Python are provided, along with a discussion of the models' practical applications and open-source licensing.