IBM's Granite 4.0 is now on Replicate
Oct 2, 2025

Summary
This post announces the availability of IBM's Granite 4.0 family of open-source small language models on Replicate. It details the hybrid architecture (Mamba-2 + Transformers) and MoE routing strategy that makes Granite 4.0 performant and efficient for long contexts and on consumer GPUs. Practical use cases like document summarization, RAG, and AI agents are highlighted. The post also emphasizes the open-source nature (Apache 2.0 license) and provides API integration examples for cURL, JavaScript, and Python.