Replicate

IBM's Granite 4.0 is now on Replicate

Oct 2, 2025
IBM's Granite 4.0 is now on Replicate
SummaryAI, from the source post

This post announces the availability of IBM's Granite 4.0 family of open-source small language models on Replicate. It details the hybrid architecture (Mamba-2 + Transformers) and MoE routing strategy that makes Granite 4.0 performant and efficient for long contexts and on consumer GPUs. Practical use cases like document summarization, RAG, and AI agents are highlighted. The post also emphasizes the open-source nature (Apache 2.0 license) and provides API integration examples for cURL, JavaScript, and Python.

More from the Language Model Deployment and Fine-tuning trail