Language Model Deployment and Fine-tuning
IBM's Granite 4.0 is now on Replicate

IBM's Granite 4.0 is now on Replicate

10/2/2025

What this post added

This post introduces IBM's Granite 4.0 family of open-source small language models to Replicate. It details their hybrid architecture (Mamba-2 + Transformers) and MoE routing strategy, which enables efficient inference on consumer GPUs for tasks like document summarization, RAG, and AI agents. API usage examples for cURL, JavaScript, and Python are provided, along with a discussion of the models' practical applications and open-source licensing.

Read the original post ↗