Why you should move your ETL stack to Modal
Apr 18, 2024

Summary
This post demonstrates how to build cost-effective and flexible ETL pipelines using Modal. It provides two concrete examples: 1) Copying 12 million ClickHouse rows to Snowflake for $0.29, highlighting Modal's cost savings over vendor solutions like Fivetran for large data transfers. 2) Enriching user data by querying the GitHub API, showcasing the ease of integrating custom code and scheduling jobs with Modal's `@app.function` decorator and `modal.Cron` schedule. The post also discusses when traditional ETL solutions or orchestration platforms like Airflow might be more suitable for long-running, business-critical, multi-stage pipelines.
More from the ETL Platform trail
- Seamless computational bio at Chai Discovery | Modal Blog
- Modal + Datalab: Deploy high-throughput document intelligence in <5 minutes
- Product updates: memory snapshotting, OIDC, async job queues & more
- How a top tier European soccer team sped up their data processing and reduced costs by 50%
- Building a cost-effective analytics stack with Modal, dlt, and dbt