Batch Processing

27 posts · 15 sources · 1 interview question

+7

Practice 1 question

SingleStoreBlog3 Aug

Identity resolution without the nightly batch

HexBlog21 May

ETL Pipelines: Architecture, Examples, and Where They Break

TemporalBlog20 Jan

How Goldcast scaled event orchestration to millions using Temporal

LyftBlog6 Jan

Lyft’s Feature Store: Architecture, Optimization, and Evolution

GoogleBlog10 Sept

Gemini Batch API now supports Embeddings and OpenAI Compatibility- Google Developers Blog

StripeBlog23 Aug

Real-time vs batch reconciliation: Practical patterns for keeping data in sync

MetaBlog24 Jul

Policy Zones: How Meta enforces purpose limitation at scale in batch processing systems

ModalBlog23 Jul

Transcribe speech 100x faster and 100x cheaper with open models

GoogleBlog7 Jul

Batch Mode in the Gemini API: Process more for less- Google Developers Blog

ModalBlog22 May

Introducing Modal Batch: Process 1 million jobs with 1 line of code

ModalBlog17 Apr

Product updates: Running batch jobs with 1M inputs, ephemeral apps, and a new TensorRT-LLM example

MetaBlog4 Feb

Data logs: The latest evolution in Meta’s access tools

ModalBlog4 Dec

How a top tier European soccer team sped up their data processing and reduced costs by 50%

ConfluentBlog4 Oct

Preventing and Fixing Bad Data in Event Streams, Part 1

ModalBlog26 Mar

How Ramp automated receipt processing with fine-tuned LLMs

GrabBlog20 Feb

The journey of building a comprehensive attribution platform

GitLabBlog12 Oct

Git 2.42 release: Here are four of our contributions in detail

PineconeBlog12 Sept

LangChain's Pinecone upsert speed increased by 5X

MetaBlog29 Aug

Scheduling Jupyter Notebooks at Meta

ConfluentBlog18 May

Stream Processing vs Batch Processing