PlanetScale

Building data pipelines with Vitess

Jul 29, 2024Matt Lord
Building data pipelines with Vitess
SummaryAI, from the source post

This post details how Vitess's VStream API, exposed through VTGates, provides a unified change stream across sharded Vitess clusters. It explains how this low-level gRPC primitive is used by popular CDC tools like Debezium, and by PlanetScale Connect for Airbyte and Fivetran sources. It also provides a practical example of using a direct gRPC client to stream changes from a Vitess cluster, demonstrating the output format and the process of setting up and running the example.

More from the Database Egress Optimization trail