Bullet Updates - Windowing, Apache Pulsar PubSub, Configuration-based Data Ingestion, and More
Mar 8, 2019
Summary
This post details several enhancements to the Bullet query system: 1. Windowing capabilities (time and record-based) have been added to support interactive and iterative queries, including tumbling and sliding window types. 2. Apache Pulsar is now supported as a native PubSub option, alongside existing Kafka and REST support. 3. A new configuration-based data ingestion mechanism (Bullet DSL) has been introduced, allowing users to plug in data sources without writing code by abstracting connector and converter components. This DSL supports Kafka and Pulsar connectors and Avro, Maps, and POJO converters, with basic ETL capabilities.