Moving Baselime from AWS to Cloudflare: simpler architecture, improved performance, over 80% lower cloud costs

Baselime migrated its observability data pipeline from AWS (Lambda, Kinesis, EC2 ClickHouse) to Cloudflare's Developer Platform. Key changes include replacing AWS Lambda with Cloudflare Workers for data reception and processing, utilizing JavaScript-native RPC for inter-component communication, and employing Durable Objects for stateful processing (real-time error tracking, log pattern detection) which replaces ElastiCache, Kinesis, and multiple Lambda functions. ClickHouse on EC2 was replaced by Workers Analytics Engine for high-cardinality analytics, with internal changes enabling high dimensionality and leveraging Adaptive Bit Rate (ABR) analytics for optimized query performance. Cloudflare Queues were adopted for asynchronous messaging, D1 for transactional data, and Workers KV for fast distributed storage. The migration followed a 'strangler fig pattern' to ensure uptime and data consistency.