TechPrufer
Get started
Lyft
Lyft logoLyft · Feature trail

Bayesian Trees for Rider Conversion Prediction

2 posts · Feb 2026 – Mar 2026

What this trail covers

Lyft developed and implemented a novel modeling framework using Bayesian Trees to predict rider conversion in sparse data environments. This system addresses the challenge of data sparsity by leveraging a hierarchical tree structure and Bayesian smoothing with Gaussian priors. It allows for robust and accurate predictions even with limited data for specific contexts, while also ensuring behavioral consistency and interpretability by enforcing monotonic relationships where domain knowledge dictates.

All Lyft trails
  1. Predicting Rider Conversion in Sparse Data Environments with Bayesian TreesThis post details the implementation of a Bayesian Tree framework for predicting rider conversion in sparse data environments. It introduces a hierarchical tree structure for organizing data by context (e.g., spatial, temporal, congestion) and employs Bayesian smoothing with Gaussian priors to leverage parent node statistics for data-sparse leaf nodes. The training process involves L2 regularization to balance local data with parent priors. The framework also enforces monotonic relationships between input features (like historical conversion rate) and predicted conversion probability to ensure behavioral consistency and interpretability.
  2. Trusting the Untestable: Validation and Diagnostics for the Doubly Robust ModelsThis post details the implementation and validation of Augmented Inverse Propensity Weighting (AIPW) models for quasi-experimental causal inference at Lyft. It introduces the concept of doubly robust estimation, the critical need for validation in non-randomized settings, and the platform's features for confounder management (pre-defined and customizable sets, leakage prevention) and model diagnostics (common support/propensity overlap, covariate balance). It also describes the scientific refinements for correcting downsampling bias through propensity score correction and outcome reweighting, and an empirical validation using weekly ride challenges to compare AIPW estimates with randomized experiment results.