We’ve enhanced our CUPED variance reduction methodology in Cloud by automatically applying Stratification to better account for users with missing pre-experiment data.
Users are grouped into strata based on available pre-experiment information. Treatment effects are then calculated within each group before being aggregated into a single estimate and applying standard difference-in-means and variance calculations.
This improvement retains more users in analysis while still applying variance reduction wherever pre-experiment data exists. The result is tighter confidence intervals for more reliable decision-making.