Menu
mediumAirAsia · experimentationBasic

Guardrail metric regressions

AirAsia tested a more aggressive seat-upsell flow. It lifted the target metric — but a guardrail is a metric you're not trying to improve and refuse to damage: page load time, refund rate, support contacts. A win on the target metric that wrecks a guardrail isn't a win.

Each row in experiment_metrics carries higher_is_better, which flips the direction of harm. From it, return every metric where treatment is worse than control by more than 2% in relative terms, with relative_change (treatment minus control, over control) rounded to 4 decimal places. Order by metric.

Schema

experiment_metrics
metricTEXT
variantTEXT
valueNUMERIC(12,4)
higher_is_betterBOOLEAN

Basic

The example input, expected output, and walkthrough for this question unlock with a Basic plan.

↑ Read the question

Basic

This is a Basic question

Premium practice questions unlock with a Basic plan. The full solution, expected output, and grading are available to Basic members.

See Basic plans

RM 25/mo · cancel anytime

Keep going

Company names are trademarks of their respective owners, used here only to describe practice material. mahir_data is not affiliated with, endorsed by, or sponsored by any company named on this site. Terms.