Diagnose Sudden Drop in Credit-Card Approval Rate
Diagnose Sudden Drop in Credit-Card Approval Rate
You are the on-call Data Scientist supporting the risk/underwriting system. Historically, the daily approval rate has been stable. Yesterday, it dropped sharply in a single day.
Assume you have access to decision logs, rule engine configs, model registry, feature store, experiment platform, observability/monitoring dashboards, and vendor status pages.
Approval rate = approvals / submitted applications, measured on decision-event timestamps. (If your org uses a different definition, state and use it.)
How would you diagnose the root cause? Provide:
- A step-by-step investigative plan to localize and explain the drop.
- The specific data you would pull.
- A set of concrete hypotheses to test (and how to test them).
Consider:
- Traffic mix shifts (channel, merchant/partner, geo, device, new vs. returning).
- Rule or model changes (new version, thresholds, reason-code distribution).
- Data/feature pipeline issues (null spikes, late features, schema changes).
- Seasonality/calendar anomalies and promotions.
- Experiment/AB-test effects (assignments, guardrails, SRM).
- External dependencies (KYC/identity, bureau pulls, device fingerprinting, payment networks).
- Infrastructure/latency/timeouts and fail-closed policies.
Constraints & Assumptions:
- Preserve the scope, facts, inputs, and requested outputs from the prompt above.
- If the prompt leaves a detail unspecified, state a reasonable assumption before relying on it.
- Keep the answer interview-ready: concise enough to present, but concrete enough to implement or evaluate.
AI interview prep
Core dilemma
Balancing the need for rapid root-cause analysis of a critical business metric drop with the potential for introducing bias or incorrect conclusions due to complex, interconnected systems and data pipelines.
3 tradeoffs and 3 stress tests locked
Interview prep
Unlock the interviewer X-Ray rubric, tradeoff matrix, stress tests, clarifying questions, and key concepts.
Diagnose Sudden Drop in Credit-Card Approval Rate
Diagnose Sudden Drop in Credit-Card Approval Rate
You are the on-call Data Scientist supporting the risk/underwriting system. Historically, the daily approval rate has been stable. Yesterday, it dropped sharply in a single day.
Assume you have access to decision logs, rule engine configs, model registry, feature store, experiment platform, observability/monitoring dashboards, and vendor status pages.
Approval rate = approvals / submitted applications, measured on decision-event timestamps. (If your org uses a different definition, state and use it.)
How would you diagnose the root cause? Provide:
- A step-by-step investigative plan to localize and explain the drop.
- The specific data you would pull.
- A set of concrete hypotheses to test (and how to test them).
Consider:
- Traffic mix shifts (channel, merchant/partner, geo, device, new vs. returning).
- Rule or model changes (new version, thresholds, reason-code distribution).
- Data/feature pipeline issues (null spikes, late features, schema changes).
- Seasonality/calendar anomalies and promotions.
- Experiment/AB-test effects (assignments, guardrails, SRM).
- External dependencies (KYC/identity, bureau pulls, device fingerprinting, payment networks).
- Infrastructure/latency/timeouts and fail-closed policies.
Constraints & Assumptions:
- Preserve the scope, facts, inputs, and requested outputs from the prompt above.
- If the prompt leaves a detail unspecified, state a reasonable assumption before relying on it.
- Keep the answer interview-ready: concise enough to present, but concrete enough to implement or evaluate.