Menu

Your Churn Model Works. Your Churn Intervention Doesn't.
πŸ“°

Your Churn Model Works. Your Churn Intervention Doesn't.

DEV Community: datascienceΒ·Jason LauΒ·16 days ago
#P8X9pHlk
#devtodatascience#science#devto#dev#customers
Reading 0:00
15s threshold

The quarterly retention review had a good slide. The churn model's top decile had been sent a 20% discount offer, and only 18% of those customers left, against the 31% the model had predicted for them. Thirteen points, at a few thousand customers, came to a satisfying number in saved revenue.

Then someone asked the question that ends most of these meetings: "Compared to what?"

The 31% was the model's forecast for those customers if nothing changed. But the model was trained on last year's customers, the offer went out in a quarter with a price change and a new competitor, and nobody had held back a group of top-decile customers who got no offer. So nobody could say whether the discount saved those customers, whether they would have stayed anyway, or whether it pushed some of them out the door. The model was fine.…

Continue reading β€” create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.