You deployed a model three months ago. It was accurate then. It may not be now. Data distributions shift, label patterns change, and your model silently degrades β until someone notices the product is broken. The problem is not writing ML models; it's knowing when they stop working.
Why Models Drift
A model learns the statistical relationship between inputs and outputs at training time. When the world changes β customer behavior shifts, a new product launches, a data pipeline upstream changes format β the model keeps predicting as if nothing happened. There are two distinct failure modes:
Data drift : the input distribution P(X) has changed. Features that were rare are now common; ranges shifted.
Concept drift : the relationship P(Y|X) has changed. The same input now maps to a different output than the model expects.
Both are silent killers.β¦