A 10-year-old CNN can beat frontier LLMs at skin cancer diagnosis, but only when the input looks like the training data. In practice, that almost never happens.
Your model sees dermoscopic images: high-resolution, ring-light illumination, no hair or text. Your users send phone photos taken under bathroom LEDs, with flash glare, arm hair, and a ruler sticker in frame. The same architecture that scores 95% on ISIC benchmarks drops to near-random when the distribution shifts. This is not a model capacity problem. It is a data pipeline problem.
By the end of this piece you will be able to:
Identify the three most common distribution shifts that break dermoscopic CNNs
Build a preprocessing pipeline that normalizes real-world photos into model-ready inputs
Choose between fine-tuning and prompt-based augmentation based on your data budget
The three shifts that kill your model
Dermoscopic datasets like ISIC are collected under controlled conditions. Real-world photos are not.…