Menu

1 / 3

Our variant classifier scored ROC-AUC 0.995 — here's why that number is mostly the easy part

DEV Community: datascience·ProTechSC Academy·1 day ago
#75uq0005
#devtodatascience#science#devto#dev#variants
Reading 0:00
15s threshold

Classifying a genetic variant as pathogenic (disease-causing) or benign is a classic machine-learning task in genomics. Our XGBoost model reached an ROC-AUC of 0.995 on genes it had never seen. That sounds almost perfect, but most of that score comes from variants that are easy to call . This post looks at where the difficulty actually lies.

The data: real ClinVar labels, real population frequencies

Labels come from ClinVar (GRCh38 VCF, release 19 October 2026, 4.6 million records). We kept germline variants of up to 50 bp, in a single gene, with at least one review star. From these we drew a seeded random sample of 25,000 pathogenic/likely pathogenic and 25,000 benign/likely benign variants across 6,531 genes.

Population allele frequencies (gnomAD, TOPMed, ALFA, 1000 Genomes) come from dbSNP via NCBI E-utilities.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.