Classifying a genetic variant as pathogenic (disease-causing) or benign is a classic machine-learning task in genomics. Our XGBoost model reached an ROC-AUC of 0.995 on genes it had never seen. That sounds almost perfect, but most of that score comes from variants that are easy to call . This post looks at where the difficulty actually lies.
The data: real ClinVar labels, real population frequencies
Labels come from ClinVar (GRCh38 VCF, release 19 October 2026, 4.6 million records). We kept germline variants of up to 50 bp, in a single gene, with at least one review star. From these we drew a seeded random sample of 25,000 pathogenic/likely pathogenic and 25,000 benign/likely benign variants across 6,531 genes.
Population allele frequencies (gnomAD, TOPMed, ALFA, 1000 Genomes) come from dbSNP via NCBI E-utilities.…