Generating high‑value synthetic questions injects dense teacher supervision into on‑policy distillation, substantially reducing the number of required training questions. The twist is that these queries need no reference answers; their value comes from how much they expose the teacher’s knowledge when a strong model answers them.
Before this work, practitioners relied on real user questions or unoptimized student‑generated prompts, often filtering them with KL divergence to approximate relevance. Vanilla on‑policy distillation (OPD) and KL‑filtered real queries have been the default baselines for math reasoning, code generation, and agentic tasks.
A2D lifts average test scores to the mid‑40s and 60s, outpacing vanilla OPD by several points.…