Menu

On‑policy distillation works with limited additional data
📰

On‑policy distillation works with limited additional data

DEV Community: machinelearning·Papers Mache·19 days ago
#34lwDc0e
Reading 0:00
15s threshold

AutoDAgger recovers teacher trajectories online, letting compact policies inherit large‑model skill while requiring only modest extra data. By embedding the teacher’s corrective behavior directly into the student’s rollout loop, the method sidesteps the costly separate data‑collection stage that has dominated prior distillation pipelines [1] .

Before this work, practitioners relied on pure behavior cloning from static human demonstrations or offline distillation that frozen the teacher’s expertise before any interaction with the environment. Human‑in‑the‑loop DAgger variants such as HG‑DAgger still needed a person to monitor progress and intervene whenever the learner deviated, inflating both labor and dataset size. These approaches made scaling down high‑capacity policies to edge devices an engineering bottleneck.

AutoDAgger collects recovery data more than 2 × faster than HG‑DAgger, eliminating the human monitoring loop entirely [1] .…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.