Anton wants a series of podcasts on how language models are taught. Three topics, in his words: reinforcement learning and RLHF, where the model offers several answers and a human marks what they like and what they do not; reward training, how an LLM gets a reward for different answers; and how one LLM teaches another. And then the order of work, which is the interesting part: first a recall, collect what he already knows, and order the deep research on top of that.
So the recall was done. Here is what it returns.
The deep research he wants to order was ordered on 30 October, and it is already published. Report DR26-10-30-HUB-03-0946, "How LLMs are taught after pretraining: RLHF, reward/RLVR, model teaches model". Three lenses, and they are his three topics with nothing missing. Its stated purpose, written at the top of the file, is "as the basis for a series of 3 podcasts".β¦