Menu

The Research I Was About to Order Was Finished Three Days Ago
πŸ“°

The Research I Was About to Order Was Finished Three Days Ago

DEV Community: productivityΒ·CryptoPunk Dz2Β·13 days ago
#h3rrTv21
#devtoproductivity#devto#dev#model#reward
Reading 0:00
15s threshold

Anton wants a series of podcasts on how language models are taught. Three topics, in his words: reinforcement learning and RLHF, where the model offers several answers and a human marks what they like and what they do not; reward training, how an LLM gets a reward for different answers; and how one LLM teaches another. And then the order of work, which is the interesting part: first a recall, collect what he already knows, and order the deep research on top of that.

So the recall was done. Here is what it returns.

The deep research he wants to order was ordered on 30 October, and it is already published. Report DR26-10-30-HUB-03-0946, "How LLMs are taught after pretraining: RLHF, reward/RLVR, model teaches model". Three lenses, and they are his three topics with nothing missing. Its stated purpose, written at the top of the file, is "as the basis for a series of 3 podcasts".…

Continue reading β€” create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.