Previously, on Day 43: Explained in-context learning, where language models adapt to new tasks by imitating examples in the input prompt rather than updating their internal parameters, and contrasted this approach with traditional fine-tuning.
What Is Zero-Shot, One-Shot, and Few-Shot Learning?
In machine learning, a "shot" means an example.
Zero-shot learning : The model is asked to solve a task with no examples to guide it.
One-shot learning : The model gets a single example before tackling the task.
Few-shot learning : The model sees a small handful—usually 2 to 10—examples before trying the task itself.
Think of learning a new card game:
Zero-shot : You get the rulebook, but no demonstration. You’re expected to play based only on the written instructions.
One-shot : You see one round played.…