Menu

1 / 19

GitHub - MakazhanAlpamys/Soup: Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.

Hacker News·3 months ago
#937qQOwY
#github#soup#model#train#config
Reading 0:00
15s threshold

Fine-tune and post-train LLMs in one command. No SSH, no config hell.

Website · Quick Start · Config · Docs · Commands · Models · Discord

Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.

pip install " soup-cli[train] " # add [train] to fine-tune; bare `soup-cli` is the light CLI soup init --template chat soup train

Why Soup?

Training LLMs is still painful. Even experienced teams spend 30-50% of their time fighting infrastructure instead of improving models. Soup fixes that.

Zero SSH. Never SSH into a broken GPU box again.

One config. A simple YAML file is all you need.

Auto everything. Batch size, GPU detection, quantization — handled.

Works locally. Train on your own GPU with QLoRA. No cloud required.

What's New

v0.72.4 — align on a laptop: DPO, ORPO, SimPO and KTO over layer streaming. Layer streaming keeps the frozen base out of VRAM and feeds it to the GPU one decoder layer at a time.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.