Menu

1 / 2

Can a 1.7B model match a 4.7x larger LLM? Distilling Qwen3-8B with QLoRA on real Brazilian Portuguese reviews

DEV Community: nlp·Matheus Soares·about 4 hours ago
#lWwkim0F
#devtonlp#devto#dev#reviews#student
Reading 0:00
15s threshold

Leia este artigo em português

Every e-commerce support team has the same problem: thousands of free-text customer reviews and no time to read them. Which ones are about a late delivery? Which customers are angry? Which ones need someone to act today?

I wanted to know whether a small language model could do that triage as well as a much larger one, at a fraction of the cost. So I set up a controlled experiment with real Brazilian Portuguese reviews, a hand-labeled test set, confidence intervals and a budget of zero.

Short answer: a Qwen3-1.7B fine-tuned with QLoRA ties a few-shot Qwen3-8B on two of three fields, loses 4 accuracy points on sentiment, and runs 3.7× faster in batch.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.