Menu

Train a Modern VLM on One GPU: Qwen3-VL with Unsloth and Transformers 5.12.1
📰

Train a Modern VLM on One GPU: Qwen3-VL with Unsloth and Transformers 5.12.1

DEV Community: computervision·Harpreet Sahota·10 days ago
#KTYiOvWp
Reading 0:00
15s threshold

Train a Modern VLM on One GPU: Qwen3-VL with Unsloth and Transformers 5.12.1

TL;DR

The original notebook was built around Qwen2-VL-7B , duplicated code, and mixed blog prose with Colab-only scaffolding.

A better current baseline is Qwen3-VL-8B-Instruct : it is newer, directly supported by transformers==5.12.1 , and still fits the same efficient LoRA-style fine-tuning story.

For the current Hugging Face API, the clean multimodal path is AutoProcessor plus Qwen3VLForConditionalGeneration , with chat-template formatting handled inside transformers .

Abstract

The hard part of maintaining model tutorials is not getting them to work once. It is keeping them honest after the ecosystem moves. The original draft here had the right instinct, but it was frozen around an older Qwen2-VL notebook export, repeated the same preprocessing twice, and relied on an inference path that no longer reflects the cleanest modern transformers workflow.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.