Before you put WeVisOne-VL-4B behind an API, decide which engine writes the answer. The authors' package runs the model two ways: through vLLM, a server built for throughput, or through plain Hugging Face Transformers as the reference. That choice sets your memory, your latency and, on one test image, whether the count was right.
The model comes from the WeChat Vision team at Tencent, on top of Alibaba's Qwen3-VL-4B-Instruct. One 4B checkpoint does the work of a detector, a segmenter and a matting tool. It boxes what you name, counts, points, reads text with its position, outlines and cuts out. We deployed it on our own cloud and sent the same 14 requests to each setup. Tables are in the full WeVisOne-VL-4B test with every measurement .
Why the fast path holds the model twice
Language models write tokens, word pieces produced one at a time. This one also has position tokens: four make a box, two a point. For outlines and cut-outs it writes a marker token after each box.…