Menu

1 / 2

LOWN Cuts Diffusion VLM Decoding FLOPs by Routing Image Access on Demand

DEV Community: machinelearning·aimodels-fyi·5 days ago
#R97211Vl
Reading 0:00
15s threshold

This is a Plain English Papers summary of a research paper called LOWN Cuts Diffusion VLM Decoding FLOPs by Routing Image Access on Demand . If you like these kinds of analyses, you can find more AI and machine-learning research on AIModels.fyi or follow us on Twitter .

LOWN cuts repeated image processing in diffusion VLM decoding

LOWN (Look Only When Needed) reduces decoding cost in LLaDA-V by deciding at each denoising step whether the image must be processed. The authors find that removing visual tokens changes a token selected for unmasking at only 22.8% of steps on average, with rates ranging from 7.9% on MMBench to 43.8% on DocVQA.

The motivation is unusually concrete: visual tokens account for 89–97% of LLaDA-V’s input on the evaluated benchmarks, yet a TEXT-ONLY forward costs just 3–10% of a FULL image-conditioned forward.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.