Menu

Tiny per‑option encoders beat larger joints
📰

Tiny per‑option encoders beat larger joints

DEV Community: machinelearning·Papers Mache·8 days ago
#mM81pj6J
Reading 0:00
15s threshold

Thirty‑two‑million‑parameter per‑option encoders now outperform larger joint models on closed‑set decision benchmarks [1] . The surprise is that a tiny per‑option reader beats a monolithic scorer even when the latter has an order of magnitude more parameters.

Until recently, practitioners have leaned on large joint encoders or full‑scale language models to rank options in tasks such as tool selection, assuming that scaling up the encoder would automatically improve accuracy and stability. Joint scoring treats all candidates as a single input sequence, while per‑option scoring evaluates each candidate independently with a shared query encoder.

Per‑option scoring beats joint scoring by 5.8 points of chance‑corrected skill on a held‑out sample of a 37‑benchmark decision suite when matched at optimizer steps [1] .…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.