Thirty‑two‑million‑parameter per‑option encoders now outperform larger joint models on closed‑set decision benchmarks [1] . The surprise is that a tiny per‑option reader beats a monolithic scorer even when the latter has an order of magnitude more parameters.
Until recently, practitioners have leaned on large joint encoders or full‑scale language models to rank options in tasks such as tool selection, assuming that scaling up the encoder would automatically improve accuracy and stability. Joint scoring treats all candidates as a single input sequence, while per‑option scoring evaluates each candidate independently with a shared query encoder.
Per‑option scoring beats joint scoring by 5.8 points of chance‑corrected skill on a held‑out sample of a 37‑benchmark decision suite when matched at optimizer steps [1] .…