🖼️00Read later0Read MoreHumanEval on a MacBook — 81.7% pass@1, Wi-Fi offDEV Community·Matt Macosko·7 months ago#CJkiU5Jz#why#ai#machinelearning#benchmark#humaneval+8 more🧰Tag tools✨Add tagQwen 3 Coder 30B (8-bit MLX) scored 81.7% pass@1 on HumanEval running on a single M5 Max MacBook with Wi-Fi off. Real run, all 164 problems, 14 minutes wall-clock. The first measured number for this variant on this hardware.15s
🖼️00Read later0Read MoreWhat 500 curated failure pairs actually fix: a breakdown across 3 seedsDEV Community·namakoo [IDFU]·7 months ago#SYq43zYl#ai#python#model#seeds#idfu+4 more🧰Tag tools✨Add tagFrom Dev.to - machinelearning: What 500 curated failure pairs actually fix: a breakdown across 3 seeds15s