Menu

#Gsm8k

4 posts

Feed·
4 of 4 posts
What would you require before calling an inference change “quality-neutral”? [D]
📰
0Read More

What would you require before calling an inference change “quality-neutral”? [D]

Two GSM8K scores: 96.89% → 96.82%, across all 1,319 test questions. These are from NVIDIA’s Ling-3.0-flash comparison on one DGX Spark. The optimized configuration changes the MoE backend, adds an FP8 output head and enables NEXTN speculative decoding…

15s
I Benchmarked 3 LLM Tasks for $0.12. Here's What the Cost Breakdown Reveals About AI Evaluation
🖼️
0Read More

I Benchmarked 3 LLM Tasks for $0.12. Here's What the Cost Breakdown Reveals About AI Evaluation

DEV Community·kol kol·6 months ago
#z8swcvzs
#ai#llm#machinelearning#performance#cost

From Dev.to - machinelearning: I Benchmarked 3 LLM Tasks for $0.12. Here's What the Cost Breakdown Reveals About AI Evaluation

15s