Menu

#Benchmark

254 posts

Feed·
20 of 254 posts
Does OpenBookQA leak its answer? It's the longest option and the first — and neither shortcut generalizes
📰
0Read More

Does OpenBookQA leak its answer? It's the longest option and the first — and neither shortcut generalizes

DEV Community: datascience·munimv2·about 5 hours ago
#8uLazbP4
#devtodatascience#science#devto#dev#length

This research is carried out by AI agents working in MV2's name at Munim, Inc., and is published...

15s
DeepSeek v4.1 Flash Benchmark: Testing a 1M Context LLM Route
📰
0Read More

DeepSeek v4.1 Flash Benchmark: Testing a 1M Context LLM Route

DEV Community·JIA·about 19 hours ago
#ZZxhF6ap
#dev#route#context#benchmark#deepseek

DeepSeek v4.1 Flash Benchmark: Testing a 1M Context LLM Route Large context window models...

15s
Picking the longest answer scores 43% on OpenBookQA and ~chance on ARC: a per-benchmark length-shortcut census
📰
0Read More

Picking the longest answer scores 43% on OpenBookQA and ~chance on ARC: a per-benchmark length-shortcut census

DEV Community: machinelearning·munimv2·1 day ago
#EfWA8w1y

This research is carried out by AI agents working in my name at Munim, Inc., and is disclosed as...

15s
Goose vs Rust: Can a New Language Beat Rust at Memory-Safe Performance?
📰
0Read More

Goose vs Rust: Can a New Language Beat Rust at Memory-Safe Performance?

DEV Community: rust·jamilxt·3 days ago
#yzXjt9NN
#devtorust#devto#dev#goose#rust

A new programming language can attract attention by promising to be faster than Rust. That claim is...

15s
Oil prices hit highest point since May
📰
0Read More

Oil prices hit highest point since May

The Hill News·Rachel Frazin·4 days ago
#JWNE5hxl
#thehill#prices#friday#iran#benchmark

Oil prices on Friday hit their highest point since May as the war in Iran drags on. As of Friday morning, futures for international benchmark Brent crude were trading at $116 per barrel, while U.S benchmark West Texas Intermediate traded at about $102.…

15s
What a Youden index of 77 actually means on the OWASP Benchmark
📰
0Read More

What a Youden index of 77 actually means on the OWASP Benchmark

DEV Community: appsec·Ward Ed·4 days ago
#vPenVr4F
#devtoappsec#devto#dev#youden#index

A neutral guide to reading OWASP Benchmark scores: why the Youden index resists precision tricks, and how to compare security tools honestly.

15s
DeepsecBench: evaluating model performance in finding cybersecurity vulnerabilities
🖼️
0Read More

DeepsecBench: evaluating model performance in finding cybersecurity vulnerabilities

Vercel News·Malte Ubl·6 days ago
#X9in0MtT
#vercel#model#models#benchmark#score

Today we're releasing DeepsecBench, a benchmark that evaluates how well different models find security vulnerabilities in application code.

15s
283Read More

MicroLLM lab — tiny LLMs, Q4, in your browser

stateofutopia.com·29 days ago
#tZWWiq90
#microllm#llm#benchmark#javascript#photo

Run Q4 small language models entirely in the browser with WebGPU. Chat, benchmark, and compare PetitGPT, SmolLM2, and friends on-device.

15s
TabPFN vs XGBoost: benchmark measured on an RTX 4070 Ti
🖼️
23Read More

TabPFN vs XGBoost: benchmark measured on an RTX 4070 Ti

Hacker News·30 days ago
#9p2h5St8
#efraingaray#tabpfn#xgboost#benchmark#article

The claim behind TabPFN and TabICL is that they predict on a table without ever training on it and still beat tuned boosting.

15s
Every Model Cheats: Prompt-Level Mitigation of Cheating on Offensive Cyber Tasks
🖼️
0Read More

Every Model Cheats: Prompt-Level Mitigation of Cheating on Offensive Cyber Tasks

Hacker News·2 months ago
#UpyJ71AN
#dreadnode#cybersecurity#ai#llm#benchmark

This post presents a controlled prompt-ablation study: 23 tasks, three prompt conditions, 1,518 individually audited traces, and a simple question: can you prompt away cheating?

15s
I Benchmarked 4 Lightweight Transformers for Fault Detection. Here's What Survived.
🖼️
0Read More

I Benchmarked 4 Lightweight Transformers for Fault Detection. Here's What Survived.

DEV Community: machinelearning·Disha Patel·5 months ago
#4fMq2a0h
#dev#ai#python#benchmark#tinybert

Everyone talks about deploying ML on edge devices. Very few people show what happens when you...

15s