Menu

1 / 4

SealedBench: A Protocol for Freezing AI Benchmarks Before the Questions Are Known

#hackernoon#technology#round#invalid#batch
Reading 0:00
15s threshold

A frozen model manifest, a generator sealed with drand, and an Arweave record anyone can use to rebuild the exam and check its scores.

I knew the question types but not the actual questions

On 2026-10-17, a bundle carrying my encrypted generator reached an Arweave block. The generator was sealed to a drand round that had not been published yet. I wrote that program, so I knew it would produce integer word problems, short Python programs, and shortest-path questions. I did not know which ones. The questions depended on a beacon the drand network would publish later, at round 33170212, on 2026-10-18T09:00:00Z.

When the round arrived, the same beacon value unlocked the program and seeded it.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.