Every engine author has a feeling for what a bigger hash table is worth. I wanted a number, so I built a clock that could give me one.
The short version, for one alpha-beta engine at 100 ms a move (a shogi engine; the smaller chess sample is further down):
Change Memory added Elo gained
Hash table 1 MiB → 4 MiB +4.6 MiB +22 ±53
Hash table 4 MiB → 16 MiB +19.5 MiB +37 ±57
History tables off → on +4.8 MiB +573 ±125
Thinking time 25 ms → 100 ms (4x) none +477 ±134
About 5 MiB of history tables was worth more than four times the thinking time . Sixteen times the hash table was inside the error bars.
I don't think this is a law of nature. I think it is one engine at one speed, and I would like you to try to break it. The rest of this post is how the measurement works, what it does not show, and how to run it on your own engine.
The clock: count instructions, not seconds
Measuring small effects with a wall clock is hard.…