Menu

Your accuracy target may be unreachable in this format, and extra limbs won't rescue it
πŸ“°

Your accuracy target may be unreachable in this format, and extra limbs won't rescue it

DEV Community: datascienceΒ·howcani howcaniΒ·3 days ago
#BbvxQiRY
#devtodatascience#science#devto#dev#format
Reading 0:00
15s threshold

Every mixed-precision kernel makes the same decision, and it is usually made by hand: pick a format, pick a limb count, pick an accumulation width, and check afterwards whether the answer is close enough. The check is always "how wrong was it", never "how wrong could it have been" β€” so nobody can say which target accuracies are reachable at all in a given format, and which ones no amount of engineering will deliver.

There is a reason the second question goes unasked: it needs a ground truth, and floating point rarely offers one. The paper How Many Bits Does a Trusted Result Need? builds one β€” exact integer and rational arithmetic over a corpus pinned by SHA-256 β€” and makes the accuracy budget itself the thing being measured.…

Continue reading β€” create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.