Menu

#Fp32

5 posts

Feed·
4 of 5 posts
BF16 FP8: checking precision across two CPU compiler versions
📰
0Read More

BF16 FP8: checking precision across two CPU compiler versions

DEV Community: pytorch·Blucca·8 days ago
#7Xf9Lnwi
#devtopytorch#devto#dev#torch#fp32

A dtype conversion can remain visible after the final FP8 quantization. It belongs in a fusion's...

15s
Unlocking Tensor Core Performance for Machine Learning Interatomic Potentials
🖼️
0Read More

Unlocking Tensor Core Performance for Machine Learning Interatomic Potentials

NVIDIA Technical Blog·Anoushka Bhutani·18 days ago
#hm8m2cc4
#developer#fp32#tf32x3#tensor#core

Atomistic simulations help researchers understand how molecules and materials behave, from chemical reactions and phase transitions to mechanical failure.

15s
Why Long bf16 Training Runs Stall: The Residual Stream Has No Room for Small Updates
🖼️
0Read More

Why Long bf16 Training Runs Stall: The Residual Stream Has No Room for Small Updates

DEV Community: pytorch·AI OpenFree·25 days ago
#zleSNZin
#devtopytorch#devto#dev#residual#fp32

A bf16 residual near 600 has a resolution of 4, so small updates vanish. Measured gaps, a reproducible simulation and fixes for long training runs.

15s
0Read More

Technical question about Mamba Selective Scan kernel and FP16/FP32 precision

Reddit r/learnmachinelearning·u/Dry-Trouble4373·7 months ago
#kGw7XvYx
#kernel#fp16#mamba#fp32#precision

I'm trying to evaluate the model's accuracy when all internal operations are strictly limited to **FP16**. However, I noticed that the `selective_scan` CUDA kernel seems to use **FP32 accumulators** by default.…

15s