📰00Read later0Read MoreWeight Decay 0.05: Catastrophe in Adam, Optimum in AdamWDEV Community: pytorch·b1ackjack12·13 days ago#geaZvlkd#devtopytorch#devto#dev#adam#adamw+5 more🧰Tag tools✨Add tagThe dose-response series reaches the knob I've been inheriting since September: weight_decay=5e-4, copied from SGD folklore into Adam15s