Menu

#Decay

16 posts

Feed·
14 of 16 posts
My Gradient Clipping Was Never Clipping. It Was Secretly Multiplying My Weight Decay
📰
0Read More

My Gradient Clipping Was Never Clipping. It Was Secretly Multiplying My Weight Decay

DEV Community: pytorch·b1ackjack12·11 days ago
#99DLnCHo
#devtopytorch#devto#dev#clipping#decay

Yesterday warmup turned out to be free insurance against a hot learning rate, so today I asked whether gradient clipping — the other famous

15s
Weight Decay 0.05: Catastrophe in Adam, Optimum in AdamW
📰
0Read More

Weight Decay 0.05: Catastrophe in Adam, Optimum in AdamW

DEV Community: pytorch·b1ackjack12·13 days ago
#geaZvlkd
#devtopytorch#devto#dev#adam#adamw

The dose-response series reaches the knob I've been inheriting since September: weight_decay=5e-4, copied from SGD folklore into Adam

15s
"We basically rewrote the entire State of Decay game": Undead Labs spent years trying to make State of Decay 3 into a full-blown zombie apocalypse MMO
🖼️
0Read More

"We basically rewrote the entire State of Decay game": Undead Labs spent years trying to make State of Decay 3 into a full-blown zombie apocalypse MMO

Rock Paper Shotgun Latest Articles Feed·Julian Benson·18 days ago
#B9X3DtCd
#rockpapershotgun#state#decay#game#undead

State of Decay 3 was an MMO before it became the open-world co-op survival game Undead Labs is preparing to release.

15s
Necropanther - The Tempest : r/Metal
🖼️
0Read More

Necropanther - The Tempest : r/Metal

#metal#redditmetal#necropanther#down#tempest

r/Metal 10h ago u/jkLottery Necropanther - The Tempest [New Release] necropanther.bandcamp.com The Tempest by Necropanther, released 13 November 2026 Sailors, you take in the topsail The mast is splitting and ready to break Make fast the lines In the name…

15s
EMA's Decay Isn't a Dial. It's a Plateau, a Cliff, and a 10%-Accuracy Crater
🖼️
0Read More

EMA's Decay Isn't a Dial. It's a Plateau, a Cliff, and a 10%-Accuracy Crater

DEV Community: pytorch·b1ackjack12·25 days ago
#M6ljGg6U
#devtopytorch#devto#dev#decay#window

A month ago EMA's tutorial default lost me three points and the tuned value earned a cosmetic +0.08, so I did what this blog now does to

15s
Your agent doesn't remember anything. Persistence isn't memory.
🖼️
0Read More

Your agent doesn't remember anything. Persistence isn't memory.

DEV Community·Andrew Kew·6 months ago
#JZHdJo8T
#ai#database#agents#memory#agent

A customer support agent that forgets a user's billing conversation from two days ago isn't broken —...

15s
I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.
🖼️
0Read More

I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.

DEV Community·Nic Lydon·6 months ago
#os9sf18v
#apple#postgres#privacy#records#device

I've been building a system called Nexus for the past few months. It's a personal data platform: 54...

15s
How the Gannon G5 Solar Storm Pushed the World’s Largest Satellite Constellation to Its Limits
🖼️
0Read More

How the Gannon G5 Solar Storm Pushed the World’s Largest Satellite Constellation to Its Limits

DEV Community·Shantanu Juvekar·6 months ago
#RfqGOyU4
#engineering#why#solar#does#orbital

From Dev.to - datascience: How the Gannon G5 Solar Storm Pushed the World’s Largest Satellite Constellation to Its Limits

15s
The exotic particles that could finally break the Standard Model
🖼️
0Read More

The exotic particles that could finally break the Standard Model

www.nature.com·Gibney, Elizabeth·7 months ago
#SEm5qSSr
#latest#search#particles#decay#model

‘Penguin’ decays from CERN’s latest Large Hadron Collider experiment hint at weird new physics. ‘Penguin’ decays from CERN’s latest Large Hadron Collider experiment hint at weird new physics.

15s
Why LLM Agents Fail: Four Mechanisms of Cognitive Decay and the Reasoning Harness Layer
📰
0Read More

Why LLM Agents Fail: Four Mechanisms of Cognitive Decay and the Reasoning Harness Layer

DEV Community·Frank Brsrk·7 months ago
#V1aSe5Qf
#ai#llm#agents#architecture#harness

From Dev Community: Why LLM Agents Fail: Four Mechanisms of Cognitive Decay and the Reasoning Harness Layer

15s