Menu

#KvCache

1 post

Feed
1 of 1 post
Pushing the Limits of KV Cache Compression · zartbot
🖼️
0Read More

Pushing the Limits of KV Cache Compression · zartbot

Hacker News·2 months ago
#9lNFhsUJ
#zartbot#deepseek#kvcache#flash#prefill

A deep dive into the DeepSeek-V4.1 Flash technical report: CED, CSA2, HSI, Single-Pass mHC, Engram and FP4 KV Cache — how the KV cache was compressed to just 890 bytes per token.

15s