Menu

#Bitcos

1 post

Feed
1 of 1 post
0Read More

Breaking the 1.58-bit Barrier for Ternary LLMs

Hacker News·about 1 month ago
#2bgCT72I

Ternary Large Language Models (LLM) store every weight as one of three symbols $\{-1,0,+1\}$, so the cost of a ternary model is conventionally referenced to the information-theoretic $\log_2 3 \approx 1.585$ bits per weight.…

15s