Menu

#HugOverGnes

1 post

Feed
1 of 1 post
Hugo Vergnes | Training a 3.8B LLM to 0.384 CORE for $998
📰
0Read More

Hugo Vergnes | Training a 3.8B LLM to 0.384 CORE for $998

Hacker News·about 2 months ago
#ab9iWIhh
#hugovergnes#llm#nanogpt#nanochat#core

A 3.8B model pretrained from scratch to 0.384 CORE on 65B tokens in 43 hours, for $998.

15s