Menu

#Wici

1 post

Feed
1 of 1 post
WiCi Infer Runs 800B-Parameter AI Models on a Laptop by Streaming Them From the SSD
📰
0Read More

WiCi Infer Runs 800B-Parameter AI Models on a Laptop by Streaming Them From the SSD

HackerNoon·sarahevans·about 5 hours ago
#qQMnhTVa
#hackernoon#technology#wici#memory#model

WiCi Infer is a free desktop app that runs 800B-parameter AI models on Macs and PCs by streaming weights from the SSD. Here is how it works and how fast it is.

15s