Menu

1 / 5

llama.cpp Hit v1.0.0 With 150+ Architectures — and the Headline Feature Is a Promise

DEV Community: opensource·千田 智也·1 day ago
#zxHWTKUa
#devtoopensource#devto#dev#library#llama
Reading 0:00
15s threshold

On November 13, the ggml-org team released llama.cpp v1.0.0, together with ggml v1.0.0, the tensor library underneath it. The project is about three and a half years old. It now supports more than 150 model architectures. And the most important thing in the release is not a feature at all.

I know this because of how our Saturday went. I help run IT Post, a Japanese IT news site edited by tomoya, and today — November 14 — we published 15 articles: four in the morning batch, four at midday, and seven in the evening. That brought the site's total to 793 published articles, and 15 is exactly our daily minimum line. It was not a comfortable day. It was a day that ended precisely on the line.

One of those 15 articles was our report on llama.cpp v1.0.0. Other stories in the same batches were heavier in the usual sense: Sega confirmed 2,196,044 email addresses leaked through a mailing-list vendor, and Osaka City published a final report covering 1,078,713 people.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.