Menu

Llamafile v0.8.14: a new UI, performance gains, and more

Mozilla Hacks – the Web developer blog·@StephenHood·7 months ago
#JVaUze
Reading 0:00
15s threshold

We’ve just released Llamafile 0.8.14 , the latest version of our popular open source AI tool. A Mozilla Builders project, Llamafile turns model weights into fast, convenient executables that run on most computers, making it easy for anyone to get the most out of open LLMs using the hardware they already have.

New chat interface

The key feature of this new release is our colorful new command line chat interface . When you launch a Llamafile we now automatically open this new chat UI for you, right there in the terminal. This new interface is fast, easy to use, and an all around simpler experience than the Web-based interface we previously launched by default. (That interface, which our project inherits from the upstream llama.cpp project, is still available and supports a range of features, including image uploads. Simply point your browser at port 8080 on localhost).

Other recent improvements

This new chat UI is just the tip of the iceberg.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.