Menu

#Localai

4 posts

Feed·
4 of 4 posts
Why we write our own C and C++ engines
📰
0

Why we write our own C and C++ engines

Hacker News·about 2 months ago
#HtyoLCQQ
#localai#python#against#parity#vllm#model

LocalAI is the open source AI engine. Run any model, LLMs, vision, voice, image and video, on any hardware. No GPU required.

15s
Read More
Local AI Just Became the Default: Gemma 4 + omlx on M4
🖼️
0

Local AI Just Became the Default: Gemma 4 + omlx on M4

DEV Community·Max Quimby·4 months ago
#nG9HYL42
#ai#localai#local#model#omlx#inference

Gemma 4 31B is the new local baseline on M4 24GB. omlx ships LLM inference as a menu-bar app. The Apple Silicon substrate just got real.

15s
Read More