u/justProto

Author Profile

Claim This Author Profile

Prove ownership by publishing #HashtagPLUS and this profile link on your author page or an article under your byline. A moderator or admin will review the request before it merges into your real HashtagPLUS username.

0 karma0 postsjoined 3 days ago

Would you replace Alexa/Google with a speaker that runs a big AI model fully locally? Building one, need honest feedback

🌐 reddit.comSource

I'm a firmware/FPGA engineer working on a smart speaker/hub that runs a large open MoE model (Qwen-Flash class, not a 3B) entirely on the device, ≤30 W, no cloud, no subscription, Matter/Thread/Zigbee built in, works with HA. Simulations on real model routing show ~25-40 tokens/s

#model #speaker #runs #building #flash #article #discussion #englishlanguage

3 days ago

Menu

u/justProto