Menu

#Edgeai

10 posts

Feed·
8 of 10 posts
How we catch silent NPU fallback on Snapdragon in CI (and why your eval set won't)
🖼️
0

How we catch silent NPU fallback on Snapdragon in CI (and why your eval set won't)

DEV Community·ashish-frozo·5 months ago
#uFm7l1Ut
#part#edgeai#mlops#median#model#latency

ONNX Runtime's QNN execution provider silently routes unsupported ops to the CPU. Your eval set passes. Production latency triples. Here's the three CI assertions that catch it before merge.

15s
Read More
Bringing Generative AI to Microcontrollers: Introducing NocLLM
📰
0

Bringing Generative AI to Microcontrollers: Introducing NocLLM

DEV Community: cpp·Muhammad Ikhwan Fathulloh·5 months ago
#idC1ceom
#dev#include#arduino#llm#generativeai#iot

The barrier between resource-constrained hardware and Large Language Models (LLMs) has finally been broken. While microcontrollers lack the VRAM to run a 70B parameter model locally, they can now act as intelligent gateways to the world's most powerful AI…

15s
Read More