There are billions of phones out there that can already run AI models locally, but most apps don't use that at all. Sending every AI request to a server is wasteful, especially for simple ones, and there are a lot of those. It costs money, it adds latency and the user's data leaves their phone. At scale it also adds up in the energy and water data centers use. I think it's important that we start making use of what these devices can already do. expo-ai-kit is my small contribution to that.

It's an Expo module for running AI on the device. This post shows how to use it for text generation, speech-to-text and vision in an Expo/React Native app. Everything runs locally on the phone, using the models and frameworks that iOS and Android already ship with (Apple Foundation Models, Apple Speech and Vision, ML Kit on Android).

saidkaban / expo-ai-kit

On-device AI for Expo and React Native. Local LLM, speech-to-text, vision, and embeddings. No API keys, no cloud.

expo-ai-kit

On-device AI for React Native.…