You can't fit a 20B or 70B model into an Android phone's memory, but you can run it on your own Mac or PC and use it from the phone. Off Grid AI Mobile (OGAM), the free Android app, finds Off Grid AI Desktop, Ollama or LM Studio on your Wi-Fi and lets you chat with whatever model the computer has loaded. The computer does the inference, the phone shows the answer, and nothing goes to a cloud.
Get Off Grid AI on Google Play | All downloads
What would you like to do with Off Grid AI?
Have a feature or use case you would like us to support? Tell us what you want to do and which device you use.
Write to [email protected] , join our Slack community , or talk to us on Reddit .
I build Off Grid AI. This walkthrough uses OGAM 0.0.124. If Ollama or LM Studio is already on your computer, you'll be done in a few minutes. The user-facing version lives on our site as the guide to using big AI models from your Android phone .
The memory math on a phone
On the phone, OGAM runs GGUF models with llama.cpp.β¦