Menu

How to Run GPT-OSS 20B and Llama 3.1 70B From Your Android Phone in 2026 (On Your Own Computer)
πŸ“°

How to Run GPT-OSS 20B and Llama 3.1 70B From Your Android Phone in 2026 (On Your Own Computer)

DEV Community: androidΒ·Mohammed Ali ChherawallaΒ·1 day ago
#q9oAnJ5y
#devtoandroid#devto#dev#computer#ollama
Reading 0:00
15s threshold

You can't fit a 20B or 70B model into an Android phone's memory, but you can run it on your own Mac or PC and use it from the phone. Off Grid AI Mobile (OGAM), the free Android app, finds Off Grid AI Desktop, Ollama or LM Studio on your Wi-Fi and lets you chat with whatever model the computer has loaded. The computer does the inference, the phone shows the answer, and nothing goes to a cloud.

Get Off Grid AI on Google Play | All downloads

What would you like to do with Off Grid AI?

Have a feature or use case you would like us to support? Tell us what you want to do and which device you use.

Write to [email protected] , join our Slack community , or talk to us on Reddit .

I build Off Grid AI. This walkthrough uses OGAM 0.0.124. If Ollama or LM Studio is already on your computer, you'll be done in a few minutes. The user-facing version lives on our site as the guide to using big AI models from your Android phone .

The memory math on a phone

On the phone, OGAM runs GGUF models with llama.cpp.…

Continue reading β€” create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.