Menu

I Ran Local LLMs on a Laptop With No GPU: Here Are the Real Numbers
📰

I Ran Local LLMs on a Laptop With No GPU: Here Are the Real Numbers

DEV Community: opensource·Khushighosh·16 days ago
#CgBAThJ2
#devtoopensource#devto#dev#model#orders
Reading 0:00
15s threshold

Most local-LLM posts are written on machines with a good GPU. Mine doesn't have one, so I'm sharing what actually happened.

The setup

Laptop: Intel Core i7-13620H, 16 GB RAM, Intel UHD graphics only (no dedicated GPU), Windows

Runtime: Ollama

Models: qwen2.5:7b , llama3.2:3b , and nomic-embed-text for embeddings

I built two apps on this machine during Hacktoberfest.

App 1: an exam study buddy (RAG)

It answers questions and quizzes you from your own notes, using local embeddings plus Chroma/SQLite, with qwen2.5:7b generating.

Request Time

First answer after server start 55 s

Normal answer 42 s

Quiz question 35 s

Honest verdict: usable for studying, since you ask, think and wait.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.