Running large language models locally on an AMD integrated GPU takes more than installing Ollama. The operating system, ROCm runtime, container configuration, and GPU permissions all need to work together. A container can start successfully while inference still runs on the CPU—or fails when the model is loaded.

I set up Ollama on an EVO-X2 equipped with an AMD Ryzen AI Max+ 395 and Radeon 8060S , using Ubuntu, ROCm, Docker, and Open WebUI. This article documents that setup, how I checked GPU detection, and the compatibility problems I encountered later. It is based on my installation notes from late 2025, with later observations clearly distinguished from the initial procedure.…