I run a local model for stuff I'd never paste into ChatGPT, client emails, bank exports, that kind of thing. Then I read the Immich telemetry thread here last week and realized I had never actually checked if my "local" setup stays local.
So I checked. Gave it a fake task with a customer name, an IBAN and a balance, and logged every network connection from the app every half second while it worked. Every single one was 127.0.0.1, the laptop talking to itself. Nothing left the machine. The answer came back in 2.5 seconds from a 1.7B model on my M4.
The app I use is Magnitude. It does check for updates in the background which is normal, but nothing went out during the actual work.
How to check yours: run lsof -i -P while the model is answering and look for anything that isn't 127.0.0.1 or localhost. If you run it in Docker, put the container on a network with internal set to true and see if anything breaks.
The whole point of running it yourself is that nothing leaves.…