Menu

NeuronDump: look inside any local LLM and make it smaller
πŸ“°

NeuronDump: look inside any local LLM and make it smaller

DEV Community: rustΒ·Aymen NaghmouchiΒ·18 days ago
#TvhzoYvN
#devtorust#devto#dev#neurondump#model
Reading 0:00
15s threshold

If you run models locally with Ollama or llama.cpp, you've probably downloaded a few gigabytes of GGUF and treated it as a black box. I wanted to open that box: see the layers, the attention heads, the vocabulary, the chat template, and then ask a simple question: which parts does this model not actually need, and what breaks if I remove them?

So I built NeuronDump , a single Rust binary (MIT) with a CLI and a local web UI. It reads GGUF files directly, with nothing hard-coded per model.

πŸ‘‰ Repo: https://github.com/aymen94/NeuronDump

πŸ‘‰ Docs & illustrated intro: https://aymen.xyz/NeuronDump/

What it does

Inspect : architecture, layers (including hybrid SSM/attention models), attention heads, the vocabulary decoded and classified, the chat template as a decision tree, and weight statistics.

Graph : the model as a 3D (or 2D) graph you can open from sections down to single attention heads, neuron buckets and MoE experts.

Cut and see the impact : select any parts and instantly see the size saved, what…

Continue reading β€” create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.