Menu

Project Maya – four huge MoE models on the GPUs you already own, each with its own engine
📰

Project Maya – four huge MoE models on the GPUs you already own, each with its own engine

DEV Community: machinelearning·Private Local AI·about 9 hours ago
#EYYFXg0f
Reading 0:00
15s threshold

Project Maya (MIT, github.com/mw00/project-maya) is a free project whose pitch is the same one this whole blog keeps landing on: the biggest open models should run on hardware people already have. What makes it interesting to me is not that pitch but the way it's built — one engine per model , four flagship-scale mixture-of-experts models supported on purpose rather than generalized, and a self-tuning memory system that keeps the experts your conversation actually uses close to the GPU and everything else on RAM and NVMe.

Created and led by Peasant Smith (@mw00), co-maintained with @needmorevram.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.