Menu

1 / 2

Mistral lets you download its biggest AI model and run it on your own servers

Reading 0:00
15s threshold

Mistral has released the downloadable files for Mistral Large 4, its biggest AI model, giving businesses the option to run it on their own infrastructure instead of sending requests through a hosted service.

The October 29 release follows an October 6 preview. The model accepts text and images and produces text, with room for up to one million tokens of context, the material it can consider in a request.

You can modify and fine-tune it for commercial work. But the license draws a boundary around businesses that sell access to models, so downloading the files does not give every provider the same commercial rights.

Running the model yourself comes with real hardware demands

The official model card lists one trillion parameters, the numerical values learned during training. Only part of the model works on each token, but its full size still makes deployment a substantial infrastructure project.

Mistral’s example setup spreads the model across eight graphics processors.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.