Menu

1 / 49

Lawyer’s $9,450 private AI server with 12 used Nvidia V100s now runs every DeepSeek V4.1 Flash expert at 4-bit NVFP4 — hits 184 tokens/s and claims to beat DGX Spark stacks on single requests

#tomshardware#half#lawyer#upped#ante
Reading 0:00
15s threshold

A lawyer has upped the ante by upgrading his private AI server from eight to 12 used Nvidia V100s, which can run every DeepSeek V4.1 Flash expert at 4-bit NVFP4. Performance can reach up to 184 tokens per second for code, and long documents start answering in about half the time as before. He says it can outrun published DGX Spark stacks at decoding a single request, for half the price of three units, based on the $9,450 he paid.

Get Tom's Hardware's best news and in-depth reviews, straight to your inbox.