I am going to build a home lab based on one single RTX PRO 6000 MAX-Q 96GB. The use case includes local LLM/agentic system and LLM finetuning, mostly on 27b models and smaller models, and 70B Q4 at most. I do not plan to build more GPUs.
I am lucky that my friend happens to have one spare R9 9950X3D CPU and a dual channel Acer Predator 6000 CL28 96GB(48GBx2) RAM, so I would take them, and buy 2 more 48GB RAM to make it 192GB in total.
My detailed build is as follows. Does it make sense, anything terribly wrong? Any QoL considerations? Many thanks for your input!
Components
CPU / MB
GPU
RAM
SSD OS
SSD Data #1
SSD Data #2
HDD Archive
PSU
CPU cooler
Case
UPS
Misc.