AMD Strix Halo RDMA Cluster Setup Guide

This guide details how to configure a two-node AMD Strix Halo cluster linked via Intel E810 (RoCE v2) for distributed vLLM inference using Tensor Parallelism.

Table of Contents

TL;DR (Quick Start)

Concepts & Architecture

Hardware Prerequisites

Host Configuration (Fedora) 4.1 Install Packages

4.2 Check Native Firmware

4.3 Network Configuration

4.4 BIOS & Kernel Configuration

4.5 Firewall Rules

Toolbox Installation & Network Verification 5.1 Prerequisites: Passwordless SSH

5.2 Installation

5.3 Verify RDMA Connection

Running the Cluster 6.1 Setup & Verify

6.2 Launching vLLM

Troubleshooting

References & Acknowledgements

1.…