Menu

#Imil

1 post

Feed
1 of 1 post
📰
0

RTX 5080 + RTX 3090 Setup: 80+ Tok/s on Qwen 3.6 27B Q8

Hacker News·3 months ago
#91vMYTif
#imil#calls#gen#acc#nvidia#tokens

Dual GPU setup: run Qwen 3.6 27B at a Q8 quantization at 80+ tokens/sec with 39GB total VRAM

15s
Read More