Pull down to go back
Running Qwen3.5-122B at 198 tok/s on Budget 2x RTX PRO 6000 Blackwell Setup — Full Results & Config Shared

Running Qwen3.5-122B at 198 tok/s on Budget 2x RTX PRO 6000 Blackwell Setup — Full Results & Config Shared

用 2 張 RTX PRO 6000 Blackwell 跑 Qwen3.5-122B 達到 198 tok/s — 平價方案、完整數據公開

A developer spent a week optimizing a dual-GPU inference server and is sharing everything: actual performance numbers, raw data, launch commands, and the exact methodology. The setup uses 2x RTX PRO 6000 Blackwell GPUs (96GB GDDR7 each) paired with an EPYC 4564P CPU and achieves 198 tokens/second on Qwen3.5-122B. All results are publicly available with complete transparency on hardware, configuration, and benchmarking approach.

Keywords

LLM inferencethroughput benchmarkingGPU optimizationQwen3.5token/squantizationNVFP4budget build