Pull down to go back
60% MatMul Performance Bug in cuBLAS on RTX 5090

60% MatMul Performance Bug in cuBLAS on RTX 5090

RTX 5090 上 cuBLAS 的 60% MatMul 效能漏洞

cuBLAS is dispatching an inefficient kernel for every batched FP32 workload, from 256×256 to 8192×8192×8, only using ~40% of available compute on RTX GPUs. Tested on RTX 5090 with CUDA 13.2.51, cuBLAS 13.3.0, and driver 595.58.03—previous versions perform even worse. The author wrote a simple but efficient kernel and compared it against cuBLAS across various workloads, demonstrating significant performance gaps.

Keywords

performance bugMatMulbatched operationsFP32GPU optimizationkernel efficiencycompute utilization