Highest multimodal server throughput
On Qwen3-VL-235B-A22B, CoreWeave sustained 1,196 queries per second in server mode and 1,135 samples per second offline on an NVIDIA GB300 NVL72 rack. That is the highest server throughput among cloud providers
Nearly 20% more throughput per GPU
On DeepSeek-R1-671B, derived per-GPU server throughput on NVIDIA GB200 NVL72 rose 19.8% in the five months since MLPerf Inference v6.0, comparing a 72-GPU v6.1 submission with a 64-GPU v6.0 submission.¹
Highest reasoning throughput per GPU
On GPT-OSS-120B, a single NVIDIA GB300 NVL72 rack sustained 16,635 tokens per second per GPU offline and 16,118 in server mode. Both are the highest of any v6.1 Datacenter Closed submission, on any silicon










