BREAKING NEWS🚨: NVIDIA has just achieved 423 tok/s/user 🚀 on the 2.8T Parameter Kimi K3 model via a new upstream vLLM | Hanami
BREAKING NEWS🚨: NVIDIA has just achieved 423 tok/s/user 🚀 on the 2.8T Parameter Kimi K3 model via a new upstream vLLM optimization. 1.68x Faster on the Same Hardware!
This was done by NVIDIA CentML's Benjamin, who wrote NVIDIA's new decode-specialized kernels in Cute DSL via aggressive Megakernel fusion. This is a 12,000 LoC Megakernel and is the future of advanced AI-assisted kernel generation. NVIDIA is already working on DeepSeekv4.1 and other models for vLLM too.
Someone should give this NVIDIA 10x engineer a raise for this great new major feature!(Historical earnings: For fiscal 2027 Q2 (period ended 2026-07-26), NVIDIA reported basic EPS of 4.87, diluted EPS of 4.85, net income of USD 118.010 billion, and revenue of USD 177.837 billion.
Consensus expectations: For fiscal 2027 Q3 (event 2026-11-17), consensus EPS is 2.48 with revenue estimate of USD 111.339 billion.)