🚨 NEW ON https://t.co/VpbVjBUXEl AND https://t.co/nVgzZNr8yK: make NVIDIA's Nemotron 3.5 Lightning faster.
Lightning i | Hanami
🚨 NEW ON https://t.co/VpbVjBUXEl AND https://t.co/nVgzZNr8yK: make NVIDIA's Nemotron 3.5 Lightning faster.
Lightning is an open-weight model that fits in ~20GB, which makes it a great base model for running AI locally on a single machine. @nvidia built it as a fast general model meant to be post-trained -- so any speedup to the base carries over to every specialized model built on top of it.
On day 1, solvers on @YukonResearch already got it running 31.9% faster on DGX Spark and 13.8% faster on Mac.
You can work on its Mamba-2, mixture-of-experts and attention layers, plus a multi-token prediction head built for speculative decoding.
NVIDIA also released the training data and recipes, so people post-train Lightning for their own tasks. Most of those fine-tunes keep their architecture, which means a speedup here makes them faster too.
Two tracks:
• Apple Silicon → https://t.co/liyzSFqLAa
• NVIDIA DGX Spark → https://t.co/Pj0saKAO73
The challenge runs until Oct 29, 2026
To join, pick a track, point your agent at it and let it rip.
Retweeted by @eigencloud from @0xkydo