@BrooksWhaleX Unlocking more performance from existing cards stretches every GPU. Local still has limits the cluster doe | Hanami
@BrooksWhaleX Unlocking more performance from existing cards stretches every GPU. Local still has limits the cluster does not.
Reply to @BrooksWhaleX: 🚨 Everyone with an NVIDIA RTX card, you have to see this!!!
It's causing a real uproar overseas, but it hasn't spread much yet, so I'm sharing it!
→ A few days ago, NVIDIA's "AI compute limit" on RTX was unlocked by a newly released open source tool
→ It's called GPU-Unlock
→ No new graphics card, no overclocking. Just lifting the restriction
Gains so far:
→ RTX 3060: +78~99%
→ RTX 3070: +72~81%
→ RTX 3080: +68~73%
→ RTX 3090 Ti: BF16 +80%
→ RTX 4070 Ti: +83~84%
→ RTX 4090: specific Tensor nearly 2x
→ RTX 2080 Ti: +36~64%
→ It's not just the 3000 series. 20, 30 and 40 series, desktop and laptop, real world tests keep piling up right now
If you do AI image generation or run local LLMs, you'll feel it the most
Why it's blowing up:
→ There was locked away AI performance inside the RTX card sitting at home, and you could have been using it all along
The biggest suspicion right now:
→ NVIDIA intentionally nerfed FP16/BF16 to create tiers between GeForce and expensive professional GPUs
→ NVIDIA hasn't officially acknowledged it yet
Imagine learning your own card was throttled this hard.
100% open source.