One answer to what's driving GPU rental prices:
Token demand on OpenRouter is up ~27x since last November, from ~6T/wee | Hanami
One answer to what's driving GPU rental prices:
Token demand on OpenRouter is up ~27x since last November, from ~6T/week to ~165T/week
Open-weight models now handle ~72% of those tokens, up from ~28% last November
Charts of the Week: https://t.co/BKHzpgt05x
Quoted @a16z: Zooming out, GPUs are still renting ahead of a standard 6-year depreciation schedule
Rental price vs. schedule:
- H200: +143%
- B200: +111%
- RTX PRO 6000: +73%
- H100: +54%
- A100: +9%
Most of the gap opened up after April, when token demand took off
Charts of the Week: https://t.co/KJWFSaIGCd