Delta League is an open competition to make AI models better by editing their weights directly.
Submissions are scored | Hanami
Delta League is an open competition to make AI models better by editing their weights directly.
Submissions are scored on a hidden test set, and every verified version is open for anyone to build on.
Powered by @near_ai. https://x.com/ilblackdragon/status/2118142451223511389
Quoted @ilblackdragon: Releasing Delta League: edit LLM weights for benchmarking and glory! Join at deltaleague(.)ai
Earlier this week, the idea of editing weights directly with an LLM got a lot of attention —
but it was shunted by limitations in the demonstrated approach.
Delta League is an open competition for everyone to submit deltas to model weights and get them scored on a hidden test set. Auto-research and hillclimb to make smaller models more performant.
The broader vision for Delta League is creating a platform for open AI research. Beyond just editing weights, this approach offers verifiable evaluation and an open collaborative space for everyone to continue improving Pareto of open source models.
In the coming days, we will extend this platform to support editing model architectures beyond just weights and custom evaluation sets to understand how models perform in specific domains and for businesses.