Every company shipping AI agents asks one question: how can I stop my agent from going rogue?
To answer it, HaloGuard | Hanami
Every company shipping AI agents asks one question: how can I stop my agent from going rogue?
To answer it, HaloGuard Output Guard now sets a new state of the art (SOTA):
83.63 average F1, ahead of the previous best at 82.5. All measured on public benchmarks.
And we did it with a 0.8B model, a quarter of the size of the previous best. Small enough to run efficiently. Cheap enough to make checking every response practical.
This was the focus of Phase 3 on Trishool:
• 7,500+ jailbreaks submitted
• 125+ unique miners
• 15 weeks of challenges
It comes at the right time. We’re taking our product to enterprises now, and this makes our security stack stronger.
We’ll share the models on Hugging Face, the arXiv paper and a full explainer soon. There’s much more to come, and we’re looking forward to an exciting week ahead.
SOTA AI security, on Bittensor. Ψ
Retweeted by @opentensor from @trishoolai