Martin Casado on why the labs missed Jev: they're building beings that speak, and software needed a model that chooses." | Hanami
Martin Casado on why the labs missed Jev: they're building beings that speak, and software needed a model that chooses.
"LLMs were text in, text out. They generate text, and they came from chat... We've spent the last few years trying to take this thing that spits out text and cram it into a traditional program... It's just been super janky."
"Jev basically said, 'Generating text as output is very expensive, but it's also more complicated than you need... If you give us a set of options, we'll choose the best option. We can do that incredibly fast, incredibly cheaply, but also with much more accuracy because we can train just for this.'"
"This has probably been the fastest adoption of an AI model since ChatGPT. It's been remarkable because we were all primed for this."
"[The labs] are trying to create beings, and beings speak. If you're trying to create God, God speaks in natural languages. This is really about something that's for traditional software."