Another big breakthrough after Jev!
Jev answers a fixed question over a fixed input, so a live chat requires re-reading the full transcript on every update.
Devs just built Sage2, which pairs an extraction model and a decision model on the same live stream.
Usually, in a live conversation, the details and the decisions keep changing.
New details show up gradually, and several questions stay open the whole time.
- The extraction stage turns each new message into structured fields in 150 ms, each tied to the exact source span it came from. Those fields then become decision options.
- The decision model scores them as text streams in, and returns typed answers with probabilities, so the full loop from raw text to action runs in about 200 ms.
This gives a fully reactive automation over a live chat, with no re-reading of the transcript.
Sage2 is built by
@levantolabs, the team that shipped the first decision model, before Jev.
The video below depicts the model live in action on a broadband support chat, and I worked with the team to put this together.
More details below.