for the last few years, ai progress mostly meant bigger models and better prompts. we’re interested in getting models to reliably know what only your business knows, at a cost that works at scale.
the labs team had a model quiz itself on what it didn't know yet. it learned long, dense documents with half the training the standard method needs, then kept getting better. fascinating work imho