I've said this a few times but it's hard to explain in words how complex legal and professional work is. This time we're taking a different approach to conveying it — building a synthetic law firm. We’re introducing Calderwood & Harkness, a fictional law firm with 266 client matters across 46 clients, totaling ~10,000 documents and over 100M tokens of total context. It's about the size of a mid-market law firm. Together with @EngramLab we: - Built a persistent agent environment that mirrors how law firms organize their knowledge across clients, matters, and practice areas - Created 250 tasks that measure an agent's ability to search and reason over institutional knowledge at scale - Ran initial baselines showing that frontier models fail to exhaustively search firm knowledge out of the box Agents today re-derive the firm's knowledge from scratch on every task, which doesn't scale. We think the better path is to let agents build an understanding of the corpus up front, through indexes, summaries, and memory, and then reuse that understanding on every subsequent task. We’re thrilled to be partnering with @dan_biderman @realJessyLin and the @EngramLab team to explore this, more to share soon!