Gabe Pereyra(@gabepereyra):We're open sourcing 10 diligence RL environments to expand @harvey's legal agent bench: - The largest one is 80M tokens - Human review of a dataroom costs ~$300K-$1M lawyer time - Each one has 100-1000 unit tests for automated evaluation This dataset will allow us to train diligence agents that can take an entire dataroom, client communication and deal context and product a diligence memo. Current frontier agents struggle due to dataroom size and domain knowledge around diligence but we are seeing improvements with post training. Awesome write up by @ItsJulioPereyra

2026.07.17 16:03

We're open sourcing 10 diligence RL environments to expand @harvey's legal agent bench: - The largest one is 80M tokens - Human review of a dataroom costs ~$300K-$1M lawyer time - Each one has 100-1000 unit tests for automated evaluation This dataset will allow us to train diligence agents that can take an entire dataroom, client communication and deal context and product a diligence memo. Current frontier agents struggle due to dataroom size and domain knowledge around diligence but we are seeing improvements with post training. Awesome write up by @ItsJulioPereyra