Nikil Ravi(@nikilravi):Web search evals typically don't do a good job disentangling the model's capability from the capability of the search tool. The web search index keeps the model/harness fixed, and tests the search tool on realistic held out tasks. Excited to see this partnership with @ExaAILabs @KeenableAI @p0 @tavilyai materialize!

Nikil Ravi

@nikilravi

evals @valsai | prev @stanfordailab, @uofillinois

Joined September 2021

4.7K Following 917 Followers

Nikil Ravi@nikilravi

2026.10.03 16:34

Web search evals typically don't do a good job disentangling the model's capability from the capability of the search tool. The web search index keeps the model/harness fixed, and tests the search tool on realistic held out tasks. Excited to see this partnership with @ExaAILabs @KeenableAI @p0 @tavilyai materialize!