Nikil Ravi(@nikilravi):Web search evals typically don't do a good job disentangling the model's capability from the capability of the search tool. The web search index keeps the model/harness fixed, and tests the search tool on realistic held out tasks. Excited to see this partnership with @ExaAILabs @KeenableAI @p0 @tavilyai materialize!

Nikil Ravi

@nikilravi

evals @valsai | prev @stanfordailab, @uofillinois

参加 September 2021

4.7K フォロー中 917 ファン

Nikil Ravi@nikilravi

2026.10.03 16:34

Web search evals typically don't do a good job disentangling the model's capability from the capability of the search tool. The web search index keeps the model/harness fixed, and tests the search tool on realistic held out tasks. Excited to see this partnership with @ExaAILabs @KeenableAI @p0 @tavilyai materialize!