Nikil Ravi(@nikilravi):Web search evals typically don't do a good job disentangling the model's capability from the capability of the search tool. The web search index keeps the model/harness fixed, and tests the search tool on realistic held out tasks. Excited to see this partnership with @ExaAILabs @KeenableAI @p0 @tavilyai materialize!

Nikil Ravi

@nikilravi

evals @valsai | prev @stanfordailab, @uofillinois

가입 September 2021

4.7K 팔로잉 중 917 팬

Nikil Ravi@nikilravi

2026.10.03 16:34

Web search evals typically don't do a good job disentangling the model's capability from the capability of the search tool. The web search index keeps the model/harness fixed, and tests the search tool on realistic held out tasks. Excited to see this partnership with @ExaAILabs @KeenableAI @p0 @tavilyai materialize!