Introducing ask-web: Rox’s in-house web search agent.
ask-web sits on the cost-per-accuracy pareto frontier of the hyper-parameter grid when compared to frontier labs and commercial search agent providers.
The agent delivers 91.3% accuracy at 1.03 cents per query on real production prompts.
It has been running in production for more than 6 months with continuous evals.
Inference partners:
@togethercompute,
@baseten,
@modal
Commercial Search vendors benchmarked:
@perplexity_ai,
@ExaAILabs,
@p0.
Frontier Search vendors benchmarked:
@OpenAI,
@AnthropicAI
Exa, OpenAI and Anthropic excel on accuracy. Parallel and Perplexity are cost-efficient.
Here’s the breakdown: