So we have language models and decision models. Don't forget search-models exist too.
One way to make your Local AI agent faster might be simple, just read less of the web.
Artificial Analysis tested Exa's new search setup with Dynamic Highlights.
But instead of huge chunking of webpages into the LLM, Exa decides how much useful text to take from each page across one shared context budget.
The results
đ tokens/task â 299K â 157K
đ searches/task â 9.4 â 7.6
đ° cost/task â $0.083 â $0.066
And quality went UP.
Artificial Analysis Search Index
đĨ Exa Auto + Dynamic Highlights â 80
đĨ Perplexity Search Medium â 80
On DeepSearchQA
Exa â 85.6 F1
Perplexity â 80.8
When a local agent searches the web, every unnecessary token it gets back still has to go through your local model.
So maybe we should also optimize what the model has to read â smaller
đ¯ Exa itself is a hosted search API, not a local/open-weight search engine.
Link in ALT