Register and share your invite link to earn from video plays and referrals.

Will Bryk
@WilliamBryk
188 Following    21.8K Followers
Exa is now one of the largest indexes in the world. We serve 80B pages, track 1.4T urls, and are on track to be Google-scale in early 2027. It's difficult to know the size of indexes, but we estimate Google to be ~1T, Bing to be ~500B, and Yandex ~200B. Brave mentioned in April that they're at 40B. Most of the web is trash that can hurt AI outputs, so you actually have to crawl way more than you serve and train models to filter out the trash. In terms of peak QPS, we estimate Bing at roughly 30k/s and Google at ~500k/s. In our case, because agent traffic often requires large fan-out (deep searches can use dozens of sub-searches) and can be spiky (like when AI labs RL with us), we're already starting to provision for Bing-scale traffic. Within 2 years, agents will search at many millions per second. They'll also want comprehensiveness over all data, far bigger than any index today. So the retrieval infra required will be larger than Google-scale in both dimensions.
Show more
0
112
2.5K
146
Forward to community