turbopuffer(@turbopuffer):tpuf BM25 index tracks matching doc IDs per term: [1, 8, 32, ... 1048576] instead of IDs (big), we store the deltas (small): [1, 7, 24, ... 16] we prefix sum the deltas at query time to rebuild IDs applying @lemire's SIMD speedup gave us up to 13% faster text search on ARM

turbopuffer

@turbopuffer

{vector, full-text} search engine built on object storage. fast, cheap, trillion scale. powers Anthropic, Harvey, Notion, Cognition, and more

가입 October 2023

6 팔로잉 중 17.8K 팬

turbopuffer@turbopuffer

2026.07.24 15:16

tpuf BM25 index tracks matching doc IDs per term: [1, 8, 32, ... 1048576] instead of IDs (big), we store the deltas (small): [1, 7, 24, ... 16] we prefix sum the deltas at query time to rebuild IDs applying @lemire's SIMD speedup gave us up to 13% faster text search on ARM