turbopuffer(@turbopuffer):tpuf quantizes vectors to improve perf (RaBitQ) the algo randomly rotates vectors, and we were using matmul at O(d²) space & time, brutal at high dims. 10k = 400MB in RAM! we rebuilt the rotation using FWHT at O(d) space & O(d log d) time. ~no recall loss, 10k = only 5kB in RAM

turbopuffer

@turbopuffer

{vector, full-text} search engine built on object storage. fast, cheap, 1T scale. powers Anthropic, Cursor, Notion, and more

Joined October 2023

5 Following 14.5K Followers

turbopuffer@turbopuffer

2026.06.01 15:45

tpuf quantizes vectors to improve perf (RaBitQ) the algo randomly rotates vectors, and we were using matmul at O(d²) space & time, brutal at high dims. 10k = 400MB in RAM! we rebuilt the rotation using FWHT at O(d) space & O(d log d) time. ~no recall loss, 10k = only 5kB in RAM