Ali Ghodsi(@alighodsi):This is true. It wasn't actually possible before 2010 because datacenter networks would bottleneck. We used to design coupled storage/compute where you brought compute close to "big data". But research on "full bisection bandwidth" networks made it possible to essentially just talk from any machine to the storage system at full speed. The disaggregation started then! Databricks and Snowflake started soon after many others followed. Now "Put it on the object store" is the way to go.

2026.08.21 02:09

This is true. It wasn't actually possible before 2010 because datacenter networks would bottleneck. We used to design coupled storage/compute where you brought compute close to "big data". But research on "full bisection bandwidth" networks made it possible to essentially just talk from any machine to the storage system at full speed. The disaggregation started then! Databricks and Snowflake started soon after many others followed. Now "Put it on the object store" is the way to go.

Nikita | Scaling Postgres@nikitabase

2026.08.19 00:57

"Put it on the object store" remains undefeated. - OLAP: Lakehouse - OLTP: Lakebase - Kafka: Warpstream - Vector Search: Turbopuffer - Git: Cursor Origin

338

轉發到社區

熱門用戶