New on the TRM Tech Blog, Staff Software Engineer Andrew Fisher writes about migrating 500 billion rows of blockchain data and why time partitioning failed. With extreme address-level skew, queries were scanning ~25,000 Iceberg files per lookup. But bucket partitioning by address brought that down to ~300, landing P95 under 2.5s.
Read his post here 👉