41.8 GB/sec. 133.5 million rows/sec. One native Snowflake table.
Our synthetic Snowpipe Streaming benchmark in AWS us-west-2 sustained 41.8 GB/sec of uncompressed throughput with Elastic Channels. Throughput grew linearly as we scaled from 15 to 455 Kubernetes workers.
The setup combined Elastic Channels, 1-vCPU worker pods and Rust-based encoding to reduce client-side overhead.
Building telemetry or log pipelines? See the benchmark method, latency measurements and how to start with one worker:
顯示更多