Jacqueline Cheong(@JacquelineSYC19):Aurora PostgreSQL can now query Apache Iceberg tables in S3 directly. You can join live Postgres rows with years of history in your lake in a single query, without a pipeline copying that data back into the database. It uses DuckDB embedded in Aurora, following AWS’s acquisition of DuckLabs (the team that maintains DuckDB). This solves the read side. But something still has to keep those Iceberg tables current, through schema changes, backfills, and high write volume. That’s what we do at @artie_labs – we stream changes from operational databases into Iceberg-backed tables in Amazon S3 Tables, so the history Aurora reads stays fresh.

2026.10.01 21:32

Aurora PostgreSQL can now query Apache Iceberg tables in S3 directly. You can join live Postgres rows with years of history in your lake in a single query, without a pipeline copying that data back into the database. It uses DuckDB embedded in Aurora, following AWS’s acquisition of DuckLabs (the team that maintains DuckDB). This solves the read side. But something still has to keep those Iceberg tables current, through schema changes, backfills, and high write volume. That’s what we do at @artie_labs – we stream changes from operational databases into Iceberg-backed tables in Amazon S3 Tables, so the history Aurora reads stays fresh.

显示更多