Register and share your invite link to earn from video plays and referrals.

Chad Wahlquist
@chadwahl
Forward Deployed Architect - @PalantirTech
Joined November 2008
823 Following    25.8K Followers
Apache Iceberg is now generally available in Palantir AIP. Sovereignty at all levels of the stack. Customers can now use an open, interoperable table format alongside the capabilities required to operate critical data: pipeline building, governance, security, lineage, and Ontology. The full open standard, not some Palantir variant of it...... THE FULL OPEN STANDARD. Managed Iceberg tables and Palantir’s Iceberg REST catalog are GA on standard Foundry enterprise environments. Tables can be stored in Palantir managed storage or a customer-provided bucket. This means one bucket (yours, ours or theirs), one iceberg file, Palantir and your other Iceberg enabled systems working on the same physical file. Zero Data Copy. Teams can build pipelines, perform row-level updates and changelog processing, create Ontology object types backed by Iceberg, analyze tables in with SQL, python or connect external tools directly to the catalog. Completely open. Adopting and supporting an open standard means more than consuming it. Our FDEs have also contributed back to the Iceberg standard to enable features we had built in Foundry but now is available as part of the standard for all, just a few examples: - Table encryption in iceberg-rust - Incremental append scans, schema evolution, and other Iceberg features in Polars - Incremental append scans and other contributions to PyIceberg More about some of the new value add: and
Show more