DuckLake: The Lakehouse That's Just SQL & Parquet
[Talk Python to Me, Ep. 562]
How many files does your query read before it reads any data? On some data lakes, you go through JSON and metadata files first, just to learn which Parquet files matter.
#
DuckLake# asks one SQL question instead. The metadata lives in a real database. The data stays in plain Parquet. That's the entire format.
With Quack as the catalog, DuckLake handles 200 transactions a second under heavy contention. No other open table format comes close.
In this episode of
@TalkPython, host
@mkennedy talks with
@holanda_pe, lead developer for DuckLake at DuckLabs, and Guillermo Sanchez Dionis, who works on both DuckLake and the new Quack protocol – together they discuss all the details of DuckLake, Quack, and more.
Watch the episode here or listen wherever you get your podcasts: