Introducing Apache Spark® 4.3, now available in Databricks Runtime 19!
The release brings major new capabilities across real-time processing, history-preserving pipelines, small-data performance, Spark Connect, and SQL.
What’s new:
- Bring state to Real-Time Mode with streaming aggregation and transformWithState
- Preserve history with SCD Type 2 Auto CDC
- Iterate faster on small data with Project Feather
- Reach Spark from more applications with expanded Spark Connect capabilities
It also begins a new quarterly feature-release cadence, bringing completed improvements to users sooner.
Get started:
显示更多