Databricks(@databricks):Introducing Apache Spark® 4.3, now available in Databricks Runtime 19! The release brings major new capabilities across real-time processing, history-preserving pipelines, small-data performance, Spark Connect, and SQL. What’s new: - Bring state to Real-Time Mode with streaming aggregation and transformWithState - Preserve history with SCD Type 2 Auto CDC - Iterate faster on small data with Project Feather - Reach Spark from more applications with expanded Spark Connect capabilities It also begins a new quarterly feature-release cadence, bringing completed improvements to users sooner. Get started:

2026.11.05 16:00

Introducing Apache Spark® 4.3, now available in Databricks Runtime 19! The release brings major new capabilities across real-time processing, history-preserving pipelines, small-data performance, Spark Connect, and SQL. What’s new: - Bring state to Real-Time Mode with streaming aggregation and transformWithState - Preserve history with SCD Type 2 Auto CDC - Iterate faster on small data with Project Feather - Reach Spark from more applications with expanded Spark Connect capabilities It also begins a new quarterly feature-release cadence, bringing completed improvements to users sooner. Get started: