With Apache Spark Declarative Pipelines, engineers describe what their pipeline should do using SQL or Python, and Apache Spark handles the execution.

Databricks debuted its Lakebase fully managed database and Agent Bricks agent development workspace at the Data + AI Summit.