With Apache Spark Declarative Pipelines, engineers describe what their pipeline should do using SQL or Python, and Apache Spark handles the execution.

Databricks debuted its Lakebase fully managed database and Agent Bricks agent development workspace at the Data + AI Summit.

Please Note: All times UK. Tables are subject to change. The BBC is not responsible for any changes that may be made. Copyright © 2025 BBC. The BBC is not ...