Accelerating Data and AI with Azure Databricks

Description

Get the most out of your investments with Azure Databricks. Learn how the deep integration in the Azure ecosystem accelerates workloads, optimizes performance, and maximizes value. See how the Databricks Data Intelligence Platform on Azure streamlines analytics and AI.

Key Takeaways

My Notes

Action Items

Slides

Accelerating
Data and AI with
Azure Databricks
Robert Saxby
Director, Product Management
Databricks
Surya Sai Turaga
Field Engineering Leader
Databricks
“Azure Databricks will continue to be the best Databricks
of all clouds!”
Satya Nadella 2023
“You can build these stateful multi-agent automations on
top of Databricks”
Satya Nadella, BUILD 2025
“I think of Azure Databricks, as any other Azure service.
What you have done with SAP is a game changer!”
Satya Nadella 2025
“We’re taking it further with Azure
Databricks, connecting your data in Genie
Spaces or AI Functions to Foundry”
Satya Nadella, BUILD 2025
Unifying Data & AI
The Databricks Data Intelligence Platform is an
integral first-party part of the Microsoft ecosystem
Copilot Studio
Event Hubs
Microsoft Foundry
Azure Data Lake Storage
Azure
Databricks
Power Platform
Data Factory
Power BI
Azure OpenAI
Excel
Dataverse
Microsoft 365
Microsoft Teams
Power Platform
Github
VSCode
embedded into the tools of every user
every AI model
Microsoft AI
Microsoft Fabric
Custom Apps
Power BI
AI/BI
Secure data and AI apps
Data Factory
data
Lakeflow
Ingest, ETL, streaming
zero
copy
And more…
Agentic business intelligence
DBSQL
Lakebase
Data warehousing
Serverless Postgres
Agent 365
agents
Microsoft Foundry
Agent Bricks
Agentic AI & Machine Learning
CoPilot Studio
OneLake
Postgres
Entra ID
Azure Virtual Machines
|
Azure Data Lake Storage
|
Azure Networking
Azure Databricks is the best data + AI
platform on Azure
Governance
Integrations
Data Warehouse
AI Development
Agent Bricks
Production AI agents
AI/BI
Agentic business intelligence
Lakehouse
Lakebase
Serverless Postgres
Open Formats
Lakeflow
Ingest, ETL, streaming
Unity Catalog
Unified Governance
TCO (DW & Spark)
And more…
Secure data and AI apps
Genie
AI with Enterprise Context
Data warehousing
Custom Apps
Postgres
Adopted by thousands of global enterprises
Agent Bricks
Production AI agents
AI/BI
Agentic business intelligence
Lakehouse
Lakebase
Serverless Postgres
Lakeflow
Ingest, ETL, streaming
Unity Catalog
Unified Governance
Open Formats
And more…
Secure data and AI apps
Genie
AI with Enterprise Context
Data warehousing
Custom Apps
Postgres
Agent Bricks
Production AI agents
AI/BI
Agentic business intelligence
Lakehouse
Lakebase
Serverless Postgres
Lakeflow
Ingest, ETL, streaming
Unity Catalog
Unified Governance
Open Formats
And more…
Secure data and AI apps
Genie
AI with Enterprise Context
Data warehousing
Custom Apps
Postgres
Genie brings new AI capabilities to all roles
Genie
Business Users
Analysts
Technical Users
Genie
Genie Code
Data Engineers
Genie
AI with Enterprise Context
Lakehouse
Data warehousing
Lakebase
Serverless Postgres
Lakeflow
Ingest, ETL, streaming
Unity Catalog
Unified Governance
Open Formats
Data Scientists
Postgres
Genie is AI that knows your business
Genie
Business Users
Analysts
Technical Users
Genie
Genie Code
Data Engineers
Genie
AI with Enterprise Context
Lakehouse
Data warehousing
Lakebase
Serverless Postgres
Lakeflow
Ingest, ETL, streaming
Unity Catalog
Unified Governance
Open Formats
Data Scientists
Postgres
Genie is AI that knows your business
Genie Code
Business Users
Analysts
Technical Users
Genie
Genie Code
Data Engineers
Genie
AI with Enterprise Context
Lakehouse
Data warehousing
Lakebase
Serverless Postgres
Lakeflow
Ingest, ETL, streaming
Unity Catalog
Unified Governance
Open Formats
Data Scientists
Postgres
Agent Bricks
Production AI agents
AI/BI
Agentic business intelligence
Lakehouse
Lakebase
Serverless Postgres
Lakeflow
Ingest, ETL, streaming
Unity Catalog
Unified Governance
Open Formats
And more…
Secure data and AI apps
Genie
AI with Enterprise Context
Data warehousing
Custom Apps
Postgres
Agent Bricks
Production AI agents
AI/BI
Agentic business intelligence
Custom Apps
Secure data and AI apps
And more…
Agent Platform
Contextual
Reasoning Agents
Developer Platform
AI Governance
Knowledge Assistant
Agent Orchestration
Agent Skill/MCP Registry
Supervisor Agent
Runtime
AI Gateway
Documents Agent
Memory
Agent Observability
AI Functions
Model
Capacity
Managed OAuth Apps
Productionizing agents is really hard
How do I manage agent quality?
What latest AI technique should I use?
How do I balance cost vs. quality?
Begin from a factory of agent types
Multi-agent Supervisor
Knowledge
Assistant
Turn your docs into an
expert AI chatbot
Forecasting
Predict future trends based on
historical data patterns
Text-to-SQL
Convert natural language
into SQL queries
Data Science
Sentiment
Analysis
Explore data, train and evaluate
models, and summarize results
Identity the tone of customer
feedback and track trends
Fraud Detection
Entity Resolution
Surface anomalies in
transactions and behavior
Identify and merge records
that refer to the same entity
Document
Processing
Extract, classify, and structure
information from text files
Then describe the high-level problem…
Build an agentic system that answers questions about the automotives we offer
Create LLM
judges
Auto-optimize
the system
Agent Learning
Present cost vs.
quality options
Agent Bricks significantly
outperformed our original
open-source implementation
in both LLM-as-judge
and human evaluation
accuracy metrics.
Joel Wasson
Manager Enterprise Data & Analytics
100%
75.9%
80%
Quality (Average QA Benchmark)
Higher quality
knowledge
assistants
60%
77.4%
80.7%
50.8%
40.8%
40%
20%
0%
Cloud 1
Agents
Cloud 2
Agents
Agent
Bricks
Agent Bricks with
Continual Learning
Agent Bricks
Production AI agents
AI/BI
Agentic business intelligence
Lakehouse
Lakebase
Serverless Postgres
Lakeflow
Ingest, ETL, streaming
Unity Catalog
Unified Governance
Open Formats
And more…
Secure data and AI apps
Genie
AI with Enterprise Context
Data warehousing
Custom Apps
Postgres
Agent Bricks
Production AI agents
Built-in Genie
Agentic dashboard
authoring
Free
AI/BI
Agentic business intelligence
Custom Apps
Secure data and AI apps
And more…
Massive user growth in AI/BI
+500%
in the past year
Analyze and visualize your data
Get useful dashboards with AI-powered understanding
Scale BI to everyone
with no additional cost
Blazing fast results
Secure by design with
Unity Catalog
But, you can’t anticipate every question
What is revenue breakdown by
order priority?
How much inventory do we
hold by location?
What are our most
profitable products?
How often are
deliveries delayed?
Where are our supply chain
bottlenecks?
What is our current
inventory level?
What is the cost of shipping
delays?
How does order priority
change over time?
How are transportation
costs trending?
Which suppliers have
quality issues?
Are we meeting
sustainability goals?
Are suppliers meeting
contractual obligations?
Which suppliers have the longest
lead times?
Which products are experiencing
stockouts?
What is our warehouse
utilization rate?
What are our most popular
shipping methods?
Where do we have
excess inventory?
How accurate are our
demand forecasts?
What is our average order
fulfillment time?
How are transportation
costs trending?
What are our most valuable
customer segments?
What is our return
rate by product?
Genie lets you go beyond your dashboards
Talk to your data to explore any question
Query your enterprise
data with open Q&A
Maintain context between
sessions to follow-up
on research
Get insights in natural
language, data tables,
and visualizations
Agent Bricks
Production AI agents
AI/BI
Agentic business intelligence
Lakehouse
Lakebase
Serverless Postgres
Lakeflow
Ingest, ETL, streaming
Unity Catalog
Unified Governance
Open Formats
And more…
Secure data and AI apps
Genie
AI with Enterprise Context
Data warehousing
Custom Apps
Postgres
Agent Bricks
Production AI agents
Bring your apps to
your data
Make agentic apps
easy to productionize
AI/BI
Agentic business intelligence
Custom Apps
Secure data and AI apps
And more…
Democratizing agents
happens through applications
Agentic apps are hard to productionize
Security and governance aren’t negotiable

Integrate auth/SSO

Deploy a database
to manage app state

Define governance and access
controls around data

Integrate with observability tools

Manage app
infrastructure/containers

Configure audit/access logs

Integrate into a VPC

Upgrade packages/containers
Databricks Apps
Bring your apps to your data
Powered by unified
infrastructure
Secure
and governed
Open
ecosystem
Built on everything
in Databricks
Managed containers and
infrastructure
All popular
Python frameworks
One-click integration
with Lakebase
Resource-level governance
through Unity Catalog
Support for Javascript
with Node.js/React
Out-of-the-box
auth and access logs
20+ pre-installed
open source packages
Agent Bricks
Production AI agents
AI/BI
Agentic business intelligence
Lakehouse
Lakebase
Serverless Postgres
Lakeflow
Ingest, ETL, streaming
Unity Catalog
Unified Governance
Open Formats
And more…
Secure data and AI apps
Genie
AI with Enterprise Context
Data warehousing
Custom Apps
Postgres
Databases were built for a different era
Massive
lock-in
Very
expensive
Built for
on-prem
Lakebase
Transactional Database Engine
Data stored in a low-cost lake
Lakebase
Transactional processing for the agentic era
Built on
open source
Separate compute
and storage
Designed for AI
Postgres foundation
Very low latency
Launches in less than 1 second
Support for community
extensions
Very high QPS
Pay only for what you use
Production SLAs
Git-like branching
What do you do with a Lakebase?
Build your app on
Lakebase today
Serve data from
the lakehouse
Analyze transactional
data in the lakehouse
Application
Lakebase
Lakehouse
Lakebase
Lakehouse
Lakebase
Order processing
Personalized recommendations
Order history (analytics)
Interactive workflow sign-off
Customer segmentation
Chatbot history (training data)
State for an agent
Feature store
Announcements
Azure
Databricks
Lakebase
Serverless Postgres
for operational +
analytical workloads
on the lakehouse.
GA
Placeholder product screenshot/GIF
Demo!
WORLD’S LARGEST DATA,
ANALYTICS AND AI
CONFERENCE
IN-PERSON
JUNE 15–18
SAN FRANCISCO
The premier event for the global data, analytics
and AI community returns to San Francisco
June 15-18, 2026. Four days packed with
keynotes by industry leaders and visionaries,
technical sessions, hands-on training and
networking opportunities.
25K+
ATTENDEES
ON SITE
800+
BREAKOUT
SESSIONS
REGISTER NOW
200+
SPONSORS
Virtual Event // June 16 - 17 // Free live stream of keynotes + select sessions // Register Now