Databricks - Unified Analytics
Databricks combines data warehousing with data lakes.
The "Lakehouse" architecture:
- Data Lake flexibility (any file format)
- Data Warehouse performance (fast SQL)
- Best of both worlds
Key features:
- Delta Lake - reliable data lake storage
- Unity Catalog - governance & security
- SQL Warehouses - run SQL queries
- Notebooks - interactive development
Databricks SQL is ANSI-standard plus:
- Delta table features
- ML functions
- Streaming support
Used at: Shell, Walgreens, Comcast, and many Fortune 500s.
Your SQL skills work perfectly in Databricks!
Check your understanding
What is a 'Lakehouse' in Databricks?