Databricks
Explore recommended reads, summarized by AI
AI and Machine Learning
Applying generative AI, LLMs, and ML models within the platform.
AI's Impact on Data Engineering
Genie AI Features
ML and GenAI Applications
Data Architecture
Approaches to structuring data platforms, from medallion layers to lakehouse design patterns.
Lakehouse Architecture
Medallion Architecture
Open Lakehouse Formats
Delta Lake and ETL
Working with Delta Lake tables and building transformation pipelines.
Delta Lake Operations
Pipeline Projects
SQL Orchestration
Development and Code
Writing, testing, and deploying code for data engineering workflows.
CI/CD for Data Engineering
PySpark Techniques
Getting Started
Introductory guides and advice for new users evaluating or learning the platform.
Adoption and Scalability
Beginner Guides
Governance and Security
Tools and strategies for managing access, compliance, and data governance.
Unity Catalog Setup
Monitoring and Observability
Tracking job health, query performance, and system metrics.
Job Monitoring
SQL Warehouse Monitoring
Performance and Cost
Optimizing compute resources, query speed, and platform expenses.
Cost Reduction
Spark Optimization
Platform Comparisons
Evaluations of how Databricks compares to competing data platforms and integration options.