Docs · By technology
Get started
Concepts
Databricks compute: SQL warehouses, jobs, all-purpose
Three physically distinct compute offerings, one right default per workload class, and the decision framework for getting it right the first time.
Lakeflow: Connect, Declarative Pipelines, Jobs
Three products consolidated into one data-engineering plane. Knowing which piece does what prevents architectural flailing.
Unity Catalog: hierarchy, grants, and lineage
The object model that governs every table, view, volume, and function on a Causeway Databricks workspace. What lives where, who can touch what, and why lineage comes for free.
How-tos
Ship jobs with Databricks Asset Bundles
YAML in, deployed resources out. The only sanctioned way to ship anything to a Causeway Databricks workspace.
Lakebase: OLTP in the lakehouse
Managed Postgres inside Databricks. When to reach for it, the adoption ladder, and the Postgres fundamentals that managed does not absolve you from.
Build a Lakeflow Declarative Pipeline
A walkthrough of building an LDP (formerly Delta Live Tables) from source to silver, with expectations, CDC, and the modes that trip teams up.
Troubleshoot a failing Databricks cluster
Cluster will not start, cluster terminates unexpectedly, cluster runs but queries hang. The 5-minute triage and the next 20.
CLI reference
Standards
Databricks asset authoring standards
Causeway's rules for how a Databricks workload is structured, named, and deployed. Enforced at review time; exceptions require an RFD.
Databricks production readiness checklist
What a Causeway Databricks workload must satisfy before its first prod deploy, and what it must keep satisfying. Enforced at the promote-to-prod gate.
Reference
SQL warehouse reference
Exhaustive config options for Databricks SQL warehouses: sizing, scaling, auto-stop, Photon, type selection.
Common Databricks errors and resolutions
Symptom-first lookup for the errors you hit most on a Databricks workspace: cluster launches, UC permissions, Delta writes, init scripts, Lakeflow pipelines.