How Databricks Autoscaling Actually Decides to Add Nodes

The one signal it watches, and why a maxed cluster lies

Most engineers turn autoscaling on and treat it like a thermostat. Set a min and a max, walk away, trust the cluster to “figure it out.”

Then the bill comes in higher than the fixed-size cluster it replaced, and nobody on the team can explain why.

Autoscaling isn’t a thermostat. It’s a control loop watching one specific signal, making one specific decisio…