The Databricks Data Engineer

The Databricks Data Engineer

Everyone thinks being a Databricks Data Engineer is “sexy”.

Let me break the myth...

Jakub Lasak's avatar
Jakub Lasak
Nov 07, 2025
∙ Paid

What people think I do:
- Build massive AI pipelines that predict the future.
- Architect self-healing data lakes with a few clicks.
- Wrangle petabytes of data with a single line of PySpark.

What I actually do:
- Wait 20 minutes for a cluster to start, just to run a 2-minute job.
- Debug a mysterious Spark error that disappears when I rerun the job.
- Explain…

User's avatar

Continue reading this post for free, courtesy of Jakub Lasak.

Or purchase a paid subscription.
© 2026 Jakub Lasak Consulting · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture