Senior Databricks Data Engineer

Stack

Responsibilities

• ▹Design, develop, and implement complex, scalable Lakehouse solutions on the Databricks platform across Azure, AWS, or GCP
• ▹Design, build, and optimize modular data pipelines using Delta Lake
• ▹Implement data governance and secure data access using Databricks Unity Catalog
• ▹Write clean, efficient, maintainable SQL and Python code in Databricks Notebooks and IDEs
• ▹Develop automation scripts using the Databricks CLI and REST APIs
• ▹Establish and maintain CI/CD pipelines (e.g. GitHub Actions, GitLab CI/CD) using Declarative Automation Bundles
• ▹Automate data pipeline processes using Databricks Workflows or Spark Declarative Pipelines
• ▹Integrate with cloud-native storage and security services (AWS S3/IAM, Azure ADLS/Entra ID, Google Cloud Storage/IAM)
• ▹Design and implement data modeling and data warehousing solutions using Databricks SQL Warehouses
• ▹Own the technical delivery of projects, participate in planning, estimation, and testing
• ▹Create comprehensive technical documentation

Requirements

• ▹Strong proficiency in both SQL and Python

About the company

Hiflylabs is a Budapest-based company with 250+ employees delivering Business Intelligence and application development solutions to clients in finance, telecommunications, and energy.