Hiflylabs, a Budapest-based company with 250+ employees, is looking for a Databricks Data Engineer. You will design, develop, and implement complex, scalable Lakehouse solutions on the Databricks platform across Azure, AWS, or GCP, build modular data pipelines with Delta Lake, and implement governance with Unity Catalog. The role also covers CI/CD automation with Declarative Automation Bundles (DABs), orchestration with Databricks Workflows, and ownership of technical delivery at least at component level.
Responsibilities
- ▹Design, develop, and implement complex, scalable Lakehouse solutions on the Databricks platform across major cloud environments (Azure, AWS, or GCP)
- ▹Design, build, and optimize modular data pipelines using Delta Lake for data efficiency, reliability, and quality
- ▹Implement data governance and secure data access layers utilizing Databricks Unity Catalog
- ▹Write clean, efficient, and maintainable SQL and Python code within Databricks Notebooks and IDEs
- ▹Develop automation scripts leveraging the Databricks CLI and REST APIs to manage workspace assets and configurations
- ▹Establish, maintain, and optimize CI/CD pipelines (e.g., GitHub Actions, GitLab CI/CD) leveraging Declarative Automation Bundles (DABs)
- ▹Automate and orchestrate data pipeline processes using Databricks Workflows or Spark Declarative Pipelines (formerly DLT)
- ▹Integrate with cloud-native storage and security services (AWS S3/IAM, Azure ADLS/Entra ID, or Google Cloud Storage/IAM)
- ▹Design and implement modern data modeling and data warehousing solutions using Databricks SQL Warehouses
- ▹Own and manage the technical aspects of deliveries (at least at component level)
- ▹Participate in project planning, task estimation, testing, and liaising with business stakeholders
- ▹Create comprehensive technical documentation
Requirements
- ▹Proficiency in both SQL and Python, with clean, efficient, maintainable code optimized for cloud data platforms
- ▹Hands-on experience with AI coding tools and agents (e.g., Databricks Assistant in Chat/Agent mode, GitHub Copilot, Cursor, or Claude Code)
- ▹Experience with API integration and scripting for platform automation
- ▹Hands-on experience using Declarative Automation Bundles (DABs) to manage, bundle, and deploy Databricks resources as code
- ▹Solid understanding of standard CI/CD tools (e.g., GitHub Actions, GitLab CI/CD) and version control (Git/Databricks Repos)
- ▹3-5 years of hands-on data engineering experience with a strong focus on Databricks Lakehouse architecture
- ▹Proven track record of delivering at least one complex, scalable data solution using core Databricks features (Unity Catalog, Delta Lake, Databricks SQL)
- ▹Strong experience operating Databricks within at least one major cloud environment (AWS, Azure, or GCP)
- ▹Native Hungarian and excellent written and verbal communication skills in English
Nice to have
- ▹Experience working with dbt (specifically dbt-databricks)
- ▹Knowledge of Databricks AI/ML and GenAI capabilities (e.g., Mosaic AI, Databricks Assistant/Genie, MLflow, Feature Store, or Model Serving)
- ▹Apache Spark knowledge
Soft skills
What we offer
- ▹Diverse projects with something new in each assignment, technically or on the business side
- ▹Empowerment and trust-based culture
- ▹Flexible ways of working, with an office and community space on Bartók Béla Road
- ▹Healthy work/life balance, no pointless meetings or unnecessary administration
- ▹Mentoring from your first day, throughout your career path
- ▹Learning and development opportunities
- ▹Supportive corporate culture built on camaraderie, mutual support, and respect
About the company
Hiflylabs is a Budapest-based company with 250+ employees. Its team has 10+ years of experience in Business Intelligence projects, both Hungarian and international, across industries such as finance, telecommunications, and energy, delivering Data Warehouses, BI, Data Analytics, and application development, and encouraging innovative initiatives as independent startups.