Senior Data Engineer (Databricks)

Stack

Responsibilities

• ▹Design and implement scalable data pipelines using Apache Spark (PySpark) on Databricks
• ▹Migrate legacy data warehouses to the Lakehouse architecture using Delta Lake
• ▹Analyze and optimize complex Spark jobs for performance and cost (partitioning, z-ordering, Photon engine)
• ▹Enforce code quality through code reviews and CI/CD (Databricks Asset Bundles), ensure security via Unity Catalog
• ▹Share knowledge internally and act as a strategic technical advisor for clients

Requirements

• ▹5-7+ years in Data Engineering or distributed systems, including at least 3 years hands-on with the Databricks ecosystem (Delta Lake internals)
• ▹Advanced proficiency in Python and SQL, with production experience in Azure (ADLS Gen2, ADF) or AWS (S3, Glue)
• ▹Expertise implementing Unity Catalog and familiarity with dbt or Delta Live Tables (DLT)
• ▹Experience or interest in Databricks Apps and features like Photon and Liquid Clustering
• ▹Strong understanding of data modeling, metadata management and data quality frameworks
• ▹Fluent English (C1+) for direct client collaboration

Nice to have

• ▹Databricks Certifications (e.g. Data Engineer Professional)

Soft skills

What we offer

• ▹Cooperation via Employment Contract (UoP) or B2B in Poland; B2B only in Romania/Greece
• ▹100% remote work from Poland, Romania or Greece
• ▹Apple MacBook Air M4 15 inch provided
• ▹Referral bonus for bringing in top-tier engineers
• ▹Coverage for Databricks technical certifications
• ▹Support in reaching the highest tiers of Databricks expertise

About the company

Entrada AI is a specialized consulting partner and strategic portfolio company of Databricks Ventures, named Genie Partner of the Year (2026), with over 150 Databricks projects delivered for Fortune 500 clients.