Senior Databricks Engineer

Stack

Responsibilities

• ▹Design and build large-scale data platforms on Databricks (Delta Lake, Spark, Unity Catalog) in Azure
• ▹Develop and maintain batch and streaming data pipelines for high-volume, complex data sources
• ▹Implement medallion/lakehouse architectures from the ground up in greenfield environments
• ▹Build and optimize data models to support analytics, reporting and downstream applications
• ▹Integrate Databricks with enterprise systems (APIs, event streams, warehouses, ML workflows)
• ▹Tune Spark jobs and pipelines for performance, reliability and cost at scale
• ▹Support production deployments, including CI/CD pipelines, testing and release management
• ▹Partner directly with enterprise clients to translate requirements into working technical solutions
• ▹Collaborate with architects, engineers and data scientists across multiple workstreams
• ▹Contribute hands-on while guiding design and approach across the team
• ▹Mentor and guide data engineers and analysts

Requirements

• ▹Deep experience in Databricks and modern data platforms in large, complex enterprise environments
• ▹Experience building and delivering data solutions at scale, ideally in greenfield settings
• ▹Comfort working with Fortune 500 clients
• ▹Ability to make sound architectural decisions and lead technical direction
• ▹Knowledge of data pipeline reliability, monitoring and incident response in production
• ▹Modern engineering practices (version control, code reviews, automated testing)
• ▹Demonstrated ability to mentor and guide data engineers and analysts
• ▹Clear communication of tradeoffs to technical and non-technical stakeholders

Soft skills

About the company

HIKE2 is an advisory and innovation partner that helps organizations in complex, regulated industries (law firms, financial services, insurance, professional services, high-growth SaaS) embed data, automation and AI into how work gets done.