Senior Cloud Data Engineer (Azure and Databricks)

Stack

Responsibilities

• ▹Take responsibility for the whole of the solutions built together with the team
• ▹Build or modify cloud data processing solutions
• ▹Create and modify documentation
• ▹Analyze and optimize solutions in running or planned systems
• ▹Analyze client requirements to deliver the optimal solution for the business need
• ▹Analyze potential risks and adapt solutions to business requirements

Requirements

• ▹At least 5 years of IT experience, including at least 3.5 years working with data in Azure (confirmed by commercial projects deployed to production)
• ▹Advanced SQL, used on Microsoft and other technology solutions
• ▹Commercial experience processing large data volumes with Databricks
• ▹Fluent knowledge and use of Git and CI/CD methodologies
• ▹Building and optimizing data processing solutions (ETL, ELT, etc.), preceded by a technical design and alternative solutions
• ▹Monitoring, diagnostics and troubleshooting in the cloud
• ▹Knowing how to plan infrastructure and calculate its cost
• ▹Familiarity with Delta Lake and Data Lakehouse concepts
• ▹Knowledge of SMP and MPP architectures and example solutions based on them
• ▹Knowledge of mechanisms for secure storage and processing of data in the cloud
• ▹Experience working directly with clients
• ▹Conscious use of Generative AI in software development and in architectural and technology decisions

Soft skills

What we offer

• ▹B2B contract: PLN 133–196 per hour net + VAT
• ▹Employment contract: PLN 16,100–23,700 gross per month