Senior Data Engineer (Microsoft Fabric and Azure Data Platform)

Stack

Responsibilities

• ▹Design, develop and maintain scalable data pipelines using Microsoft Fabric, Azure Databricks and Azure Synapse
• ▹Develop ETL/ELT solutions using PySpark and SQL
• ▹Build and optimize data integration solutions using Azure Data Factory and Microsoft Fabric
• ▹Design scalable lakehouse and data warehouse solutions
• ▹Optimize data performance, reliability and quality across cloud platforms
• ▹Collaborate with data scientists, analysts and software engineers to deliver business solutions
• ▹Implement data governance, security and best practices
• ▹Participate in code reviews and contribute to engineering standards
• ▹Troubleshoot production issues and continuously improve platform performance

Requirements

• ▹Strong commercial experience as a Data Engineer (5+ years)
• ▹Strong experience with PySpark
• ▹Advanced SQL skills
• ▹Experience with Microsoft Fabric, Azure Databricks and/or Azure Synapse Analytics
• ▹Experience building data pipelines using Azure Data Factory (ADF), Synapse Pipelines or Microsoft Fabric Data Factory
• ▹Experience working with cloud-based data platforms
• ▹Excellent problem-solving and communication skills

Nice to have

• ▹Power BI
• ▹Graph database experience
• ▹Node.js REST API development
• ▹LLM / Generative AI experience
• ▹Data Science experience
• ▹Microsoft certifications (DP-600 Fabric Analytics Engineer, DP-700 Fabric Data Engineer) advantageous but not essential

About the company

Ascent has recently been acquired by Acuity Analytics, a business with a strong global reputation delivering deep insights and domain-led digital transformation to high-growth and heavily regulated organisations.