Principal Engineer - Data Platform (Identity Solutions)

Stack

Responsibilities

• ▹Assess data processing pipelines against cost, efficiency and reliability targets
• ▹Prototype solutions to validate feasibility and measure results against clear KPIs
• ▹Work with engineers, product managers and business stakeholders to build the case for change
• ▹Provide hands-on technical leadership, setting the standard for engineering quality through your own work
• ▹Develop and mentor lead and senior engineers
• ▹Identify gaps in development practices with a methodical, evidence-based approach
• ▹Maintain a clear view of how the platform fits into the broader Mastercard technology ecosystem, anticipating partner team needs and identifying opportunities to consolidate on shared platforms

Requirements

• ▹A track record of delivering complex systems through personal depth and attention to detail, with the ability to design an architecture, write and review code, and hold high standards for quality at every level of the stack
• ▹Deep experience designing and operating large-scale data processing pipelines, with the ability to reason about tradeoffs in pipeline architecture, cost, performance and reliability
• ▹Experience with distributed systems, cloud infrastructure (AWS), security and reliability engineering
• ▹Extensive hands-on experience with Spark and Databricks
• ▹Proficiency in Scala or Java
• ▹Able to assess technical proposals with data: prototyping to validate feasibility and defining measurable success criteria
• ▹Familiarity with machine learning workflows, including feature engineering, model training and the data infrastructure requirements that support them
• ▹Abide by Mastercard's security policies and practices, ensure the confidentiality and integrity of information accessed, report suspected security violations or breaches, and complete all periodic mandatory security trainings

Nice to have

• ▹Python experience

Soft skills

About the company

Mastercard powers economies and empowers people in 200+ countries and territories worldwide, working with customers to build a sustainable economy where everyone can prosper. It supports a wide range of digital payment choices, making transactions secure, simple, smart and accessible. The Identity Solutions Data Platform team builds and operates the platform underlying Mastercard's Identity Graph and Identity Network.