← Back to list
Job · Senior

Senior Data Engineer

Data Engineer • Senior • Remote • Full-time • European Union EU/EMEA

540 is hiring a Senior Data Engineer for a federal health data modernization initiative, building scalable, production-ready data pipelines with Spark, Python and SQL in Databricks, while guiding engineering teams and establishing reusable patterns.

Responsibilities

  • ▹design, build and maintain scalable production data pipelines (Spark, Python, SQL, Databricks)
  • ▹integrate complex defense and federal health data
  • ▹design data ingestion and integration approaches with API-based integrations
  • ▹establish reusable data engineering patterns and standards
  • ▹provide technical guidance on architecture, pipeline design and data modeling
  • ▹monitor, troubleshoot and optimize production workflows
  • ▹define data validation, quality and governance practices
  • ▹mentor other engineers

Requirements

  • ▹10+ years of data engineering, software engineering or related technical experience
  • ▹extensive hands-on experience building and operating production data pipelines
  • ▹advanced proficiency in Python and SQL
  • ▹strong Apache Spark and distributed data processing experience
  • ▹experience with Databricks or a similar modern data platform
  • ▹experience designing and maintaining ETL/ELT processes

Soft skills

mentoring and leadership abilityownership of complex technical areasinitiative in driving process improvements

About the company

540 is a technology company focused on U.S. federal government contracts, delivering data modernization solutions.

Similar jobs