540 is hiring a Senior Data Engineer for a federal health data modernization initiative, building scalable, production-ready data pipelines with Spark, Python and SQL in Databricks, while guiding engineering teams and establishing reusable patterns.
Responsibilities
- ▹design, build and maintain scalable production data pipelines (Spark, Python, SQL, Databricks)
- ▹integrate complex defense and federal health data
- ▹design data ingestion and integration approaches with API-based integrations
- ▹establish reusable data engineering patterns and standards
- ▹provide technical guidance on architecture, pipeline design and data modeling
- ▹monitor, troubleshoot and optimize production workflows
- ▹define data validation, quality and governance practices
- ▹mentor other engineers
Requirements
- ▹10+ years of data engineering, software engineering or related technical experience
- ▹extensive hands-on experience building and operating production data pipelines
- ▹advanced proficiency in Python and SQL
- ▹strong Apache Spark and distributed data processing experience
- ▹experience with Databricks or a similar modern data platform
- ▹experience designing and maintaining ETL/ELT processes
Soft skills
mentoring and leadership abilityownership of complex technical areasinitiative in driving process improvements
About the company
540 is a technology company focused on U.S. federal government contracts, delivering data modernization solutions.
Similar jobs

Job
· Senior
1150 - Senior Data Platform Architect - Palantir Foundry & Databricks Integratio
GoFasti
AI/MLBigqueryDatabricks
+7
$6,000–$7,000/mo
gross
🌍 Remote
🗣️ EN
Himalayas

Job
· Senior
Senior Data Engineer, Data Lake
VISA
Databricks
+4
💰 Salary: not specified
🌍 Remote
🗣️ EN

Job
· Senior
Senior Data Engineer – AWS Data Lake & Pipeline Architecture
Toptal
Data Science
+6
💰 Salary: not specified
🌍 Remote
Anywhere in the World
🗣️ EN

Job
· Senior
Staff Analytics Engineer
Alpaca
Dbt
+3
💰 Salary: not specified
🌍 Remote
🗣️ EN
Himalayas

Job
· Senior
Data Engineer (Spark)
Addepto
AI/MLBigquery
+11
💰 Salary: not specified
🌍 Remote
🗣️ EN
Himalayas

Job
· Senior
Senior Data Engineer
Carrot Fertility
Data ScienceDbt
+7
$145,000–$165,000/yr
gross
🌍 Remote
🗣️ EN
Himalayas