Design, build and optimize ETL/ELT pipelines and data lakes for a vehicle lifecycle solutions client, supporting insurance/finance reporting and ML feature stores.
Responsibilities
- ▹Design, build and optimize ETL/ELT pipelines that transform customer and internal data into actionable datasets
- ▹Partner with Markets and Product teams to develop reporting tools and dashboards
- ▹Build and maintain data lakes and feature stores used by the ML Engineering team for subrogation solutions
Requirements
- ▹Strong proficiency in Python and SQL
- ▹Experience with Spark or similar distributed processing technologies
- ▹Deep experience with AWS data services (Glue, S3, Step Functions, Athena, EMR, DynamoDB, SQS)
- ▹Experience with data streaming technologies (Kafka, Spark Streaming, etc.)
- ▹Experience in data modeling, preferably in finance or insurance
- ▹Familiarity with MongoDB and document-oriented data sources
- ▹Experience with data lake patterns: medallion architecture (bronze/silver/gold), schema management, incremental processing
- ▹Comfort with IaC (CloudFormation or Terraform)
- ▹Ability to debug data quality issues across distributed systems
- ▹Experience implementing data quality frameworks (e.g. Great Expectations)
Nice to have
- ▹Experience in subrogation, claims processing, insurance or financial technology
What we offer
- ▹International projects
- ▹In-office, hybrid, or remote flexibility
- ▹Medical healthcare
- ▹Recognition program
- ▹Ongoing learning & reimbursement
- ▹Well-being program
- ▹Team events & local benefits
- ▹Sports compensation
- ▹Referral bonuses
- ▹Top-tier equipment provision
About the company
Exadel is an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members and 500+ active projects powering Fortune 500 clients. The client is a Chicago-headquartered leading provider of vehicle lifecycle solutions.
Languages: Angol: Felső-középfok
Similar jobs

Job
· Senior
Senior Data Platform Engineer
Betsson
+5
💰 Salary: not specified
🏢 On-site
Budapest

Job
· Senior
Senior Data Platform Engineer
Depop
AI/MLFlink
+14
💰 Salary: not specified
🌍 Remote
🗣️ EN
Himalayas

Job
· Senior
Senior Data Engineer (Remote within the UK)
Chip
AI/MLDatabricks
+8
£70,000–£80,000/yr
gross
🌍 Remote
🗣️ EN
Himalayas

Job
· Senior
Staff Data Engineer
Sonatype
AI/MLDagsterDatabricks
+8
💰 Salary: not specified
🌍 Remote
🗣️ EN

Job
· Senior
Big Data Architect
SDG Group
DatabricksDbt
+6
💰 Salary: not specified
🌍 Remote
🗣️ EN
Himalayas

Job
· Senior
Senior Data Engineer
Relayfi
FlinkDagsterDbt
+7
$144,000–$176,000/yr
gross
🔀 Hybrid
Toronto
🗣️ EN
