Design, build and optimize ETL/ELT pipelines and data lakes for a vehicle lifecycle solutions client, supporting insurance/finance reporting and ML feature stores.
Responsibilities
- ▹Design, build and optimize ETL/ELT pipelines that transform customer and internal data into actionable datasets
- ▹Partner with Markets and Product teams to develop reporting tools and dashboards
- ▹Build and maintain data lakes and feature stores used by the ML Engineering team for subrogation solutions
Requirements
- ▹Strong proficiency in Python and SQL
- ▹Experience with Spark or similar distributed processing technologies
- ▹Deep experience with AWS data services (Glue, S3, Step Functions, Athena, EMR, DynamoDB, SQS)
- ▹Experience with data streaming technologies (Kafka, Spark Streaming, etc.)
- ▹Experience in data modeling, preferably in finance or insurance
- ▹Familiarity with MongoDB and document-oriented data sources
- ▹Experience with data lake patterns: medallion architecture (bronze/silver/gold), schema management, incremental processing
- ▹Comfort with IaC (CloudFormation or Terraform)
- ▹Ability to debug data quality issues across distributed systems
- ▹Experience implementing data quality frameworks (e.g. Great Expectations)
Nice to have
- ▹Experience in subrogation, claims processing, insurance or financial technology
What we offer
- ▹International projects
- ▹In-office, hybrid, or remote flexibility
- ▹Medical healthcare
- ▹Recognition program
- ▹Ongoing learning & reimbursement
- ▹Well-being program
- ▹Team events & local benefits
- ▹Sports compensation
- ▹Referral bonuses
- ▹Top-tier equipment provision
About the company
Exadel is an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members and 500+ active projects powering Fortune 500 clients. The client is a Chicago-headquartered leading provider of vehicle lifecycle solutions.
Languages: Angol: Felső-középfok
Ähnliche Stellen

Stelle
· Senior
Senior Data Platform Engineer
Betsson
+5
💰 Gehalt: keine Angabe
🏢 Vor Ort
Budapest

Stelle
· Senior
Staff Data Engineer
Sonatype
AI/MLDagsterDatabricks
+8
💰 Gehalt: keine Angabe
🌍 Remote
🗣️ EN

Stelle
· Senior
Big Data Architect
SDG Group
DatabricksDbt
+6
💰 Gehalt: keine Angabe
🌍 Remote
🗣️ EN
Himalayas

Stelle
· Senior
Senior Data Engineer
Relayfi
FlinkDagsterDbt
+7
124 498–152 164 €/Jahr
brutto
🔀 Hybrid
Toronto
🗣️ EN

Stelle
· Senior
Senior Data Engineer (Databricks)
Capgemini
BicepDatabricks
+6
💰 Gehalt: keine Angabe
🏢 Vor Ort
Wrocław
🗣️ EN

Stelle
· Senior
Senior AI Data Engineer (AI/Data Platform, Cloud Technologies, Python)
Capgemini
AI/MLBigquery
+18
💰 Gehalt: keine Angabe
🏢 Vor Ort
Warszawa
🗣️ EN
