Middle Data Engineer

Stack

Responsibilities

• ▹Design, build and optimize ETL/ELT pipelines that turn customer and internal data into actionable datasets
• ▹Partner with Markets and Product teams to develop reporting tools and dashboards that guide business strategy and serve customer needs
• ▹Build and maintain data lakes and feature stores used by the ML Engineering team for subrogation ML solutions

Requirements

• ▹Proficiency in Python and SQL
• ▹Experience with Spark or similar distributed processing technologies
• ▹Experience with AWS data services (Glue, S3, Step Functions, Athena, EMR, DynamoDB, SQS)
• ▹Experience with data streaming technologies (Kafka, Spark Streaming, etc.)
• ▹Familiarity with MongoDB and document-oriented data sources
• ▹Experience with data lake patterns: medallion architecture (bronze/silver/gold), schema management, incremental processing
• ▹Comfort with IaC (CloudFormation or Terraform)
• ▹Ability to debug data quality issues across distributed systems
• ▹Experience implementing data quality frameworks (e.g. Great Expectations)

Nice to have

• ▹Experience in subrogation, claims processing, insurance or financial technology

What we offer

• ▹International projects
• ▹In-office, hybrid or remote flexibility
• ▹Medical healthcare
• ▹Recognition program
• ▹Ongoing learning and reimbursement
• ▹Well-being program
• ▹Team events and local benefits
• ▹Sports compensation
• ▹Referral bonuses
• ▹Top-tier equipment provision

About the company

Exadel is an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members and 500+ active projects for Fortune 500 clients such as HBO, Microsoft, Google and Starbucks. The client is a Chicago-based vehicle lifecycle solutions provider connecting insurers, repair facilities and parts suppliers.