Lead Data Engineer (Partner Company Role)

Stack

Responsibilities

• ▹Design the target-state data architecture: Postgres CDC → Kafka → Snowflake → client-facing data products
• ▹Own tooling decisions across ingestion, orchestration, transformation, and quality layers
• ▹Implement CDC-based ingestion from PostgreSQL services (RDS, Aurora, EC2, K8s operator) using Debezium or equivalent
• ▹Build streaming and near-real-time pipelines with defined SLAs
• ▹Build a data quality control layer: checksums, reconciliation, schema validation, anomaly detection, and alerting
• ▹Define quality checkpoints across the full pipeline
• ▹Define and enforce data contracts with service-owning teams for core entities: transaction, merchant, settlement, and processing status
• ▹Build the external data delivery layer: financial settlement, transaction status, processor reconciliation, and client analytics
• ▹Design tenant separation and implement replay/reload mechanisms for failure recovery
• ▹Start hands-on, then gradually hire and grow a small data engineering team
• ▹Build a pragmatic roadmap with concrete deliverables at 3, 6, and 12 months

Requirements

• ▹5+ years in data engineering with end-to-end ownership of production pipelines
• ▹Hands-on with Snowflake, PostgreSQL CDC (Debezium preferred), and Kafka
• ▹Solid AWS experience - S3, RDS, Aurora, and cloud data infrastructure
• ▹Data quality engineering mindset: monitoring, reconciliation, lineage
• ▹Comfortable defining data contracts and driving requirements with backend engineering teams
• ▹Technical leadership experience: project ownership, cross-team alignment, delivery under constraints
• ▹Familiarity with gRPC, RabbitMQ, and reading Go/Python service code

Nice to have

• ▹Kubernetes, Airflow/Prefect/Dagster, and dbt
• ▹Payments domain knowledge - settlement, transaction lifecycle, processor integrations

Soft skills

What we offer

• ▹An opportunity to make something great even greater
• ▹Career prospects at a young, ambitious company
• ▹Coworkers who are passionate about the business
• ▹Compensation that fully corresponds to competence and knowledge, with yearly performance reviews
• ▹Remote work
• ▹20 days of vacation time, bank holidays, sick leave, additional birthday day off

About the company

A young, ambitious fintech company aiming to become the best in its market.