Senior Data Engineer

Stack

Responsibilities

• ▹Design and implement scalable data platforms and pipelines across cloud environments (Azure/Fabric, AWS, GCP, Databricks, Snowflake)
• ▹Develop reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake
• ▹Build ingestion, transformation, and curation workflows for both structured and unstructured data
• ▹Implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold)
• ▹Deliver high-quality datasets supporting analytics, machine learning, causal modeling, and optimization systems
• ▹Enable data pipelines for GenAI use cases (LLMs, RAG pipelines, vector-based data flows) and agent-based architectures
• ▹Design scalable logical and physical data models for analytical and operational use cases
• ▹Orchestrate workflows using tools such as Airflow, dbt, or Lakeflow
• ▹Apply modern architecture patterns including event-driven and streaming architectures
• ▹Ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC)
• ▹Establish strong data observability, including monitoring of data freshness, pipeline reliability, and SLA adherence

Requirements

• ▹Experience designing and implementing cloud-based data platforms (Azure/Fabric, AWS, GCP, Databricks, Snowflake)
• ▹Batch, streaming, and near-real-time pipeline development (Spark, Delta Lake)
• ▹Experience with lakehouse architecture and medallion layering
• ▹Familiarity with workflow orchestration tools (Airflow, dbt, Lakeflow)
• ▹Understanding of data governance, lineage, quality, and access control (RBAC/ABAC)
• ▹Experience enabling AI/GenAI data pipelines (LLMs, RAG, vector-based data flows)

Soft skills

About the company

Valtech is the experience innovation company - a trusted partner to the world's most recognized brands, offering growth opportunities, a values-driven culture, and international careers.