Senior Data Engineer (Databricks, Python, AI)

Stack

Responsibilities

• ▹Design, build and maintain data pipelines and curated datasets within Databricks Unity Catalog
• ▹Develop and document Metric Views defining core business metrics (schedules, on-time performance, bookings, pricing) to ensure consistency across the platform
• ▹Configure and tune domain-specific Genie Agents for conversational analytics
• ▹Contribute to the multi-agent orchestration architecture, including the Supervisor Agent layer
• ▹Implement MLflow tracing and evaluation to monitor agent quality and manage versioning
• ▹Support the integration of the intelligence layer with external AI tools via the MCP Server
• ▹Collaborate with data and product teams to translate business questions into governed, reusable data definitions

Requirements

• ▹Proven hands-on experience with Databricks (non-negotiable)
• ▹Minimum 4 years of relevant data engineering or analytics engineering experience
• ▹Strong knowledge of data modelling, Delta Tables, Metric Views and Genie Agents
• ▹Excellent skills in SQL and Python
• ▹Experience building solutions using agentic AI methods and patterns
• ▹Familiarity with Unity Catalog or similar data governance and lineage frameworks
• ▹Track record of delivering reliable, production-grade data pipelines and analytical systems

Nice to have

• ▹Experience with MLflow for experiment tracking, model/agent evaluation or observability
• ▹Knowledge of multi-agent orchestration patterns in enterprise data environments
• ▹Familiarity with Model Context Protocol (MCP) or exposing AI capabilities via APIs
• ▹Background in the aviation or travel industry and understanding of flight data concepts

What we offer

• ▹Professional development and personal growth
• ▹Flexible employment and hybrid work
• ▹Non-corporate atmosphere
• ▹Lunch tickets
• ▹Private healthcare and insurance
• ▹Multisport card
• ▹Well-being initiatives
• ▹Travel programs

About the company

Software Mind develops impactful solutions for companies around the globe. It builds cross-functional engineering teams that take ownership. This position is at Software Mind Poland.