Data Engineer

Stack

Responsibilities

• ▹Implement, maintain, and support the MS SQL Server warehouse and SSIS processes and jobs on a daily basis
• ▹Design, build, and maintain scalable data processing pipelines using SQL, Python, and Apache Spark / PySpark
• ▹Work with raw data and design methods for integrating it into the data platform
• ▹Develop CI/CD pipelines for data engineering solutions
• ▹Create and maintain Infrastructure as Code solutions
• ▹Integrate the data platform with other systems and applications
• ▹Participate in architectural decision-making and define engineering standards
• ▹Conduct code reviews, document solutions, and share knowledge with team members

Requirements

• ▹At least 3 years of experience as a Data Engineer or in a related software engineering role
• ▹At least 1 year of experience with MS SQL Server, SSIS, and SQL Server Agent, including deploying new features
• ▹Ability to analyze existing legacy code for improvement and migration to newer technology
• ▹Flexibility to join a Databricks-oriented project at some point
• ▹Proficiency in Python and the ability to write clean, testable production code
• ▹Hands-on experience with Apache Spark
• ▹Advanced SQL skills (query optimization on large datasets)
• ▹Strong understanding of data warehouse design principles and data modeling
• ▹Practical knowledge of ETL/ELT processes
• ▹Familiarity with data quality, monitoring, and pipeline reliability
• ▹Experience with relational databases, including data modeling and optimization
• ▹Understanding of REST and gRPC standards for system integration
• ▹Experience with workflow orchestration tools (e.g. Airflow, Dagster, or similar)
• ▹Knowledge of CI/CD pipeline building and maintenance
• ▹Strong analytical problem-solving skills and attention to detail
• ▹Effective communication and collaboration skills
• ▹Openness to learning new technologies and methodologies

Nice to have

• ▹Experience with dbt
• ▹Experience with Kafka, Pub/Sub, or other event streaming systems
• ▹Experience building near-real-time or real-time pipelines
• ▹Experience with Infrastructure-as-Code tools
• ▹Understanding of CDC (Change Data Capture) and data integration from transactional systems
• ▹Experience with Databricks or other lakehouse platforms

Soft skills

About the company

XTB is a global company in the financial industry, focused on the online trading of financial instruments. It is the largest fintech in Poland and a leader in Central and Eastern Europe, with operations spanning several countries including Asia and South America. XTB is a certified Great Place to Work company.