Big Data Developer

Stack

Responsibilities

• ▹Design, develop, and maintain ETL and data transformation processes
• ▹Build, optimize, and support Spark-based data pipelines
• ▹Develop scalable data processing solutions in a Big Data environment
• ▹Integrate data from multiple sources while ensuring data quality and consistency
• ▹Analyze, troubleshoot, and resolve data-related issues
• ▹Optimize data performance and processing efficiency
• ▹Collaborate with cross-functional teams to gather and refine business requirements
• ▹Participate in Agile ceremonies and contribute to continuous improvement
• ▹Follow DevOps and CI/CD best practices throughout the development lifecycle

Requirements

• ▹3+ years of experience in software development and data engineering
• ▹Strong SQL knowledge (ANSI SQL, Hive SQL, Spark SQL, or equivalent)
• ▹Hands-on experience with Apache Spark and at least one of Scala, Python, or Java
• ▹Experience with Spark-based platforms such as Azure Databricks, Amazon EMR, Cloudera, Apache Hive, or similar Big Data environments
• ▹Experience with Qlik Sense reporting and dashboard development
• ▹Familiarity with Agile methodologies and DevOps practices
• ▹Experience with version control and CI/CD tools: Git, GitHub, SonarQube, Nexus
• ▹Strong analytical and problem-solving skills
• ▹Ability to work collaboratively within a multidisciplinary team
• ▹English level B2+ or above

Nice to have

• ▹Interest or experience in AI-assisted development tools
• ▹Knowledge of AI-driven approaches for data engineering, automation, and analytics
• ▹Experience with process optimization through AI technologies

Soft skills

What we offer

• ▹Permanent, full-time contract with career development opportunities
• ▹Chance to work in a multicultural environment with international projects
• ▹Exposure to large-scale financial IT systems and cross-country operations
• ▹Training opportunities in finance, technology, and data management

About the company

Talan is an international advisory group specializing in innovation and transformation through technology, with 5,000 employees and an annual turnover of 600M€.