Senior Cloud Data Engineer (AWS)
Hiflylabs is looking for a Senior Cloud Data Engineer to design, develop and implement complex, scalable data solutions on the AWS cloud platform. The role spans building and optimizing data pipelines, writing clean SQL and Python code, containerization with Docker, CI/CD automation, and delivering solutions on AWS data services such as S3, Redshift, Glue, EMR and Lambda. It also includes owning technical deliveries at component level, participating in project planning and estimation, and providing technical leadership to smaller teams.
Responsibilities
- ▹Design, develop and implement complex and scalable data solutions on the AWS cloud platform
- ▹Design, build and optimize data pipelines to ensure efficiency and reliability
- ▹Write clean, efficient and maintainable SQL and Python code, and develop shell scripts to support automation
- ▹Containerize applications and data pipelines using Docker
- ▹Establish and maintain CI/CD pipelines (e.g. GitHub Actions, GitLab CI/CD) and automate data pipeline processes
- ▹Deliver solutions on AWS data services (e.g. S3, Redshift, Glue, EMR, Lambda) and design data modeling and data warehousing solutions
- ▹Own and manage the technical aspects of deliveries, at least at component level
- ▹Participate in project planning, task estimation, testing and liaising with business stakeholders
- ▹Provide technical leadership to smaller teams and create technical documentation
Requirements
- ▹Proficiency in SQL and at least one imperative programming language, particularly Python, with emphasis on clean, efficient, maintainable code
- ▹Experience with shell scripting
- ▹Familiarity with Docker and at least one CI/CD tool (e.g. GitHub Actions, GitLab CI/CD)
- ▹A minimum of 5 years of hands-on data engineering experience with a strong focus on cloud-based solutions
- ▹Delivery of at least one complex and scalable data solution on a cloud platform's data services, with primary AWS data engineering skills
- ▹Excellent written and verbal communication skills in English
Nice to have
- ▹Experience with dbt or SQLMesh
- ▹GCP or Azure experience in addition to AWS
Soft skills
What we offer
- ▹Diverse projects with something new on the technical or business side in every assignment
- ▹Work with many of the most up-to-date technologies and tools
- ▹Strong, cohesive and motivating teams where members help each other
- ▹Work-life balance, with work coordinated to align with leisure activities
- ▹Regular team gatherings for knowledge sharing and deep technical discussions
- ▹Company culture built on mutual respect and helping one another
- ▹Personal mentor for both professional and personal matters
About the company
Hiflylabs is a Budapest-based company with more than 250 employees. Its application development team and business intelligence experts have proven their expertise through 10 years of experience on Hungarian and international Business Intelligence projects in the financial, telecommunications and energy sectors. The portfolio spans Data Warehouses, Business Intelligence, Data Analytics and Application Development, and the company encourages innovative initiatives in the form of independent startups.