Senior Data Engineer - Worldwide, Part Time

Stack

Responsibilities

• ▹Design, build and maintain ETL/ELT pipelines that process large-scale data
• ▹Develop cloud-native data pipelines using AWS Glue, Python and SQL
• ▹Orchestrate data workflows and stateful jobs using AWS Step Functions
• ▹Store and manage large datasets in Amazon S3 with efficient partitioning, data formats (e.g. Parquet) and access control
• ▹Design and optimize relational data structures in PostgreSQL
• ▹Implement data quality monitoring, logging and alerting in the pipelines
• ▹Define data requirements with cross-functional teams
• ▹Participate in code reviews and architecture discussions
• ▹Ensure adherence to data security, privacy and governance standards

Requirements

• ▹5+ years of experience as a Data Engineer or in a similar data-focused engineering role
• ▹Strong experience building and managing ETL/ELT pipelines in production environments
• ▹Hands-on experience with AWS Glue and Step Functions
• ▹Deep understanding of Amazon S3 and data lake best practices
• ▹Advanced proficiency in SQL, particularly PostgreSQL, including performance tuning and complex queries
• ▹Solid programming skills in Python (or similar languages) for data processing
• ▹Experience designing scalable data architectures and workflow orchestration solutions
• ▹Familiarity with CI/CD tools, version control (e.g. Git) and DevOps principles

Nice to have

• ▹Experience with other AWS data services (e.g. Athena, Lambda)
• ▹Familiarity with workflow orchestration alternatives
• ▹Exposure to modern data modeling concepts
• ▹Knowledge of data security and compliance frameworks (e.g. GDPR)

Soft skills

What we offer

• ▹Equity: participation in the VendueTech Ltd ESOP Trust, with share allocation based on hours worked and achievements
• ▹Innovative data and AI-driven projects transforming the real estate auction market
• ▹Flexible remote work environment with global collaboration
• ▹Direct contribution to the growth of a mission-driven, forward-thinking company

About the company

VendueTech is a high-growth startup building data and AI-driven products that transform the real estate auction market.