Data Platform Engineer (Metadata, DQ)

Stack

Responsibilities

• ▹Implement, configure and maintain the Metadata Management platform and Data Quality environment
• ▹Integrate the solution with the lakehouse, data warehouse, domain systems and analytical tools
• ▹Automate metadata ingestion, data lineage, data quality monitoring and DQ reporting
• ▹Implement and maintain the metamodel and the technical mechanisms for enforcing data quality rules
• ▹Develop and extend integrations between Data Quality and Metadata Management solutions
• ▹Monitor the stability, performance and security of the environment
• ▹Collaborate with Data Governance, Data Engineering and business teams to roll out standards and drive practical adoption of the data catalog and DQ mechanisms
• ▹Produce technical documentation and provide user support

Requirements

• ▹Minimum 3-5 years of experience as a Data Engineer / Data Platform Engineer or in a related role
• ▹Proven experience building and maintaining production data pipelines (ETL/ELT)
• ▹Experience with Metadata Management / Data Catalog tools (e.g. DataHub, Apache Atlas, Amundsen)
• ▹Experience with Data Quality tools (e.g. Great Expectations, Soda, Deequ or similar)
• ▹Knowledge of event-driven architecture
• ▹Experience in environments with established Data Governance or Master Data Management processes
• ▹Strong proficiency in Python (APIs, automation, integrations) and SQL
• ▹Hands-on experience working in an AWS environment
• ▹Solid knowledge of CI/CD practices and GitHub
• ▹Experience implementing data validation, data testing or data quality control mechanisms within pipelines
• ▹Experience with system integrations (REST API, GraphQL or similar)
• ▹Understanding of Data Governance, Metadata Management, Data Lineage and Data Quality concepts
• ▹Ability to work independently in a project-based environment
• ▹Good communication skills in both Polish and English

Soft skills

What we offer

• ▹Flexible employment and remote work
• ▹International projects with leading global clients
• ▹International business trips
• ▹Non-corporate atmosphere
• ▹Language classes
• ▹Internal and external training
• ▹Private healthcare and insurance
• ▹Multisport card
• ▹Well-being initiatives

About the company

Software Mind develops solutions that make an impact for companies around the globe. It builds cross-functional engineering teams that take ownership, and its culture embraces openness, respect and grit.