Lead Data Engineer (Poland)

Stack

Responsibilities

• ▹Work directly with product owners and data experts to build products that solve complex client problems
• ▹Build and support a distributed platform supporting all ExParte data
• ▹Work across the product, primarily on data pipelines
• ▹Interface directly with internal teams
• ▹Evaluate software and implementation options and document them for technical teams
• ▹Work with data analysts to identify data collection efficiencies and automation potential for manual workflows
• ▹Integrate best qualitative practices in program design and development
• ▹Work with Azure cloud and Databricks
• ▹Develop technical architectures and implementations to meet business needs
• ▹Guide the team's software engineering best practices through documented standards and code reviews
• ▹Troubleshoot new and existing code and provide feedback on structural issues in the codebase
• ▹Advise on the feasibility of nonfunctional requirements and ensure successful feature implementation

Requirements

• ▹3+ years' knowledge of Spark, Python or Scala
• ▹3+ years' experience with RDBMS and T-SQL
• ▹3+ years' experience with NoSQL and data lakes
• ▹Strong familiarity with map/reduce programming models
• ▹Proficiency writing production-quality code
• ▹Deep expertise in database schema design, optimization and scalability
• ▹Experience with Azure or AWS cloud-based service-oriented architecture
• ▹Solid understanding of the testing pyramid (unit, integration, black box, service)
• ▹Experience working in an Agile/Scrum environment
• ▹Strong analytical and problem-solving skills
• ▹Good time management and organizational skills
• ▹Bachelor's degree in Computer Science, Engineering, Mathematics or a related field

Nice to have

• ▹Experience with Databricks or Azure ML
• ▹Experience applying machine learning algorithms to complex data mining problems
• ▹Experience with JavaScript/TypeScript, HTML5 and CSS3
• ▹Experience with .NET core and entity framework core
• ▹Experience with Power BI Embedded
• ▹Understanding of cloud platforms, specifically Microsoft Azure
• ▹Knowledge of CI/CD tools in Azure DevOps

Soft skills

About the company

Ex Parte provides customers with data and insight for informed decisions on important legal issues; as an early-stage company it is looking for entrepreneurial senior data engineers passionate about big data, AI and machine learning.