Software Engineer (L3) Data Substrate

Stack

Responsibilities

• ▹Design, build and maintain infrastructure and scalable frameworks for data ingestion, processing and analysis
• ▹Collaborate with stakeholders, analysts and product teams to translate business requirements into technical solutions
• ▹Architect and implement data solutions using Kafka, Spark, Hive, Hudi, Presto, Airflow, AWS Lakeformation, Glue and Athena
• ▹Design frameworks and solutions for performance, reliability and cost-efficiency
• ▹Ensure data quality, integrity and security throughout the data lifecycle
• ▹Stay current with emerging technologies and best practices in big data
• ▹Mentor early-career engineers and foster a culture of continuous learning

Requirements

• ▹Bachelor's or Master's degree in Computer Science, Engineering or a related field
• ▹5+ years of experience in software development or a related field
• ▹Strong proficiency in programming languages such as Python, Java or Scala
• ▹Strong experience building frameworks for big data technologies: Spark, Kafka, Hive and distributed computing systems
• ▹Experience with AWS technologies at scale
• ▹Solid understanding of software engineering principles: OOP and functional paradigms, design patterns, code quality
• ▹Excellent problem-solving and analytical skills
• ▹Strong verbal and written communication in cross-functional teams

Nice to have

• ▹Bias to action, ability to iterate and ship rapidly
• ▹Passion for building data products, prior projects in this area

Soft skills

What we offer

• ▹Health care insurance
• ▹401(k) retirement savings program
• ▹Paid sick time, paid personal time off, paid parental leave
• ▹Equity plan and corporate bonus plan

About the company

Twilio powers real-time business communications and data solutions, headquartered in San Francisco with presence across South America, Europe, Asia and Australia.