Senior Data Platform Engineer

Stack

Responsibilities

• ▹Design and implement solutions for the platform's most complex challenges, from high-scale pipeline architecture to modeling decisions affecting multiple consuming teams
• ▹Lead in-depth code reviews, pointing out performance, cost and maintainability trade-offs
• ▹Serve as a technical reference point: investigate production inconsistencies, optimize cloud costs
• ▹Collaborate with partner teams on data contracts, latency, quality and governance
• ▹Identify relevant technical debt, propose when to address it and lead execution
• ▹Work in an AI-driven environment where the team actively uses AI to boost productivity, contributing ideas on how this applies to data engineering

Requirements

• ▹Knowledge of Python, Scala, Java or Go
• ▹SQL knowledge
• ▹Knowledge of algorithms, data structures and application scalability
• ▹Knowledge of distributed processing frameworks (Apache Spark or Beam)
• ▹Containerization and deployment with Docker and Kubernetes
• ▹CI/CD knowledge
• ▹Platform monitoring and observability
• ▹Pipeline orchestration knowledge (Airflow, dbt or Dataform)
• ▹Knowledge of Google Cloud Platform solutions (BigQuery, GCS, GKE, IAM, DataProc, Cloud SQL, Composer, Pub/Sub, Dataflow)
• ▹Management and maintenance of an analytics visualization platform (Metabase, Looker, Tableau)

Nice to have

• ▹Experience or study in AI architectures applied to data: building RAG pipelines, how MCP standardizes data source access, ensuring quality and traceability in non-deterministic agentic systems
• ▹Experience building data warehouse, data lake or data lakehouse environments
• ▹Infrastructure as code experience

Soft skills

What we offer

• ▹Meal and/or food allowance
• ▹Health and dental insurance
• ▹Transportation allowance
• ▹Extended maternity and paternity leave
• ▹Childcare support
• ▹Health partnership with Wellhub and Zenklub
• ▹Education support
• ▹Discount on flights
• ▹Pet health insurance partnership
• ▹Access to educational materials for employees' children
• ▹MBA and postgraduate program partnerships

About the company

Arcotech is the technology team of Arco Educação, building digital learning solutions for students, parents and schools in Brazil.