Senior Software Engineer - Data Platform

Stack

Responsibilities

• ▹Design, build and operate high-scale data ingestion and replication systems from production data stores (RDS, DynamoDB, internal APIs, event-driven systems) into the data lakehouse
• ▹Build and maintain reliable, scalable data platform infrastructure for petabytes of data
• ▹Improve the reliability, observability, scalability, security and developer experience of the Spark and Databricks-based processing platform
• ▹Develop internal libraries, APIs, frameworks and tooling in Go and Python
• ▹Work on data lake and lakehouse technologies: Delta Lake on S3, data catalogs, metadata services, orchestration systems, platform automation
• ▹Collaborate with infrastructure, product engineering, data science, analytics, security and data engineering teams
• ▹Help shape the long-term data infrastructure roadmap, including support for AI, privacy, security and customer-facing data products

Requirements

• ▹4+ years of professional software engineering experience in production environments
• ▹4+ years building or maintaining large-scale production data infrastructure, data platforms, distributed systems or data lake systems
• ▹Strong experience with Apache Spark or similar distributed data processing systems
• ▹Experience operating production infrastructure in AWS (S3, RDS, DynamoDB, SQS, Kinesis, Lambda or similar)
• ▹Experience designing and operating reliable systems with ownership of scalability, observability, security and operational excellence
• ▹Proficiency in at least one production language: Go, Python, Scala or Java
• ▹Ability to collaborate with software engineers, data scientists, analysts, security teams and product stakeholders

Nice to have

• ▹Experience with Databricks, Delta Lake or similar lakehouse technologies (Iceberg, Hudi)
• ▹Building replication or ingestion systems from OLTP stores into a data lake
• ▹Infrastructure-as-Code tools such as Terraform or CloudFormation
• ▹Data catalogs and metadata tools: Unity Catalog, Hive Metastore, DataHub, Amundsen
• ▹Orchestration systems: Airflow, Dagster, Prefect
• ▹Streaming data, event-driven architectures, late-arriving or mutable data
• ▹Containerization and orchestration: Docker, Kubernetes, ECS, Fargate
• ▹Building internal platforms, libraries or developer tooling used by other engineering teams
• ▹Contributing to data infrastructure roadmaps and evaluating new technologies

Soft skills

What we offer

• ▹Initial RSU grant with no vesting cliff, plus ongoing performance-based refreshes

About the company

Samsara (NYSE: IOT) is the pioneer of the Connected Operations Cloud, using IoT data to help industries built on physical operations work more safely, efficiently and sustainably.