Cloud Data Architect (GCP)

Stack

Responsibilities

• ▹Consult with current and potential clients and advise on GCP technology choices, aiming for cost-optimal solutions
• ▹Take part in discovery and pitch meetings: present experience, process and approach to GCP, clarify requirements
• ▹Contribute to offers: architecture diagrams, TCO/ROI and GCP cost calculations with the Pricing Calculator, project and team resource estimates
• ▹Build the case for the proposed solution and point out advantages over alternatives
• ▹Take part in offer meetings: answer questions, present the architecture and cost estimate
• ▹R&D in GCP Data & Analytics: analyze new services and build proofs of concept
• ▹Maintain relationships with the client's technical team and coordinate the engineers on the project
• ▹Actively develop the Data Solutions business line (recruitment, client acquisition, conference talks, mentoring)
• ▹End-to-end responsibility for data platform solutions built together with the team
• ▹Build and optimize ETL/ELT pipelines in GCP (BigQuery, Dataflow, Dataproc, Cloud Composer)
• ▹Create and update documentation, build and maintain the catalog and data models according to Data Governance best practices
• ▹Analyze business requirements and choose optimal technology solutions
• ▹Analyze potential risks, monitoring, diagnostics and cloud cost optimization (FinOps)

Requirements

• ▹At least 5 years of experience working with data in Google Cloud Platform, confirmed by commercial production deployments, and experience as a Lead Developer / Architect or similar
• ▹Broad knowledge of GCP Data & Analytics services (BigQuery, BigLake, Dataflow, Dataproc, Pub/Sub, Cloud Composer, Dataplex, Sensitive Data Protection, Looker, Vertex AI)
• ▹Fluency with CI/CD tools and processes, IaC (Terraform and/or Cloud Deploy/Cloud Build) and Git
• ▹Ability to design and modify data models and choose the right architecture (DWH, Data Marts, Data Lake, Delta Lake, Lakehouse, BigLake), with knowledge of Lambda and Kappa architectures and how to implement them in GCP
• ▹Experience building near-real-time solutions (Pub/Sub, Dataflow)
• ▹Advanced SQL and Python
• ▹Ability to design scalable, fault-tolerant pipelines with Dataflow (Apache Beam) and Dataproc, using suitable patterns for batch and streaming
• ▹Experience optimizing performance and cost of Dataflow pipelines and Dataproc clusters and applying monitoring best practices (Cloud Monitoring, Logging)
• ▹Cloud diagnostics and troubleshooting (Cloud Monitoring, Logging, Error Reporting, Cloud Trace)
• ▹Cost planning and optimization (FinOps, GCP Pricing Calculator, BigQuery Reservations)
• ▹Knowledge of migrating on-premise solutions to GCP and the migration types (lift-and-shift, re-platform, re-architect)
• ▹Knowledge of secure data storage and processing mechanisms in GCP (VPC Service Controls, CMEK, DLP, Cloud KMS)
• ▹Experience in pre-sales meetings and translating business requirements into technical solutions
• ▹Advanced English (at least C1)
• ▹Openness to business travel

Soft skills

What we offer

• ▹Pay: 165 - 240 PLN/h net + VAT (B2B)
• ▹19,700 - 29,300 PLN gross (employment contract)