Databricks Solution Architect, Senior Manager

Stack

Responsibilities

• ▹Lead the architecture and implementation of scalable data solutions using Databricks, including Delta Lake, SQL, Lakeflow pipelines and cloud-native storage
• ▹Collaborate with stakeholders to gather requirements and translate business needs into detailed technical designs, data models and solution architectures
• ▹Design, build and optimize data pipelines, workflows and data models, including ingestion, transformation, orchestration and metadata management
• ▹Provide technical leadership, coaching and mentorship to engineering teams
• ▹Establish and enforce best practices for data security, access controls, governance, cataloging, lineage and compliance within Databricks environments
• ▹Oversee configuration and management of Databricks Workspaces, Unity Catalog, CI/CD automation, environment setup and deployment frameworks
• ▹Troubleshoot and resolve complex technical issues related to performance, data quality, integration and environment configuration
• ▹Lead test strategy and quality assurance activities, including unit, regression and system testing and readiness reviews
• ▹Drive platform optimization and cost efficiency, including cluster tuning, storage optimization and pipeline performance improvements
• ▹Plan and oversee data migration iterations, parallel runs and production deployment processes to ensure smooth cutover
• ▹Support knowledge transfer, documentation and training activities
• ▹Stay current with Databricks platform advancements and proactively introduce innovations
• ▹Document architectures, technical designs, processes and best practices

Requirements

• ▹Strong expertise in Databricks, Apache Spark, Delta Lake and cloud platforms such as AWS or Azure
• ▹Experience with ETL/ELT processes, data modeling, CI/CD pipelines and performance tuning in large-scale environments
• ▹Experience leading technical teams, coordinating complex migrations, managing project timelines and mentoring engineers
• ▹Bachelor's degree or 10+ years of industry experience
• ▹US Citizenship required
• ▹The ability to obtain and maintain a government security clearance

Nice to have

• ▹Advanced degree
• ▹15+ years of industry experience
• ▹In-depth knowledge of Accenture delivery methodologies and practices

Soft skills

About the company

Accenture Federal Services is the technology company within global Accenture dedicated solely to serving the US federal government, working across defense, national security, public safety, civilian and military health organizations. It employs more than 13,000 people and has been recognized as a Glassdoor Top 100 Best Place to Work.