Lead Data Engineer

Stack

Responsibilities

• ▹Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models using Python, Apache Spark (PySpark), SQL (PostgreSQL), and AWS Glue
• ▹Develop and optimize AWS-native data platforms with Glue, EMR, MWAA (Apache Airflow), S3, RDS, and CloudWatch
• ▹Build high-performance ingestion, transformation, and orchestration workflows using Apache Iceberg and Parquet
• ▹Design and optimize analytical data platforms with Amazon Athena, Trino, Hive, OpenSearch, and enterprise data catalogs
• ▹Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search (Amazon S3 Vectors, OpenSearch vector indexes)
• ▹Develop cloud infrastructure with CloudFormation, GitHub, and enterprise CI/CD pipelines
• ▹Improve reliability, scalability, and performance of data platforms through monitoring and automation
• ▹Implement solutions compliant with FedRAMP and NIST SP 800-53 in federal AWS environments
• ▹Mentor junior engineers and collaborate with cross-functional teams in an Agile environment

Requirements

• ▹U.S. citizenship and ability to obtain a Public Trust clearance

Soft skills

About the company

Capital Technology Group provides consulting in software development, digital transformation, data analytics, and cybersecurity for federal and commercial clients. It was named a Top Workplace by The Washington Post in 2025 and 2026.