Senior Data Engineer

Stack

Responsibilities

• ▹Design scalable data pipelines, ETL/ELT workflows and data models using Python, PySpark, dbt and SQL
• ▹Develop AWS-native data platforms (Glue, EMR, MWAA/Airflow, Lambda, Step Functions, S3, Redshift, RDS, DMS, CloudWatch)
• ▹Build high-performance ingestion and transformation workflows (Iceberg, Parquet, ORC, Avro)
• ▹Design analytical data platforms (Athena, Trino, Hive, OpenSearch, data catalogs)
• ▹Integrate enterprise and external data sources (PostgreSQL, Oracle, Redshift, GraphDB, NoSQL)
• ▹Build AI-enabled data solutions (Bedrock, RAG pipelines, vector search)
• ▹Develop cloud infrastructure with CloudFormation, GitHub, Harness and CI/CD
• ▹Improve reliability and performance through monitoring and automation
• ▹Support mission-critical federal analytics complying with FedRAMP and NIST 800-53
• ▹Lead modernization of legacy platforms (DataStage, Hadoop, RunDeck) to cloud-native AWS
• ▹Mentor junior engineers

Requirements

• ▹US citizenship and ability to obtain Public Trust clearance (client requirement)

Soft skills

About the company

Capital Technology Group is a consulting firm delivering software development, digital transformation, data analytics and cybersecurity for federal and commercial clients, recognized as a Washington Post Top Workplace in 2025 and 2026.