Senior Data Engineer

Stack

Responsibilities

• ▹Develop, maintain and test infrastructures for data generation to transform data from various structured and unstructured sources
• ▹Develop complex queries to ensure accessibility while optimizing the performance of NoSQL and/or big data infrastructure
• ▹Create and maintain optimal data pipeline architecture
• ▹Build and maintain the infrastructure to support extraction, transformation and loading (ETL) of data from a wide variety of data sources
• ▹Extract data from multiple sources, relational SQL and NoSQL databases and other platform APIs, for ingestion and integration
• ▹Configure and manage data analytic frameworks and pipelines using databases and tools such as NoSQL, SQL, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, OrientDB, Spark, Hadoop, Kafka, Hive and Pig
• ▹Apply distributed systems concepts and principles such as consistency and availability, liveness and safety, durability, reliability, fault-tolerance and consensus algorithms
• ▹Administrate cloud computing and CI/CD pipelines, including Azure, Google and Amazon Web Services (AWS)
• ▹Coordinate with product, data and design teams to assist with data-related technical issues and support their data infrastructure needs

Requirements

• ▹Minimum of 3 years of experience
• ▹Bachelor's degree in a STEM field, with preference towards Computer Science and Software Engineering
• ▹Verifiable work experience with data structures, database management, distributed computing and API-driven architectures using SQL and NoSQL engines
• ▹Proficiency in modeling frameworks like UML, Agile development and Git operations
• ▹A Secret Clearance is required to start

Nice to have

• ▹Familiarity with Palantir and/or MSS
• ▹Familiarity with DoD
• ▹Top Secret Clearance with SCI eligibility

Soft skills

What we offer

• ▹Performance-based bonuses
• ▹Extensive medical, dental and vision coverage
• ▹401(k) plan with company match
• ▹Substantial paid time off and holidays
• ▹Flexible work arrangements where possible
• ▹Income protection benefits

About the company

Clarity Innovations is a trusted national security partner that helps the US Intelligence Community and Department of Defense turn data into actionable intelligence. Its mission-first software and data engineering platform modernizes data operations.