Clarity · 20 hours ago
Data Engineer
Clarity Innovations is a trusted national security partner, dedicated to safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community and Department of Defense. The Data Engineer role supports the U.S. Special Operations Command by providing expertise in data governance and modernization efforts, ensuring effective data integration and usage for mission success.
AppsDatingFitnessInformation TechnologyMobile AppsSoftwareWellness
Responsibilities
Developing, maintaining, and testing infrastructures for data generation to transform data from various structured and unstructured data sources
Develop complex queries to ensure accessibility while optimizing the performance of NoSQL and or big data infrastructure. Create and maintain optimal data pipeline architecture
Build and maintain the infrastructure to support extraction, transformation, and loading (ETL) of data from a wide variety of data sources. Extract data from multiple data sources, relational SQL and NoSQL databases, and other platform APIs, for data ingestion and integration
Configure and manage data analytic frameworks and pipelines using databases and tools such as NoSQL, SQL, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, OrientDB, Spark, Hadoop, Kafka, Hive, and Pig
Apply distributed systems concepts and principles such as consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms
Administrate cloud computing and CI/CD pipelines to include Azure, Google, and Amazon Web Service (AWS)
Coordinate with stakeholders, including product, data and design teams to assist with data-related technical issues and support their data infrastructure needs
Qualification
Required
Minimum of 1-year experience is required
Bachelor's degree in a STEM field with preference towards Computer Science and Software Engineering
Verifiable work experience working with data structures, database management, distributed computing, and API driven architectures using SQL and No-SQL engines
A Certified Data Management Professional certification is preferred
Proficient in modeling frameworks like Universal Modeling Language (UML), Agile Development, and Git Operations
A Top Secret clearance with SCI eligibility is required
Preferred
Familiarity with PowerBI, Foundry, Databricks
Familiarity with DoD