Apply on Employer Site

Celestar Holdings Corporation · 1 month ago

Mid-level Data Engineer (OBI Advanced Analytic Method Augmentation) - OBIQUA

Reston, VA

Full-time

Onsite

Mid, Senior Level, Lead/Staff

8+ years exp

Celestar Corporation is seeking a Mid-level Data Engineer to support The Defense Intelligence Agency (DIA) under the Object Based Intelligence and Quality Assurance (OBIQUA) task order. The role involves designing, implementing, and operating data management systems for intelligence needs and collaborating with team members to develop scalable ETL pipelines and database solutions.

EducationInformation Technology

No H1B

Security Clearance Required

U.S. Citizen Only

Responsibilities

The Data Engineer (OBI Advanced Analytic Method Augmentation), Designs, implements, and operates data management systems for intelligence needs

Designs how data will be stored, accessed, used, integrated, and managed by different data regimes and digital systems

Works with data users to determine, create, and populate optimal data architectures, structures, and systems

Plans, designs, and optimizes data throughput and query performance

Participates in the selection of backend database technologies (e.g. SQL, NoSQL, HPC, etc.), their configuration and utilization, and the optimization of the full data pipeline infrastructure to support the actual content, volume, ETL, and periodicity of data to support the intended kinds of queries and analysis to match expected responsiveness

Manages complex, long term projects involving design, development, and installation of new information systems

Performs technical studies to ensure the design meets user requirements

Develops, integrates, and installs data management capabilities and databases

Collaborate with team members to develop or refine resilient and scalable extract, transform, load (ETL) pipelines using industry-standard tools and frameworks (e.g. Apache NiFi) to support and enable data acquisition, normalization, enrichment, and delivery across enterprise systems and platforms

Collaborate with team members to ensure ETL pipelines operate in accordance with security controls and rules, SLA requirements, and evolving data architecture needs

Collaborate with team members to develop, implement, and maintain GraphQL APis to enable flexible and efficient access and aggregation of data across distributed sources

Designs data management capabilities, data integration solutions, and databases to ensure optimization, efficiency, and sustained operations

Performs systems analysis and feasibility studies to define concepts and design specifications for new or existing databases and content management solutions

Collaborate with team members to design, implement, ana maintain scalable, performant relational and non-relational database solutions (e.g. PostgreSQL) to support ingestion, storage, retrieval, and analytics of data across enterprise systems

Conducts testing and promotes the integration of new databases within the existing IT infrastructure

Discovers sources of redundancy and designs solutions for efficiently integration or consolidating these sources in order to reduce costs of storage and maintenance, and to provide consistency to the enterprise

Creates test plans and scenarios and executes and documents database test activities (i.e. component, integration, systems, compatibility/interface, user acceptance, and performance/stress tests)

Conducts operational readiness testing and transitional user support

Conducts monitor services and upgrades data services, content management systems, and databases

Produces technical data and reporting outlining the performance characteristics of specified databases and data services in the DIA infrastructure

Conducts analysis of database and system reports to ensure optimal performance

Develops disaster recovery planning to ensure data and access reliability and database integrity during crisis

Analyzes, evaluates and provides recommendations and associated artifacts (e.g. OV/SV- 1s, reference models, integration plans and patterns) on new, current, and planned data service, data management and database technologies and architecture based on performance, cost, and security requirements

Conducts assessments of current trends and determines the impact of emerging technologies upon the existing infrastructure

Analyzes, evaluates and provides recommendations for current and planned programmatic solutions and capabilities to manage, organize, and transform data outside of databases to ensure unstructured data integrity, security, access, and formats

Identify and leverage containerization capabilities (e.g. Docker, Kubernetes) and, infrastructure as code tools to manage and provision resources and ensure repeatability and automation

Independently designs, develops, tests, and implements unstructured data management solutions, content extraction and tagging capabilities, data integration solutions, and complex data web services

Designs, upgrades and maintains data service versioning to ensure uninterrupted availability and access across the DIE

Conducts analysis of service and database failures and user system interface problems

Conducts the development of immediate temporary fixes and implements final corrections

Interfaces with vendors, programmers, and users to identify, isolate and resolve problems. Evaluates user requested changes and plans the implementation, enhancement and update of databases and data services as necessary

Prepares and presents briefings to senior management to effectively communicate technical and complex data management issues

Supports capability development by contributing, editing, and storing code in Government owned/controlled source version control repositories

Qualification

Data management systemsETL pipelinesDatabase technologiesGraphQL APIsContainerization DockerContainerization KubernetesPostgreSQLTechnical studiesCollaborationProblem-solvingCommunication

Required

Minimum 8 years of experience related to the specific labor category with at least a portion of the experience within the last 2 years with a bachelor's degree

Active TS/SCI with a Current CI Poly