EPIC SYSTEMS INC · 1 day ago
Sr. Data Engineer – Must have an Active Secret (S) clearance and be able to obtain a TS/SCI clearance and DHS Suitability
Herndon, VA
Full-time
Onsite
Senior Level, Lead/Staff
8+ years expEpic Systems Inc is supporting a U.S. Government customer on a large mission critical development and sustainment program. They are seeking a Sr. Data Engineer to design and implement data ingestion and processing pipelines, while ensuring the quality and efficiency of data operations.
Information Technology & Services
No H1B
Security Clearance RequiredU.S. Citizen Only
Responsibilities
Data Pipeline Developer: design, develop and implement, end-to-end data ingestion and processing pipelines using various Cloud and Platform Technologies
Transform incoming bronze data (RAW) into silver (clean) and finally projections into gold tier. (Medallion model)
Schedule, orchestrate and monitor automated/semi-automated data pipelines
Perform mapping and integration of data assets in support of the execution of multiple mission customers
Develop and maintain the data engineering team process improvement plan
Develop code using various programming and scripting languages to automate data ingestion, pipeline orchestration and improve data management processes
Ingest transparency, leveraging technologies such as AWS CloudWatch to identify places for measuring and gathering performance information on automated data pipelines
Ensure Data Engineering Team Standard Operating Procedures are appropriately captured and communicated across the team
Ensure technical correctness, timeliness and quality of delivery for the team
Demonstrate excellent oral and written communication skills to all levels of management and the customer
Qualification
Required
Active Secret (S) clearance. Must be able to obtain a TS/SCI clearance
Must be able to obtain DHS Suitability
8+ years of software engineering experience
Minimum of 4 years of experience performing data engineering work in a cloud environment
Experience with relational, noSQL and/or file-based storage (e.g. Databricks, Elastic, Postgres, etc.)
Experience with DevOps tools such as Jenkins, Docker, Ansible, Puppet, Chef, Splunk, etc
Working knowledge of Databricks, Cloud Relational Database Services and Elasticsearch
Bachelor's degree in Software Engineering, Computer Science or a related discipline is required. [Ten (10) years of experience (for a total of eighteen (18) or more years) may be substituted for a degree.]
Preferred
Experience with Databricks workflows, Databricks Unity Catalog, Databricks Autoloader, and Databricks Delta Live Tables and Apache Spark
Basic working knowledge with Apache Niagara Files (NiFi)
Experience with collaboration tools including MS Teams, MS Outlook, MS SharePoint, and Confluence
Amazon Web Services (AWS) Professional certification or equivalent
DoD 8570.1-M Compliance at IAT Level I (e.g., Certified Information Systems Security Professional (CISSP)) certification highly desired
Company
EPIC SYSTEMS INC
We exist to turn data into decisive action.
51-200 employees
Funding
Current Stage
Growth StageLeadership Team
Krishna Marreddy
Chief Technology Officer
Company data provided by crunchbase