Shield Consulting Solutions, Inc. · 8 hours ago
Data Engineer
Shield Consulting Solutions, Inc. is seeking a Data Engineer to transform raw and complex data into high-quality analysis-ready datasets. The role involves creating consistent capabilities that support advanced analytics and data-driven decision-making across the organization.
ConsultingInformation ServicesInformation TechnologySoftware
Responsibilities
Responsible for identifying ways to create consistent and repeatable capabilities including transforming raw, complex, and often unstructured data into clean, reliable, and high-quality analysis-ready datasets that support advanced analytics, predictive modeling, and data-driven decision-making across the organization
Qualification
Required
Active TS/SCI w/Polygraph REQUIRED
5 years of experience as a software engineer
Bachelor's degree in a technical discipline
2 additional years of experience as a software engineer may be substituted for a degree
Experience using the Linux CLI and Linux tools
Experience developing Bash scripts to automate manual processes
Recent software development experience using Python
Familiar with Distributed Big Data processing engines including Apache Spark
Experience using Jupyter Notebook
Experience with data wrangling and preprocessing tools such as pandas and NumPy
Experience working with structured, semi-structured, and unstructured data
Familiarity with data quality concepts, data validation, and anomaly detection
Experience with Git Source Control System
Preferred
Familiar with Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
Familiar with HPC Job Scheduling tools including Slurm
Experience using the Atlassian Tool Suite (JIRA, Confluence)
Benefits
25 days PTO
11 paid holidays
100% employer-paid healthcare for employees and dependents – available day 1
8% 401(k) employer match – immediate vesting
Company
Shield Consulting Solutions, Inc.
Shield Consulting Solutions Incorporated is a veteran-owned small government contractor that was formed in 2002 with the idea that a small company can provide affordable and agile capabilities to our clients.
Funding
Current Stage
Growth StageCompany data provided by crunchbase