Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Shield Consulting Solutions, Inc. · 8 hours ago

Data Engineer

Shield Consulting Solutions, Inc. is seeking a Data Engineer to transform raw and complex data into high-quality analysis-ready datasets. The role involves creating consistent capabilities that support advanced analytics and data-driven decision-making across the organization.

ConsultingInformation ServicesInformation TechnologySoftware
check
Growth Opportunities
badNo H1BnoteSecurity Clearance RequirednoteU.S. Citizen Onlynote

Responsibilities

Responsible for identifying ways to create consistent and repeatable capabilities including transforming raw, complex, and often unstructured data into clean, reliable, and high-quality analysis-ready datasets that support advanced analytics, predictive modeling, and data-driven decision-making across the organization

Qualification

Active TS/SCI w/PolygraphPythonLinux CLIApache SparkGit Source ControlData wrangling toolsBash scriptingJupyter NotebookData quality conceptsSQL technologiesHPC Job SchedulingAtlassian Tool Suite

Required

Active TS/SCI w/Polygraph REQUIRED
5 years of experience as a software engineer
Bachelor's degree in a technical discipline
2 additional years of experience as a software engineer may be substituted for a degree
Experience using the Linux CLI and Linux tools
Experience developing Bash scripts to automate manual processes
Recent software development experience using Python
Familiar with Distributed Big Data processing engines including Apache Spark
Experience using Jupyter Notebook
Experience with data wrangling and preprocessing tools such as pandas and NumPy
Experience working with structured, semi-structured, and unstructured data
Familiarity with data quality concepts, data validation, and anomaly detection
Experience with Git Source Control System

Preferred

Familiar with Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
Familiar with HPC Job Scheduling tools including Slurm
Experience using the Atlassian Tool Suite (JIRA, Confluence)

Benefits

25 days PTO
11 paid holidays
100% employer-paid healthcare for employees and dependents – available day 1
8% 401(k) employer match – immediate vesting

Company

Shield Consulting Solutions, Inc.

twittertwittertwitter
company-logo
Shield Consulting Solutions Incorporated is a veteran-owned small government contractor that was formed in 2002 with the idea that a small company can provide affordable and agile capabilities to our clients.

Funding

Current Stage
Growth Stage
Company data provided by crunchbase