Shield Consulting Solutions, Inc. · 2 hours ago
Senior Software Engineer, Data Platforms
Annapolis Junction, MD
Full-time
Onsite
Senior Level
$230K/yr - $240K/yr
7+ years expShield Consulting Solutions, Inc. is seeking a Senior Software Engineer specializing in Data Platforms. The role involves designing, implementing, and optimizing data pathways for efficient and reliable processing of analytics workloads.
ConsultingInformation ServicesInformation TechnologySoftware
No H1B
Security Clearance RequiredU.S. Citizen Only
Responsibilities
Possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing
In this role, the Software Engineer will be responsible for designing, implementing, and optimizing data ingress and egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads
Qualification
Required
Active TS/SCI w/Polygraph REQUIRED
7 years of experience as a software engineer
Bachelor's degree in a technical discipline
2 additional years of experience as a software engineer may be substituted for a degree
possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing
Experience using the Linux CLI and Linux tools
Experience developing Bash scripts to automate manual processes
Recent software development experience using Python and Java
Experience with Distributed Big Data processing engines including Apache Spark
Experience using Jupyter Notebook
Experience with data wrangling and preprocessing using tools such as pandas, NumPy
Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
Familiarity with data quality concepts, data validation, and anomaly detection
Experience with Git Source Control System
Preferred
Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
Familiar with HPC Job Scheduling tools including Slurm
Experience using the Atlassian Tool Suite (JIRA, Confluence)
Benefits
25 days PTO
11 paid holidays
100% employer-paid healthcare for employees and dependents – available day 1
8% 401(k) employer match – immediate vesting
Company
Shield Consulting Solutions, Inc.
Shield Consulting Solutions Incorporated is a veteran-owned small government contractor that was formed in 2002 with the idea that a small company can provide affordable and agile capabilities to our clients.
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase