Senior Data Engineer - Clearance Required jobs in United States
cer-icon
Apply on Employer Site
company-logo

LMI · 2 months ago

Senior Data Engineer - Clearance Required

LMI is a digital solutions provider dedicated to accelerating government impact with innovation and speed. The Senior Data Engineer will provide big data ETL support on classified data and systems to directly support Special Operations Command (SOCOM).

AnalyticsConsultingInformation TechnologyLogisticsManagement ConsultingProfessional Services
check
Comp. & Benefits
badNo H1BnoteSecurity Clearance RequirednoteU.S. Citizen Onlynote

Responsibilities

Design, develop, and implement scalable data pipelines and ETL processes using Apache Airflow
Implement and optimize Python-based data processing solutions
Utilize Trino for distributed SQL query processing
Develop messaging solutions utilizing Kafka to support real-time data streaming and event-driven architectures
Build and maintain high-performance data retrieval solutions using ElasticSearch/OpenSearch
Integrate batch and streaming data processing techniques to enhance data availability and accessibility
Ensure adherence to security and compliance requirements when working with classified data
Work closely with cross-functional teams to define data strategies and develop technical solutions aligned with mission objectives
Deploy and manage cloud-based infrastructure to support scalable and resilient data solutions, including AWS S3
Optimize data storage, retrieval, and processing efficiency, focusing on big data

Qualification

PythonSQLETLApache AirflowAWSKubernetesKafkaElasticSearch/OpenSearchApache IcebergHDFSSparkPostgresDOD experience

Required

Bachelor's degree or higher in data engineering, computer science, data science, or similar
At least 5 years of experience in data engineering or related work
Expert in Python with significant on the job experience
Advanced proficiency in SQL (especially Postgres and/or Trino) with significant on the job experience
Significant experience with big data technology and ETL
Experience with Airflow (or equivalent) as an ETL workflow technology
Experience with Kubernetes as an operating environment and Helm as infrastructure management
Experience with AWS or equivalent cloud based services (e.g. S3 or S3-like services)
Active Top Secret SCI Clearance, for which you must be a US citizen

Preferred

Experience with Postgres or Trino
Experience with Apache Iceberg, Hive, HDFS, or Spark
Previous DOD experience
Active CI Poly

Company

LMI is a consulting firm dedicated to improving the management of government.

Funding

Current Stage
Late Stage
Total Funding
$0.25M
Key Investors
Mission Daybreak
2022-09-19Grant· $0.25M
2022-07-12Private Equity
2020-12-21Acquired

Leadership Team

leader-logo
Joshua Wilson
Chief Executive Officer
linkedin
Company data provided by crunchbase