Data Engineer with Apache Spark, PySpark, Python, and SQL jobs in United States
cer-icon
Apply on Employer Site
company-logo

Peraton · 1 month ago

Data Engineer with Apache Spark, PySpark, Python, and SQL

Peraton is a next-generation national security company that drives missions of consequence spanning the globe. They are seeking an experienced Data Engineer to lead the development of a robust data infrastructure supporting global military logistics and strategic decision-making.

Information TechnologyRobotics
badNo H1BnoteSecurity Clearance RequirednoteU.S. Citizen Onlynote

Responsibilities

Architect and optimize data infrastructure for mission-critical areas such as time-series forecasting, aerial refueling analysis, and transportation planning
Build scalable data pipelines that transform raw inputs into high-value assets for analysts and data scientists
Design and evolve data schemas and ontologies to support seamless integration into platforms like Palantir Foundry
Leverage distributed processing tools (e.g., PySpark) to streamline data ingestion from diverse sources
Implement proactive data health monitoring to ensure accuracy, consistency, and reliability
Collaborate across teams to understand analytical needs and deliver tailored data solutions
Stay ahead of emerging technologies and continuously improve system performance and resilience
Ensure compliance with data governance and security protocols while maintaining clear documentation

Qualification

Apache SparkPySparkPythonSQLData architectureCloud platformsETL technologiesNoSQL databasesTroubleshootingCommunication skillsCollaboration

Required

U.S. citizenship and ability to obtain a Secret clearance (interim Secret clearance required to begin)
BS/BA with 8+ years, MS/MA with 6+ years, or PhD with 3+ years in Data Engineering, Computer Science, or related field
Proven experience designing and implementing enterprise-level data architecture and ontologies
Expertise in Apache Spark, PySpark, Python, and SQL
Strong background in cloud platforms, distributed data systems, and ETL/MDM technologies
Familiarity with both SQL and NoSQL databases and backend development
Excellent communication skills and ability to translate complex requirements into practical solutions
Demonstrated ability to troubleshoot independently, prioritize effectively, and collaborate across divisions

Preferred

Experience developing ontologies within Palantir Foundry
Active DoD Secret clearance
Familiarity with USTRANSCOM or Department of Defense logistics operations

Benefits

Medical
Dental
Vision
Life
Health savings account
Short/long term disability
EAP
Parental leave
401(k)
Paid time off (PTO) for vacation
Company paid holidays

Company

Peraton Fearlessly solving the toughest national security challenges.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Thomas Terjesen
Chief Information Officer
linkedin
Company data provided by crunchbase