Zapata Technology · 7 hours ago
Software / Data Engineer (1451) (Remote)
United States
Full-time
Remote
Mid Level
4+ years expZapata Technology is seeking an experienced Software / Data Engineer for a remote role for west coast hours. The Data Engineer will lead the transformation of our data infrastructure, utilizing a custom ASP.NET application and Postgres stored procedures to build and manage ETL processes.
Government
No H1B
Security Clearance RequiredU.S. Citizen Only
Responsibilities
Design and develop modular ETL solutions that facilitate data ingestion and delivery across various systems, utilizing custom ASP.NET applications and Postgres stored procedures
Develop and maintain scalable data storage systems, focusing on Postgres or other relational databases, to support efficient data retrieval and transformation processes
Develop optimized SQL queries and stored procedures that process and transform both structured and unstructured data, ensuring performance and reliability in data handling
Build and manage data pipelines tailored for reporting and analytics, leveraging custom scripting rather than relying on third-party ETL tools to maintain flexibility and control
Collaborate with cross-functional teams to understand data requirements and implement custom data solutions that support the organization’s analytics and reporting needs
Create custom scripts and applications to enhance data transformation capabilities and address specific data management requirements
Document data ingestion and transformation processes thoroughly, ensuring compliance with data governance frameworks, including HRPP, Privacy, HIPAA, and SOP guidelines
Perform quality assurance tasks to validate data accuracy and troubleshoot data quality issues, upholding system integrity and reliability
Support metadata management practices, ensuring all data processes comply with governance standards and industry best practices
Qualification
Required
Design and develop modular ETL solutions that facilitate data ingestion and delivery across various systems, utilizing custom ASP.NET applications and Postgres stored procedures
Develop and maintain scalable data storage systems, focusing on Postgres or other relational databases, to support efficient data retrieval and transformation processes
Develop optimized SQL queries and stored procedures that process and transform both structured and unstructured data, ensuring performance and reliability in data handling
Build and manage data pipelines tailored for reporting and analytics, leveraging custom scripting rather than relying on third-party ETL tools to maintain flexibility and control
Collaborate with cross-functional teams to understand data requirements and implement custom data solutions that support the organization's analytics and reporting needs
Create custom scripts and applications to enhance data transformation capabilities and address specific data management requirements
Document data ingestion and transformation processes thoroughly, ensuring compliance with data governance frameworks, including HRPP, Privacy, HIPAA, and SOP guidelines
Perform quality assurance tasks to validate data accuracy and troubleshoot data quality issues, upholding system integrity and reliability
Support metadata management practices, ensuring all data processes comply with governance standards and industry best practices
4+ years of Software Development
This position requires an active Secret clearance with the ability to obtain TS/SCI
Preferred
Experience with Python, ASP.NET, C#, and related web application development frameworks
Advanced knowledge of Postgres, particularly in writing complex stored procedures, query optimization, and transitioning data infrastructure to Postgres
Strong familiarity with AWS cloud environments, with experience in migrating data systems to AWS
Experience with low-code/no-code platforms and distributed data processing tools such as Spark, Databricks, or similar
Knowledge of real-time data processing, streaming applications, and data warehousing concepts, especially in cloud-native environments
Proficiency in shell scripting and automation to support cloud migrations and system integrations
Experience working in Agile methodologies, particularly within cloud-based or hybrid cloud environments
Requires Security+ Certification
Company
Zapata Technology
We save lives. We solve mission-critical problems for the U.S. Federal market.
51-200 employees
Funding
Current Stage
Growth StageLeadership Team
Andrew "Drew" Scholefield
Chief Information Security Officer
Christina Hall
Chief Human Resources Officer
Company data provided by crunchbase