Apply on Employer Site

OKAYA INFOCOM · 1 day ago

Foundry Data Engineer / Architect

Oakland, CA

Full-time

Onsite

Mid, Senior Level

3+ years exp

OKAYA INFOCOM is seeking a skilled Palantir Foundry Data Engineer / Architect to design, implement, and optimize data solutions for the utility industry. The role involves building data pipelines, ensuring data quality, and collaborating with cross-functional teams to support advanced analytics and operational insights.

ConsultingInformation TechnologySoftware

Hiring Manager

Anmol Rathor

Responsibilities

Build and optimize ETL workflows in Palantir Foundry for ingesting data from SCADA, AMI, GIS, OMS, and ERP systems

Develop scalable pipelines for real-time sensor data and IoT streams

Implement data transformations and enrichment to support analytics and reporting

Integrate structured and unstructured data sources into Foundry

Automate data ingestion and validation processes to ensure accuracy and timeliness

Collaborate with IT and OT teams to bridge operational and enterprise data systems

Monitor and maintain data integrity across all pipelines

Apply data governance standards and ensure compliance with NERC CIP, FERC, and state regulations

Implement robust security and access controls within Foundry

Work closely with data scientists, analysts, and business teams to deliver reliable datasets for predictive analytics and reporting

Provide technical support and documentation for Foundry workflows

Optimize workflows for high-volume, high-velocity data

Troubleshoot and resolve pipeline failures and performance bottlenecks

Architect scalable data platforms in Palantir Foundry to support grid operations, outage management, asset health monitoring, and energy forecasting

Design workflows and pipelines for real-time and batch data ingestion from SCADA, AMI, GIS, and ERP systems

Ensure compliance with NERC, FERC, and state regulatory standards

Integrate diverse data sources (structured, semi-structured, unstructured) into Foundry

Develop custom applications and workflows using Foundry’s APIs and frameworks

Collaborate with engineering teams to implement best practices for data ingestion and transformation

Establish data governance standards, access controls, and compliance frameworks

Ensure adherence to regulatory requirements (GDPR, CCPA, etc.) and internal policies

Work closely with business analysts, data scientists, and operations teams to translate requirements into technical solutions

Provide technical guidance and mentorship to junior team members

Monitor and optimize data pipelines for efficiency and reliability

Troubleshoot and resolve issues related to data quality, latency, and system performance

Optimize data pipelines for high-volume sensor data and IoT streams

Qualification

Palantir FoundryData integrationPythonSQLCloud platformsContainerizationData governanceAnalytical skillsStakeholder managementProblem-solvingCommunicationTeam collaboration