PRI Global · 1 month ago
Cloud Data Engineer only on w2(USC or GC )
PRI Global is seeking a Cloud Data Engineer to provide production support for data engineering tasks. The role involves managing data ingestion processes and optimizing products while ensuring the integrity and performance of data workflows.
Responsibilities
Production support for Databricks notebooks, Spark streaming apps, and APIs
Ownership of Level 1 / Bronze batch ingestion for ~60 data sources
Work includes:
Data ingestion from various relational DBs or AWS → Delta Lake
Adding new tables/columns, change management, GDPR/purge processes
Product optimization: upgrades, resiliency work, performance improvements
Occasional new development for shared-service tools, not business-facing projects
Qualification
Required
Python (must have)
Spark fundamentals (architecture, DataFrames, Spark SQL)
Databricks experience
Relational DB experience (Oracle, SQL Server, Postgres; not a DBA)
Understanding of Delta Lake
Preferred
Spark streaming
API development experience
Azure experience preferred; AWS acceptable
Scala not required
Company
PRI Global
PRI Global provides business intelligence, cyber security, IoT, analytics, physical security and cloud services.