Unity Catalog Platform Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Apolis · 13 hours ago

Unity Catalog Platform Engineer

positionUnited States
timeFull-time
remoteRemote
seniorityMid Level
money$70/hr - $72/hr

Apolis is seeking a Unity Catalog Platform Engineer to be responsible for provisioning data through Unity Catalog by implementing technical backend solutions and managing governance requirements. The role includes streamlining data processes and collaborating with cross-functional teams to ensure data integrity and compliance.

ConsultingEnterprise ApplicationsEnterprise Resource Planning (ERP)Information TechnologyIT InfrastructureIT ManagementMobileSoftwareWeb Hosting
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Implement data provisioning patterns based on business requirements, following follow predefined processes, policies, standards, and metadata management rules
Create and manage distributed workspaces in Databricks, set up workspace policies, provision Databricks clusters and manage data infrastructure sizing and capacity
Create Python notebooks, implement data masking processes, create UDFs (SQL/Python), troubleshoot data pipelines
Ensure data security and compliance with regulations using Databricks and Privacera's features
Navigate multi-step enterprise approval process across architecture, security, and governance teams
Design and implement data architecture leveraging technologies such as Databricks, Unity Catalog, Privacera, and Collibra
Develop, optimize, and manage data pipelines for ETL processes using Databricks, with a focus on data integrity and quality
Design and maintain data models and schemas, incorporating Unity Catalog and Collibra data governance practices
Establish a robust data governance strategy, defining standards, metadata management, lineage, and quality practices
Operationalize Machine Learning models in Batch and Real Time Data Pipelines, leveraging relevant governance setups
Collaborate with cross-functional teams including data scientists, engineers, and analysts to translate business requirements into scalable solutions

Qualification

Unity CatalogDatabricks developmentData engineeringSQLPythonScriptingAutomationAzure infrastructure provisioningData security managementData governance frameworksMetadata modelingData architectureData discovery solutionsCollaboration

Required

Unity Catalog
Databricks development and programming
Data engineering, SQL, Python
Scripting and automation
Privacera data security and access control management
Azure infrastructure provisioning
Familiar with data requirements of common ML/AI use cases
Awareness of data governance frameworks, enterprise data compliance requirements, metadata modeling, data architecture, and enterprise-scale data discovery solutions

Company

Apolis

twittertwittertwitter
Glassdoor4.2
company-logo
Apolis is a IT consultancy that offers provides ERP solutions, hosting, assessment, web and mobile, IT staffing and IT workforce solutions.
dateFounded in 1996
location
El Segundo, California, USA
people-size501-1000 employees
web-link
https://apolisrises.com/

H1B Sponsorship

Apolis has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (15)
2022 (15)
2021 (12)
2020 (122)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Amar Shokeen
President/ CEO
linkedin
leader-logo
Rita Shokeen
COO
linkedin
Company data provided by crunchbase