Apply on Employer Site

VARITE INC · 1 month ago

Data Platform Engineer

San Jose, CA

Full-time

Hybrid

Mid Level

$70/hr - $79.56/hr

VARITE INC is a company that specializes in data solutions, and they are seeking a Data Platform Engineer. The role involves setting up and maintaining production-scale environments, managing data storage platforms, and ensuring compliance with security standards.

Information Technology & Services

Growth Opportunities

Responsibilities

Set up and maintain production-scale Databricks' environments on public cloud platforms such as Microsoft Azure and AWS

Handle production-scale data storage platforms like ADLS and S3 for multiple tenant teams within our Data Platform

Coordinate production-scale microservices that support the daily operations of our data platform, including job scheduling, security, financial, and administrative services

Maintain enterprise-scale SQL Server and SSAS environments

Provide triage and mentorship to the team on various support issues raised by our tenants

Develop tools and automation solutions for configuration management, service deployments, monitoring, and alerting

Ensure security and privacy compliance, implementing client's Security & Compliance solutions to secure data in our data lake

Explore GenAI technologies to integrate technical improvements and improve user experience

Collaborate with various 3rd party vendors to resolve issues, conduct proof of concepts, and improve our product

Qualification

AWSAzureDatabricksSQL Server & SSASADLS Gen2S3MongoDBVector DatabasesLangchainAirflowAzure Kubernetes ServiceElastic Kubernetes ServicePrometheusSplunkMLFlowLinux ServersKubernetes EnvironmentJiraService NowComputer Science Degree

Required

Set up and maintain production-scale Databricks' environments on public cloud platforms such as Microsoft Azure and AWS

Handle production-scale data storage platforms like ADLS and S3 for multiple tenant teams within our Data Platform

Coordinate production-scale microservices that support the daily operations of our data platform, including job scheduling, security, financial, and administrative services

Maintain enterprise-scale SQL Server and SSAS environments

Provide triage and mentorship to the team on various support issues raised by our tenants

Develop tools and automation solutions for configuration management, service deployments, monitoring, and alerting

Ensure security and privacy compliance, implementing client's Security & Compliance solutions to secure data in our data lake

Explore GenAI technologies to integrate technical improvements and improve user experience

Collaborate with various 3rd party vendors to resolve issues, conduct proof of concepts, and improve our product

AWS

Azure

ADLS Gen2

MongoDB

Vector Databases

Langchain