Cypress HCM ยท 16 hours ago
Data Platform Engineer
Cypress HCM is seeking a Data Platform Engineer to join their IDS Data Platform team. The role involves setting up and maintaining production-scale Databricks environments, managing data storage platforms, and providing mentorship to the team while ensuring security compliance and exploring GenAI technologies.
Human ResourcesInformation TechnologyStaffing Agency
Responsibilities
Setup and maintain production-scale Databricks environments on public cloud platforms such as Microsoft Azure and AWS
Handle production-scale data storage platforms like ADLS and S3 for multiple tenant teams within our Data Platform
Coordinate production-scale microservices that support the daily operations of our data platform, including job scheduling, security, financial, and administrative services
Maintain enterprise-scale SQL Server and SSAS environments
Provide triage and mentorship to the team on various support issues raised by our tenants
Develop tools and automation solutions for configuration management, service deployments, monitoring, and alerting
Ensure security and privacy compliance, implementing Adobe Security & Compliance solutions to secure data in our data lake
Explore GenAI technologies to integrate technical improvements and improve user experience
Collaborate with various 3rd party vendors to resolve issues, conduct proof of concepts, and improve our product
Qualification
Required
AWS
Azure
ADLS Gen2
S3
MongoDB
Vector Databases
Langchain
Databricks
SQL Server & SSAS
Airflow
Azure Kubernetes Service or Elastic Kubernetes Service
DBX System Tables
Prometheus
Splunk
MLFlow
Linux Servers
Kubernetes Environment
Jira
Service Now
BS or equivalent experience in Computer Science, Computer Engineering, or a similar field