Sarah Cannon Research Institute · 4 days ago
Senior Platform Engineer
USA, Remote
Full-time
Remote
Senior Level
$129K/yr - $215K/yr
7+ years exp
Maximize your interview chancesResearch Services
Insider Connection @Sarah Cannon Research Institute
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Oversee the day-to-day operations of the Azure Databricks platform, ensuring optimal performance, security, and scalability. This includes cluster management, workload optimization, and monitoring for anomalies.
Monitor platform usage and costs, identifying opportunities for optimization and cost-saving measures. Implement strategies to optimize resource utilization and reduce unnecessary expenses.
Diagnose and resolve complex technical issues related to the Databricks platform, including performance bottlenecks, data ingestion challenges, and cluster management problems. Leverage Azure Cloud tools and services (e.g., Azure Monitor, Azure Log Analytics) for effective troubleshooting.
Develop and implement automation scripts and workflows using Azure DevOps or similar tools to streamline platform management tasks, improve efficiency, and reduce errors.
Demonstrate a strong understanding of Azure cloud services and architecture. Leverage Azure resources (e.g., Azure Storage, Azure Data Factory) to integrate Databricks with other components of the cloud infrastructure.
Ensure that the Databricks environment adheres to security best practices and complies with relevant regulations (e.g., HIPAA, GDPR). Implement security measures, such as access controls, encryption, and vulnerability management.
Work closely with data scientists, analysts, and engineers to provide technical guidance and support for their data projects. Facilitate the efficient use of the databricks platform and address their specific needs.
Stay up to date with the latest Azure and Databricks features and best practices, recommending and implementing platform enhancements to improve performance, scalability, and security.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Degree or equivalent and typically requires 7+ years of relevant experience.
BS or MS in Computer Science, Mathematics or related field
7+ years of professional experience with architecting and managing big data platforms in Azure
4+ administration experience with databricks
Familiarity with CI/CD pipelines and DevOps practices.
Experience in engineering large-scale distributed systems in a production environment
Working knowledge of SQL or other relational databases, and data warehousing principles
Strong verbal and written communication skills, including the ability to articulate complex technical concepts to non-technical stakeholders
Ability to work gracefully and effectively in high-pressure situations
Knowledge of healthcare IT systems and workflows
Preferred
Experience with Visualization tool like tableau or PowerBI is plus
Certifications in Azure or Databricks
Company
Sarah Cannon Research Institute
Sarah Cannon Research Institute is one of the world’s leading oncology research organizations conducting community-based clinical trials.
501-1,000 employees
Funding
Current Stage
Late StageLeadership Team
Deepak Bhamidipati
Assistant Director of Drug Development
Recent News
Company data provided by crunchbase
