Diligente Technologies · 1 week ago
Lead / Data Engineer- AI/ML
Palo Alto, CA
Full-time
Hybrid
Mid, Senior Level
2+ years expDiligente Technologies is focused on building solutions incorporating Artificial Intelligence for healthcare. The Data Engineer will design, implement, and support data processing software and infrastructure, working closely with the Data Science team to enhance patient outcomes through innovative data solutions.
ConsultingRecruitingStaffing Agency
Hiring Manager
Gaurav P.
Responsibilities
Build end-to-end data pipelines and infrastructure for ML models used by the Data Science team and others at SHC
Understand the requirements of data processing and analysis pipelines and make appropriate technical design and interface decisions. Elucidating these requirements will require training, developing, and validating researcher-built or vendor provided machine learning algorithms on hospital data as well as working with other members of the data science team
Understand data flows among the SHC applications and use this knowledge to make recommendations and design decisions for languages, tools, and platforms used in software and data projects
Troubleshoot and debug environment and infrastructure problems found in production and non-production environments for projects by the Data Science Team
Work with other groups at SHC and the Technology and Digital Solutions (TDS) group to ensure servers and system maintenance based on updates, system requirements, data usage, and security requirements
Qualification
Required
Bachelor's or Master's degree in Computer Science, Engineering, or related, or equivalent working experience
2+ years' experience in building data infrastructure for analytics teams, including ability to write code in SQL, R, or Python for processing large datasets in distributed cloud environments
Experience with cloud deployment strategies and CI/CD
Experience building and working with data infrastructure in a SaaS environment
Build end-to-end data pipelines and infrastructure for ML models used by the Data Science team and others at SHC
Understand the requirements of data processing and analysis pipelines and make appropriate technical design and interface decisions
Understand data flows among the SHC applications and use this knowledge to make recommendations and design decisions for languages, tools, and platforms used in software and data projects
Troubleshoot and debug environment and infrastructure problems found in production and non-production environments for projects by the Data Science Team
Work with other groups at SHC and the Technology and Digital Solutions (TDS) group to ensure servers and system maintenance based on updates, system requirements, data usage, and security requirements
Preferred
Knowledge of multiple programming languages, commitment to choosing languages based on project-specific requirements, and willingness to learn new programming languages as necessary
Knowledge of resource management and automation approaches such as workflow runners
Collaborative mentality and excitement for iterative design working closely with the Data Science team
Company
Diligente Technologies
Diligente Technologies provides recruiting and staffing as well as IT consulting services for organizations.
51-200 employees
H1B Sponsorship
Diligente Technologies has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2020 (2)
Funding
Current Stage
Growth StageLeadership Team
Rohita Joshi
CEO and Founder
Company data provided by crunchbase