ChatGPT Jobs · 2 weeks ago
AI Data Engineer
ChatGPT Jobs is a company focused on shaping the future of healthcare through AI technology. They are seeking an AI Data Engineer responsible for managing the entire data lifecycle for healthcare datasets to support LLMs and machine learning models.
Computer Software
Responsibilities
Collaborate with data scientists and machine learning engineers to understand data requirements for LLM and machine learning model fine-tuning
Design, build, and maintain scalable data pipelines to ingest, process, and store massive and diverse healthcare datasets
Implement robust data validation and monitoring to ensure the integrity, accuracy, and consistency of all training datasets
Implement robust data cleaning, validation, and transformation processes to ensure data quality and integrity
Develop and optimize data structures and schemas for efficient access and utilization by LLMs and machine learning models
Work with the team to identify and acquire new data sources, ensuring compliance with relevant healthcare regulations (e.g., HIPAA)
Monitor data pipeline performance, troubleshoot issues, and implement optimizations to improve efficiency and reliability
Document data engineering processes, data models, and data dictionaries
Stay up-to-date with the latest advancements in data engineering, big data technologies, and machine learning
Qualification
Required
Bachelor's degree in Computer Science, Engineering, or a related field
Proven experience as a Data Engineer, with a focus on big data technologies
Strong proficiency in programming languages such as Python, Scala, or Java
Extensive experience with data warehousing, ETL processes, and data modeling
Experience with major cloud providers (e.g., AWS, GCP, Azure) and their data storage and processing services
Hands-on experience with big data frameworks like Apache Spark for distributed processing
Excellent problem-solving skills and the ability to work independently and as part of a team
Strong communication and interpersonal skills
Must be a US Citizen, Green Card holder, or currently in the US have valid H1B visa
Preferred
Master's degree in a related field
Experience with healthcare data and a good understanding of healthcare data standards (e.g., FHIR, HL7)
Familiarity with machine learning concepts and LLM fine-tuning processes
Experience with data orchestration tools (e.g., Apache Airflow)
Benefits
Competitive salary and benefits package.
Flexible working arrangements (remote or hybrid options available).
The opportunity to work on life-changing AI technology that directly impacts patient outcomes.
Join a team that combines cutting-edge innovation with a mission to save lives and improve health equity.
Continuous learning opportunities with access to the latest tools and advancements in AI and healthcare.
Company
ChatGPT Jobs
We find the best job offers for experts in ChatGPT and related technologies.
Funding
Current Stage
Early StageCompany data provided by crunchbase