200+ applicantsPosted by Agency
People In AI ยท 2 days ago
Senior Data Engineer
San Francisco Bay Area
Full-time
Hybrid
Senior Level
$220K/yr - $720K/yr
Wonder how qualified you are to the job?
Maximize your interview chancesStaffing and Recruiting
Hiring Manager
Sam Jones
Insider Connection @People In AI
Responsibilities
Collaborate closely with machine learning teams to understand their data needs and provide robust data solutions.
Develop and maintain data pipelines using Apache Spark for large-scale data processing.
Implement real-time data processing solutions using streaming technologies like Apache Kafka or Apache Flink.
Optimize and manage feature stores to ensure efficient data access for machine learning models.
Perform feature engineering to prepare data for training and serving machine learning models.
Ensure data quality, reliability, and performance across all data engineering processes.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Proven experience in data engineering, with a focus on big data technologies.
Expertise in Apache Spark and big data feature engineering.
Hands-on experience with real-time data processing and streaming technologies (e.g., Apache Kafka, Apache Flink).
Strong understanding of feature stores and their optimization.
Ability to work effectively within machine learning teams and contribute to their success.
Excellent problem-solving skills and attention to detail.
Preferred
Experience in AI or machine learning projects.
Familiarity with cloud-based data solutions (e.g., AWS, GCP, Azure).
Strong programming skills in languages such as Python or Scala.
Benefits
Equity (4 year vest + annual refreshers)
Company
People In AI
Welcome to People in AI, your staffing partner committed to facilitating connections between exceptional AI talent and transformative companies.
Founded in 2023
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase
