Brooksource · 16 hours ago
Data Engineer II
United States
Full-time
Remote
Entry, Mid Level
$95K/yr - $105K/yr
1+ years expBrooksource is seeking a mid-level Data Engineer to join their Fortune 500 Healthcare Clients AI's organization. This role involves building and maintaining scalable data pipelines on Databricks, supporting AI/ML use cases, and collaborating with cross-functional teams in an Agile environment.
EmploymentHuman ResourcesInformation Technology
Responsibilities
Build, enhance, and maintain ETL processes and data pipelines using Databricks
Perform data engineering using Apache Spark, Delta Live Tables (DLT), and Lakeflow
Support development and maintenance of vector databases used in RAG architectures for GenAI
Implement and maintain data quality checks, validation rules, and monitoring processes
Ensure reliable and timely data delivery for AI/ML workloads
Contribute to Git-backed pipelines and follow version control best practices
Participate in Scrum/Agile ceremonies and collaborate within a DevOps-oriented team
Qualification
Required
1–3 years of experience in data engineering or a closely related role
Python
Apache Spark (Top Priority)
Databricks (Key requirement)
Experience with DLT, Lakeflow, and Databricks-based data engineering
SQL
Git (all pipelines are Git-backed)
Experience with data pipeline orchestration
Experience using ETL frameworks
Familiarity with Scrum / Agile / DevOps methodologies
Preferred
Technical undergraduate degree (Computer Science, Engineering, or related field)
Candidates with a data science background transitioning into data engineering are welcome
Understanding of parallel processing concepts
Experience building ETL pipelines from source systems into Databricks
Exposure to AI/ML data pipelines, GenAI platforms, or RAG workflows
Company
Brooksource
Brooksource is a single source for project and supplemental support through contract employment, contract-to-hire labor employment.
1001-5000 employees
H1B Sponsorship
Brooksource has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2020 (10)
Funding
Current Stage
Late StageLeadership Team
Ashley Cigolotti
Director, Global Partnerships
Matt Ayala
National Account Executive (Global Partnerships)
Recent News
Technically Media
2025-05-27
Technically Media
2025-05-17
2025-05-06
Company data provided by crunchbase