Brooksource · 12 hours ago
Data Engineer
Brooksource is seeking a Data Engineer to help productionalize ML and graph-driven capabilities for the Infrastructure Intelligence & Analytics initiative. The role involves building scalable pipelines and transforming raw network data into graph-ready structures while collaborating with Data Scientists to move models from prototype to production.
Responsibilities
Build and maintain scalable data pipelines using Spark (PySpark preferred)
Implement feature engineering and data transformations to support anomaly detection and graph models
Develop and manage cloud‑based infrastructure for model deployment (AWS preferred)
Collaborate on graph data construction , storage patterns, and query optimization
Implement CI/CD workflows with Git/GitLab
Write unit tests, data quality checks, and ensure reliability of production systems
Contribute to schema design, metadata strategies, and pipeline orchestration
Qualification
Required
3+ years in Data Engineering or backend engineering
Strong hands‑on experience with Python, Spark/PySpark, and SQL
Knowledge of data modeling and distributed data systems
Cloud experience, preferably AWS
Strong programming fundamentals, ideally fluency in at least two languages
Excellent communication and collaboration skills
Preferred
Experience with ML pipeline support or production ML systems
AWS certification
Ability to flex between engineering and light DS work when needed
Company
Brooksource
Brooksource is a single source for project and supplemental support through contract employment, contract-to-hire labor employment.
H1B Sponsorship
Brooksource has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2020 (10)
Funding
Current Stage
Late StageLeadership Team
Recent News
Technically Media
2025-05-27
Technically Media
2025-05-17
2025-05-06
Company data provided by crunchbase