ALLSTARSIT ยท 2 months ago
Middle Data Engineer
United States
Full-time
Remote
Mid Level
3+ years expAllStars-IT is an international outstaffing service provider founded in 2004, dedicated to bridging the gap between companies and skilled professionals. They are seeking a Mid-Level Data Engineer to design, build, and optimize scalable data pipelines, ensuring data reliability and contributing to machine learning solutions.
Information Technology & Services
Responsibilities
Design, build, and maintain data pipelines using PySpark and AWS services
Deliver production-grade data solutions that are accurate, efficient, and reliable
Develop automated testing and QA systems to ensure data quality
Integrate ML, MLflow, and LLM-based workflows into existing data pipelines
Troubleshoot and resolve complex pipeline and performance issues
Work closely with Product Managers and Analysts to define release quality and readiness standards
Follow and promote best practices in data engineering, QA, and documentation
Qualification
Required
3+ years of professional experience as a Data Engineer
Strong hands-on experience with PySpark, Python, and SQL
Proven experience with AWS frameworks (e.g., S3, Glue, Redshift, Lambda)
Knowledge of automated testing, data QA, and performance optimization
Excellent communication skills in English and ability to work cross-functionally in global teams
Preferred
Experience with Databricks (DBX)
Familiarity with big data and data lake architectures
Understanding of CI/CD pipelines and DevOps practices
Experience with MLflow or exposure to LLM-based solutions
Knowledge of data governance and monitoring frameworks
Company
ALLSTARSIT
ALLSTARSIT is a global outstaffing service provider with operations in 25+ locations across four continents.
501-1000 employees
Funding
Current Stage
Late StageLeadership Team
Solomon Amar
Company Owner & CEO
Esma Gulordava
HR Business Partner
Recent News
Company data provided by crunchbase