New York Technology Partners ยท 19 hours ago
Data Engineer Lead (Only W2 or Selfcorp)
New York Technology Partners is a mission-driven organization supporting a vital medical professional community, and they are seeking a Data Engineer Lead to join its Data Governance and Analytics team. This role focuses on building and optimizing scalable data pipelines, enabling advanced analytics and machine learning models, and supporting enterprise data governance standards.
Responsibilities
Design and optimize scalable data pipelines for analytics, AI/ML, and BI workloads
Implement ETL/ELT solutions for multi-source data ingestion and transformation
Drive DevOps adoption with CI/CD automation and Infrastructure as Code
Manage and optimize Azure cloud data storage for cost and performance
Ensure data quality, integrity, and compliance with governance standards
Collaborate with architects, analysts, and business stakeholders to deliver data-driven solutions
Mentor junior engineers and foster continuous improvement
Evaluate emerging technologies to enhance scalability and innovation
Qualification
Required
Bachelor's degree in Computer Science, Engineering, or related field
7+ years building enterprise-level data solutions on cloud platforms
Proven expertise in Databricks, Azure, Python, SQL, and Apache Spark
Strong experience with CI/CD automation and DevOps practices
Familiarity with data governance frameworks and security compliance
Excellent collaboration and communication skills
Preferred
Experience in Non-Profit, Associations, or Mission Driven Organizations
Company
New York Technology Partners
New York Technology Partners is an information technology company that provides IT and engineering services.