Openmind Technologies Inc. · 12 hours ago
Lead Data Engineer - Capital Finance
Openmind Technologies Inc. is seeking an experienced Data Engineering Lead to drive large-scale data initiatives for a Private Equity firm based in New York. This hands-on leadership role involves architecting, building, and leading modern data platforms on Azure Databricks while managing an offshore delivery team.
ConsultingSoftwareInformation TechnologySmall and Medium Businesses
Responsibilities
Act as the onsite lead and primary point of contact for data engineering initiatives
Manage and mentor an offshore team of 5–7 data engineers and data testers, ensuring delivery quality and timelines
Architect and implement robust, scalable data pipelines using PySpark and SQL
Define and enforce best practices for data engineering, performance optimization, and data quality
Work closely with data architects and stakeholders to align data solutions with enterprise data architecture
Leverage Unity Catalog for data governance, security, and access control
Collaborate with business users, analysts, and leadership to translate business requirements into technical solutions
Qualification
Required
15+ years of experience delivering large-scale data programs in enterprise environments
Databricks Certified Data Engineer with 5+ years of experience leading Azure Databricks programs
Strong hands-on experience with PySpark, including 5+ years delivering production-grade data pipelines
Solid working knowledge of Unity Catalog and modern data governance practices
Strong understanding of data architecture principles, including data lakes, lakehouse patterns, and ETL/ELT design
Advanced SQL skills for data transformation, analysis, and optimization
Proven experience managing offshore teams of data engineers and data testers
Excellent communication skills with the ability to engage both technical and non-technical stakeholders
Preferred
Experience working on Private Equity or Capital Markets data programs
Exposure to investment, portfolio, deal, or financial data domains
Prior experience in regulated or high-performance data environments
Company
Openmind Technologies Inc.
Openmind Technologies Inc, a premier TIER 1 Software Consulting services and solutions company head quatered in heart of Silicon Valley California offers a world class combination of people, coverage, process and technology that makes us an employer of choice among companies.
H1B Sponsorship
Openmind Technologies Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (5)
2021 (1)
2020 (1)
Funding
Current Stage
Growth StageCompany data provided by crunchbase