Apply on Employer Site

New York Technology Partners · 1 day ago

Azure Data Engineer

Houston, TX

Contract

Hybrid

Mid Level

New York Technology Partners is seeking an Azure Data Engineer to join a high-impact project modernizing business data into a cloud-native architecture. This role focuses on building complex, scalable end-to-end pipelines using Azure Data Factory and Databricks to deliver BI insights and advanced analytics.

ConsultingInformation TechnologySoftwareStaffing Agency

H1B Sponsor Likely

Hiring Manager

Aditya Jain

Responsibilities

Design and develop end-to-end scalable pipelines in Azure Data Factory for seamless data ingestion into Azure Data Lake Storage (ADLS)

Build and implement robust ETL processes to move data across environments while ensuring data integrity and high availability

Optimize pipelines to handle time-series data and support real-time analytics requirements

Build curated datasets within Databricks using PySpark and SQL, applying complex pivot logic and aggregations

Enhance data management by extracting data from multiple disparate sources and transforming it for downstream AI and BI consumption

Write complex SQL queries from scratch and develop reusable Python/PySpark scripts for data transformation

Support the transition of legacy digital data to a modern cloud structure within the complete Azure ecosystem

Work closely with BI and AI teams to ensure curated data meets the requirements for advanced analytics and insights

Leverage or integrate with Microsoft Fabric to further streamline the data engineering workspace

Qualification

Azure Data FactoryDatabricksPySparkSQLOil & Gas

Required

Experience with complex, scalable ingestion pipelines in Azure Data Factory

Expert-level PySpark, SQL, and curated dataset building in Databricks

Proven ability to write high-performance SQL queries from scratch

Preferred

Leverage or integrate with Microsoft Fabric to further streamline the data engineering workspace

Company

New York Technology Partners

New York Technology Partners is an information technology company that provides IT and engineering services.

Founded in 1999

Iselin, New Jersey, USA

201-500 employees

http://nytp.com

H1B Sponsorship

New York Technology Partners has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (52)

2024 (74)

2023 (59)

2022 (104)

2021 (74)

2020 (115)

Funding

Current Stage

Growth Stage

Leadership Team

Amy Reynolds

Senior Talent Acquisition Partner

Hetal Shah

Technical Recruiter at New York Technology Partners

Company data provided by crunchbase