Wall Street Consulting Services LLC · 3 hours ago
Lead Azure Data Engineer
Wall Street Consulting Services LLC is seeking an experienced Azure Data Engineer responsible for designing, developing, and maintaining cloud-based data solutions. The ideal candidate will have strong expertise in Azure Data Factory and JSON, focusing on building scalable pipelines and optimizing data workflows across Azure services.
Responsibilities
Design, build, and maintain ETL/ELT pipelines using Azure Data Factory (ADF – mandatory)
Create and manage ADF pipelines, activities, triggers, linked services, and integration runtimes
Develop and customize JSON-based ADF pipeline definitions (mandatory)
Ingest data from diverse sources (SQL, APIs, Blob, ADLS, On-premises) into Azure
Work with Azure services such as Azure SQL Database, Azure Synapse Analytics, ADLS Gen2, Databricks, etc
Implement data transformation logic using Mapping Data Flows, Databricks, or SQL
Optimize data pipelines for performance, reliability, and cost efficiency
Participate in data modeling, validation, quality checks, and CI/CD deployments (Azure DevOps)
Troubleshoot pipeline failures, performance bottlenecks, and integration issues
Ensure security best practices including access control, encryption, and monitoring
Qualification
Required
Strong hands-on experience with Azure Data Factory (MANDATORY)
Expertise in JSON for pipeline definitions, datasets, and configurations (MANDATORY)
Proficiency with Azure cloud data services (Synapse, ADLS, Key Vault, Azure SQL)
Solid understanding of ETL/ELT processes and data warehousing principles
Experience with SQL (T-SQL), stored procedures, and query optimization
Familiarity with Git, CI/CD, and Azure DevOps
Strong problem-solving and debugging skills
Good communication and documentation abilities
Company
Wall Street Consulting Services LLC
“Why wait for change? Drive it yourself!” At Wall Street the next generation IT solutions meet the next generation career opportunities.
H1B Sponsorship
Wall Street Consulting Services LLC has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (23)
2024 (28)
2023 (22)
2022 (11)
2021 (10)
2020 (5)
Funding
Current Stage
Growth StageCompany data provided by crunchbase