Quantum World Technologies Inc. · 12 hours ago
Azure Data Engineer
Dallas, TX
Full-time
Onsite
Senior Level
7+ years expQuantum World Technologies Inc. is seeking an Azure Data Engineer to design and implement data engineering solutions. The role involves developing scalable data pipelines, collaborating with teams to understand data requirements, and ensuring data quality and governance within Azure environments.
ConsultingHuman ResourcesInformation TechnologyStaffing Agency
Hiring Manager
Akhil Singh
Responsibilities
Design, develop and maintain scalable data pipelines and ETL processes using Python and Azure Data Factory
Collaborate with source data application teams and product owners to understand data requirements and deliver analytics solutions
Utilize Azure Data Factory and Azure Data Lake for data ingestion storage and processing
Implement data migration and transformation workflows leveraging Azure cloud services
Ensure data quality performance tuning and optimization of data pipelines
Support continuous integration and continuous deployment, CICD pipelines for data engineering projects
Apply best practices for data governance privacy and security within Azure environments
Stay updated with emerging Azure technologies and recommend improvements to existing data solutions
Lead the design and implementation of batch and streaming data pipelines using Azure Data Factory and related Azure services
Provide technical leadership and mentorship to team members on Python programming and Azure Data Factory best practices
Collaborate with DevOps teams to manage deployment monitoring and support of data engineering solutions
Troubleshoot and resolve data pipeline issues ensuring high availability and reliability
Participate in architectural discussions and contribute to the development of coding standards and security guidelines
Engage with cross-functional teams to align data engineering efforts with business objectives
Drive automation of data workflows and improve operational efficiency
Support production environments and provide timely incident response and root cause analysis
Qualification
Required
7+ years of experience in designing and implementing data engineering solutions using Python and Azure Data Factory
Design, develop and maintain scalable data pipelines and ETL processes using Python and Azure Data Factory
Collaborate with source data application teams and product owners to understand data requirements and deliver analytics solutions
Utilize Azure Data Factory and Azure Data Lake for data ingestion storage and processing
Implement data migration and transformation workflows leveraging Azure cloud services
Ensure data quality performance tuning and optimization of data pipelines
Support continuous integration and continuous deployment, CICD pipelines for data engineering projects
Apply best practices for data governance privacy and security within Azure environments
Stay updated with emerging Azure technologies and recommend improvements to existing data solutions
Lead the design and implementation of batch and streaming data pipelines using Azure Data Factory and related Azure services
Provide technical leadership and mentorship to team members on Python programming and Azure Data Factory best practices
Collaborate with DevOps teams to manage deployment monitoring and support of data engineering solutions
Troubleshoot and resolve data pipeline issues ensuring high availability and reliability
Participate in architectural discussions and contribute to the development of coding standards and security guidelines
Engage with cross-functional teams to align data engineering efforts with business objectives
Drive automation of data workflows and improve operational efficiency
Support production environments and provide timely incident response and root cause analysis
Preferred
Azure Data Lake
Company
Quantum World Technologies Inc.
QUANTUM WORLD TECHNOLOGIES INC, is a IT Consulting and Staffing venture of QUANTUM GROUP OF COMPANIES having its presence in IT and I.T.E.S, Real Estate, Hospitality, Pharmaceuticals, and Entertainment Industries across the globe, with its headquarters in Los Alamitos CA, Parsippany – NJ, Seattle – WA, Canada, Dubai and India.
501-1000 employees
Funding
Current Stage
Late StageLeadership Team
A
Ashish Srivastava
Managing Director
Company data provided by crunchbase