Sr. Data Engineer (PySpark, Azure Data Factory) jobs in United States
info-icon
This job has closed.
company-logo

ePATHUSA, Inc. · 5 days ago

Sr. Data Engineer (PySpark, Azure Data Factory)

ePATHUSA, Inc. is seeking a Sr. Data Engineer to contribute to BI development for optimizing energy operations. The role involves designing scalable data pipelines and collaborating with cross-functional teams to enhance forecasting and operational efficiency.

Cloud ComputingDatabaseInformation TechnologySoftware
check
H1B Sponsor Likelynote

Responsibilities

Engage with business users to gather requirements and translate them into comprehensive data and BI solutions
Design and implement scalable data pipelines using PySpark and Azure Data Factory , integrating with Azure Data Lake , Synapse Analytics , DataBricks , and Microsoft Fabric
Develop and optimize data models and visualizations using Power BI , ensuring performance and usability across business units
Lead modernization efforts by migrating legacy BI systems to cloud-based platforms
Collaborate with cross-functional teams to ensure alignment with architectural standards and business objectives
Oversee system testing, user acceptance testing (UAT), and production deployments
Maintain and enhance existing BI solutions, ensuring reliability and scalability
Document data flows, transformation logic, and architectural decisions
Communicate effectively with stakeholders regarding upcoming changes and coordinate change management activities

Qualification

PySparkAzure Data FactoryPower BIAzure Data ServicesAdvanced SQLDimensional modelingCloud architectureData governancePerformance optimizationSSISSSRSSSASDAXMDXPower AppsData FlowsMachine learningArtificial intelligenceAzure ML ServicesRole-based securityRow-level securityCommunication skillsCollaboration skills

Required

Minimum 10 years of experience in data engineering and BI development
Proven expertise in PySpark for data transformation and pipeline development
Extensive experience with Azure Data Services, including Data Factory, Data Lake, Synapse, Microsoft Fabric and DataBricks
Strong proficiency in Power BI dashboard development and data modeling
Solid understanding of cloud architecture, data governance, and performance optimization
Advanced SQL skills with a focus on query performance and scalability
Experience with dimensional modeling (Star and Snowflake schemas)
Excellent communication and collaboration skills in cross-functional environments
Ability to manage multiple priorities in a dynamic and fast-paced setting
Familiarity with SSIS, SSRS, and SSAS (tabular and multi-dimensional models)
Experience with DAX and MDX query languages
Exposure to Power Apps, Data Flows
Knowledge of machine learning (ML) and artificial intelligence (AI) concepts and their application in data analytics
Have worked with Azure ML Services, and understand OpenAI LLM Model
Experience implementing role-based and row-level security in BI platforms

Benefits

Medical, vision and dental
Prescription drug coverage
Calpine’s Retirement Savings Plan (401(K)) matching
Paid time off and paid parental leave
Comprehensive health programs, including our Wellness Program, telemedicine, Employee Assistance Program, Health Care and Dependents Care Flexible Spending Accounts (FSAs) and more
Life insurance
Education reimbursement program
Adoption assistance
Scholarship and vocational grant programs
Training and education opportunities
Bonus eligible

Company

ePATHUSA, Inc.

twittertwittertwitter
company-logo
ePATHUSA was founded in 2005 as a global software consulting and outsourcing company of the highest standard.

H1B Sponsorship

ePATHUSA, Inc. has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)
2024 (7)
2023 (9)
2022 (12)
2021 (16)
2020 (14)

Funding

Current Stage
Early Stage
Company data provided by crunchbase