Infowave Systems, Inc · 1 hour ago
Senior Data Engineer with Pyspark
Rocky Hill, CT
Full-time
Onsite
Senior LevelInfowave Systems, Inc is looking for an experienced and motivated Data Engineer with expertise in PySpark to join their dynamic team. The role involves designing, building, and maintaining scalable data pipelines for efficient data processing and analytics in the healthcare domain.
Business IntelligenceInformation Technology
No H1B
Responsibilities
Design, develop, and maintain scalable ETL pipelines using PySpark to process large datasets
Collaborate with cross-functional teams (data scientists, analysts, business stakeholders) to understand data requirements and deliver high-quality solutions
Work on administrative tasks, including monitoring, troubleshooting, and optimizing data pipelines and infrastructure
Manage data integration across healthcare systems, ensuring compliance with relevant standards
Leverage SSIS for ETL development and ensure smooth data movement across different environments
Integrate and transform data from multiple sources, ensuring data quality and consistency
Handle and resolve data processing issues, ensuring minimal disruption to operations
Document best practices, processes, and workflows to maintain pipeline efficiency and scalability
Work with both relational and non-relational databases, ensuring smooth data flow and optimized performance
Qualification
Required
Strong experience in Data Engineering, with expertise in designing, building, and maintaining ETL pipelines
Strong proficiency in PySpark for large-scale data processing and transformation
Experience with ETL tools, particularly SSIS (SQL Server Integration Services)
Solid understanding of data modeling, relational databases, and data warehousing principles
Experience working with cloud-based data storage and processing technologies (AWS, GCP, or Azure)
Familiarity with healthcare data standards, such as HL7 and FHIR, is highly desirable
Proven ability in data pipeline monitoring, troubleshooting, and performance tuning
Strong communication skills and the ability to work collaboratively with cross-functional teams
Company
Infowave Systems, Inc
Infowave Systems is a leading Information Technology Solutions and Services company, providing cutting-edge software solutions to large and mid-market companies for over 20 years in Healthcare, Insurance, and Utilities.
Founded in 1998
51-200 employees
Funding
Current Stage
Growth StageLeadership Team
Ravi Obbu
Chief Executive Officer
Company data provided by crunchbase