Pyramid Consulting, Inc ยท 21 hours ago
Data Engineer
Pyramid Consulting, Inc is a leading company in the Pharmaceutical Industry, and they are seeking a talented Data Engineer for a contract opportunity. The role involves designing and optimizing data pipelines, building ETL workflows, and collaborating with various stakeholders to ensure data quality and performance.
ConsultingInformation TechnologyLegalProfessional ServicesSoftwareStaffing Agency
Responsibilities
Design, develop, and optimize end-to-end data pipelines using Python and PySpark
Build and maintain ETL/ELT workflows to process structured and semi-structured data
Write complex SQL queries for data transformation, validation, and performance optimization
Develop scalable data solutions using Azure services such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, and Databricks
Ensure data quality, reliability, and performance across data platforms
Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements
Implement best practices for data governance, security, and compliance
Monitor and troubleshoot data pipeline failures and performance issues
Support production deployments and ongoing enhancements
Qualification
Required
Data Engineer
Azure
Python
PySpark
Strong proficiency in SQL for querying and data modeling
Hands-on experience with Python for data processing and automation
Solid experience using PySpark for distributed data processing
Experience working with Microsoft Azure data services
Understanding of data warehousing concepts and big data architectures
Experience with batch and/or real-time data processing
Ability to work independently and within cross-functional teams
Experience with Azure Databricks
Knowledge of data modelling techniques (star/snowflake schemas)
Familiarity with CI/CD pipelines and version control tools (Git)
Exposure to data security, access control, and compliance standards
Experience with streaming technologies
Knowledge of DevOps or DataOps practices
Preferred
Cloud certifications (Azure preferred)
Benefits
Health insurance (medical, dental, vision)
401(k) plan
Paid sick leave (depending on work location)
Company
Pyramid Consulting, Inc
Pyramid Consulting, a global leader in workforce and technology solutions, empowers individuals and organizations to transform and thrive in the most challenging and competitive markets.
H1B Sponsorship
Pyramid Consulting, Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (178)
2024 (112)
2023 (95)
2022 (62)
2021 (50)
2020 (117)
Funding
Current Stage
Late StageRecent News
2025-08-18
Company data provided by crunchbase