Apply on Employer Site

Pyramid Consulting, Inc · 16 hours ago

Data Engineer II

Charlotte, NC

Contract

Hybrid

Entry, Mid Level

$60/hr - $65/hr

2+ years exp

Pyramid Consulting, Inc. is a leading Utility Industry company, and they are seeking a Data Engineer II for a contract opportunity. The role involves collaborating with developers and architects to design and maintain data pipelines and warehousing solutions, ensuring high data quality and performance.

ConsultingInformation TechnologyLegalProfessional ServicesSoftwareStaffing Agency

Growth Opportunities

H1B Sponsor Likely

Responsibilities

Where applicable, collaborate with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead) to understand requirements/use cases to outline technical scope and deliver the technical solution

Collaborate with Data and Solution architects on key technical decisions

Skilled in developing data pipelines, focusing on long-term reliability and maintaining high data quality

Design data warehousing solutions with the end-user in mind, ensuring ease of use without compromising on performance

Manage and resolve issues in production data warehouse environments on AWS

Ability to build new data pipelines, identify existing data gaps, and provide automated solutions to deliver analytical capabilities and enriched data to applications

Ability to implement data pipelines with the right attentiveness to durability and data quality

Implement data warehousing products thinking of the end user's experience (ease of use with the right performance)

Qualification

AWSPythonData pipelinesSQLTerraformKafkaData warehousingPysparkGitHubAirflow

Required

Must have skills: AWS, Python, Data pipelines

2+ years of AWS experience

AWS services: S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions

Experience with Kafka, preferably Confluent Kafka

Experience with Lake Formation, Amazon Redshift and Amazon Athena

Strong SQL and data modeling skills, executing ETL processes tailored for data warehousing

Competence in developing and refining data pipelines within AWS

Extensive understanding of database management fundamentals

Tools and Languages: Python (good experience in Pyspark), SQL

Infrastructure as Code technology: Terraform

DevOps pipeline (CI/CD): GitHub

Deep knowledge of IAM roles and Policies

Experience with AWS workflow orchestration tool like Airflow or Step Functions

Ability to perform hands-on development and peer review for certain components/tech stack on the product

Standing up of development instances and migration path (with required security, access/roles)

Develop components and related processes (e.g., data pipelines and associated ETL processes, workflows)

Ability to build new data pipelines, identify existing data gaps, and provide automated solutions to deliver analytical capabilities and enriched data to applications

Ability to implement data pipelines with the right attentiveness to durability and data quality

Implement data warehousing products thinking of the end user's experience (ease of use with the right performance)

Benefits

Health insurance (medical, dental, vision)

401(k) plan

Paid sick leave (depending on work location)

Company

Pyramid Consulting, Inc

Glassdoor4.2

Pyramid Consulting, a global leader in workforce and technology solutions, empowers individuals and organizations to transform and thrive in the most challenging and competitive markets.

Founded in 1996

Alpharetta, Georgia, USA

5001-10000 employees

https://pyramidci.com/

H1B Sponsorship

Pyramid Consulting, Inc has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (178)

2024 (112)

2023 (95)

2022 (62)

2021 (50)

2020 (117)