Alpha Consulting Corp. ยท 1 day ago
Data Engineer II
Charlotte, NC
Full-time
Onsite
Mid, Senior Level
$60/hr - $66/hr
5+ years expAlpha Consulting Corp. is a consulting company seeking a Data Engineer II. The role involves developing data pipelines and designing data warehousing solutions, focusing on long-term reliability and high data quality.
ConsultingPharmaceuticalStaffing Agency
Responsibilities
Where applicable, collaborate with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead) to understand requirements/use cases to outline technical scope and deliver the technical solution
Collaborate with Data and Solution architects on key technical decisions
Skilled in developing data pipelines, focusing on long-term reliability and maintaining high data quality
Design data warehousing solutions with the end-user in mind, ensuring ease of use without compromising on performance
Manage and resolve issues in production data warehouse environments on AWS
Ability to perform hands-on development and peer review for certain components/tech stack on the product
Standing up of development instances and migration path (with required security, access/roles)
Develop components and related processes (e.g., data pipelines and associated ETL processes, workflows)
Ability to build new data pipelines, identify existing data gaps, and provide automated solutions to deliver analytical capabilities and enriched data to applications
Ability to implement data pipelines with the right attentiveness to durability and data quality
Implement data warehousing products thinking of the end user's experience (ease of use with the right performance)
Qualification
Required
5+ years of AWS experience
AWS services: S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions
Experience with Kafka, preferably Confluent Kafka
Experience with Lake Formation, Amazon Redshift and Amazon Athena
Strong SQL and data modeling skills, executing ETL processes tailored for data warehousing
Competence in developing and refining data pipelines within AWS
Extensive understanding of database management fundamentals
Tools and Languages: Python (good experience in Pyspark), SQL
Infrastructure as Code technology: Terraform
DevOps pipeline (CI/CD): GitHub
Deep knowledge of IAM roles and Policies
Experience with AWS workflow orchestration tool like Airflow or Step Functions
Ability to perform hands-on development and peer review for certain components/tech stack on the product
Standing up of development instances and migration path (with required security, access/roles)
Develop components and related processes (e.g., data pipelines and associated ETL processes, workflows)
Ability to build new data pipelines, identify existing data gaps, and provide automated solutions to deliver analytical capabilities and enriched data to applications
Ability to implement data pipelines with the right attentiveness to durability and data quality
Implement data warehousing products thinking of the end user's experience (ease of use with the right performance)
Education Requirements: Associate's Degree, Bachelor's Degree, High School Diploma/GED, Master's Degree
Company
Alpha Consulting Corp.
Alpha Consulting Corp. has been exceeding expectations in the IT, pharmaceutical, and clinical staffing business since 1994.
201-500 employees
H1B Sponsorship
Alpha Consulting Corp. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (4)
2023 (3)
2021 (4)
2020 (6)
Funding
Current Stage
Growth StageCompany data provided by crunchbase