Senior Data Engineer - Contractor jobs in United States
cer-icon
Apply on Employer Site
company-logo

Wavicle Data Solutions · 17 hours ago

Senior Data Engineer - Contractor

Wavicle Data Solutions is a high-growth consulting firm focused on cloud, data, and AI solutions. They are seeking a Senior Data Engineer to build and improve data pipelines using advanced technologies, particularly within the AWS ecosystem.

AnalyticsArtificial Intelligence (AI)Information TechnologyRestaurants
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of sources like Hadoop, Spark, AWS Lambda, etc
Experience with AWS Cloud on Data Integration with Apache Spark, EMR, Glue, Kafka, Kinesis and Lambda in S3, Redshift, RDS, and MongoDB/DynamoDB ecosystems
Strong real-life experience in Python development, especially in PySpark in AWS Cloud environment
Design, develop, test, deploy, maintain and improve data integration pipeline
Develop pipeline objects using Apache Spark / Pyspark / Python or Scala
Design and develop data pipeline architectures using Hadoop, Spark and related AWS Services
Load and performance test data pipelines built using the above-mentioned technologies

Qualification

AWS CloudPythonApache SparkETL pipeline implementationSQLData warehousing solutionsDBTTroubleshooting skillsAutomation of data workflowsProblem solving

Required

Bachelor or Master's degree in Computer Science, or related field is required
8+ years of hands-on professional work experience with AWS and Python programming, experience with Python frameworks is required
Hands-on expertise with cloud platforms including AWS and GCP
Expert level knowledge of using SQL to write complex, highly-optimized queries across large volumes of data
Working experience on ETL pipeline implementation using AWS services such as Glue, Lambda, EMR, Shell, S3, SNS, Pyspark, etc. is required
Strong knowledge of data warehousing solutions, particularly Amazon Redshift
Strong real-life experience in building data pipelines using emerging technologies
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of sources like Hadoop, Spark, AWS Lambda, etc
Experience with AWS Cloud on Data Integration with Apache Spark, EMR, Glue, Kafka, Kinesis and Lambda in S3, Redshift, RDS, and MongoDB/DynamoDB ecosystems
Strong real-life experience in Python development, especially in PySpark in AWS Cloud environment
Design, develop, test, deploy, maintain and improve data integration pipeline
Develop pipeline objects using Apache Spark / Pyspark / Python or Scala
Design and develop data pipeline architectures using Hadoop, Spark and related AWS Services
Load and performance test data pipelines built using the above-mentioned technologies
Strong problem solving and troubleshooting skills with the ability to exercise mature judgement

Preferred

Hands-on professional work experience using emerging technologies (Snowflake, Talend, and/or Databricks) is highly desirable
Proficiency in DBT for data transformation and modeling
Experience with automation of data workflows and processes

Benefits

Competitive compensation and bonuses
Unlimited paid time off
Health, retirement, and life insurance plans
Long-term incentive programs
Meaningful work that blends innovation and purpose

Company

Wavicle Data Solutions

company-logo
Wavicle offers Rapid Delivery Data and Analytics Solutions that reduce the time, cost and risk of data and analytics projects

H1B Sponsorship

Wavicle Data Solutions has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (21)
2024 (24)
2023 (26)
2022 (54)
2021 (33)
2020 (40)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Naveen Venkatapathi
Managing Partner
linkedin
leader-logo
Niyaz Kamookagath
Managing Partner
linkedin
Company data provided by crunchbase