Apply on Employer Site

TestingXperts · 4 hours ago

AWS Data Engineer (Apache Spark, Iceberg, Redshift) – Remote | Independent Visa Only

United States

Contract

Remote

Mid, Senior Level

TestingXperts is looking for an experienced AWS Data Engineer with strong expertise in big data distributed systems and Spark-based data processing. The ideal candidate will build scalable data pipelines on AWS and work with modern data lake technologies.

DevOpsInformation TechnologyPenetration TestingQuality AssuranceSoftwareUsability Testing

No H1B

Hiring Manager

Mahesh Kumar

Responsibilities

Strong experience with Big Data distributed systems such as:

Apache Iceberg

Hadoop

Hudi

Amazon Redshift

Deep expertise in Apache Spark (batch and/or streaming)

Hands-on experience with:

Shell scripting (Bash)

Python

PySpark

Solid experience with AWS services , including:

AWS Glue

Lambda

Airflow

Lake Formation

EKS

EC2

SQS

SNS

Strong understanding of data pipeline design, performance optimization, and troubleshooting

Qualification

Apache SparkAWS servicesBig Data distributed systemsPythonApache IcebergAmazon RedshiftShell scriptingHadoopHudiAWS GlueLambdaAirflowLake FormationEKSEC2SQSSNSGoogle Cloud PlatformBigQueryDBTReal-time processing