TestingXperts · 4 hours ago
AWS Data Engineer (Apache Spark, Iceberg, Redshift) – Remote | Independent Visa Only
TestingXperts is looking for an experienced AWS Data Engineer with strong expertise in big data distributed systems and Spark-based data processing. The ideal candidate will build scalable data pipelines on AWS and work with modern data lake technologies.
Responsibilities
Strong experience with Big Data distributed systems such as:
Apache Iceberg
Hadoop
Hudi
Amazon Redshift
Deep expertise in Apache Spark (batch and/or streaming)
Hands-on experience with:
Shell scripting (Bash)
Python
PySpark
Solid experience with AWS services , including:
AWS Glue
Lambda
Airflow
Lake Formation
EKS
EC2
SQS
SNS
Strong understanding of data pipeline design, performance optimization, and troubleshooting
Qualification
Required
Strong experience with Big Data distributed systems such as: Apache Iceberg, Hadoop, Hudi, Amazon Redshift
Deep expertise in Apache Spark (batch and/or streaming)
Hands-on experience with Shell scripting (Bash)
Hands-on experience with Python
Hands-on experience with PySpark
Solid experience with AWS services, including: AWS Glue, Lambda, Airflow, Lake Formation, EKS, EC2, SQS, SNS
Strong understanding of data pipeline design, performance optimization, and troubleshooting
Preferred
Experience with Google Cloud Platform (GCP)
Hands-on exposure to BigQuery
Experience working with DBT
Familiarity with real-time / streaming data processing
Company
TestingXperts
Next Gen QA & Software Testing Company
Funding
Current Stage
Late StageRecent News
PR Newswire
2025-09-02
Canada NewsWire
2025-08-14
Company data provided by crunchbase