Sr. SDET - (AWS Lakehouse, Python, PySpark, Kafka Streaming) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Centraprise · 5 days ago

Sr. SDET - (AWS Lakehouse, Python, PySpark, Kafka Streaming)

positionUnited States
timeContract
remoteRemote
senioritySenior Level

Centraprise is seeking a Senior SDET with expertise in AWS Lakehouse and various data technologies. The role involves testing and validating ETL processes, automating data validation, and working with cloud architectures to ensure data integrity and compliance, particularly in healthcare contexts.

EmploymentRecruitingStaffing Agency
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Rahul Pandit
linkedin

Responsibilities

Python (Pandas, PySpark), Apache Spark
Kafka / Kafka Streaming
Delta Lake
Advanced SQL (PostgreSQL, Window Functions, CASE)
Shell scripting, Unix/Linux
Multi-threading & Performance Testing
AWS Lakehouse Architecture
AWS Glue, S3, Data Lakes
Glue Migration
AWS ETL & Data Pipeline Testing
AWS Cloud Practitioner–level knowledge
SDET (Data/Lakehouse)
ETL / ELT Data Validation & Automation
ICEDQ / QuerySurge
Data Testing Strategy (Batch & Streaming)
TDD for Spark & Kafka
Test Automation Frameworks
GitHub, GitHub Actions, Jenkins
Terraform
CI/CD Pipeline Testing
Data Engineering workflows
Streaming & Batch architectures
Healthcare Data & Compliance (HIPAA)

Qualification

PythonAWS Lakehouse ArchitectureKafka StreamingAdvanced SQLETL / ELT Data ValidationTest Automation FrameworksGitHub ActionsTerraformShell scriptingMulti-threadingData Engineering workflowsHealthcare Data ComplianceAWS Certifications

Required

Python (Pandas, PySpark), Apache Spark
Kafka / Kafka Streaming
Delta Lake
Advanced SQL (PostgreSQL, Window Functions, CASE)
Shell scripting, Unix/Linux
Multi-threading & Performance Testing
AWS Lakehouse Architecture
AWS Glue, S3, Data Lakes
Glue Migration
AWS ETL & Data Pipeline Testing
AWS Cloud Practitioner–level knowledge
SDET (Data/Lakehouse)
ETL / ELT Data Validation & Automation
ICEDQ / QuerySurge
Data Testing Strategy (Batch & Streaming)
TDD for Spark & Kafka
Test Automation Frameworks
GitHub, GitHub Actions, Jenkins
Terraform
CI/CD Pipeline Testing
Data Engineering workflows
Streaming & Batch architectures
Healthcare Data & Compliance (HIPAA)

Preferred

Healthcare / Health Insurance experience
AWS Certifications (Cloud Practitioner, Data Analytics, Solutions Architect)

Company

Centraprise

twittertwitter
company-logo
Centraprise is an executive search and direct hire company.
dateFounded in 2010
location
Edison, New Jersey, USA
people-size501-1000 employees
web-link
https://www.centraprise.com/

H1B Sponsorship

Centraprise has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (34)
2024 (16)
2023 (49)
2022 (35)
2021 (42)
2020 (125)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Praveen Mummaneni
Chief Executive Officer
linkedin
leader-logo
Anand Bandarupally
Managing Partner - Developing Recruitment and Business Development
linkedin
Company data provided by crunchbase