This job has closed.

Suncap Technology · 2 months ago

Sr. Data Engineer/Dallas, Orlando, Chicago or NYC (hybrid)- 6 months Contract

Dallas, TX

Full-time, Contract

Hybrid

Senior Level

5+ years exp

Suncap Technology is seeking a Senior Data Engineer with expertise in PySpark and Snowflake on the AWS platform. The role involves designing and maintaining high-performance data pipelines, optimizing Spark jobs, and integrating AWS services for data ingestion and automation.

Human ResourcesRecruitingStaffing Agency

Responsibilities

Design, build, and maintain high-performance ETL/ELT pipelines using PySpark on AWS

Develop automated ingestion, transformation, and validation workflows for large structured and semi-structured datasets

Optimize Spark jobs for performance, scalability, and cost efficiency

Build and manage data pipelines that load into Snowflake using PySpark, Snowpipe, and external stages

Create and maintain Snowflake objects including: Databases, schemas, tables, Virtual warehouses, Internal/external stages, file formats, Streams, Tasks, Dynamic Tables

Implement Snowpipe for continuous or incremental ingestion

Apply Snowflake optimization techniques (clustering, micro-partitioning, query profiling, etc.)

Work with AWS services such as S3, IAM, Lambda, CloudWatch, and EventBridge for data ingestion and automation

Implement event-driven ingestion using SNS/SQS or other AWS-native triggers

Qualification

PySparkSnowflakeAWSSQLETL/ELT

Required

5+ years of experience with PySpark, including performance tuning, DataFrames, Spark SQL, and distributed data processing

3+ years of hands-on experience with Snowflake, including Snowpipe, stages, tasks, streams, and performance optimization

Strong experience building data pipelines on AWS

Strong SQL skills with the ability to write optimized, complex queries

Solid understanding of ETL/ELT concepts, data warehousing, and modern data architecture

Company

Suncap Technology

Suncap Technology is a staffing firm that provides recruiting and financial staffing services.

Davie, Florida, USA

51-200 employees

https://suncaptech.com

Funding

Current Stage

Growth Stage

Leadership Team

Ron G.

Managing Partner/VP of Recruiting

Company data provided by crunchbase