Apply on Employer Site

Suncap Technology · 1 month ago

Sr. Data Engineer/Dallas, Orlando, Chicago or NYC (hybrid)- 6 months Contract

Dallas, TX

Full-time, Contract

Hybrid

Senior Level

5+ years exp

Suncap Technology is seeking an experienced Data Engineer with strong skills in PySpark and hands-on expertise in Snowflake on the AWS platform. The ideal candidate will build, optimize, and maintain large-scale data pipelines, ensuring high performance and efficiency in data processing workflows.

Human ResourcesRecruitingStaffing Agency

Responsibilities

Design, build, and maintain high-performance ETL/ELT pipelines using PySpark on AWS

Develop automated ingestion, transformation, and validation workflows for large structured and semi-structured datasets

Optimize Spark jobs for performance, scalability, and cost efficiency

Build and manage data pipelines that load into Snowflake using PySpark, Snowpipe, and external stages

Create and maintain Snowflake objects including: Databases, schemas, tables, Virtual warehouses, Internal/external stages, file formats, Streams, Tasks, Dynamic Tables

Implement Snowpipe for continuous or incremental ingestion

Apply Snowflake optimization techniques (clustering, micro-partitioning, query profiling, etc.)

Work with AWS services such as S3, IAM, Lambda, CloudWatch, and EventBridge for data ingestion and automation

Implement event-driven ingestion using SNS/SQS or other AWS-native triggers

Qualification

PySparkSnowflakeAWSSQLETL/ELT

Required

5+ years of experience with PySpark, including performance tuning, DataFrames, Spark SQL, and distributed data processing

3+ years of hands-on experience with Snowflake, including Snowpipe, stages, tasks, streams, and performance optimization

Strong experience building data pipelines on AWS

Strong SQL skills with the ability to write optimized, complex queries

Solid understanding of ETL/ELT concepts, data warehousing, and modern data architecture

Company

Suncap Technology

Suncap Technology is a staffing firm that provides recruiting and financial staffing services.

Davie, Florida, USA

51-200 employees

https://suncaptech.com

Funding

Current Stage

Growth Stage

Leadership Team

Ron G.

Managing Partner/VP of Recruiting

Company data provided by crunchbase