Data Platform Engineer /Architect jobs in United States
cer-icon
Apply on Employer Site
company-logo

Net2Source (N2S) ยท 2 weeks ago

Data Platform Engineer /Architect

positionUnited States
timeFull-time
remoteRemote
senioritySenior Level, Lead/Staff
money$120K/yr - $140K/yr
date8+ years exp

Net2Source (N2S) is seeking a Data Platform Engineer / Architect to lead the design and development of a cloud-native data platform. The role involves architecting ETL/ELT pipelines, managing AWS infrastructure, and ensuring efficient deployments while focusing on data quality and performance.

B2BDeliveryHuman ResourcesInformation Technology
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Vimal Khandelwal
linkedin

Responsibilities

Build and maintain high-scale ETL/ELT pipelines across diverse data sources
Implement and optimize Databricks workflows using PySpark, Python, DLT, and Unity Catalog
Configure and manage AWS environments including VPCs, IAM, S3, and secure connectivity
Establish CI/CD pipelines using GitHub Actions for automated deployment of Databricks notebooks, jobs, and pipelines
Drive data quality via automated testing frameworks (unit, integration, performance)
Optimize cluster performance and cost efficiency
Lead best practices in Medallion Architecture, ACID data principles, and high-performance SQL
Create clear technical documentation, architecture diagrams, and design specifications

Qualification

Databricks developmentAWS experiencePython programmingPySparkCI/CD automationETL/ELT conceptsAgile (Scrum)Performance tuningCapacity planningTechnical documentation

Required

8+ years of experience building scalable Data Engineering platforms and production-grade pipelines
3+ years of hands-on Databricks development, including expertise in Delta Lake (ACID, time travel, optimization)
Unity Catalog (security, governance, metadata)
Delta Live Tables (DLT)
Workspaces, Repos, Jobs, and Databricks SQL
3+ years of AWS experience, including VPC, Subnets, Endpoints, Routing
IAM roles, policies, cross-account access
S3-based data lake implementation
Expert programming skills in Python (4+ years)
Deep hands-on experience with PySpark and advanced SQL
Proven CI/CD experience using GitHub Actions or similar tools
Strong understanding of ETL/ELT, Data Lake, Data Warehouse, and distributed computing concepts
Agile (Scrum) experience and Git proficiency

Preferred

Experience with AWS data services such as Glue, Athena, Redshift, RDS, DynamoDB
Knowledge of real-time streaming (Kafka, Spark Structured Streaming)
Experience building ML feature pipelines
Background in performance tuning and capacity planning for large Spark clusters

Company

Net2Source (N2S)

twittertwittertwitter
Glassdoor4.1
company-logo
Net2Source (N2S) is a Minority owned global workforce solutions company recognized by SIA as the largest and fastest-growing Total Talent Solutions provider with a presence in 34 countries and in-house Glo-Cal (global and local) teams to support our clients.
dateFounded in 2007
location
Somerset, New Jersey, USA
people-size1001-5000 employees
web-link
http://net2source.com

H1B Sponsorship

Net2Source (N2S) has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
2024 (7)
2022 (8)
2021 (10)
2020 (25)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Ashish Garg
Founder & CEO
linkedin
Company data provided by crunchbase