Apply on Employer Site

Vallen USA · 2 months ago

Databricks Data Engineer (Remote)

United States

Full-time

Remote

Senior Level

5+ years exp

Vallen USA is an industry leader in delivering flexible supply chain solutions. They are seeking a Senior Data Engineer with 5–7 years of experience in data engineering and a strong background in Databricks to design and develop scalable data pipelines and collaborate with various stakeholders to deliver high-impact data solutions.

Business DevelopmentInformation ServicesMarketing

H1B Sponsor Likely

Responsibilities

Design and develop scalable data pipelines using PySpark, Spark SQL, and Python within the Databricks environment

Build modular, version-controlled transformation workflows using DBT (Data Build Tool)

Package and deploy Databricks workflows and notebooks using Databricks Asset Bundles (DABS) for CI/CD and environment management

Integrate Databricks workflows with Azure DevOps for automated testing, deployment, and version control

Develop and maintain robust CI/CD pipelines for data engineering workflows using Git, Azure DevOps, and DABS

Implement and optimize dimensional data models, ELT/ETL processes, and performance tuning in cloud data platforms

Collaborate with data scientists, analysts, and business stakeholders to deliver high-impact data solutions

Implement logging, alerting, and monitoring for data pipelines using tools like Databricks Jobs, MLflow, or Azure Monitor

Qualification

DatabricksPythonPySparkSpark SQLDBTAzure DevOpsCI/CD pipelinesData modelingCommunication skillsCollaboration skills

Required

5–7 years of experience as a Data Engineer, with at least 3 years working in Databricks

Strong proficiency in Python, PySpark, and Spark SQL

Hands-on experience with DBT in a cloud data platform

Experience with DABS for workflow packaging and deployment

Proven expertise in Azure DevOps, Git, and CI/CD pipeline development

Solid understanding of data modeling, ETL/ELT, and performance optimization

Experience implementing monitoring and observability for data pipelines

Excellent communication and collaboration skills

Preferred

Experience in Azure cloud ecosystem

Familiarity with MLflow and other observability tools

Exposure to data governance and metadata management practices

Benefits

Medical, Dental, Vision

Paid time off (vacation, holidays, sick days)

401K with discretionary company match - (US positions only)

Employer-paid Basic Life for Employee, Spouse, and Dependents

Employer-paid Short-Term and Long-Term Disability

Health Care and Dependent Care Flexible Spending Accounts

Vitality Wellness Program

Employee Assistance Program

Employee Resource Groups for networking and team building

Tuition Reimbursement Program

Employee Referral Program

Safety Shoe and Safety Glasses reimbursement

Employee Discounts through BenefitHub

Advancement Opportunity.

Company

Vallen USA

Vallen is a leading provider of indirect industrial supplies—all those materials that are not part of the products our customers manufacture.

Founded in 1997

Belmont, North Carolina, USA

1001-5000 employees

https://www.vallen.com

H1B Sponsorship

Vallen USA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2024 (3)

2022 (1)

2021 (5)

2020 (3)