Apply on Employer Site

SMBC Group · 11 hours ago

Senior Data Engineer - Databricks

Charlotte, NC

Full-time

Hybrid

Senior Level

5+ years exp

SMBC Group is a top-tier global financial group offering a diverse range of financial services. They are seeking a Senior Data Engineer to implement and enhance their internal fraud detection platform by developing scalable data pipelines and ensuring compliance with risk management and regulatory requirements.

AdviceBankingFinancial Services

H1B Sponsor Likely

Responsibilities

Design, develop, and optimize large-scale batch data pipelines using Databricks and PySpark on the Azure cloud platform

Lead technical architecture and implementation of Azure-based solutions, supporting cloud migration and consolidation initiatives

Build and maintain ETL processes, ensuring seamless data integration and high data quality across diverse sources

Develop orchestration workflows using Azure Functions, Azure Data Factory (ADF), Logic Apps, and other Azure services

Proven expertise in designing and managing CI/CD pipelines using tools such as Azure DevOps, GitHub, or similar

Implement secure and scalable solutions leveraging Blob Storage, Key Vault, Managed Identities, and Azure DevOps

Provide technical guidance and support for architectural decisions and platform enhancements

Own end-to-end project delivery, working closely with business stakeholders, IT teams, and third-party vendors

Incorporating a variety of data processing techniques—including batch and streaming workflows—while exposing and integrating APIs and external services into Databricks pipelines to enhance platform functionality and enable seamless data exchange across systems

Review and contribute to core code changes, ensuring best practices and supporting production deployments

Experience in developing and implementing disaster recovery strategies for cloud-based applications

Qualification

DatabricksPySparkAzureCI/CD pipelinesData integrationProblem-solvingCommunicationCollaboration

Required

Bachelor's degree in Computer Science, Information Systems, or a related technical field

Minimum 5 years of experience in data engineering, with a focus on Databricks, PySpark, and Azure

Strong understanding of data integration, transformation, and migration strategies

Experience with CI/CD pipelines and version control using Azure DevOps or GitHub

Excellent problem-solving skills and ability to resolve moderately complex technical challenges

Strong communication and collaboration skills

Company

SMBC Group

Glassdoor3.5

SMBC Group is a top-tier global financial group.

Founded in 1590

New York, New York, USA

10001+ employees

https://www.smbcgroup.com/americas

H1B Sponsorship

SMBC Group has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (160)

2024 (87)

2023 (73)

2022 (44)

2021 (29)

2020 (26)