Apply on Employer Site

SMBC Group · 2 days ago

Data Engineer - DataBricks

Charlotte, NC

Full-time

Hybrid

Mid Level

3+ years exp

SMBC Group is a top-tier global financial group with a diverse range of financial services. They are seeking a Data Engineer specializing in Azure and Databricks to architect and build secure data pipelines for compliance analytics and regulatory reporting.

AdviceBankingFinancial Services

H1B Sponsor Likely

Responsibilities

Own the design and implementation of ETL workflows using Azure Data Factory and Databricks for compliance-related data ingestion and transformation

Integrate and normalize data from multiple structured and unstructured sources, ensuring adherence to strict data quality governance framework

Develop secure, auditable, and optimized pipelines for performance and reliability across sensitive financial datasets

Automate ingestion and transformation processes to enable real-time compliance analytics and reporting

Implement efficient storage formats and partitioning strategies for fast loading and retrieval

Utilize Databricks and Delta Lake for distributed processing and versioned data storage

Enforce data retention, archiving, and purging policies aligned with global regulatory requirements

Migrate legacy application logic into modern Azure Databricks/Data Lake and SQL environments

Maintain comprehensive data lineage, metadata, and audit trails using Azure Purview or custom frameworks

Collaborate with governance teams and compliance analysts to define requirements and manage access controls

Participate in Agile development cycles, sprint planning, and compliance reviews

Review code changes and support production deployments

Qualification

Azure Data FactoryDatabricksSQLPythonData governanceData modelingETL developmentGit/GitLabCI/CD toolsAzure DevOpsFinancial Compliance TechnologyData wranglingCollaboration skillsCommunication skills

Required

3+ years of experience in data engineering within financial services, preferably compliance/regulatory

Advanced proficiency in SQL, Python, and Azure Databricks

Hands-on experience with Azure Data Factory, Databricks notebooks, and ADLS

Expertise in data wrangling, modeling, and analytics enablement for compliance use cases

Experience integrating Microsoft ADF and Databricks for complex ETL development

Familiarity with data governance, quality frameworks, and audit processes

Strong communication and collaboration skills

Experience with Git/GitLab and CI/CD tools such as Azure DevOps

Preferred

Certifications in Azure Data Engineering, Databricks, or Financial Compliance Technology

Bachelor's or Master's in Computer Science, Data Engineering, or related field

Benefits

Hybrid workforce model

Reasonable accommodations during candidacy for applicants with disabilities

Company

SMBC Group

Glassdoor3.5

SMBC Group is a top-tier global financial group.

Founded in 1590

New York, New York, USA

10001+ employees

https://www.smbcgroup.com/americas

H1B Sponsorship

SMBC Group has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (160)

2024 (87)

2023 (73)

2022 (44)

2021 (29)

2020 (26)