SMBC Group · 1 week ago
Senior Data Engineer - Vice President
Charlotte, NC
Full-time
Hybrid
Senior Level, Lead/Staff
10+ years expSMBC Group is a top-tier global financial group offering a diverse range of financial services. The VP, Senior Data Engineer will design and develop cloud data solutions for the Information Security department, focusing on building a centralized Cybersecurity Data Lakehouse and ensuring data governance.
AdviceBankingFinancial Services
Responsibilities
Design, develop, testing & support of cloud data solutions for the CyberDW catalogue focusing on data ingestion, data quality, data tuning and performance of upstream cybersecurity data sources
Indirect leadership and mentorship of junior team members. Able to lead data feed development efforts and design initiatives. Participate in development meetings to align development priorities and objectives, assign tasks, and share experiences and challenges with applications under development
Consult with other technology and development teams as needed to coordinate on the integration of applications with the larger company software ecosystem
Capture and document metadata for identified Key Data Elements (KDEs) to ensure accuracy and completeness for Data Quality rules and processing of daily datasets
Work with the data architecture team to align KDEs to logical data models, develop physical data structures, and document physical data names, definitions, and data types
Partner with the data owners and stakeholders to create technical requirements and DQ rules around the data elements needed in the CyberDW. Partner with the Business Management team and Data Owners to understand what critical metrics and data fields are needed for Metric Dashboards
Establish CyberDW views to encapsulate the data so that it is fit for downstream consumption. Ensure that the data aligns with DQ rules established on that metadata, so it is fit for daily use. Utilize IBM TWS production job scheduling system and adhere to standards around the daily scheduling and batch monitoring of production jobs
Identify and resolve DQ issues including inaccuracies and incomplete information. Enhance data quality efforts by implementing improved procedures and processes
Qualification
Required
Bachelor's degree in Computer Science, Information Security, Data Management, or related field
10+ years' experience in IT development, data governance, data architecture or related roles, preferably in a highly regulated environment such as financial services
5+ years' experience in Azure Databricks, Azure Data Factory, Azure Functions, Azure Data Lake storage, Azure Event Grid, Azure Log Analytics, Azure Monitor, Unity catalog repository configuration
Proficient in data management & data modeling tools (e.g., Collibra DQIM/DQE, IBM Infosphere DA)
Strong knowledge of CI/CD and DevOps tooling (i.e., Git, Jenkins, Azure DevOps)
Proficient in SQL Server, Oracle / PL-SQL, T-SQL and SQL stored procedures
Proficient in Python, Java or similar high-level server-side languages
Strong knowledge of enterprise Information Security data (i.e., Phishing, Identity Management, Privileged Access, Cloud Security, Incident Response, Vulnerability Management, Threat Detection)
Data knowledge of PaaS/SaaS products (i.e., ServiceNow, Crowdstrike, MS Purview, Proofpoint, WIZ.IO, JIRA, SharePoint, Azure Active Directory, SAI360)
Understanding of information security frameworks and security controls (i.e., NIST, CIS, CRI Profile) and regulatory compliance (i.e., NYSDFS, GDPR, CCPA)
Experience with REST API web services and microservice architecture
Strong understanding of ETL/ELT
Problem solving and analytical skills, with an initiative-taking and results oriented approach
Preferred
Knowledge of Microsoft Sentinel for security information and event management (SIEM) is a plus
Exposure to PowerBI for data visualization and reporting is a plus
Knowledge of IBM Tivoli Workload Scheduler a plus
Benefits
Hybrid workforce model
Reasonable accommodations during candidacy for applicants with disabilities
Company
SMBC Group
SMBC Group is a top-tier global financial group.
10001+ employees
H1B Sponsorship
SMBC Group has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (160)
2024 (87)
2023 (73)
2022 (44)
2021 (29)
2020 (26)
Funding
Current Stage
Late StageLeadership Team
Hirofumi Otsuka
Senior Managing Executive Officer & CEO of Americas Division
Juan Kreutz
Head of Structured Finance Solutions and Deputy Head of the Americas
Recent News
Company data provided by crunchbase