Senior Cloud Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

BOK Financial · 11 hours ago

Senior Cloud Data Engineer

BOK Financial is a stable and financially strong organization that values technological innovation and career development. As a Senior Cloud Data Engineer, you will design, build, and maintain data solutions on Azure and AWS, transforming raw data into valuable insights while collaborating with various teams to meet data requirements.

BankingCredit CardsFinancial Services
check
H1B Sponsor Likelynote

Responsibilities

You will design and develop data architecture: Create scalable, reliable, and efficient data lakehouse solutions on Azure, leveraging Databricks Unity Catalog and native Azure data services
You will build and maintain data pipelines: Design, construct, and automate ETL/ELT processes to ingest data from diverse sources into the Azure ecosystem
You will create and manage data APIs: design, develop, and maintain secure and scalable RESTful and other APIs to facilitate data access for internal teams and applications, typically leveraging AWS services
You will manage Delta tables: build and manage Unity Catalog tables on Azure Blob Storage to enable data lakehouse features like ACID transactions, time travel, and schema evolution
You will optimize data performance: implement partitioning strategies, data compaction, and fine-tuning techniques for Unity Catalog Delta tables to enhance query performance
You will ensure data quality and integrity: implement data validation and error-handling processes, leveraging Delta’s transactional capabilities for consistent data
You will collaborate with stakeholders: work closely with data scientists, analysts, software engineers, and business teams to understand their data needs and deliver effective solutions
You will provide technical support: offer technical expertise and troubleshooting for data-related issues related to pipelines and API endpoints
You will maintain documentation: create and maintain technical documentation for data workflows, processes, and API specifications

Qualification

Azure DatabricksAWS ServicesData EngineeringSQLETL/WorkflowAPI DevelopmentBig DataProgramming (Python/Java/Scala)DevOpsApache IcebergCertificationsProblem-solvingCommunicationCollaboration

Required

Bachelor's Degree in a data-centric field (Computer Science, Economics, Information Systems, Data Analytics, etc.)
7+ years' experience with demonstrated track record of successful technical leadership in the execution of large-scale data projects or equivalent combination of education and experience
Proven experience in data engineering, with significant hands-on experience using Databricks and Azure
Programming-proficiency in programming languages like Python, Java, or Scala
Strong SQL skills for querying, data modeling, and database design
Hands-on experience administering and managing access to Databricks Unity Catalog
Experience with big data technologies like Apache Spark and Hadoop
Experience creating and deploying RESTful APIs, with knowledge of best practices for performance and security
Experience with ETL tools and workflow orchestration tools like Azure Data Factory and Apache Airflow
Familiarity with DevOps practices, CI/CD pipelines, and infrastructure as code (Terraform) is often desired
Strong problem-solving and analytical skills
Excellent communication and collaboration skills
Ability to work independently and as part of an agile team

Preferred

Expertise in relevant AWS services such as S3, EMR, Lambda, API Gateway, SageMaker and IAM
Hands-on experience building and managing Apache Iceberg tables
Databricks Data Engineer Associate or higher or other relevant AWS certifications

Company

BOK Financial

company-logo
BOK Financial offers financial services to consumers and businesses.

H1B Sponsorship

BOK Financial has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (1)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Carrie Clasen Porter
Chief Operating Officer, Wealth Management
linkedin
leader-logo
Chris Butta
Senior Vice President , Director-Petroleum Engineering
linkedin
Company data provided by crunchbase