Senior Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

CRC Group · 5 hours ago

Senior Data Engineer

CRC Group is seeking a highly skilled Data Engineer to design, build, and optimize enterprise-grade data solutions leveraging Databricks and modern cloud technologies. This role will lead data solutions, ensuring scalable, secure, and efficient data pipelines that power analytics and business intelligence across the division.

Financial ServicesReal Estate
check
H1B Sponsor Likelynote

Responsibilities

Design and develop data pipelines using Databricks Lakehouse architecture, including ingestion, transformation, and orchestration layers
Implement Medallion architecture (Bronze, Silver, Gold layers) and manage data lineage, quality, and governance using Unity Catalog
Drive adoption of best practices for data governance, metadata management, and cost optimization
Mentor and guide junior engineers, ensuring adherence to coding standards and architectural principles
Collaborate with cross-functional teams (data scientists, analysts, business stakeholders) to translate requirements into technical solutions
Automate workflows for data ingestion and transformation using Databricks Jobs and orchestration tools
Monitor and troubleshoot performance issues across pipelines and clusters
Implement robust data security measures, including encryption, access controls, and auditing
Stay current with emerging technologies and recommend improvements to enhance scalability and efficiency

Qualification

DatabricksSparkPythonSQLData Lakehouse architectureUnity CatalogCI/CD practicesInfrastructure-as-codeDBTAzure Data Engineer AssociateAWS certificationsData governance frameworksObservability toolsMachine learning pipelinesMLflow

Required

Experienced Senior Data Engineer with over 3 years of Databricks expertise
Strong hands-on expertise with Databricks, including:
Spark (PySpark or Spark SQL)
Delta Lake
Data Lakehouse architecture
Unity Catalog
Proficiency in Python and SQL for data engineering workflows
Databricks Certified Data Engineer Professional (or equivalent) is mandatory
Familiarity with CI/CD practices and infrastructure-as-code

Preferred

Experience with DBT for transformation and dependency management
Azure Data Engineer Associate or AWS certifications are often preferred
Knowledge of data governance frameworks and observability tools
Exposure to machine learning pipelines and MLflow is a plus

Company

CRC Group

twittertwitter
company-logo
CRC Group is one of the largest wholesale providers of property and casualty insurance. It is a sub-organization of Truist Insurance Holdings.

H1B Sponsorship

CRC Group has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Dave Obenauer
Chief Executive Officer
linkedin
leader-logo
Mike Brennan
CEO - Commercial Solutions
linkedin
Company data provided by crunchbase