CRC Group · 15 hours ago
Senior Data Engineer
CRC Group is seeking a highly skilled Data Engineer to design, build, and optimize enterprise-grade data solutions leveraging Databricks and modern cloud technologies. This role will lead data solutions, ensuring scalable, secure, and efficient data pipelines that power analytics and business intelligence across the division.
Financial ServicesReal Estate
Responsibilities
Design and develop data pipelines using Databricks Lakehouse architecture, including ingestion, transformation, and orchestration layers
Implement Medallion architecture (Bronze, Silver, Gold layers) and manage data lineage, quality, and governance using Unity Catalog
Drive adoption of best practices for data governance, metadata management, and cost optimization
Mentor and guide junior engineers, ensuring adherence to coding standards and architectural principles
Collaborate with cross-functional teams (data scientists, analysts, business stakeholders) to translate requirements into technical solutions
Automate workflows for data ingestion and transformation using Databricks Jobs and orchestration tools
Monitor and troubleshoot performance issues across pipelines and clusters
Implement robust data security measures, including encryption, access controls, and auditing
Stay current with emerging technologies and recommend improvements to enhance scalability and efficiency
Qualification
Required
Experienced Senior Data Engineer with over 3 years of Databricks expertise
Strong hands-on expertise with Databricks, including:
Spark (PySpark or Spark SQL)
Delta Lake
Data Lakehouse architecture
Unity Catalog
Proficiency in Python and SQL for data engineering workflows
Databricks Certified Data Engineer Professional (or equivalent) is mandatory
Familiarity with CI/CD practices and infrastructure-as-code
Preferred
Experience with DBT for transformation and dependency management
Azure Data Engineer Associate or AWS certifications are often preferred
Knowledge of data governance frameworks and observability tools
Exposure to machine learning pipelines and MLflow is a plus
Company
CRC Group
CRC Group is one of the largest wholesale providers of property and casualty insurance. It is a sub-organization of Truist Insurance Holdings.
H1B Sponsorship
CRC Group has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Late StageRecent News
2026-01-11
Bizjournals.com Feed (2025-11-12 15:43:17)
2026-01-08
2026-01-06
Company data provided by crunchbase