CBTS · 1 day ago
Senior Data Engineer
CBTS is searching for a Senior Databricks Engineer that serves as a technical leader responsible for designing, building, and evolving Databricks-based analytics and data platform. This role plays a critical part in advancing our modern data architecture, enabling scalable analytics, reliable data products, and advanced use cases across the organization.
Responsibilities
Serve as a senior technical contributor and platform leader for Databricks environment, supporting ongoing implementation, optimization, and continuous improvement
Design, build, and maintain scalable data pipelines using Databricks, supporting Bronze, Silver, and Gold layer architectures
Develop and optimize data transformations using Python and SQL to support analytics, reporting, and data science use cases
Partner with data science and analytics teams to enable advanced analytics, machine learning workflows, and self-service analytics capabilities
Implement and maintain data governance standards using Unity Catalog, including access controls, data lineage, and environment management
Monitor platform performance, troubleshoot complex issues, and optimize jobs for reliability, scalability, and cost efficiency
Design and support data ingestion processes from enterprise systems such as Dynamics, HRIS, finance, and other operational platforms
Establish and promote engineering best practices including code standards, testing, documentation, and deployment processes
Support the enablement of business users and analysts through curated data products, semantic layers, and tooling such as Databricks SQL and Genie
Collaborate with IT and security teams to ensure platform security, compliance, and operational stability
Serve as an escalation point for complex data platform issues, ensuring root-cause analysis and long-term remediation
Continuously evaluate new Databricks features and capabilities and recommend adoption where beneficial
Qualification
Required
5+ years of experience in data engineering, analytics engineering, or platform engineering roles
Strong hands-on experience with Databricks in a production enterprise environment
Advanced proficiency in Python and SQL for data transformation and pipeline development
Experience designing and implementing modern data architectures, including layered (Bronze/Silver/Gold) data models
Experience working with cloud-based data platforms and distributed data processing concepts
Solid understanding of data governance, security, and access control concepts
Experience monitoring, troubleshooting, and optimizing data pipelines and jobs
Ability to translate business and analytical requirements into scalable technical solutions
Strong problem-solving skills with the ability to diagnose and resolve complex data issues
Excellent communication skills and ability to partner effectively with technical and non-technical stakeholders
Excellent client management skills and the ability to work with customers to develop and manage an action plan
Demonstrated excellence in communicating and presenting complex information to technical and non-technical stakeholders, both verbally and in written form
Self-starter and able to work independently with minimal supervision
Accounts for possible project challenges on constraints including risks, time, resources, and scope
Works closely with project management teams to successfully monitor progress of initiatives
Preferred
Experience with Unity Catalog, data governance, and security implementation in Databricks
Experience supporting machine learning workflows and collaboration with data science teams
Experience with Databricks SQL, dashboards, and self-service analytics enablement
Experience integrating Databricks with enterprise systems such as CRM, HRIS, ERP, or finance platforms
Experience with cloud services supporting Databricks (Azure preferred)
Databricks certifications
Experience in healthcare, staffing, or professional services environments
Company
CBTS
CBTS provides end-to-end IT and communications solutions that allow businesses to improve efficiency, enable innovation, and mitigate risk.
Funding
Current Stage
Late StageTotal Funding
unknown2024-02-06Acquired
Recent News
Business Wire
2026-01-16
2025-11-04
Company data provided by crunchbase