Databricks Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Mfinite Consulting LLC ยท 5 hours ago

Databricks Engineer

Mfinite Consulting LLC is seeking a Databricks Engineer to design, build, and operate a scalable Data & AI platform for UMGC. The role involves orchestrating complex data workflows and scalable ELT pipelines, integrating data from various enterprise systems.

Management Consulting

Responsibilities

Design, implement, and optimize end-to-end data pipelines on Databricks, following Medallion Architecture principles
Build robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake
Operationalize Databricks Workflows for orchestration and dependency management
Connect and ingest data from enterprise systems such as PeopleSoft, D2L, and Salesforce
Implement Unity Catalog or equivalent tools for centralized metadata management, data lineage, and governance
Enable data scientists by delivering high-quality, feature-rich data sets, supporting the MLOps lifecycle using MLflow

Qualification

DatabricksApache SparkDelta LakeSQLPythonELT pipeline developmentCloud platformsScalaData integration

Required

Hands-on experience with Databricks, Delta Lake, and Apache Spark for large-scale data engineering
Deep understanding of ELT pipeline development, orchestration, and monitoring
Strong proficiency in SQL, Python, or Scala for data transformations and workflow logic
Proven experience integrating enterprise platforms (PeopleSoft, Salesforce, D2L) into centralized data platforms
Familiarity with cloud platforms like Azure or AWS, including storage and security aspects
Minimum Years of Experience: Extensive hands-on experience with Databricks required

Company

Mfinite Consulting LLC

twitter
company-logo
Who We Are: We are an award-winning, dynamic, client-centric professional services firm passionately committed to delivering outstanding results.

Funding

Current Stage
Early Stage
Company data provided by crunchbase