Mfinite Consulting LLC ยท 5 hours ago
Databricks Engineer
Mfinite Consulting LLC is seeking a Databricks Engineer to design, build, and operate a scalable Data & AI platform for UMGC. The role involves orchestrating complex data workflows and scalable ELT pipelines, integrating data from various enterprise systems.
Management Consulting
Responsibilities
Design, implement, and optimize end-to-end data pipelines on Databricks, following Medallion Architecture principles
Build robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake
Operationalize Databricks Workflows for orchestration and dependency management
Connect and ingest data from enterprise systems such as PeopleSoft, D2L, and Salesforce
Implement Unity Catalog or equivalent tools for centralized metadata management, data lineage, and governance
Enable data scientists by delivering high-quality, feature-rich data sets, supporting the MLOps lifecycle using MLflow
Qualification
Required
Hands-on experience with Databricks, Delta Lake, and Apache Spark for large-scale data engineering
Deep understanding of ELT pipeline development, orchestration, and monitoring
Strong proficiency in SQL, Python, or Scala for data transformations and workflow logic
Proven experience integrating enterprise platforms (PeopleSoft, Salesforce, D2L) into centralized data platforms
Familiarity with cloud platforms like Azure or AWS, including storage and security aspects
Minimum Years of Experience: Extensive hands-on experience with Databricks required
Company
Mfinite Consulting LLC
Who We Are: We are an award-winning, dynamic, client-centric professional services firm passionately committed to delivering outstanding results.
Funding
Current Stage
Early StageCompany data provided by crunchbase