University of Virginia · 3 weeks ago
Data Engineer, Darden School of Business
Charlottesville, VA
Full-time
Hybrid
Mid, Senior Level
4+ years expThe University of Virginia Darden School of Business is one of the world's leading business schools, seeking a highly skilled and motivated Data Engineer to join its Strategic IT Data & Analytics team. The role involves building and maintaining data infrastructure, ensuring efficient ELT of data from various sources into cloud environments, and collaborating with cross-functional teams to support enterprise analytics and reporting.
Higher Education
Responsibilities
Design and implement scalable, metadata-driven data pipelines using cloud-based ELT frameworks to support enterprise analytics and reporting
Collaborate with cross-functional teams to translate data requirements into Lakehouse-integrated solutions
Build and maintain data models, integration workflows, and transformation processes supporting analytics and reporting
Develop, orchestrate, and optimize data pipelines to ensure reliability, data quality, and performance
Monitor and troubleshoot production pipelines to maintain availability, scalability, and operational excellence
Identify and resolve performance bottlenecks, data quality issues, and compute inefficiencies
Support implementation of data governance, security controls, and privacy requirements for regulated data environments
Stay current with emerging data engineering and cloud technologies to enhance platform capabilities
Extend ELT architectures to support machine learning workloads
Build feature engineering pipelines using Databricks Feature Store, Delta Lake, or vectorization techniques
Assist in deploying and monitoring machine learning models using MLflow or Databricks Model Serving
Implement vector search, embedding pipelines, or retrieval-augmented generation (RAG) components
Contribute to orchestrating AI workflows or agent-based pipelines using Lakehouse AI capabilities
Develop CI/CD workflows for data and ML artifacts to ensure reproducibility and alignment with governance standards
Troubleshoot and optimize model and feature pipelines
Track emerging AI technologies and identify opportunities to apply them within the platform
Integrate Databricks and Unity Catalog with enterprise data governance tools to ensure compliant access and lineage tracking
Qualification
Required
High school diploma and at least 4 years of relevant experience required. Education may be substituted in lieu of experience with an Associate's degree or Bachelor's degree and 2 years of relevant experience
Bachelor's degree in computer science, MIS, engineering, business, or related field, with at least five years of relevant experience preferred
Proven experience developing and maintaining data pipelines and ELT processes
Strong proficiency with Databricks, Unity Catalog, and Delta Lake
Expertise in SQL and Python for ingestion, transformation, and automation
Experience with REST APIs and web services for data integration
Strong understanding of data warehousing concepts and dimensional modeling
Familiarity with CI/CD and DevOps practices for data engineering
Strong analytical and problem-solving skills working with complex datasets
Effective communication and collaboration skills
Preferred
Databricks Data Engineer Associate or Professional certification
Experience integrating Databricks with enterprise governance platforms such as Microsoft Purview
Coursework or certification in Databricks Machine Learning or AI Engineering
Experience with MLflow, Feature Store, Model Serving, or AI workflow orchestration
Experience with vector search, embeddings, or LLM-based application components
Familiarity with machine learning operational practices and monitoring
Experience with Microsoft Power BI or Microsoft Fabric
Company
University of Virginia
The University of Virginia was founded in 1819 as the model for modern universities that has since been emulated all over the world.
10001+ employees
H1B Sponsorship
University of Virginia has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (263)
2024 (223)
2023 (262)
2022 (202)
2021 (163)
2020 (155)
Funding
Current Stage
Late StageLeadership Team
Greg Fairchild
Dean and CEO, UVA|Northern Virginia
Luis Alvarez
President and CEO
Recent News
The Republic Reporter
2024-02-29
Company data provided by crunchbase