Heritage Construction + Materials · 1 day ago
Data Engineer (No Sponsorship Available)
Heritage Construction + Materials is a privately held, family-owned business headquartered in Indianapolis, specializing in infrastructure building. They are seeking a data-driven technical expert to develop and implement strategic data initiatives, focusing on data collection, analysis, and pipeline maintenance.
Building Materials
Responsibilities
Develop and support data pipelines within our Cloud Data Platform Databricks
Monitor and optimize Databricks cluster performance, ensuring cost-effective scaling and resource utilization
Design, implement, and maintain Delta Lake tables and pipelines to ensure optimized storage, data reliability, performance, and versioning
Python application development
Automate CI/CD pipelines for data workflows using Azure DevOps
Integrate Databricks with other Azure services, such as Azure Data Factory and ADLS
Design and implement monitoring solutions, leveraging Databricks monitoring tools, Azure Log Analytics, or custom dashboards for cluster and job performance
Collaborate with cross-functional teams to support data governance using Databricks Unity Catalog
Additional duties and responsibilities as assigned, including but not limited to continuously growing in alignment with the Company’s core values, competencies, and skills
Qualification
Required
U.S. work authorization
Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field required
Expertise with programming languages such as Python and/or SQL
Experience with Python Data Science Libraries (PySpark, Pandas, etc.)
Experience with Test Drive Development (TDD)
Automated CI/CD Pipelines
Linux / Bash / Docker
Database Schema Design and Optimization
Experience working in a cloud environment (Azure preferred) with strong understanding of cloud data architecture
Hands-on experience with Databricks or Snowflake Cloud Data Platforms
Experience with workflow orchestration (e.g., Databricks Jobs, or Azure Data Factory pipelines)
Strong analytical and problem-solving skills
Experience with programming languages such as Python, Java, R, or SQL
Experience with Databricks or Snowflake Cloud Data Platforms
Knowledge of statistical analysis and data visualization tools, such as PowerBI or Tableau
Proficient in Microsoft Office
Company
Heritage Construction + Materials
Heritage Construction + Materials is part of a family business committed to providing our customers with innovative solutions.