iShare Inc. · 2 months ago
Data Engineer – Databricks & Azure
iShare Inc. is a boutique IT consulting firm focused on delivering strategic advisory, development, and staffing services. They are seeking a skilled Data Engineer to develop and optimize data pipelines, implement robust data checks, and ensure the accuracy and integrity of data flows to support data-driven decision-making processes.
AdviceBusiness IntelligenceInformation Technology
Responsibilities
Collaborate with data analysts, reporting team and business advisors to gather requirements and define data models
Develop and maintain scalable and efficient data pipelines
Implement robust data checks and validate large datasets
Monitor data jobs and troubleshoot issues
Review and audit data processes for compliance
Work within Agile methodologies including scrum and sprint planning
Qualification
Required
Bachelor's degree in Computer Science, IT, or related field
7–12 years of experience in Data Engineering with Databricks & Cloud
Strong proficiency in PySpark, Python, SQL
Experience in data modeling, ETL/ELT pipeline development, and automation
Hands-on experience with Azure Data Factory, Azure Databricks, Azure Data Lake
Experience with Delta Lake, Delta Live Tables, Autoloader & Unity Catalog
Strong analytical and communication skills
Preferred
Knowledge of insurance industry data requirements
Company
iShare Inc.
iShare is a NJ-based boutique IT consulting firm that offers strategic advisory, development, and staffing services designed for specific verticals: Chemicals/Manufacturing (general & specialty chemical product manufacturers), Pharma & Healthcare (hospitals, clinics, labs), Software (data visualization, HR, risk management), and Professional Services (HR firms, architects, doctors) industries.