This job has closed.

Independence Pet Group · 2 hours ago

Data Engineer - Senior

United States; Massachusetts

Full-time

Hybrid

Senior Level

7+ years exp

Independence Pet Holdings is a corporate holding company managing a diverse portfolio of modern pet health brands and services. They are seeking a Senior Data Engineer to develop and optimize data pipelines, ensuring accuracy and integrity of data flows to support product development processes.

Pet

H1B Sponsor Likely

Responsibilities

Design, develop, and deploy robust and scalable data pipelines using Databricks, integrating data from various sources

Optimize pipeline performance for greater efficiency and cost-effectiveness

Contribute to the design and implementation of robust data models in the data lake environment, ensuring data consistency, integrity and accessibility for various use cases

Implement rigorous data quality controls and validation procedures throughout the data pipeline to ensure high accuracy and reliability

Comply with the data governance policies and best practices

Seamlessly integrate Databricks with Azure cloud services for storage, compute and security, leveraging services like Azure Data Lake Storage

Qualification

Data pipelinesDatabricksAzure data servicesPythonSQLPySparkData modelingCI/CD pipelinesAnalytical skillsCloud securityProblem-solving

Required

Bachelor's degree in computer science, Information Technology, or related field

At least 7 years of experience in building data pipelines using ELT/ETL

Experience working with Databricks, Spark, and Azure data services

Strong coding skills with Python, SQL and PySpark

Experience designing and maintaining config-driven pipelines with support for Change Data Capture (CDC) and event/stream-based processing

Proficiency with NoSQL and SQL databases

Strong understanding of data modeling, schema design, and database performance optimization

Practical experience working with various file formats, including JSON, Parquet, and ORC

Hands-on experience building and maintaining CI/CD pipelines (Azure DevOps, GitLab) and automating data workflow deployments

Solid understanding of data governance, lineage, and cloud security (Unity Catalog, encryption, access control)

Excellent problem-solving and analytical skills

Experience with data modeling tools and techniques

Knowledge of cloud-based data solutions and platforms

Benefits

Comprehensive full medical, dental and vision Insurance

Basic Life Insurance at no cost to the employee

Company paid short-term and long-term disability

12 weeks of 100% paid Parental Leave

Health Savings Account (HSA)

Flexible Spending Accounts (FSA)

Retirement savings plan

Personal Paid Time Off

Paid holidays and company-wide Wellness Day off

Paid time off to volunteer at nonprofit organizations

Pet friendly office environment

Commuter Benefits

Group Pet Insurance

On the job training and skills development

Employee Assistance Program (EAP)

Company

Independence Pet Group

Independence Pet Group is an integrated, full-stack pet insurance platform.

Founded in 2021

Chicago, Illinois, USA

501-1000 employees

https://www.independencepetgroup.com

H1B Sponsorship

Independence Pet Group has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2023 (3)