200+ applicants

Company

Original Job Post

Veterinary Practice Partners · 3 days ago

Senior Data Engineer

United States

Full-time

Onsite

Senior Level

3+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

Health CarePet

H1B Sponsorship

Growth Opportunities

Insider Connection @Veterinary Practice Partners

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Pipeline Development: Define and execute processes for developing, testing, deploying, and maintaining high-quality data pipelines.

Performance Optimization: Continuously monitor and optimize data processing performance and efficiency.

Data Governance: Establish and enforce data quality management policies, access controls, and privacy standards.

Technical Leadership: Stay updated on engineering tools and provide guidance to the team on technical challenges.

Strategy Creation: Collaborate with cross-functional teams to define data engineering strategies aligned with business objectives.

Documentation: Maintain comprehensive documentation of data pipelines, architecture, and processes for knowledge sharing.

Third-party Management: Evaluate and manage relationships with third-party vendors and tools.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

PythonSQLDatabricksData ModelingData ArchitectureData IntegrationApache SparkData GovernanceSecurityPrivacy PrinciplesGitSoftware DevelopmentProject ManagementProblem-SolvingHard WorkingTeam PlayerCollaborationAzure CloudMachine LearningPrivate EquityMLFlowCI/CD

Required

3+ years in data engineering roles in a production environment

Advanced proficiency in Python and SQL for data engineering

Up-to-date knowledge of and 1+ years of experience using Databricks for Lakehouse management

Deep understanding of data modeling, data architecture, and data integration best practices

Strong hands-on experience with Apache Spark

Familiarity with data governance, security, and privacy principles

Comfort using git or equivalent to manage the software development life cycle

Exceptional ability to learn and use new software development techniques and tools

Ability to manage multiple projects simultaneously

High energy, humble team player with 'get it done' attitude, seeking collaboration with colleagues

Preferred

Experience with the Azure cloud ecosystem

Experience developing production-ready, real-time machine learning model serving pipelines

Comfort developing in the Apache Spark Structured Streaming paradigm

Experience working in a private equity-backed services company

Experience deploying machine learning models with MLFlow or equivalent

Experience developing CI/CD pipelines

Company

Veterinary Practice Partners

Veterinary Practice Partners partners with veterinarians and their teams to enhance their ability to provide companion animal care.

Founded in 2011

King Of Prussia, Pennsylvania, USA

1,001-5,000 employees

http://www.vetpartners.com/

H1B Sponsorship

Veterinary Practice Partners has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Trends of Total Sponsorships

2022 (1)