Apply on Employer Site

Life Science Connect · 3 days ago

Staff Data Engineer (EL Focus - Azure/Snowflake)

United States

Full-time

Remote

Senior Level, Lead/Staff

7+ years exp

Life Science Connect is dedicated to uniting life sciences professionals and suppliers to accelerate research, development, and manufacturing. They are seeking an expert, hands-on Staff Data Engineer to be the technical backbone of their data ingestion strategy, focusing on the Extraction and Load (EL) portion of their architecture.

Content MarketingLife ScienceSalesSales Enablement

No H1B

Responsibilities

Own the design, development, and optimization of scalable data ingestion pipelines using Azure Data Factory (ADF)

Design robust pipelines for high-volume, complex sources including Salesforce, Google Analytics (GA4), and internal APIs

Architect efficient loading patterns into Snowflake (Snowpipe, External Stages), ensuring that the 'Raw Layer' is optimized for cost and performance before transformation begins

Act as the primary partner to the Analytics Engineering team

Collaborate on Raw Layer schema design, ensuring that data lands in a structure that is easily consumable by dbt, preventing 'garbage in' scenarios

Provide the downstream teams with thoroughly documented reliable raw data feeds

Design dependency-aware pipeline orchestrations that manage the full data lifecycle, ensuring data arrives in the correct order and at the required frequency

Continuously monitor pipeline performance (latency, throughput) and optimize ADF resource allocation to control costs without sacrificing speed

Define and lead the implementation of CI/CD pipelines for data workflows

Implement security best practices within the ingestion layer, specifically regarding Azure Key Vault for credential management and PIPL/GDPR compliance for PII handling