Senior Data Engineer, DPD Team (Remote, International) jobs in United States
cer-icon
Apply on Employer Site
company-logo

PulsePoint · 3 months ago

Senior Data Engineer, DPD Team (Remote, International)

PulsePoint is a leading healthcare ad technology company that uses real-world data in real-time to optimize campaign performance and revolutionize health decision-making. The Senior Data Engineer will design, build, and maintain scalable data processing systems while optimizing jobs and ensuring data quality across various platforms.

Advertising PlatformsAnalyticsContentContent DiscoveryContent SyndicationHealth CareInternet
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Design, build, and maintain reliable and scalable enterprise-level distributed transactional data processing systems for scaling the existing business and supporting new business initiatives
Optimize jobs to utilize Kafka, Hadoop, Presto, Spark, and Kubernetes resources in the most efficient way
Monitor and provide transparency into data quality across systems (accuracy, consistency, completeness, etc)
Increase accessibility and effectiveness of data (work with analysts, data scientists, and developers to build/deploy tools and datasets that fit their use cases)
Collaborate within a small team with diverse technology backgrounds
Provide mentorship and guidance to junior team members
Ingest, validate and process internal & third party data
Create, maintain and monitor data flows in Python, Spark, Hive, SQL and Presto for consistency, accuracy and lag time
Maintain and enhance framework for jobs(primarily aggregate jobs in Spark and Hive)
Create different consumers for data in Kafka using Spark Streaming for near time aggregation
Tools evaluation
Backups/Retention/High Availability/Capacity Planning
Review/Approval - DDL for database, Hive Framework jobs and Spark Streaming to make sure they meet our standards

Qualification

Data engineering experienceSQLPythonSparkHadoopHiveLinuxScala/JavaRDBMS understandingCloud migration

Required

8+ years of data engineering experience
Strong skills in and current experience with SQL and Python
Strong recent Spark experience (3+ years)
Experience working in on-prem environments
Hadoop and Hive experience
Proficiency in Linux
Strong understanding of RDBMS and query optimization
Passion for engineering and computer science around data
East Coast U.S. hours 9am-6pm EST; you can work fully remotely
Notice period needs to be less than 2 months (or 2 months max)
Knowledge and exposure to distributed production systems i.e Hadoop

Preferred

Experience in Scala/Java is a plus (Polyglot programmer preferred!)
Knowledge and exposure to Cloud migration (AWS/GCP/Azure) is a plus

Company

PulsePoint

company-logo
PulsePoint is a technology company using data to accelerate healthcare marketing.

H1B Sponsorship

PulsePoint has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (4)
2023 (6)
2022 (11)
2021 (14)
2020 (5)

Funding

Current Stage
Growth Stage
Total Funding
$43.49M
2021-04-29Acquired
2015-09-29Debt Financing· $30M
2013-01-01Series Unknown· $3M

Leadership Team

leader-logo
Ezra Suveyke
CPO/CTO
linkedin
leader-logo
Andrew Stark
Chief Commercial Officer (CCO)
linkedin
Company data provided by crunchbase