PulsePoint · 3 months ago
Senior Data Engineer, DPD Team (Remote, International)
PulsePoint is a leading healthcare ad technology company that uses real-world data in real-time to optimize campaign performance and revolutionize health decision-making. The Senior Data Engineer will design, build, and maintain scalable data processing systems while optimizing jobs and ensuring data quality across various platforms.
Advertising PlatformsAnalyticsContentContent DiscoveryContent SyndicationHealth CareInternet
Responsibilities
Design, build, and maintain reliable and scalable enterprise-level distributed transactional data processing systems for scaling the existing business and supporting new business initiatives
Optimize jobs to utilize Kafka, Hadoop, Presto, Spark, and Kubernetes resources in the most efficient way
Monitor and provide transparency into data quality across systems (accuracy, consistency, completeness, etc)
Increase accessibility and effectiveness of data (work with analysts, data scientists, and developers to build/deploy tools and datasets that fit their use cases)
Collaborate within a small team with diverse technology backgrounds
Provide mentorship and guidance to junior team members
Ingest, validate and process internal & third party data
Create, maintain and monitor data flows in Python, Spark, Hive, SQL and Presto for consistency, accuracy and lag time
Maintain and enhance framework for jobs(primarily aggregate jobs in Spark and Hive)
Create different consumers for data in Kafka using Spark Streaming for near time aggregation
Tools evaluation
Backups/Retention/High Availability/Capacity Planning
Review/Approval - DDL for database, Hive Framework jobs and Spark Streaming to make sure they meet our standards
Qualification
Required
8+ years of data engineering experience
Strong skills in and current experience with SQL and Python
Strong recent Spark experience (3+ years)
Experience working in on-prem environments
Hadoop and Hive experience
Proficiency in Linux
Strong understanding of RDBMS and query optimization
Passion for engineering and computer science around data
East Coast U.S. hours 9am-6pm EST; you can work fully remotely
Notice period needs to be less than 2 months (or 2 months max)
Knowledge and exposure to distributed production systems i.e Hadoop
Preferred
Experience in Scala/Java is a plus (Polyglot programmer preferred!)
Knowledge and exposure to Cloud migration (AWS/GCP/Azure) is a plus
Company
PulsePoint
PulsePoint is a technology company using data to accelerate healthcare marketing.
H1B Sponsorship
PulsePoint has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (4)
2023 (6)
2022 (11)
2021 (14)
2020 (5)
Funding
Current Stage
Growth StageTotal Funding
$43.49M2021-04-29Acquired
2015-09-29Debt Financing· $30M
2013-01-01Series Unknown· $3M
Recent News
2025-10-16
Company data provided by crunchbase