200+ applicants

Company

Endpoint Clinical · 12 hours ago

Data Engineer

United States

Full-time

Remote

Senior Level, Lead/Staff

$100K/yr - $140K/yr

8+ years exp

Maximize your interview chances

Clinical TrialsComputer

H1B Sponsor Likely

Hiring Manager

Melissa Tran Araza, PHR

Insider Connection @Endpoint Clinical

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and other big data technologies.

Optimize data workflows to handle large volumes of data efficiently.

Build and manage data warehouses and data lakes to store structured and unstructured data.

Utilize SQL, Python, Spark for data extraction, transformation, and loading (ETL) processes.

Work closely with data analysts and data scientists to understand their data needs and ensure the availability of clean, reliable data.

Integrate data from various sources, ensuring consistency and accuracy across the data ecosystem.

Implement data quality checks to ensure data accuracy, completeness, and consistency.

Develop and enforce data governance policies and procedures to maintain high data quality standards.

Develop and support BI tools and dashboards, providing business insights and data-driven decision-making support.

Work with stakeholders to understand reporting requirements and deliver actionable insights.

Automate repetitive data processing tasks to improve efficiency and reduce manual work.

Continuously monitor and improve data pipeline performance, addressing bottlenecks and optimizing resources.

Document data processes, workflows, and architecture for future reference and knowledge sharing.

Ensure compliance with data security and privacy regulations, such as GDPR, HIPAA, etc.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

DatabricksSQLPythonSparkETL processesBig Data toolsData warehousingBI toolsAzure ADFData modelingData architectureMachine learning conceptsData initiative leadershipData strengthsWeaknesses understandingLogical data modelingPhysical data modeling

Required

Bachelor's degree in Computer Science, Software Engineering, Mathematics, or a related technical field

8+ years of technical experience with a strong focus on Big Data technologies in any of these areas: software engineering, integrations, data warehousing, data analysis, business intelligence, preferably at a technology or biotech/pharma company

Proficiency in Databricks for data engineering tasks

Advanced knowledge of SQL for complex queries, data manipulation, and performance tuning

Strong programming skills in Python for scripting and automation

Experience with Big Data tools (e.g., Spark, Hadoop) and data processing frameworks

Familiarity with BI tools (e.g., Tableau, Power BI) and experience in developing dashboards and reports

Experience with cloud platforms & tools like Azure ADF or Databricks

Familiarity with data modeling and data architecture design

Understanding of machine learning concepts and their application in data engineering

Keen attention to detail and bias for action

Excellent organizational skills and proven ability to multi-task

Ability to influence without authority and lead successful teams

Strong interpersonal skills with the ability to work effectively with a wide variety of professionals

Ability to lead back-end data initiatives – identify data sources, write scripts, transfer and transform data, and automate processes

Ability to understand source data, its strengths, weaknesses, semantics, and formats

Excellent knowledge of logical and physical data modeling concepts (relational and dimensional)

Benefits

Medical

Dental

Vision

Life

STD/LTD

401(K)

Paid time off (PTO) or Flexible time off (FTO)

Company bonus where applicable

Company

Endpoint Clinical

Glassdoor

3.5

Endpoint Clinical designs, engineers, and tests interactive response technology platforms that enables data access through phones.

Founded in 2009

San Francisco, California, USA

501-1,000 employees

http://www.endpointclinical.com

H1B Sponsorship

Endpoint Clinical has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2021 (16)

2020 (11)