ESHYFT · 20 hours ago

Data Quality and Architecture Engineer

United States

Full-time

Remote

Mid Level

$110K/yr - $145K/yr

3+ years exp

Maximize your interview chances

AppsHealth Care

Growth Opportunities

Insider Connection @ESHYFT

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Design and maintain scalable data models to ensure optimal performance and usability for analytics and downstream systems.

Define and implement best practices for data governance, including lineage, cataloging, and documentation.

Collaborate with data engineers to optimize ETL/ELT processes for reliability and performance.

Develop and execute data validation frameworks, ensuring accuracy and consistency across pipelines and workflows.

Create and maintain unit tests, integration tests, and regression tests for data systems, including dbt models and Salesforce workflows.

Monitor data pipeline health using observability tools or custom monitoring scripts to proactively address data issues.

Design and implement custom APIs for data integration and pipeline automation.

Build, test, and deploy end-to-end data pipelines to integrate disparate data sources into cloud platforms like BigQuery.

Write efficient, scalable code for data ingestion, transformation, and delivery in dbt.

Optimize pipeline performance, ensuring low-latency and high-reliability data flows.

Partner with developers, product managers, and analytics teams to understand data requirements and workflows.

Support integration of marketing and analytics tools (e.g., Braze, Mixpanel, GrowthBook) with reliable data pipelines.

Document and communicate data lineage and data dictionary updates for business and technical stakeholders.

Automate data testing and monitoring processes to improve efficiency and reduce manual effort.

Stay updated with the latest data architecture, pipeline development, and quality assurance trends, applying them to enhance system performance.

Suggest architectural improvements to prevent downstream disruptions and ensure data scalability.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Data modelingPipeline validationData architecture designSQLDbtPostgreSQLMySQLSalesforce workflowsETL/ELT processesCustom APIsPythonJavaScriptBigQuerySnowflakeFlaskFastAPINode.jsAirflowMageCI/CD pipelinesGitObservability tools