Apply on Employer Site

Case IQ · 2 months ago

Data Quality Engineer

United States

Full-time

Hybrid

Mid Level

CAD$70K/yr - CAD$90K/yr

3+ years exp

Case IQ helps companies protect their employees and business through software for uncovering and preventing fraud and security incidents. As a Data Quality Engineer on the Continuous Monitoring team, you will ensure the integrity of business-critical data and manage data testing activities to certify smooth data movement through pipelines.

AnalyticsComplianceHuman ResourcesInformation ServicesInformation TechnologyRisk ManagementSaaSSoftware

Responsibilities

Ensure the quality (accuracy, completeness, timeliness) of Continuous Monitoring customer data

Run, monitor, and troubleshoot Apache Airflow data pipelines

Leverage Apache Spark to design and implement scalable data processing pipelines, ensuring efficient handling of large datasets and high data quality

Implement and maintain data validation frameworks using Great Expectations

Write SQL queries to analyze data for various quality conditions

Develop and maintain Python-based data ingestion pipelines and automated test scripts

Debug issues and conduct exploratory testing to identify root cause of issues

Implement test plans and create test scenarios and test cases

Report defects and issues identified during the test process using a defect tracking system (Jira)

Attend daily stand-ups to report on testing progress and identify and impediments

Prioritize and implement multiple activities in parallel

Engage in peer reviews, requirements, code, design, and tests

Take ownership of the quality of the product, reproduce customer issues, and perform root cause analysis for test escapes

Work with developers to capture root causes and supporting artifacts (e.g., logs)

Qualification

Apache AirflowApache SparkSQLPythonGreat ExpectationsCI/CD pipelinesGitHubSoftware quality assuranceTroubleshootingInterpersonal skillsOrganizational skillsSelf-motivatedCollaborative