Compunnel Inc. · 5 hours ago
ETL Data QA
United States
Contract
Remote
Mid Level
4+ years exp
Maximize your interview chancesIT Services and IT Consulting
Hiring Manager
Rakesh T.
Insider Connection @Compunnel Inc.
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Develop and execute test plans, test cases, and scripts to validate data pipelines, BI reports, dashboards, ETL processes, schemas, tables, stored procedures, queries, jobs and ETL in support of all data lake, data warehouse feeds, functions, data layers and integrations for on-premises and cloud environments.
Perform through data quality checks, including data completeness, accuracy, consistency, and timeliness.
Identify, document, and track data defects, and work with data engineers (ETL developers) to resolve issues.
Develop automated test scripts using tools like Python, SQL, or cloud-native testing frameworks.
Integrate automated tests into CI/CD pipelines to ensure continuous testing and monitoring of data quality in real-time.
Maintain and enhance the automation framework, ensuring it is scalable and adaptable to changing data requirements.
Generate reports on data quality metrics, test coverage, and defect rates, providing insights to drive continuous improvement.
Develop dashboards and visualizations to track data quality trends over time.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
4 - 6 years’ experience leading and executing Data Quality Assurance testing which includes hands-on experience in manual and automated testing and test data generation for Data Lakes; Data Warehouse models (Star Schemas); ETL; tables; views; cubes; reports; dashboards and inbound/outbound feeds and integrations; applications, and inter-connected systems.
Develop and execute test plans, test cases, and scripts to validate data pipelines, BI reports, dashboards, ETL processes, schemas, tables, stored procedures, queries, jobs and ETL in support of all data lake, data warehouse feeds, functions, data layers and integrations for on-premises and cloud environments.
Perform through data quality checks, including data completeness, accuracy, consistency, and timeliness.
Identify, document, and track data defects, and work with data engineers (ETL developers) to resolve issues.
Develop automated test scripts using tools like Python, SQL, or cloud-native testing frameworks.
Integrate automated tests into CI/CD pipelines to ensure continuous testing and monitoring of data quality in real-time.
Maintain and enhance the automation framework, ensuring it is scalable and adaptable to changing data requirements.
Generate reports on data quality metrics, test coverage, and defect rates, providing insights to drive continuous improvement.
Develop dashboards and visualizations to track data quality trends over time.
5+ years’ proficiency in complex SQL, Python, or any other scripting languages used for data testing/data test automation.
Direct experience with cloud-based data services such as Azure DevOps, Azure Blob Storage, Azure Data Factory, Cloud Power, etc.
Familiarity with CI/CD tools (Jenkins, GitLab, etc.) and integrating testing into deployment pipelines.
Knowledge of data quality frameworks and tools
Company
Compunnel Inc.
Founded in 1994, Compunnel Inc.
1,001-5,000 employees
H1B Sponsorship
Compunnel Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (1572)
2022 (2192)
2021 (2385)
2020 (2157)
Funding
Current Stage
Late StageLeadership Team
Andy Gaur
Founder, Chairman & CEO
Karthik Natarajan
Executive VP & CTO
Company data provided by crunchbase
