Curate Partners · 1 day ago
Data Engineer
Curate Partners is seeking a Data Engineer with 2–5 years of experience who can work confidently in a GCP-based big data environment. The role involves building and maintaining data pipelines, ensuring data integrity and security while collaborating with various teams to manage data usage and governance.
Responsibilities
Build, maintain, and support data pipelines in Google Cloud Platform (GCP)
Safely move, replicate, or transform data while understanding permissions, access controls, and pipeline dependencies
Analyze existing data workflows to assess impact before making changes
Troubleshoot data access, permission, and pipeline issues in production environments
Use SQL to validate data accuracy, completeness, and consistency
Use Python for data processing, automation, and pipeline support
Develop and support batch data processing jobs using GCP Dataproc
Monitor pipeline performance and data quality, escalating issues as needed
Collaborate with platform, security, and analytics teams to ensure proper data usage and governance
Document data flows, dependencies, and operational procedures
Qualification
Required
2–5 years of experience in data engineering or a closely related role
Hands-on experience with Google Cloud Platform (GCP)
Experience working with Dataproc and big data processing frameworks
Strong SQL skills for querying and validating large datasets
Working knowledge of Python for data processing and automation
Experience working in big data environments
Understanding of data permissions, access control, and security concepts
Ability to make changes carefully and thoughtfully in production pipelines
Preferred
Experience supporting production data pipelines in enterprise environments
Familiarity with data governance or regulated data environments
Experience working with analytics or reporting consumers downstream
Comfortable working independently with guidance on complex systems
Company
Curate Partners
Curate Partners is a specialized recruitment agency that bridges the talent gap in digital transformation.