Senior Data Engineer GCP (remote Europe) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Revolgy · 3 months ago

Senior Data Engineer GCP (remote Europe)

Revolgy is a leading multinational company providing digital transformation services through online collaboration tools and cloud infrastructure. As a Senior Data Engineer, you will lead complex data platform migrations to Google Cloud Platform, focusing on refactoring Databricks workloads and migrating DBT environments.

Cloud InfrastructureInformation Technology

Responsibilities

Refactor Spark & Databricks Workloads: Architect and lead the refactoring of complex Spark/PySpark jobs from Databricks into GCP-native services, specifically Dataflow or Dataproc. You will determine the best-fit execution engine for legacy logic
Migrate DBT Architecture: Own the migration of the data transformation layer, specifically migrating ~60 interdependent SQL models within DBT (Data Build Tool), ensuring logical and functional parity with the source system
Design Migration Strategy: Lead the design and implementation of the end-to-end data migration strategy, with a sharp focus on BI integration (e.g., AWS QuickSight to BigQuery) and robust pipeline testing
Ensure Data Integrity: Design and implement a comprehensive data validation framework to ensure data quality and accuracy between source (Databricks) and target (BigQuery) systems

Qualification

DBTGCPSparkData MigrationData QualityCloud ComposerBigQueryVertex AIDataPlexInnovationTeamwork

Required

Deep DBT Expertise: You possess strong, hands-on experience with DBT (dbt-core, dbt-bigquery). You have successfully migrated or managed complex environments with 60+ interdependent SQL models
Spark to GCP Refactoring: You have proven experience refactoring Spark jobs (specifically Databricks) into GCP Dataflow or Dataproc. You understand the nuances of translating PySpark logic into Beam or Cloud-native processing
5+ years of hands-on experience as a data engineer with a track record of delivering complex, enterprise-scale data platform migrations (especially AWS/Databricks to GCP)
3+ years of deep experience with the core GCP data stack, including BigQuery, Cloud Composer, Vertex AI, and DataPlex

Benefits

Fully Remote: A 100% remote position with the flexibility to manage your own schedule.
Impactful Culture: Join a supportive team driven by values like teamwork and innovation, where your proactivity is always celebrated.
Commitment to Growth: We invest in your professional development through our "Continuous Learning" mindset, supporting both hands-on experience and certifications (like GCP Professional Cloud Architect).
Innovation in Action: AI and automation aren't just buzzwords here. They are essential tools we expect everyone to use to amplify their impact.
Autonomy & Accountability: Enjoy the flexibility and trust to influence your work, with full accountability for delivering results.

Company

Revolgy

twittertwittertwitter
company-logo
Revolgy focus on providing next generation cloud services.

Funding

Current Stage
Growth Stage
Total Funding
unknown
Key Investors
Sandberg Capital
2020-06-18Private Equity
Company data provided by crunchbase