GCP Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Programmers.io · 5 hours ago

GCP Data Engineer

Programmers.io is seeking a GCP Data Engineer for one of their leading clients. The role involves designing and implementing scalable data solutions using GCP tools, developing data models for analytics, and ensuring compliance with healthcare regulations.

Enterprise SoftwareInformation TechnologyManufacturingSoftware
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Dhirender Yadav
linkedin

Responsibilities

Architect Scalable Data Solutions: Design and implement data warehouses, marts, lakes, and batch and/or real-time streaming pipelines using GCP-native tools
Data Modeling & Integration: Design and Develop conformed data models (star/snowflake schemas) and ETL/ELT processes for analytics and BI tools (MicroStrategy, Looker, Power BI)
Pipeline Development: Build scalable pipelines and automate data ingestion and transformation workflows using BigQuery, Dataflow , Dataproc/PySpark, Cloud Functions, Pub/Sub, Kafka, and Cloud Composer for orchestration
Security & Compliance: Implement IAM, encryption, and compliance standards (GDPR, HIPAA) with GCP security tools
Performance Optimization: Apply best practices for partitioning, clustering, and BI Engine to ensure high performance and cost efficiency
DevOps & Automation: Integrate CI/CD pipelines, IaC (Terraform), and containerization (Docker, Kubernetes) for deployment and scalability
Collaboration & Leadership: Engage with stakeholders including leadership, Project Managers, BAs, Engineers, QA, platform teams, mentor teams, and provide technical guidance on best practices
Troubleshooting: Resolve complex technical issues and support incident response
Healthcare Domain Expertise: Ensure compliance with healthcare regulations and stay updated on industry trends

Qualification

GCP ExpertiseAdvanced SQLPythonPerformance OptimizationAutomationSecurityArchitecture DesignDomain KnowledgeCommunication

Required

GCP Expertise: BigQuery, Cloud Storage, Dataflow (Apache Beam with python), Dataproc/PySpark, Cloud Functions, Pub/Sub, Kafka, Cloud Composer
Programming: Advanced SQL and Python for analytics and pipeline development
Performance Optimization: Experience with optimization of query performance, partitioning, clustering, and BI Engine, in BigQuery
Automation: Experience with CI/CD for data pipelines, IaC for data services, automation of ETL/ELT processes
Security: Strong knowledge of IAM, encryption, and compliance frameworks
Architecture Design: Ability to create fault-tolerant, highly available, and cost-optimized solutions
Communication: Excellent ability to convey technical concepts to both technical and non-technical stakeholders
Domain Knowledge: Familiarity with healthcare data management and regulatory compliance

Company

Programmers.io

twittertwittertwitter
company-logo
IBM i is evolving. And so are we.

H1B Sponsorship

Programmers.io has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (2)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Anshul Choudhry
President
linkedin
Company data provided by crunchbase