Mindlance · 15 hours ago
GCP/Cloud Engineer - Python/Spark / GCP Cloud Engineer / Cloud Engineer
Charlotte, NC
Contract
Hybrid
Senior Level
$70/hr - $85/hr
5+ years expMindlance is seeking a skilled GCP/Cloud Engineer to join their team in the Banking/Financial Industry. The role focuses on designing, deploying, and managing scalable data processing solutions in a cloud-native environment, collaborating closely with data scientists and software engineers to ensure high-performance data pipelines and analytics platforms.
Human Resources
Hiring Manager
Rohit Singh
Responsibilities
Platform Management: Deploy, configure, and maintain OpenShift clusters or GCP projects to support containerized Spark Applications
Data Pipeline Development: Design and implement large-scale data processing workflows using Apache Spark
Optimization: Tune Spark jobs for performance, leveraging OpenShift's resource management capabilities(e.g., Kubernetes orchestration, auto-scaling)
Integration: Integrate spark with other data sources (e.g., Kafka, s3, cloud storage) and sinks (e.g., databases, data lakes)
CI/CD Implementation: Build and maintain CI/CD pipelines for deploying Spark application in OpenShift or GCP using tools like GitHub actions, Sonar, Harness
Monitoring & Troubleshooting: Monitor cluster health, Spark job performance, and resource utilization using OpenShift tools (e.g., Prometheus, Grafana) and resolve issues proactively
Security: Ensure compliance with security standards, Implementing role-based access control(RBAC) and encryption for data in transit and at rest
Collaboration: Work with cross-functional teams to define requirements, Architect solutions, and support production deployments
Qualification
Required
Bachelor's degree in Computer Science, Engineering or related filed
5+ years working on Apache Spark for big data processing
3+ years of Django development experience
2+ years of creating and maintaining conda environments
4+ years managing containerized environments with OpenShift or Kubernetes
Proficiency in Spark frameworks(Python/PySpark, Scala, or Java)
Hands-on experience with OpenShift administration (e.g., cluster setup, networking, storage)
Proficiency in creating and maintaining Conda environments and dependencies
Familiarity with Docker and Kubernetes concerts(e.g., pods, deployments, services and images)
Knowledge of distributed systems, cloud platforms(AWS, GCP, Azure), and data storage solutions (e.g., S3, HDFS)
Strong coding skills in Python, Scala, or Java; experience with shell scripting is a plus
Experience with Git Actions, Helm, Harness, and CI/CD tools
Ability to debug complex issues across distributed systems and optimize resource usage
Company
Mindlance
Mindlance is a Staffing and Recruiting company which provides multi-vertical staffing services
1001-5000 employees
H1B Sponsorship
Mindlance has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (71)
2024 (53)
2023 (37)
2022 (72)
2021 (36)
2020 (40)
Funding
Current Stage
Late StageLeadership Team
R
Rajat Paul Dhall
Co-Founder & Managing Director
V
Vik Kalra
Co-Founder and Managing Director
Recent News
2025-11-19
Kelly Services, Inc.
2025-05-17
2025-04-14
Company data provided by crunchbase