Apply on Employer Site

Scalence L.L.C. · 2 months ago

Cloud Data Engineer – GCP & Streaming

HARTFORD, CT

Full-time

Onsite

Mid Level

$45/hr - $60/hr

Scalence L.L.C. is seeking a Cloud Data Engineer with expertise in GCP and streaming technologies. The role involves designing and implementing data pipelines, working with various GCP services, and ensuring efficient data processing and management.

Information Technology & Services

No H1B

Responsibilities

Proven experience in designing and implementing data pipelines using GCP services like BigQuery, Cloud Storage, and Pub/Sub

Strong proficiency in Python for writing clean, efficient, and scalable code

Experience with Cloud Composer (Apache Airflow) for workflow management

Expertise in writing complex SQL queries in BigQuery, including window functions and performance tuning

Hands-on experience with real-time data processing using Apache Kafka

Experience with NoSQL databases, particularly MongoDB, with a focus on scalable schema design

Proficiency in Shell scripting and Linux system administration

Strong analytical and problem-solving skills for troubleshooting data-related issues

Qualification

GCP servicesPythonSQL queriesApache KafkaNoSQL databasesShell scriptingLinux system administrationAnalytical skillsProblem-solving skills

Required

Applicants must be able to work directly on W2