PTR Global · 9 hours ago
Data Systems Engineer
Menlo Park, CA
Contract
Hybrid
Senior Level
$60/hr - $69/hr
7+ years expPTR Global is seeking a Data Systems Engineer to join their team, focusing on developing and maintaining ETL pipelines within a large-scale distributed system. The role involves working with technologies such as Kafka, ELK, and Linux to ensure the smooth operation of data processing for hundreds of customers.
Hiring Manager
Akash Khajuria
Responsibilities
This person will not only be doing the pipeline development, but will work in large scale cluster setting
Will requires the understanding of scalability in the kafka environment
This person will ensure the jobs are up and running, debug it and support the 100s of customers who use their system
Be the person to support those people
Pipeline development using Kafka, ELK and Hycon
Will need a strong knowledge of linux because that’s where they deploy their jobs in the 100s
Pipeline is within kafka and almost all the data is writing within ELK (need to understand how the data is stored)
Understand distributed systems architecture, design and tradeoff
Design and develop ETL pipelines with a wide range of technologies
Able to work on full cycle of development including defining requirement, design, implementation, testing, deployment
Strong communication skills to collaborate with various teams
Able to learn new technologies and work independently
Qualification
Required
7-15 years Exp
Strong working knowledge on Linux platform
Application Development Exp - Python (#1) - Ruby or Shell (#2)
Ability to run the application within Linux - debug - understand memory CPU, etc
ELK (Elastic Search) Exp
Kafka building pipeline with ELK and Kafka
Strong communication skills
Team Player
Open to learning and getting their hands dirty
Ability to learn - Curiosity
5 years of application development experience
At least 2 years data engineering with Kafka
Working experience writing and running applications on Linux
5 years of coding experience with at least one of the languages: Python, Ruby, Java, C/C++, GO
SQL and database experience
Preferred
Fling
Snowflake Database Exp
Spark Data processing
Good Data Analysis Background
ELK Certification
Observability and Data Analysis
AWS or other cloud technologies
ElasticSearch ELK
Company
PTR Global
Engage with the largest Latina-owned IT & Professional staffing provider in the U.S.
201-500 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase