The Dignify Solutions, LLC · 2 months ago
Data Engineer (GCP/ Spark/Pyspark & Scala functional)
Bentonville, AR
Full-time
Onsite
Senior Level
$100K/yr - $120K/yr
7+ years expThe Dignify Solutions, LLC is seeking a Data Engineer with expertise in GCP and Spark technologies. The role involves working with Big Data technologies and managing workflows, requiring strong skills in Scala, Spark, and various data processing tools.
AccountingEducationHuman ResourcesBookkeeping and PayrollRecruitingStaffing AgencyTraining
Responsibilities
Experience with workflow management tools such as Jenkins, Airflow
Experience running spark/hadoop workloads using Dataproc, Dataflow, Cloud composer, EMR, HD Insights or similar
Proven working expertise with Big Data Technologies Spark, PySpark, hive, and SQL
Demonstrates expertise in writing complex, highly optimized queries across large data sets
Knowledge and experience in Kafka, Storm, Druid and Presto
Qualification
Required
7 years exp
Tech Skills - Scala, Spark, GCP, Dataproc, Hadoop, Airflow, SBT, Maven, Docker, Kubernetes, pyspark, Jenkins, Bigquery
Experience with workflow management tools such as Jenkins, Airflow
Experience running spark/hadoop workloads using Dataproc, Dataflow, Cloud composer, EMR, HD Insights or similar
Proven working expertise with Big Data Technologies Spark, PySpark, hive, and SQL
Demonstrates expertise in writing complex, highly optimized queries across large data sets
Knowledge and experience in Kafka, Storm, Druid and Presto
Company
The Dignify Solutions, LLC
The Dignify Solutions with Global Capabilities and Local Excellence – has combined experience of 30 +years in Client Services/ Engagement/ Relationship/ Partnership, Sales/ Account Management, Service Delivery, Recruiting, Staffing and Talent Acquisition for the whole gamut of skillsets in Information Technology (Digital Transformation, Artificial Intelligence, Machine Learning and other business domains).
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase