Randstad Digital Americas ยท 2 days ago
Big Data Engineer
Charlotte, NC
Full-time
Onsite
Senior Level
$76.87/hr - $81/hr
5+ years expRandstad Digital is hiring and looking for a Big Data Engineer to join their team. The role involves designing and maintaining data pipelines, collaborating with teams on data security, and transforming data into actionable datasets.
Information Technology & Services
Responsibilities
Designing, developing, and maintaining scalable data pipelines and robust ETL/ELT processes to support our enterprise analytics initiatives
Architect distributed data processing solutions within a Cloudera Hadoop ecosystem, ensuring high performance and reliability
Take ownership of workflow orchestration using Apache Airflow to automate complex data lifecycles and monitor pipeline health
Collaborate with cross-functional teams to integrate data security best practices
Play a key role in migrating or integrating workloads within Google Cloud Platform (GCP)
Transform raw, disparate data into high-quality, actionable datasets while maintaining the highest standards of data integrity and security
Qualification
Required
5+ years of Big Data Engineer experience
Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related technical field
3+ years of professional experience in Python development, specifically for data manipulation, automation, and API integrations
Proven track record of building and optimizing 'big data' data pipelines, architectures, and data sets using PySpark and Cloudera Hadoop (Hive, Impala, HDFS)
Advanced experience with Apache Airflow for scheduling, monitoring, and managing complex DAGs (Directed Acyclic Graphs)
Strong command of SQL for profiling data, performing complex joins, and tuning query performance in distributed environments
Benefits
Medical
Prescription
Dental
Vision
AD&D
Life insurance offerings
Short-term disability
401K plan
Company
Randstad Digital Americas
Randstad Digital is a trusted digital enablement partner that facilitates accelerated transformation for businesses by providing global talent, capacity, and solutions across specialized domains.
10001+ employees
Funding
Current Stage
Late StageLeadership Team
Graig Paglieri
CEO, Randstad Digital Americas
Pascal de Hesselle
SVP, Executive Client Partner - Technology, Media & Telecom
Company data provided by crunchbase