Rockwoods Inc · 3 days ago
Data Engineer with Pyspark
Salt Lake City, UT
Full-time
Onsite
Senior Level, Lead/Staff
8+ years expRockwoods Inc is seeking an ETL Data Engineer with strong experience in building and supporting large-scale data pipelines. The role involves designing, developing, and optimizing ETL processes using tools like DataStage, SQL, Python, and Spark while collaborating with various teams to create efficient data solutions.
Information Technology & Services
Hiring Manager
Mohammed Shoaib
Responsibilities
Collaborate with architects, engineers, analysts, and business teams to develop and deliver enterprise-level data platforms that support data-driven solutions
Apply strong analytical, organizational, and problem-solving skills to design and implement technical solutions based on business requirements
Develop, test, and optimize software components for data platforms, improving performance and efficiency
Troubleshoot technical issues, identify root causes, and recommend effective solutions
Work closely with data operations teams to deploy updates into production environments
Provide support across Test, QA, and Production environments and perform additional tasks as needed
Qualification
Required
Bachelor's degree in Computer Science, Computer Engineering, or a related discipline
Strong experience in Data Warehousing, Operational Data Stores, ETL tools, and data management technologies
8+ years of hands-on expertise in ETL (IBM DataStage), SQL, UNIX/Linux scripting, and Big Data distributed systems
4+ years of experience with Teradata (Vantage), SQL Server, Greenplum, Hive, and delimited text data sources
3+ years of experience with Python programming, orchestration tools, and ETL pipeline development using Python/Pandas
Deep understanding of data migration, data analysis, data transformation, large-volume ETL processing, database modeling, and SQL performance tuning
Experience creating DDL scripts, stored procedures, and database functions
Practical experience with Git for version control and release processes
Familiarity with Spark framework, including RDDs using Python or Scala
Company
Rockwoods Inc
Our team has diverse group of experienced and talented professionals who can deliver everything from individual consulting and training to full-scale re-engineering, software planning, integration, database design, data migration and implementation.
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase