200+ applicantsPosted by Agency
Emerald Resource Group ยท 2 days ago
Senior Data Engineer
United States
Full-time
Remote
Senior Level
$125K/yr - $140K/yr
10+ years exp
Wonder how qualified you are to the job?
Maximize your interview chancesRecruitingStaffing Agency
Hiring Manager
Thomas Gaebelein
Insider Connection @Emerald Resource Group
Responsibilities
Design, develop, and maintain ETL workflows using Airflow, leveraging Python to orchestrate data transformations.
Collaborate with cross-functional teams to understand data requirements and implement efficient solutions.
Optimize and tune infrastructure to support data processing and storage needs, utilizing services / databases such as Oracle, SQL Server, Python, Databricks etc.)
Troubleshoot and debug data pipelines, ensuring reliability and accuracy in data delivery.
Stay updated on industry best practices and emerging technologies, driving continuous improvement in our data engineering processes.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Bachelor's degree in Computer Science, Engineering, or related field.
10 years experience within data and development.
Spark and Databricks expertise (this is the most important)
Proven experience in data engineering, with a focus on ETL development and workflow automation.
Strong data warehouse experience, including creating using Kimball, STAR, and Snowflake methodologies. You must also be able to tune and manage non-relational DB and Data Lakes
Strong proficiency in Python programming, with hands-on experience in development.
Experience developing BI solutions with market-edge tools (PowerBI, SAS, Qlik, etc.)
Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
Company
Emerald Resource Group
Emerald Resource Group is a professional staffing and solutions firm that specializes in the Information Technology Industry.
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase
