Jobs via Dice · 10 hours ago
Data Engineer
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Resource Innovative Technologies LLC, is seeking a Senior Data Engineer who has a strong software engineering background and is skilled in building ELT pipelines and validating data. The role involves working in a fast-paced environment, ensuring data accuracy for executive dashboards, and contributing to a major cloud migration planned for the future.
Computer Software
Responsibilities
Independently validate & reconcile data
Write complex SQL without assistance
Catch and fix data issues before business escalation
Data feeds executive dashboards
CEO reviews data daily at 8am
Accuracy is critical
Qualification
Required
Software Engineering Foundation
Strong understanding of SOLID principles
Strong understanding of design patterns
Strong understanding of scalable, reusable architecture
Experience in test-driven development (TDD)
Experience in agile environments
Experience with CI/CD pipelines
Python proficiency (real engineering use cases, not scripting only)
Extensive experience building ELT pipelines
Experience loading data source ? target DB at scale
Strong knowledge of partitioning strategies
Strong knowledge of incremental loading
Strong knowledge of CDC (Change Data Capture)
Strong knowledge of idempotency
Strong knowledge of performance tuning & cost awareness
Familiar with Medallion Architecture (Bronze / Silver / Gold)
Strong knowledge of Cloud & Platform Stack (Very Important)
Strong knowledge of AWS
Strong knowledge of S3 (semi/unstructured data)
Strong knowledge of Iceberg
Strong knowledge of Snowflake
Strong SQL skills required: INSERT / UPDATE / DELETE / MERGE
Strong SQL skills required: Partition management
Current environment includes: Airflow (Astronomer – on-prem today)
Current environment includes: dbt
Current environment includes: SQL Server
Current environment includes: Dremio
Candidate must be able to independently validate & reconcile data
Candidate must be able to write complex SQL without assistance
Candidate must be able to catch and fix data issues before business escalation
Data feeds executive dashboards
Accuracy is critical
Preferred
Midstream oil & gas experience (big plus)
Upstream / Midstream / Downstream
Supply chain / logistics experience
Chemical engineering background
GitHub or personal projects (must be non-proprietary)
Knowledge of machine learning concepts
Company
Jobs via Dice
Welcome to Jobs via Dice, the go-to destination for discovering the tech jobs you want.
Funding
Current Stage
Early StageCompany data provided by crunchbase