Impac Exploration Services ยท 5 months ago
Data Engineer - Real-Time Systems
Impac Exploration Services is seeking a Data Engineer to join their DATUM division, focusing on real-time systems. The role involves building streaming pipelines and infrastructure for real-time machine learning inference, enabling insights from data that flows continuously from various sources.
EnergyOil and Gas
Responsibilities
Streaming pipelines that handle millions of events per second
Infrastructure for real-time ML inference at the edge and core
Systems that treat historical data as streaming replay, not static files
Data architectures that scale
Fault-tolerant pipelines that keep flowing when hardware fails
Qualification
Required
Experience building streaming systems that stayed up when it mattered
Familiarity with Apache Kafka/Pulsar/Redpanda (or better alternatives)
Experience with Flink/Spark Streaming for complex event processing
Knowledge of time-series databases that can keep up (TimescaleDB, InfluxDB, or custom)
Proficiency in programming languages such as Python/Java/Rust
Experience with container orchestration without cloud vendor lock-in
Understanding of hardware from NVMe optimization to network tuning
Experience migrating from batch to streaming
Ability to handle millions of events per second in streaming pipelines
Experience building on-premise streaming infrastructure that rivals cloud offerings
Ability to make time-series data sing at scale
Belief that data gravity is a solvable problem
Preferred
Excitement for real-time inference over data warehousing
Experience with fault-tolerant pipelines that keep flowing when hardware fails
Philosophy that the best data lake is a flowing river
Understanding that every millisecond of latency is a missed opportunity
Experience with analytics that prevent problems rather than explaining them later
Company
Impac Exploration Services
Impac Exploration Services is a geoscience company that helps oil & gas companies to optimize assets and operations.
H1B Sponsorship
Impac Exploration Services has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (1)
2022 (1)
Funding
Current Stage
Growth StageCompany data provided by crunchbase