Data Engineer - Real-Time Systems jobs in United States
cer-icon
Apply on Employer Site
company-logo

Impac Exploration Services ยท 5 months ago

Data Engineer - Real-Time Systems

Impac Exploration Services is seeking a Data Engineer to join their DATUM division, focusing on real-time systems. The role involves building streaming pipelines and infrastructure for real-time machine learning inference, enabling insights from data that flows continuously from various sources.

EnergyOil and Gas
check
H1B Sponsor Likelynote

Responsibilities

Streaming pipelines that handle millions of events per second
Infrastructure for real-time ML inference at the edge and core
Systems that treat historical data as streaming replay, not static files
Data architectures that scale
Fault-tolerant pipelines that keep flowing when hardware fails

Qualification

Apache KafkaFlink/Spark StreamingReal-time ML inferenceTime-series databasesPython/Java/RustContainer orchestrationOn-premise streaming infrastructureNetwork tuningNVMe optimization

Required

Experience building streaming systems that stayed up when it mattered
Familiarity with Apache Kafka/Pulsar/Redpanda (or better alternatives)
Experience with Flink/Spark Streaming for complex event processing
Knowledge of time-series databases that can keep up (TimescaleDB, InfluxDB, or custom)
Proficiency in programming languages such as Python/Java/Rust
Experience with container orchestration without cloud vendor lock-in
Understanding of hardware from NVMe optimization to network tuning
Experience migrating from batch to streaming
Ability to handle millions of events per second in streaming pipelines
Experience building on-premise streaming infrastructure that rivals cloud offerings
Ability to make time-series data sing at scale
Belief that data gravity is a solvable problem

Preferred

Excitement for real-time inference over data warehousing
Experience with fault-tolerant pipelines that keep flowing when hardware fails
Philosophy that the best data lake is a flowing river
Understanding that every millisecond of latency is a missed opportunity
Experience with analytics that prevent problems rather than explaining them later

Company

Impac Exploration Services

twittertwittertwitter
company-logo
Impac Exploration Services is a geoscience company that helps oil & gas companies to optimize assets and operations.

H1B Sponsorship

Impac Exploration Services has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (1)
2022 (1)

Funding

Current Stage
Growth Stage
Company data provided by crunchbase