LINQX · 1 day ago
Senior Data Engineer
LINQX is an industry-leading provider of end-to-end digital solutions and analytics for the oil and gas sector. The Senior Data Engineer designs, builds, and operates cloud-scale data platforms and pipelines that power AI, analytics, ML, and data products across the business.
Responsibilities
Lead the end-to-end design and implementation of enterprise data platforms (e.g., lakehouse, streaming, and “data hub” patterns); coordinate dependencies and integrations with product and enterprise systems
Provide technical leadership to internal and partner teams; plan scope, estimate effort, manage risks, and uphold delivery commitments
Coach engineers on data engineering standards, observability, and operational excellence; conduct design and code reviews
Define and evolve cloud data architecture (ingest, storage, compute, catalog, access) for both real-time and batch use cases; select services and patterns aligned to scalability, performance, and security requirements
Build robust data pipelines (ELT/ETL) using orchestration frameworks (e.g., Airflow, Dagster), event/stream platforms (e.g., Kafka/Kinesis/Event Hub/IoT Hub), and distributed processing (e.g., Spark/Databricks/Beam/Flink)
Implement lakehouse/lake patterns with medallion layering, CDC, and schema evolution; operationalize quality gates, testing, and lineage
Establish SLOs for data freshness, availability, and quality; implement observability (metrics, logs, lineage) and on-call runbooks
Optimize cost/performance of storage and compute; manage capacity, autoscaling, and usage governance for data solutions
Ensure privacy, security, and compliance (IAM, tokenization, row/column security, data retention); collaborate with enterprise security
Translate product and stakeholder requirements into data contracts and SLAs; document architecture and operational procedures
Evaluate emerging data technologies; create POVs and reference implementations
Anticipate future needs (multi-cloud, edge/IoT ingestion, vector/AI workloads) and create roadmaps and platform capabilities
Champion modernizing existing data architectures using current best practices: lakehouse, CDC, medallion layering, data mesh principles, and streaming
Strong software engineering in Python/SQL and one of Scala/Java; familiarity with REST/gRPC and microservices patterns
Expert with cloud data services (e.g., Azure Data Lake/Databricks/Synapse; or AWS S3/EMR/Glue/Redshift; or GCP BigQuery/Dataflow)
Hands-on with distributed stores (e.g., Delta/Iceberg/Hudi; Kafka; Redis) and both SQL/NoSQL databases (e.g., Postgres, Cosmos/ DynamoDB, MongoDB, Cassandra)
CI/CD (GitHub Actions/Azure DevOps), containerization (Docker/Kubernetes), Infrastructure as Code (Terraform)
Data governance and security (catalogs, lineage, RBAC/ABAC, encryption, key management)
Exposure to or experience implementing real time systems, with IoT/hardware design preferred, within oil and gas industry a huge plus
Excellent stakeholder communication; ability to translate business needs into scalable data solutions
Qualification
Required
Bachelor's in computer science, Engineering, or related field
5–10+ years in data engineering or platform roles delivering enterprise-grade data systems (SaaS or large-scale internal platforms)
2+ years leading or building technical design/delivery for cloud data platforms at scale
Proven delivery of streaming and batch pipelines, lakehouse implementations, and production ML data flows
Experience operating data platforms with SLAs/SLOs, cost governance, and on-call ownership
Strong software engineering in Python/SQL and one of Scala/Java
Familiarity with REST/gRPC and microservices patterns
Expert with cloud data services (e.g., Azure Data Lake/Databricks/Synapse; or AWS S3/EMR/Glue/Redshift; or GCP BigQuery/Dataflow)
Hands-on with distributed stores (e.g., Delta/Iceberg/Hudi; Kafka; Redis) and both SQL/NoSQL databases (e.g., Postgres, Cosmos/ DynamoDB, MongoDB, Cassandra)
CI/CD (GitHub Actions/Azure DevOps), containerization (Docker/Kubernetes), Infrastructure as Code (Terraform)
Data governance and security (catalogs, lineage, RBAC/ABAC, encryption, key management)
Excellent stakeholder communication; ability to translate business needs into scalable data solutions
Preferred
Master's degree in computer science, Engineering, or related field
Experience implementing real-time systems, with IoT/hardware design preferred
Experience within the oil and gas industry
Company
LINQX
Linqx provides cloud-based software solutions to optimize well construction, stimulation, and operations in the oil and gas industry.
Funding
Current Stage
Early StageCompany data provided by crunchbase