Senior Data Engineer – Observability & Security jobs in United States
cer-icon
Apply on Employer Site
company-logo

Colossus Technologies Group · 5 hours ago

Senior Data Engineer – Observability & Security

Colossus Technologies Group is partnering with a large enterprise organization to find a Senior Data Engineer to help build and scale a modern Observability Lakehouse. This role involves designing and operating high-volume log, metric, and trace pipelines, and working closely with SRE, Cloud, and Security teams to turn massive volumes of telemetry into actionable insight.

Computer & Network Security

Responsibilities

Design and operate high-volume log, metric, and trace pipelines
Work with distributed data platforms to support threat detection, incident response, and operational intelligence
Shape data models aligned to OpenTelemetry standards
Improve data quality and performance
Build automation that enables scalable, cost-efficient observability at enterprise scale

Qualification

Data EngineeringSecurityPythonAWS / Azure / GCPObservabilityDatabricksSparkOpenTelemetry (OTEL)SQLCI/CDTerraformHigh-volume log pipelinesOperational intelligenceAutomationSoft Skills

Required

Experience in data engineering, observability, and security
Ability to design and operate high-volume log, metric, and trace pipelines
Experience with distributed data platforms
Knowledge of threat detection, incident response, and operational intelligence
Ability to shape data models aligned to OpenTelemetry standards
Experience in improving data quality and performance
Ability to build automation for scalable, cost-efficient observability
Experience with Databricks, Spark, OpenTelemetry (OTEL), Delta Lake, Cribl / Vector, Kafka, AWS / Azure / GCP, Python, SQL, CI/CD, Terraform, and Observability Platforms (Splunk, Datadog, Elastic)

Preferred

Experience in a contract-to-hire role
Interest in building platforms, not just pipelines
Desire to improve security and reliability outcomes

Company

Colossus Technologies Group

twitter
company-logo
At Colossus Technologies Group, we provide top-tier cybersecurity and digital trust staffing, IT consulting, and project management solutions, including privacy, security, and GRC SaaS platform solution implementation.

Funding

Current Stage
Early Stage

Leadership Team

leader-logo
Kort Evans
Founder and Principal Cybersecurity Consultant
linkedin
Company data provided by crunchbase