Apply on Employer Site

Optomi · 13 hours ago

Senior Data Engineering Specialist

New Jersey, United States

Full-time

Hybrid

Senior Level

$65/hr - $70/hr

Optomi is seeking a Senior Data Engineering Specialist with extensive Databricks experience to enhance data pipelines and products. The role involves designing scalable data solutions, collaborating with stakeholders, and driving a shift towards a Databricks-first architecture.

Information TechnologyRecruiting

H1B Sponsor Likely

Responsibilities

Design, build, and maintain Databricks-based data pipelines using best practices and modern patterns

Implement ingestion and transformation workflows leveraging Autoloader, batch and real-time/streaming pipelines, and orchestrated jobs

Apply Medallion architecture principles (Bronze/Silver/Gold) to build reliable, high-quality datasets and curated data marts

Develop using Spark (Spark SQL / PySpark) and Python to support current needs and future high-volume/unstructured ingestion

Partner with business stakeholders to clarify requirements, translate them into scalable solutions, and communicate tradeoffs clearly

Contribute to modeling and analytics enablement, including star schema and relational modeling to support BI/reporting use cases

Support data governance and platform-aligned practices (e.g., cataloging, lineage, quality) as part of delivery work

Mentor peers and contribute to engineering standards, reusable patterns, and documentation

Qualification

DatabricksData engineering principlesAdvanced SQLMedallion architectureStreaming experienceT-shaped talentCommunication skills

Required

Strong understanding of the full Databricks ecosystem with demonstrated delivery experience

Hands-on experience with Databricks Autoloader

Building pipelines end-to-end (including real-time ingestion where applicable)

Medallion architecture and data product thinking

Advanced SQL skills (core competency)

Solid foundation in data engineering principles: Data warehousing concepts, data marts, lake/lakehouse concepts

Star schema, relational modeling, and pipeline design rationale (“the why”)

Strong communication skills: able to articulate requirements, explain solutions, and align across teams

Ability to work as T-shaped talent: deep in Databricks, flexible in adjacent areas when needed

Preferred

Cloud experience in Azure (preferred), with openness to Databricks experience in AWS/GCP

Streaming/eventing experience with Azure Event Hubs and/or Kafka (Kafka welcome and highly transferable)

Familiarity with tools/approaches such as Debezium, Flink, or similar streaming/CDC technologies

Experience with Power BI modeling (star schema, semantic model design, relationships, and performance considerations)

Exposure to legacy/on-prem data tools such as Informatica PowerCenter and/or Netezza (not required)

Comfort picking up Python-based ML pipelines if needed (ML engineering experience not required)

Company

Optomi

Glassdoor3.8

OPTOMI is an IT staffing firm that serves its consultants, clients, and employees through its consultant-focused approach.

Founded in 2012

Roswell, Georgia, USA

501-1000 employees

http://www.optomi.com/

H1B Sponsorship

Optomi has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (7)

2024 (6)

2023 (2)

2022 (5)

2021 (8)

2020 (7)