SIGN IN
Lead Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Auris · 1 day ago

Lead Data Engineer

Auris is a payroll and HR partner built for small and medium-sized businesses. They are seeking a Lead Data Engineer to lead the design and implementation of scalable data pipelines and ensure engineering best practices across the team.
Financial Services

Responsibilities

Lead the design and implementation of scalable data pipelines across Azure Data Factory, batch, streaming, messaging platforms (Kafka, Event Hub, or similar)
Architect and optimize data models and storage patterns in Azure SQL, including performance tuning, partitioning, indexing, and workload optimization
Support and modernize legacy Oracle environments, including schema design, PL/SQL logic, and data extraction strategies
Drive the migration of data assets from Oracle to Azure SQL using tools such as SSMA, ADF, and custom ETL/ELT frameworks
Apply strong software engineering principles (CI/CD, version control, testing, code reviews, modular design) to all data engineering work
Build reusable frameworks, libraries, and automation to accelerate data ingestion, transformation, and quality checks
Ensure engineering best practices across the team, including coding standards, documentation, and observability
Design and implement streaming data pipelines using Spark Structured Streaming, Kafka, Event Hub, or similar technologies
Build and maintain high‑throughput, low‑latency data ingestion and processing systems
Integrate streaming and batch pipelines into unified, reliable data products
Implement data quality frameworks, monitoring, and observability across pipelines
Partner with data governance teams to ensure lineage, metadata, and compliance requirements are met
Enforce secure data access patterns and RBAC across Azure environments
Mentor and guide data engineers, promoting a culture of technical excellence and continuous learning
Collaborate with DBAs, analysts, architects, and business stakeholders to deliver high‑impact data solutions
Influence platform strategy, tooling decisions, and long‑term data architecture

Qualification

Azure SQLOracleData EngineeringStreaming PipelinesPythonCI/CDSparkData ModelingLeadershipCollaboration

Required

10+ years of experience in data engineering with a strong foundation in software engineering
Deep expertise in Azure SQL (performance tuning, T-SQL, security, optimization)
Strong experience with Oracle (PL/SQL, schema design, performance tuning, data extraction)
Hands-on experience with Spark (Databricks, PySpark, or Scala Spark) is preferred
Experience building streaming pipelines using Kafka, Event Hub, or similar platforms
Strong proficiency in Python, SQL, and at least one general-purpose programming language (Java, Scala, C#, etc.)
Experience with CI/CD, Git, DevOps practices, and infrastructure-as-code (Terraform, ARM, Bicep)
Strong understanding of distributed systems, data modeling, and data architecture patterns

Preferred

Hands-on experience with Spark (Databricks, PySpark, or Scala Spark) is preferred

Benefits

Comprehensive medical insurance, dental insurance, and vision insurance
Life and disability insurance
Fertility benefits
Wellness resources
Paid sick time
Generous paid time off and holidays
Employee Assistance Program (EAP)
A complimentary Calm app subscription
Immediate vesting in a 401(k) plan
Health Savings Account (HSA) and Flexible Spending Account (FSA) options
Commuter benefits
Employee discount programs
Paid maternity leave and paid paternity leave (including for adoptive parents)
Legal plan options
Pet insurance coverage

Company

Auris

twitter
company-logo
Auris™ is the payroll and HR partner built for small and medium-sized businesses who can’t afford to get it wrong.

Funding

Current Stage
Late Stage
Company data provided by crunchbase