Lead Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Valtech · 8 hours ago

Lead Data Engineer

Valtech is the experience innovation company that partners with recognized brands to drive transformation. The Lead Data Engineer will design and manage data architecture within Microsoft Fabric, lead data engineering efforts, and collaborate with cross-functional teams to implement effective data solutions.

ConsultingInformation ServicesInformation Technology

Responsibilities

Design and own the end‑to‑end medallion data architecture within Microsoft Fabric, including Bronze/Silver/Gold standards, modeling patterns, and governance frameworks
Define and drive architectural standards, patterns, and best practices across ingestion, transformation, data modeling, lineage, quality, and orchestration
Partner as a peer with the Director of Data & Analytics to shape long-term platform strategy, roadmap, and technical decision-making
Anticipate downstream implications of architectural choices, proactively guiding decisions that ensure long-term reliability, scalability, and maintainability
Architect and build highly available, distributed, fault‑tolerant data pipelines supporting batch and real‑time workloads
Lead the migration and integration of multiple disparate data sources into the new Fabric-based enterprise platform
Define data modeling approaches for enterprise‑scale structured, semi‑structured, and unstructured datasets
Establish end‑to‑end standards for ingestion → processing → serving layers
Tune and optimize distributed processing across large datasets and high-volume pipelines
Develop complex transformations and scalable pipelines using SQL, Python, dbt, and Fabric-native tools
Implement automation across the Fabric ecosystem leveraging REST APIs, Data Factory, pipelines, and workflow orchestration
Guide and mentor engineering teams on advanced data architecture concepts, distributed systems, metadata management, and platform hygiene
Conduct root cause analysis on platform issues, driving permanent solutions rather than short-term fixes
Act as a senior technical authority in design reviews, architectural discussions, and cross‑functional planning
Collaborate with analytics, product, and business stakeholders to understand requirements and translate them into architectural solutions
Communicate complex technical concepts clearly to both technical and non‑technical audiences

Qualification

Microsoft FabricSQLPythonData ArchitectureCloud ServicesDbtETL/ELT PipelinesAutomationAnalytical ThinkingUpper-Intermediate EnglishCommunication Skills

Required

8+ years of experience in data engineering, data architecture, or platform engineering
Experience building or migrating enterprise data platforms on Microsoft Fabric
Deep expertise with SQL, Python, and distributed data processing
Significant experience designing enterprise data architectures and medallion/lakehouse patterns
Strong knowledge of modern data platforms — Databricks, Azure Synapse, Microsoft Fabric, Delta Lake, or similar
Hands-on experience with cloud-native data engineering (Fabric preferred)
Expertise building and optimizing large‑scale ETL/ELT pipelines across raw → refined → curated zones
Experience with automation and integration using REST APIs
Strong analytical thinking, system design skills, and the ability to foresee downstream technical consequences
Excellent communication skills and ability to engage as a peer with senior leadership
Upper-Intermediate English skills

Preferred

Deep expertise with dbt
Familiarity with visualization/reporting tools such as Tableau and PowerBI
Proficiency scripting in UNIX environment
Proficiency in big data environments and tools such as Spark, Hive, Impala, Pig, etc
Proficiency with cloud architecture components (AWS, Azure, Google)
Proficiency with data pipeline software such as Airflow, Azure Data Factory, or Prefect
Familiarity with front and back-end web application stacks and frameworks (JavaScript, HTML, CSS, React/Vue/AngularJS) and API design and usage (REST/GraphQL)
Experience leading and managing technical data/analytics/machine learning projects

Benefits

Flexibility, with remote and hybrid work options (country-dependent)
Career advancement, with international mobility and professional development programs
Learning and development, with access to cutting-edge tools, training and industry experts
Medical, dental, and vision insurance for you and your family, plus employer contributions to Health Savings Accounts

Company

Valtech is a digital agency that offers marketing, digital technology, and business transformation consulting.

Funding

Current Stage
Public Company
Total Funding
unknown
2021-07-14Acquired
2001-01-12IPO

Leadership Team

leader-logo
Laurent Pretet
Group CFO
linkedin
leader-logo
Christoph Thommen
Group EVP / COO - Business Innovation & Optimization
linkedin
Company data provided by crunchbase