SilverSearch, Inc. · 11 hours ago
Senior Data Engineer
SilverSearch, Inc. is seeking a highly skilled, hands-on Senior Data Engineer to build and scale modern lakehouse and analytics solutions in Azure and Databricks. The role focuses on developing high-performance data pipelines, implementing scalable data models, and delivering trusted datasets that power enterprise reporting and advanced analytics.
Information Technology & Services
Responsibilities
Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF), Databricks , and DBT
Implement batch and near real-time processing using DLT
Orchestrate workflows using Apache Airflow, Databricks LakeFlow, and ADF
Develop ingestion and replication pipelines using Fivetran, SQDR, Rivery, or custom Python/PySpark solutions
Design and implement Data Vault 2.0 models to support enterprise analytics
Write optimized SQL, Python, and PySpark for complex transformations and performance tuning
Ensure data quality, reliability, monitoring, and operational excellence across pipelines
Contribute to CI/CD, DevOps automation, documentation, and Agile delivery practices
Provide technical mentorship and promote strong engineering standards
Qualification
Required
8+ years of experience in data or software engineering
5+ years building enterprise ETL/ELT and analytics solutions
Strong experience with Azure Data Factory and Azure Data Lake Storage
Hands-on experience with Databricks, Delta Live Tables, and Unity Catalog
Advanced SQL expertise (T-SQL, performance tuning, optimization)
Strong Python and PySpark development experience
Experience with DBT and Apache Airflow
Experience implementing Data Vault 2.0 modeling
Familiarity with CI/CD and DevOps practices
Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and DBT
Implement batch and near real-time processing using DLT
Orchestrate workflows using Apache Airflow, Databricks LakeFlow, and ADF
Develop ingestion and replication pipelines using Fivetran, SQDR, Rivery, or custom Python/PySpark solutions
Design and implement Data Vault 2.0 models to support enterprise analytics
Write optimized SQL, Python, and PySpark for complex transformations and performance tuning
Ensure data quality, reliability, monitoring, and operational excellence across pipelines
Contribute to CI/CD, DevOps automation, documentation, and Agile delivery practices
Provide technical mentorship and promote strong engineering standards
Company
SilverSearch, Inc.
Celebrating 20 years in business, SilverSearch is a boutique IT recruitment firm.
Funding
Current Stage
Early StageCompany data provided by crunchbase