EDI Staffing, an EDI Specialists Company ยท 4 hours ago
Cloud Data Warehouse Architect
EDI Staffing is an EDI Specialists Company seeking a Cloud Data Warehouse Architect to design and deliver a next-generation enterprise analytics platform. The role focuses on building a cloud-native, SAP-integrated architecture that supports analytics, reporting, and advanced machine learning, while modernizing existing BI and data warehouse environments.
ConsultingHuman ResourcesInformation TechnologyStaffing Agency
Responsibilities
Lead the design of a cloud data warehouse and data lakehouse architecture capable of ingesting large-scale transactional and operational data
Define integration strategies for core systems
Develop a reference architecture that leverages Azure Data Lake Storage (ADLS) and Databricks Delta Lake as core components
Implement semantic modeling to unify reporting across Tableau, Power BI, and SAP Analytics Cloud (SAC)
Oversee ingestion pipelines for batch (Netezza extracts, flat files, nightly jobs) and near real-time (APIs, streaming) data sources
Optimize query performance through partitioning, clustering, caching, and Delta Lake / warehouse design
Establish reusable ETL/ELT patterns across Databricks notebooks, SQL-based orchestration, and integration with ActiveBatch scheduling
Define and enforce data governance standards (naming conventions, metadata, lineage, data quality)
Partner with InfoSec on identity management (Azure AD), encryption, and RBAC/ABAC models
Implement governance tooling such as Azure Purview, SAP metadata catalogs, Databricks Unity Catalog, and Glasswing
Partner with data engineers and visualization teams to deliver governed, high-performance datasets consumable in Tableau, Power BI, SAC, and SAP Fiori
Serve as the technical SME for architects, engineers, and analysts, ensuring alignment to best practices in cloud-native data warehouse design
Drive knowledge transfer from legacy platforms (Netezza, Cognos) into the new ecosystem
Qualification
Required
Bachelor's degree in Computer Science, Engineering, or related field
7+ years in data engineering, data warehouse architecture, or cloud data architecture
Expertise in Azure (ADLS, Synapse, Purview, Databricks, networking, security)
Strong proficiency in Databricks (Delta Lake, PySpark, SQL) and/or Snowflake (warehouse design, scaling, security)
Proven experience in data modeling (3NF, star schema, semantic layers)
Deep SQL expertise across both cloud and traditional RDBMS (Netezza, SQL Server, Progress OpenEdge)
Understanding of SAP S/4HANA integration and familiarity with SAP Datasphere
Preferred
Prior experience migrating from on-prem Netezza or other MPP systems to cloud-native platforms
Familiarity with Cognos to Tableau/Power BI migrations and dashboard optimization
Hands-on experience with SAP Analytics Cloud (SAC) and embedded analytics
Knowledge of machine learning workflows and integration with Databricks MLflow or Azure ML
Strong knowledge of data governance frameworks and tooling (Purview, Unity Catalog, SAC governance)