VARITE INC ยท 3 weeks ago
SAP-to-Databricks Migration Engineer
VARITE INC is a global IT services and consulting company specializing in a wide array of IT services. The SAP-to-Databricks Migration Engineer will lead the migration of SAP data into the Databricks platform, focusing on integration, performance optimization, and adherence to governance standards.
Information Technology & Services
Responsibilities
Design and implement migration plans for SAP data to Azure Databricks using tools like Qlik Replicate, ADF, and Airflow
Convert SAP BW data models and ETL jobs into PySpark workflows on Databricks
Develop Bronze, Silver, and Gold layers following Medallion Architecture for structured ingestion and transformation
Ensure accurate mapping of SAP tables and business objects to Databricks Delta tables
Implement data quality checks, lineage tracking, and governance using Unity Catalog
Optimize ingestion pipelines for large SAP datasets to minimize latency and maximize throughput
Conduct performance tuning for queries and transformations
Work closely with SAP SMEs, data architects, and business analysts to validate requirements
Produce comprehensive documentation for migrated jobs and provide support during UAT and hypercare phases
Ensure compliance with enterprise security policies and manage RBAC for Databricks workspaces
Qualification
Required
Experience ( Relevant) : 8+ Years
SAP Expertise
Strong knowledge of SAP BW, ECC, and related modules
Experience with SAP data extraction and transformation
Proficiency in Databricks, PySpark, and Delta Lake
Familiarity with Azure Data Lake Storage (ADLS) and orchestration tools like Airflow
Hands-on experience with Qlik Replicate, Informatica, or similar tools
Understanding of Unity Catalog, RBAC, and data governance frameworks
Strong analytical, problem-solving, and communication skills
Benefits
Candidate Referral program
Experience Level Bonus Referral