Method360 · 2 months ago
SAP Databricks Solution Architect
Method360 is a company specializing in data architecture solutions, and they are seeking an SAP BDC / Databricks Solution Architect to lead the design and execution of scalable data architecture strategies. The role involves collaborating with various teams to ensure data integrity and governance while optimizing data flows and integration between SAP systems and cloud platforms.
AnalyticsBig DataData ManagementInformation TechnologyRoboticsSoftware
Responsibilities
Lead the end-to-end data architecture strategy across SAP BDC initiatives, including data modeling, transformation, and governance
Define target and transition architectures for both SAP and non-SAP data domains, integrating with modern platforms such as Azure, AWS, Snowflake, and Databricks
Ensure data platform alignment with architectural principles across hybrid cloud environments, leveraging third-party tools from Microsoft, Nvidia, Google, and others
Design and validate data flows, lineage, and integration points between legacy systems, SAP S/4HANA, and cloud-based platforms
Collaborate with migration teams to drive effective ETL/ELT strategy and data quality frameworks, ensuring consistency across enterprise systems
Identify and mitigate data risks, including data duplication, data loss, latency, or security compliance gaps
Guide tool selection, integration architecture, and usage of cloud-native services (e.g., Azure Data Factory, BigQuery, Snowpark, Databricks notebooks) to support data lifecycle processes
Lead the design and implementation of data pipelines, notebooks, and workflows on the Databricks platform supporting SAP data migration and analytics use cases
Develop, optimize, and tune Spark jobs for large-scale, distributed data processing
Collaborate with data architects to align Databricks solutions with enterprise data governance and architecture principles
Enable data engineers and scientists by building reusable libraries, APIs, and data transformation frameworks using Databricks and related technologies
Integrate Databricks with SAP data sources and external platforms such as Snowflake, Azure Data Lake, and AWS S3
Establish and promote best practices around security, cost optimization, and performance on Databricks
Participate in tooling and automation efforts such as CI/CD pipelines for Databricks assets
Provide training, mentorship, and knowledge sharing to junior team members and other stakeholders
Stay current with Databricks and Apache Spark ecosystem updates and innovations
Collaborate with cross-functional teams leveraging NVIDIA GPU acceleration or AI/ML frameworks integrated with Databricks
Qualification
Required
12–15+ years of experience in enterprise data architecture, with at least 5 years in SAP BDC or related data transformation environments, with 3+ years specifically on Databricks and Spark-based data platforms
Strong background in enterprise data architecture and SAP data management (SAP ECC, S/4HANA, MDG, BW/4HANA)
Experience working with cloud providers and platforms: Microsoft Azure, AWS, Google Cloud, Snowflake, Nvidia RAPIDS, Databricks
Proficiency in data modeling (conceptual, logical, physical), data governance, and metadata management
Experience designing and governing large-scale data migration and transformation initiatives
Agile mindset and experience working in DevOps/CI-CD environments
Knowledge of data migration tools such as SAP BDC, LSMW, IDocs, or CPI
Solid understanding of data privacy and compliance standards (GDPR, HIPAA, etc.)
Strong leadership, stakeholder management, and cross-functional collaboration skills
Familiarity with architecture frameworks such as TOGAF or DAMA-DMBOK
Strong expertise in Databricks platform and Apache Spark (Scala, Python, or SQL)
Experience designing and developing large-scale ETL pipelines and batch/streaming data workflows
Familiarity with cloud ecosystems, particularly Azure, AWS, or GCP, and integrating Databricks within these environments
Knowledge of data architecture, governance, and security practices on cloud data platforms
Ability to troubleshoot and optimize Spark job performance and resource utilization
Strong communication skills to collaborate with SAP, data architecture, and delivery teams
Relevant certifications such as Databricks Certified Data Engineer and ML Architect
Tangible experience working on SAP BDC projects
Preferred
Understanding of data science and machine learning workflows on Databricks is a plus
Company
Method360
Method360 is an information technology company that offers data management and analytics solutions.
H1B Sponsorship
Method360 has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (7)
2020 (3)
Funding
Current Stage
Growth StageCompany data provided by crunchbase