Programmers.io · 6 hours ago
Senior Databricks Architect
Programmers.io is seeking a highly senior, deeply hands-on Databricks Architect to lead a large-scale Oracle-to-Databricks migration. The role involves architecting and implementing cloud-native data platforms, driving data modernization strategy, and providing technical mentorship to engineering teams.
Responsibilities
Architect, design, and implement cloud-native data platforms using Databricks (ingestion → transformation → consumption)
Lead the full Oracle → Databricks migration including schema translation, ETL/ELT logic modernization, and ODI job replacement
Develop reusable PySpark frameworks, data processing patterns, and orchestration using Databricks Workflows
Build scalable, secure, and cost-optimized Databricks infrastructure and data pipelines
Collaborate with business and technical stakeholders to drive data modernization strategy
Establish development best practices, coding standards, CI/CD, and DevOps/DataOps patterns
Provide technical mentorship and create training plans for engineering teams
Contribute to building MLOps and advanced operations frameworks
Qualification
Required
14+ years in Data Engineering/Architecture with at least 4+ years hands-on Databricks experience delivering end-to-end cloud data solutions
Strong experience migrating from Oracle/on-prem systems to Databricks, including SQL, PL/SQL, ETL logic, and ODI pipelines
Deep hands-on expertise in: PySpark, Spark SQL, Delta Lake, Unity Catalog
Building reusable data frameworks
Designing high-performance batch and streaming pipelines
Proven experience with greenfield Databricks implementations
Strong understanding of cloud-native architectures on AWS and modern data platform concepts
Solid knowledge of data warehousing, columnar databases, and performance optimization
Good understanding of Agile/Scrum development processes
Preferred
Experience designing Data Products
Data Mesh architectures
Data Vault or enterprise data governance models
Good Understanding of Golde Gate
Company
Programmers.io
IBM i is evolving. And so are we.
H1B Sponsorship
Programmers.io has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (2)
Funding
Current Stage
Late StageRecent News
linkedin.com
2025-12-12
linkedin.com
2025-12-08
Company data provided by crunchbase