Databricks Architect jobs in United States
cer-icon
Apply on Employer Site
company-logo

Programmers.io · 16 hours ago

Databricks Architect

Programmers.io is looking for a highly senior Databricks Architect to lead a large-scale Oracle-to-Databricks migration. The role involves architecting, designing, and implementing cloud-native data platforms using Databricks, while also providing technical mentorship and establishing development best practices.

Enterprise SoftwareInformation TechnologyManufacturingSoftware
check
Growth Opportunities
badNo H1Bnote
Hiring Manager
Devansh T.
linkedin

Responsibilities

Architect, design, and implement cloud-native data platforms using Databricks (ingestion → transformation → consumption)
Lead the full Oracle → Databricks migration including schema translation, ETL/ELT logic modernization, and ODI job replacement
Develop reusable PySpark frameworks , data processing patterns, and orchestration using Databricks Workflows
Build scalable, secure, and cost‑optimized Databricks infrastructure and data pipelines
Collaborate with business and technical stakeholders to drive data modernization strategy
Establish development best practices, coding standards, CI/CD, and DevOps/DataOps patterns
Provide technical mentorship and create training plans for engineering teams
Contribute to building MLOps and advanced operations frameworks

Qualification

DatabricksPySparkSpark SQLOracle migrationAWSData warehousingAgile/ScrumData governanceData MeshData VaultGolden Gate

Required

14+ years in Data Engineering/Architecture with at least 4+ years hands-on Databricks experience delivering end-to-end cloud data solutions
Strong experience migrating from Oracle/on-prem systems to Databricks, including SQL, PL/SQL, ETL logic, and ODI pipelines
Deep hands-on expertise in: PySpark, Spark SQL, Delta Lake, Unity Catalog
Building reusable data frameworks
Designing high-performance batch and streaming pipelines
Proven experience with greenfield Databricks implementations
Strong understanding of cloud-native architectures on AWS and modern data platform concepts
Solid knowledge of data warehousing, columnar databases, and performance optimization
Good understanding of Agile/Scrum development processes

Preferred

Experience designing Data Products, Data Mesh architectures, Data Vault or enterprise data governance models
Good Understanding of Golde Gate

Company

Programmers.io

twittertwittertwitter
company-logo
IBM i is evolving. And so are we.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Anshul Choudhry
President
linkedin
Company data provided by crunchbase