This job has closed.

TestingXperts · 1 day ago

Data Architect (Azure Databricks)

Plano, TX

Full-time

Onsite

Lead/Staff

8+ years exp

TestingXperts is seeking a Data Architect specialized in Azure Databricks. The role involves managing end-to-end delivery, optimizing data pipeline architecture, and leading teams in a SaaS environment while following Agile methodologies.

DevOpsInformation TechnologyPenetration TestingQuality AssuranceSoftwareUsability Testing

H1B Sponsor Likely

Hiring Manager

Khushi Malhotra

Responsibilities

Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders

Follow the Agile development methodology; think strategically and execute methodically

Develop and manage capacity and growth projection forecasts of the environment within budgets

Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements

Drive optimization, testing and tooling to improve quality of solutions

Manage teams that build and operate high volume distributed systems in a SaaS environment

Great at devising efficient processes that increase velocity and quality

Qualification

DatabricksAzure Cloud platformData WarehousingData LakePySparkArchitecture DesignProject managementAPIsContainerizationOrchestration

Required

8+ years of relevant experience

At least 5 years of experience building and leading highly complex technical engineering teams

Strong hands-on experience in Databricks

Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale

Project management skills: financial/budget management, scheduling and resource management experience with medium and large-scale projects

Comfortable working with ambiguity and multiple stakeholders

Experience in medallion architecture, optimization, Ingestion, Quality

Should have worked on Unity Catalog and understands its architecture and how to leverage its Data Governance and Observability capabilities

Comfortable working cross functionality with product management and directly with customers; ability to deeply understand product and customer personas

Architecture Design Experience for Cloud and Non-cloud platforms

Expertise on Azure Cloud platform

Knowledge on orchestrating workloads on cloud

Ability to set and lead the technical vision while balancing business drivers

Strong experience with PySpark, Python programming

Bachelor's and/or master's degree

Preferred

Experience managing distributed teams preferred

Proficiency with APIs, containerization and orchestration is a plus

Company

TestingXperts

Glassdoor4.1

Next Gen QA & Software Testing Company

Founded in 1996

Mechanicsburg, Pennsylvania, USA

1001-5000 employees

https://www.testingxperts.com/

H1B Sponsorship

TestingXperts has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (10)

2024 (1)

2020 (1)