Azure Databricks Architect jobs in United States
cer-icon
Apply on Employer Site
company-logo

VBeyond Corporation · 1 day ago

Azure Databricks Architect

VBeyond Corporation is seeking an Azure Databricks Architect to lead and architect solutions on Azure and Databricks. The role requires extensive experience in data engineering and a strong understanding of retail data domains.

ConsultingCRMDeliveryHuman ResourcesInformation Technology
Hiring Manager
Pushpendra Kumar
linkedin

Responsibilities

Proven years of hands-on experience in architecting solutions on Azure, Databricks and Spark
Proficiency in data engineering tools: Spark, Kafka, Airflow, SQL, Python
Strong understanding of retail or CPG data domains
Familiarity with vector search and semantic retrieval for retail use cases
Expertise in data privacy and compliance in consumer-facing environments
Good experience in end-to-end implementation of data warehouse and data marts
Strong understanding of Data Warehousing concepts of Data Vault, Dimensional modelling, OLAP design
Extensive experience with CI/CD platforms such as GitLab CI, GitHub Actions, AWS CodeBuild, Azure Pipelines, and Jenkins
Experience designing and implementing complex solutions for distributed systems
Experience in leading and mentoring teams

Qualification

AzureDatabricksSparkData WarehousingCI/CD platformsData Engineering toolsData privacy complianceRetail data domainPythonKafkaAirflowSQLGenerative AI frameworksAgile frameworksAnalytical skillsCommunication skillsTeamwork

Required

Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education
At least 11 years of experience with Information Technology
Proven years of hands-on experience in architecting solutions on Azure, Databricks and Spark
Proficiency in data engineering tools: Spark, Kafka, Airflow, SQL, Python
Strong understanding of retail or CPG data domains
Familiarity with vector search and semantic retrieval for retail use cases
Expertise in data privacy and compliance in consumer-facing environments
Good experience in end-to-end implementation of data warehouse and data marts
Strong understanding of Data Warehousing concepts of Data Vault, Dimensional modelling, OLAP design
Extensive experience with CI/CD platforms such as GitLab CI, GitHub Actions, AWS CodeBuild, Azure Pipelines, and Jenkins
Experience designing and implementing complex solutions for distributed systems
Experience in leading and mentoring teams

Preferred

Experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data
Familiarity with log and monitoring solutions
Experience in utilizing development containers, unit testing/code quality review/linting - standard best practice
Good understanding of Agile software development frameworks
Strong communication and Analytical skills
Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams
Experience and desire to work in a global delivery environment
Experience with Generative AI frameworks: OpenAI, Hugging Face, LangChain
Knowledge of Model Context Protocol (MCP) or similar AI integration standards
Experience and detailed knowledge with Master Data Management, ETL, Data Quality, metadata management, data profiling, micro-batches, streaming data loads

Company

VBeyond Corporation

twittertwittertwitter
company-logo
VBeyond Corporation is a staffing and recruiting company specializing in emerging search and HR consulting services.

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Rajesh Khanna
President
linkedin
leader-logo
Sandeep Mitra
Director
linkedin
Company data provided by crunchbase