Tredence Inc. · 1 day ago
Data Architect (Azure Databricks)
United States
Full-time
Remote
Senior Level, Lead/Staff
10+ years exp
Maximize your interview chancesAnalyticsArtificial Intelligence (AI)
Insider Connection @Tredence Inc.
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders
Follow the Agile development methodology; think strategically and execute methodically
Develop and manage capacity and growth projection forecasts of the environment within budgets
Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements
Drive optimization, testing and tooling to improve quality of solutions
Manage teams that build and operate high volume distributed systems in a SaaS environment
Great at devising efficient processes that increase velocity and quality
Train counterparts in the data pipelining and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases.
Promote the available data and analytics capabilities and expertise to business unit leaders and educate them in leveraging these capabilities in achieving their business goals.
Accountable for operational effectiveness in performance, uptime, release management of the enterprise data platform
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
10+ years of relevant experience
Bachelor's and/or master’s degree in computer science or equivalent experience.
Strong communication, analytical and problem-solving skills with a high attention to detail.
Strong hands-on experience in Databricks
Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python. The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
Expertise on Azure Cloud platform
Good SQL knowledge
Knowledge on orchestrating workloads on cloud
Strong experience with Unity Catalog
Ability to set and lead the technical vision while balancing business drivers
Strong experience with PySpark, Python programming
Experience handling large and complex sets of data from various sources and databases
Solid grasp of database engineering and design principles
Preferred
At 8+ years of experience building and leading highly complex, technical engineering teams.
Experience managing distributed teams preferred.
Comfortable working with ambiguity and multiple stakeholders.
Comfortable working cross functionality with product management and directly with customers; ability to deeply understand product and customer personas.
Familiarity with CI/CD methods desired.
Good to have Teradata Experience (not Mandatory).
Proficiency with APIs, containerization and orchestration is a plus.
Company
Tredence Inc.
Tredence is a global data science solutions provider focused on solving the last mile problem in AI.
1,001-5,000 employees
H1B Sponsorship
Tredence Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (63)
2022 (91)
2021 (73)
2020 (60)
Funding
Current Stage
Late StageTotal Funding
$205MKey Investors
Advent InternationalChicago Pacific Founders
2022-12-22Series B· $175M
2020-12-10Series A· $30M
Leadership Team
Shub Bhowmick
Chief Executive Officer & Co-Founder
Shashank Dubey
Chief Revenue Officer and Co-founder
Recent News
The Indian Express
2024-11-06
Yahoo Finance Canada
2024-05-23
2024-05-23
Company data provided by crunchbase
