Fractal · 2 days ago
Databricks Architect
Maximize your interview chances
Insider Connection @Fractal
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Data Architecture Design: Develop and maintain a robust data architecture strategy that aligns with the organization's business goals. Design scalable, efficient, and flexible data pipelines, data warehouses, and data lakes.
Team Leadership: Lead and mentora team of data engineers, providing guidance, coaching, and technical expertise to ensure the successful execution of data projects.
Data Pipeline Development: Design and implement data pipelines for data extraction, transformation, and loading(ETL) processes. Ensure data quality, reliability, and timeliness.
Data Integration: Part of data integration efforts, ensuring seamless data flow between different systems and sources. Collaborate with data analysts, data scientists, and business stakeholders to define data integration requirements.
Data Modeling: Define and implement data models that support analytical and reporting needs. Optimize data structures for query performance and storage efficiency.
Database Management: Manage and optimize databases, both relational and NoSQL, for performance, scalability, and security.
Big Data Technologies: Stay current with emerging technologies and trends in the data engineering and big data space. Evaluate and implement new tools and frameworks as needed.
Data Security and Compliance: Implement data security best practices and ensure compliance with relevant data regulations (e.g., GDPR, HIPAA). Maintain data privacy and security standards.
Performance Optimization: Monitor system performance and take proactive measures to optimize data processing and reduce bottlenecks.
Documentation: Maintain comprehensive documentation for data architecture, data flows, and ETL processes. Ensure knowledge transfer within the team.
Collaboration: Collaborate with cross-functional teams, including data scientists, analysts, software engineers, and business stakeholders, to understand their data needs and deliver solutions accordingly.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Bachelor's or Master's degree in computer science, information technology, or a related field.
Must have 4+ hands-on Databricks and Snowflake
Proven experience in data engineering and architecture, with at least 7+ years of experience.
Proficiency in programming languages such as PySpark, Python, Java, or Scala.
Strong knowledge of data warehousing concepts, ETL processes, and data modeling.
Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
Knowledge of cloud platforms like AWS, Azure, or Google Cloud.
Excellent problem-solving skills and attention to detail.
Strong communication and interpersonal skills for effective collaboration.
Knowledge of data governance, data security, and compliance regulations.
Project management skills and the ability to manage multiple priorities effectively.
Benefits
Health, dental, vision, life insurance, and disability plans
401(k) Plan
11 paid holidays
12 weeks of Parental Leave
Free time PTO policy
Company
Fractal
Fractal is a software company that offers artificial intelligence solutions and products to enable every human's decision in an enterprise.
H1B Sponsorship
Fractal has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (45)
2022 (77)
2021 (52)
2020 (49)
Funding
Current Stage
Late StageTotal Funding
$685MKey Investors
TPG Capital AsiaApax PartnersKhazanah Nasional
2022-01-05Private Equity· $360M
2019-01-16Private Equity· $200M
2016-05-10Private Equity· $100M
Leadership Team
Recent News
2024-12-09
BusinessLine
2024-11-19
Company data provided by crunchbase