Calfus Inc. · 12 hours ago
Senior Data Architect
San Francisco Bay Area
Full-time
Onsite
Senior Level, Lead/Staff
$180K/yr - $200K/yr
10+ years expCalfus Inc. is known for delivering cutting-edge AI agents and products that transform businesses. They are seeking an experienced Sr. Data Architect to design, optimize, and govern their data infrastructure, enabling advanced analytics and AI-driven insights.
AnalyticsBusiness DevelopmentInformation TechnologySoftware Engineering
Responsibilities
Architect & Implement Scalable Data Solutions: Design and implement high-performance data architectures leveraging Databricks, Apache Spark, and Delta Lake
Data Integration & Pipelines: Develop optimized ETL/ELT workflows using Databricks Workflows, Delta Live Tables, and integration with cloud storage solutions
Cloud Data Management: Design data lakehouse architectures in Azure/AWS/GCP using Databricks and similar platforms, ensuring high availability, security, and compliance
Performance Optimization: Optimize Spark jobs, query performance, and cluster configurations to ensure efficient data processing
Data Governance & Security: Implement data quality frameworks, access controls, and compliance measures using Unity Catalog, Delta Sharing, and equivalent tools
Collaboration & Leadership: Work closely with engineering teams, data scientists, and business analysts to enable data-driven decision-making
Machine Learning, Analytics & Agents Enablement: Support the development and operationalization of ML models, AI applications, and agent-based systems using Databricks, MLflow, Feature Store, and other ML/AI platforms such as SageMaker, Vertex AI, or Azure ML. Familiarity with agentic frameworks, AI agents, and orchestration tools (e.g., LangChain, AutoGen, CrewAI) is highly desirable
Technical Documentation: Maintain detailed architecture diagrams, process flows, and best practices documentation
Qualification
Required
10+ years of experience in Data Architecture, with strong expertise in Databricks, Apache Spark, and other distributed data platforms
Proficiency in SQL, Python, Scala, and Cloud platforms (Azure, AWS, GCP)
Deep understanding of Delta Lake, Medallion Architecture, and Data Engineering best practices
Experience in data governance, cataloging, and security (Unity Catalog, RBAC, IAM)
Strong knowledge of distributed computing, data pipeline orchestration (Airflow, Azure Data Factory), and cloud storage (S3, ADLS, GCS)
Experience integrating BI tools (Power BI, Tableau) with data platforms for analytics
Strong understanding of machine learning workflows, AI infrastructure, and emerging agentic technologies
Excellent problem-solving skills and ability to communicate complex technical concepts to non-technical stakeholders
Preferred
Databricks certifications (Databricks Certified Data Engineer/Architect)
Experience with data streaming technologies (Kafka, Spark Streaming)
Familiarity with agentic frameworks, AI orchestration tools, and multi-agent systems
Hands-on experience with ML & AI platforms (e.g., SageMaker, Vertex AI, Azure ML)
Benefits
Comprehensive health coverage, which includes medical (by Kaiser & Aetna), Dental & Vision (by Guardian) plans.
Retirement savings plan (401k) where you can start saving as soon as you join!
Company
Calfus Inc.
Calfus is a modern software engineering and AI services company purpose-built for the enterprise.
51-200 employees
H1B Sponsorship
Calfus Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (5)
2023 (6)
Funding
Current Stage
Growth StageLeadership Team
Baljeet Chhazal
Chief Executive Officer
Rohit Agarwal
Co-Founder & Managing Director
Recent News
2023-12-21
Company data provided by crunchbase