griddable.io · 22 hours ago
Lead Software Engineer, Data Platform
San Francisco, CA
Full-time
Onsite
Lead/Staff
8+ years expGriddable.io is looking for exceptional Lead Engineers to build the engine that powers Salesforce’s enterprise intelligence. In this role, you will be a hands-on technical contributor responsible for modernizing the core data ecosystem and implementing scalable data pipelines and transformation logic using modern tools.
AnalyticsBig DataCloud Data ServicesData IntegrationInformation TechnologySaaSSoftware
Responsibilities
Build & Ship: Design and implement scalable data pipelines and transformation logic using Snowflake (SQL) and dbt. Replace legacy hardcoded scripts with modular, testable, and reusable data components
Orchestration: Engineer robust workflows in Airflow. Write custom Python operators and ensure DAGs are dynamic, factory-generated, and resilient to failure
Performance Tuning: Own the performance of your datasets. Deep dive into query profiles, optimize pruning/clustering in Snowflake, and reduce credit consumption while improving data freshness
Infrastructure as Code: Manage the underlying platform infrastructure (warehouses, roles, storage integration) using Terraform or Helm. Click-ops is not an option
CI/CD & Quality: Enforce a strict "DataOps" culture. Ensure every PR has unit tests, schema validation, and automated deployment pipelines
Reliability (SRE): Build monitoring and alerting (Monte Carlo, Grafana, Newrelic, Splunk) to detect data anomalies before stakeholders do
Data Mesh Implementation: Work with domain teams (Sales, Marketing, Finance) to onboard them to the platform, helping them decentralize their data ownership while adhering to platform standards
AI Readiness: Prepare structured data for AI consumption, ensuring high-quality, governed datasets are available for LLM agents and advanced analytics models
Focus: System Design & Technical Leadership. You proactively identify problems (e.g., "Our ingestion pattern won't scale 10x") and design the architectural solution. You lead the technical direction for a squad
Scope: You own entire subsystems or domain architectures. You are the "Tech Lead" for a group of engineers, driving technical consensus, RFCs, and coordinating cross-team dependencies
Qualification
Required
Strong background in software engineering (Python/Java/Go) applied to data
Comfortable writing custom API integrations and complex Python scripts
Deep production experience with Snowflake (architecture/tuning) and dbt (Jinja/Macros/Modeling)
Advanced proficiency with Airflow (Managed Workflows for Apache Airflow)
Hands-on experience with AWS services (S3, Lambda, IAM, ECS) and containerization (Docker/Kubernetes)
Experience with Git, CI/CD (GitHub Actions/Jenkins), and Terraform
8+ years of experience, with a proven track record of leading technical projects or small teams
Preferred
Familiarity with Graph Databases (Neo4j) or Semantic Standards (RDF/SPARQL, TopQuadrant)
Experience with Apache Iceberg or Delta Lake
Experience with Kafka or Snowpipe Streaming
Experience using AI coding assistants (Copilot, Cursor) to accelerate development
Company
griddable.io
Griddable.io is a San Jose, CA based SaaS startup that closed Series A funding in 2017 from August Capital, Artiman Ventures, and Carsten Thoma, founding CEO of Hybris (acquired by SAP).
11-50 employees
Funding
Current Stage
Early StageTotal Funding
$8M2019-01-28Acquired
2018-02-28Series A· $8M
Leadership Team
Burton Hipp
VP of Engineering/Founder
Company data provided by crunchbase