Otter · 12 hours ago
Backend Engineer, Otter POS - Los Angeles, CA
Otter is transforming restaurant operations at scale with its leading multichannel point-of-sale platform. The Backend Engineer will help architect and scale real-time order management and payment processing systems, focusing on building performance-critical distributed systems that handle millions of transactions daily.
Computer Software
Responsibilities
Write high-quality, well-tested code in Java and Kotlin, set a strong bar for engineering excellence, and own the full software lifecycle from design to production monitoring
Lead backend initiatives, ensuring scalability, reliability, and low-latency performance across critical domains such as order orchestration, payment processing, menu management, and real-time device synchronization
Design and implement distributed systems using CockroachDB, Kafka Event Queues (KEQ), and Flink stream processing that handle millions of transactions with strong consistency guarantees
Build APIs and services that support offline-first operation using CRDT (Conflict-Free Replicated Data Types), enabling POS devices to function reliably without network connectivity
Drive development with a strong focus on reliability-by-design, observability, and testability, including comprehensive metrics, distributed tracing, and alerting
Design scalable databases and data models; write complex SQL queries for analytics and operational insights using Trino and Superset
Work with Protocol Buffers for inter-service communication and event schemas
Build and maintain integrations with external systems including payment processors (Mercury), kitchen display systems (KDS), third-party delivery platforms, and loyalty services
Collaborate on the architecture of event-driven systems that process order lifecycle events, payment transactions, and device synchronization events in real-time
Mentor and uplevel engineers through technical leadership, code reviews, design reviews, and hands-on collaboration
Qualification
Required
Strong proficiency in backend programming with Java and/or Kotlin (or willingness to learn if coming from similar JVM languages)
Experience with distributed databases such as CockroachDB, PostgreSQL, or similar SQL databases, with deep understanding of transactions, consistency models, and distributed systems challenges
Experience with event streaming platforms like Kafka, understanding of event-driven architectures, and familiarity with stream processing frameworks (Flink, Kafka Streams, etc.)
Understanding of cloud platforms like AWS, Google Cloud, or Azure, including container orchestration, service mesh, and cloud-native architectures
Deep knowledge of backend system design: RESTful APIs, gRPC, microservices, distributed systems patterns (eventual consistency, CQRS, saga patterns), concurrency, and fault tolerance
Experience with offline-first or local-first architectures is a plus—understanding CRDTs, sync protocols, or conflict resolution strategies
Hands-on experience with observability tools: metrics (Prometheus, Grafana), distributed tracing (Jaeger, Zipkin), logging platforms, and building production-grade monitoring
A high-performance, hands-on engineer who sets a high bar for code quality, reliability, and operational excellence—you understand production is where your work matters most
Strong collaboration skills: experience working closely with Android/mobile engineers, frontend teams, product managers, data scientists, and business stakeholders
Product mindset: passion for building systems that directly impact restaurant operations, staff efficiency, and customer experiences—you care about the 'why' behind the code
Preferred
Experience with Bazel build system for large monorepo codebases
Knowledge of payment processing systems, PCI compliance, and financial transaction processing
Experience with Android development or understanding mobile constraints and offline operation requirements
Background in restaurant technology, retail POS systems, or logistics/fulfillment platforms
Experience with real-time synchronization protocols and multi-device coordination
Familiarity with loyalty platforms, discount engines, or promotional systems
Benefits
Medical, dental, and vision insurance (multiple plans, incl. HSA options)
Company-paid life and disability insurance (short- and long-term)
Voluntary insurance: accident, critical illness, hospital indemnity
Optional supplemental life insurance for self, spouse, and children
Pet insurance discount
401(k) with company match
Discretionary vacation days
8 paid holidays per year
Paid sick time
Paid Bereavement leave
Paid Parental Leave
Health Savings Account (HSA)
Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
Lunch stipend/meal allowance (because we power restaurant ordering!)