Senior Software Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Undisclosed · 2 days ago

Senior Software Engineer

Undisclosed company is seeking a highly skilled Full Stack Engineer with deep AI engineering experience to design, build, and scale next-generation intelligent applications used globally by enterprises and end-users. The role involves working across the entire stack, integrating AI models, building scalable microservices, and collaborating with product, design, data science, and platform engineering teams to deliver high-performance systems.

Financial Services

Responsibilities

Design and build end-to-end application architectures spanning backend microservices, frontend UI layers, and machine learning inference paths
Architect data workflows for: LLM prompting, chaining, and agent execution; Embedding generation and vector retrieval; Streaming and event-driven services (Kafka, Pub/Sub)
Implement scalable APIs and backend services using Node.js, Python (FastAPI / Flask), Go, or Java
Own technical design documents, architectural reviews, RFCs, and cross-team engineering alignment
Build high-throughput distributed services with microservice patterns (gRPC, REST, event-driven)
Implement AI workflow orchestration and model-serving endpoints for LLMs, fine-tuned models, and multi-model routing
Use distributed caching, queueing, and pub-sub systems for low-latency AI applications
Optimize performance across compute, memory, concurrency, and horizontal scalability
Implement robust testing frameworks across unit, integration, load, and performance layers
Build AI-powered features using: LLMs (OpenAI, Anthropic, Mistral, Llama); Embedding models (text-embedding, multi-modal); Vector databases (Pinecone, Weaviate, FAISS, pgvector); Model-serving frameworks (TensorRT, ONNX Runtime, Triton Inference Server)
Develop pipelines for: Document chunking; Embedding generation; Retrieval-augmented generation (RAG); Prompt optimization and evaluation
Use AI tools/frameworks such as LangChain, LlamaIndex, HuggingFace Transformers
Build intuitive, high-performance web applications using: React, Next.js, TypeScript; Tailwind, MUI, or custom design systems; GraphQL/REST/GRPC clients; WebSockets, SSE for real-time interactions
Implement AI-native UX patterns (chat interfaces, agent dashboards, AI copilots, model results visualization)
Collaborate with design and product to deliver refined, responsive experiences across web and mobile browsers
Deploy workloads on AWS, GCP, or Azure, including GPU-backed environments for inference
Build CI/CD pipelines (GitHub Actions, ArgoCD, GitLab CI) to safely ship code multiple times per day
Use infrastructure-as-code (Terraform, Helm) to manage cloud resources
Instrument monitoring and observability (Prometheus, Grafana, Datadog, OpenTelemetry)
Optimize cloud costs across compute, storage, embeddings, and AI inference
Apply secure coding best practices across backend and frontend systems
Implement guardrails and governance for AI systems: prompt injection mitigation; model hallucination detection; safe output filtering; user data privacy & PII redaction
Collaborate with security teams on: IAM principles; Role-based access control; API authentication & authorization; Data encryption (in transit & at rest)
Work closely with: Product to refine AI capabilities and refine user workflows; Data Science & ML on model evaluation, tuning, and feature ideation; Design on AI-first UX patterns; Platform Engineering on scalable pipeline architecture; Participate in sprint planning, architecture reviews, incident response, and release planning

Qualification

AI/ML engineeringFull stack developmentMicroservices architectureCloud infrastructureJavaScript/TypeScriptPythonGoDistributed systemsRelationalNoSQL databasesDevOps practicesTechnical curiosityHigh craftsmanshipInnovative thinkingCollaborationProblem-solving

Required

7–12+ years of professional engineering experience across backend + full stack development
Strong proficiency in JavaScript/TypeScript, Python, or Go
Hands-on experience with LLMs, embeddings, vector databases, and AI/ML pipelines
Strong knowledge of modern web development: React/Next.js, TypeScript, state management patterns
Experience with distributed systems, microservices, event-driven architectures
Proficiency with relational and NoSQL data stores (PostgreSQL, Redis, MongoDB, Elasticsearch)
Experience deploying and scaling systems in AWS/GCP/Azure environments
Strong grasp of DevOps, container orchestration (Kubernetes), and CI/CD pipelines
Experience working in scaling environments (500–2,000+ employee tech orgs preferred)
Bachelor's degree in Computer Science or related field (Master's preferred)

Company

Undisclosed

twitter
company-logo
Financial Services

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Sean Blanton, Ph.D.
Co-Founder and Member of the Management Board
linkedin
leader-logo
Jeff Saginor
Chief Technology Officer
linkedin
Company data provided by crunchbase