Confluent · 2 days ago
AI Architect
United States
Full-time
Hybrid
Senior Level, Lead/Staff
$156K/yr - $183K/yr
8+ years expConfluent is a company focused on transforming how data is utilized, enabling real-time data movement. They are seeking a hands-on AI Architect to design and implement internal AI tools that integrate with core business platforms, ensuring secure and efficient data flow while enhancing automation and accessibility.
AnalyticsCloud Data ServicesEnterprise SoftwareOpen Source
Responsibilities
Design for Action: Build AI integrations that do more than just summarize text. Design systems that can securely read from and write back to our core platforms (e.g., updating a record in Salesforce or drafting a response in Zendesk)
Secure Data Flow: Architect the integration layer between external LLM providers (Google, Anthropic, OpenAI) and internal data. Ensure all data retrieval is governed by strict permissions so users are only able to access data they are authorized to see
Scalability: Design a model-agnostic inference layer that allows us to switch between models based on performance and cost requirements
Backend Engineering: Write production-ready code using modern agent frameworks (ADK, LangChain). This is a technical role that requires coding
Retrieval Augmented Generation (RAG): Implement robust RAG pipelines to ground AI responses in company data. This includes managing vector databases and optimizing search strategies (hybrid search, reranking) to ensure accuracy
Deployment: Set up the CI/CD pipelines and infrastructure required to deploy and maintain these services in a cloud environment
Evaluation: Move beyond 'eye-balling' results. Implement automated testing frameworks to measure response accuracy, latency, and costs before deploying changes
Data Privacy: Ensure strict handling of PII and adherence to enterprise security standards. You will be the gatekeeper for how sensitive data is exposed to LLMs
Requirements Gathering: Partner with leaders in Sales, Marketing, and Support to identify high-impact automation opportunities. Translate business needs into technical specifications
Qualification
Required
8+ years of experience in software development with strong proficiency in Python and API design (REST)
2+ years of experience building LLM-powered applications or agents (using libraries like LangChain or ADK)
Experience with Vector Databases (e.g., Pinecone, pgvector) and building pipelines to process unstructured text
Hands-on experience deploying services on AWS, Azure, or GCP
Proven experience integrating custom applications with SaaS platforms like Salesforce, NetSuite, or Zendesk
Ability to explain technical concepts to non-technical stakeholders and collaborate effectively with product managers and business analysts
Preferred
Hands-on experience with GCP Vertex AI features and technologies (Agent Engine, RAG Engine etc)
Company
Confluent
Confluent offers a streaming platform based on Apache Kafka that enables companies to easily access data as real-time streams.
1001-5000 employees
H1B Sponsorship
Confluent has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (142)
2024 (107)
2023 (91)
2022 (155)
2021 (119)
2020 (50)
Funding
Current Stage
Public CompanyTotal Funding
$459.6MKey Investors
CoatueSequoia CapitalIndex Ventures
2025-12-08Acquired
2021-06-24IPO
2021-06-10Secondary Market
Leadership Team
Jun Rao
Co-founder
Chad Verbowski
CTO
Recent News
2026-01-08
2026-01-05
2026-01-05
Company data provided by crunchbase