ngrok · 2 weeks ago
Software Engineer III/Senior, AI Gateway
United States
Full-time
Hybrid
Mid, Senior Level
$180K/yr - $225K/yr
3+ years expngrok Inc. is a company dedicated to simplifying networking for developers and engineers. As a Software Engineer on the AI Gateway Team, you will design and implement distributed systems to enhance secure connections for applications, focusing on high-performance traffic routing and management.
AppsDeveloper APIsInternetSoftware
No H1B
Responsibilities
Build and evolve the gateway services that handle traffic routing, policy enforcement
Implement new traffic policy objects (e.g., secrets, IP rules, mTLS/CA policies) to give customers fine-grained control over their applications
Extend and optimize endpoint services that provide reliability and observability for developers
Partner with product, platform, and security teams to ensure traffic management is robust, scalable, and enterprise-ready
Write clean, high-quality, well-tested code and participate in thoughtful design/code reviews
Investigate and resolve production issues across distributed systems
Continuously improve the developer experience—simplifying how teams configure, secure, and scale their traffic
Contribute to the evolution of shared infrastructure, tools, and libraries across ngrok
Qualification
Required
3+ years of experience writing high-quality production software in Go or languages like Rust, C, Java, or C++
Understand networking and distributed systems fundamentals (protocols, TLS/mTLS, proxies, load balancers, traffic shaping)
Have experience building AI gateways, working with LLMs or AI/ML service traffic
Are motivated by building scalable, performant systems that developers love to use
Enjoy working at the intersection of infrastructure, security, and developer tooling/experience
Value pragmatism—delivering solutions that balance complexity with simplicity and maintainability
All candidates must be US-based, and legally authorized to work in the United States
Benefits
We provide a 401(k) with a 100% match up to 3% of your salary and a 50% match up to another 2%.
We provide healthcare, dental, and vision with premiums fully covered on the base plan for employees. Half of premiums are covered for dependents.
We offer unlimited PTO and a culture in which the overwhelming majority of employees take more than four weeks.
Company
ngrok
Ngrok is an API-first ingress-as-a-service platform that helps developers build their apps faster and more securely with no code changes.
51-200 employees
Funding
Current Stage
Growth StageTotal Funding
$50MKey Investors
Lightspeed Venture Partners
2022-12-13Series A· $50M
Leadership Team
Alan Shreve
Chief Executive Officer
Peter Shafton
Chief Technology Officer
Recent News
2025-12-05
2025-10-14
Company data provided by crunchbase