ByteDance · 3 weeks ago
Senior Software Engineer, AI Infrastructure - Developer Tooling
ByteDance is a company that inspires creativity and enriches life through innovative products. They are seeking a Senior Software Engineer to work on AI-powered developer tools, focusing on retrieval infrastructure, coding agent development, and evaluation frameworks.
ContentData MiningFoundational AIInternetSocial Media
Responsibilities
Design and scale retrieval pipelines including vector search, BM25, and hybrid retrieval strategies
Build and optimize embedding pipelines, chunking strategies, and re-ranking systems
Develop query understanding and rewriting components to improve retrieval relevance
Manage vector database infrastructure at production scale
Build agent architectures that support multi-step code generation, refactoring, debugging, and diagnostics
Implement tool-use patterns (function calling, code execution sandboxing, file system interaction)
Develop context management strategies for long-form code understanding
Design and maintain evaluation frameworks for retrieval quality and agent task completion
Build custom benchmark suites for real-world coding task assessment
Create reproducible testing infrastructure with automated regression detection
Qualification
Required
Bachelor's degree in CS, EE, or related field (or equivalent experience)
4+ years of software engineering experience
Strong proficiency in Python (primary) and TypeScript/JavaScript
Experience with at least one systems-level language (C++, Rust, Go)
Practical experience integrating LLMs into applications (prompt engineering, context management, output parsing)
Understanding of agent patterns: tool use, multi-turn reasoning, error recovery
Familiarity with code-specific LLM tasks (generation, summarization, analysis)
Preferred
Master's or Ph.D. in Computer Science, Machine Learning, or related field
Contributions to open-source developer tooling, retrieval systems, or coding assistants
Experience with AST parsing, code analysis tools, or language servers
Familiarity with rendering pipelines or cross-platform framework architecture
Experience deploying and optimizing ML models in production (latency, cost, reliability)
Benefits
Employees have day one access to medical, dental, and vision insurance
A 401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
Company
ByteDance
ByteDance is a technology company that develops content creation platforms and services.
H1B Sponsorship
ByteDance has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1350)
2024 (1123)
2023 (775)
2022 (487)
2021 (417)
2020 (245)
Funding
Current Stage
Late StageTotal Funding
$9.8BKey Investors
Capital TodayG42Tiger Global Management
2025-11-20Secondary Market· $300M
2024-07-25Secondary Market
2023-03-14Secondary Market· $100M
Leadership Team
Recent News
2026-01-25
2026-01-25
2026-01-25
Company data provided by crunchbase