Atlassian · 1 week ago
Senior Machine Learning Engineer
Seattle, WA
Full-time
Hybrid
Senior LevelAtlassian is a company dedicated to unleashing the potential of every team through their software products. They are seeking a Senior Machine Learning Engineer to define and evaluate search quality, optimize retrieval paths for low-latency responses, and ensure operational excellence in search functionality.
CollaborationEnterprise SoftwareSaaSSoftware
Responsibilities
Define and track core retrieval metrics (Hit@K, Precision, Recall) to objectively measure the effectiveness of the search tool across different internal datasets
Collaborate with domain experts to curate "Golden Datasets" (Ground Truth) to benchmark passage ranking and chunking strategies against real-world agent queries
Develop automated regression suites that flag degradation in retrieval quality before code reaches production
Optimize the retrieval path to ensure low-latency responses, critical for multi-step agent chains where search creates compounding delays
Serve as the primary on-call engineer for "Search Dissatisfaction" (Dissat), investigating instances where agents failed tasks due to poor information retrieval
Perform root cause analysis on bad queries to determine if the fix requires re-indexing, better chunking logic, or updated embedding models
Monitor system health and search saturation, proactively scaling infrastructure to handle bursty workloads from concurrent agents
Qualification
Required
Define and track core retrieval metrics (Hit@K, Precision, Recall) to objectively measure the effectiveness of the search tool across different internal datasets
Collaborate with domain experts to curate 'Golden Datasets' (Ground Truth) to benchmark passage ranking and chunking strategies against real-world agent queries
Develop automated regression suites that flag degradation in retrieval quality before code reaches production
Optimize the retrieval path to ensure low-latency responses, critical for multi-step agent chains where search creates compounding delays
Serve as the primary on-call engineer for 'Search Dissatisfaction' (Dissat), investigating instances where agents failed tasks due to poor information retrieval
Perform root cause analysis on bad queries to determine if the fix requires re-indexing, better chunking logic, or updated embedding models
Monitor system health and search saturation, proactively scaling infrastructure to handle bursty workloads from concurrent agents
Benefits
Health and wellbeing resources
Paid volunteer days
Company
Atlassian
Atlassian is a software company that offers proprietary software products for teamwork, project management, and software development.
Founded in 2002
10001+ employees
H1B Sponsorship
Atlassian has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (351)
2024 (184)
2023 (190)
2022 (259)
2021 (156)
2020 (162)
Funding
Current Stage
Public CompanyTotal Funding
$210MKey Investors
T. Rowe PriceAccel
2015-12-10IPO
2014-04-08Secondary Market· $150M
2010-07-14Series A· $60M
Leadership Team
Michael Cannon-Brookes
Co-founder & Co-CEO
Scott Farquhar
Co-Founder and Board Member
Recent News
Investing.com
2026-01-16
CB Insights
2026-01-16
Company data provided by crunchbase