Apply on Employer Site

Ally · 2 days ago

Principal Software Test Engineer - Ally.ai Platform

Charlotte, NC

Full-time

Hybrid

Senior Level, Lead/Staff

$90K/yr - $150K/yr

5+ years exp

Ally Financial is a customer-centric, leading digital financial services company. They are seeking a Principal Software Test Engineer to define the quality strategy and test architecture for the Ally.ai platform, ensuring the reliability and security of their LLM-powered APIs and services.

AutomotiveFinanceFinancial Services

No H1B

Responsibilities

Own the Test Strategy & Architecture for Ally.ai platform services, aligning with the existing test strategy and environments. Define what, where, and how we test across functional, integration, regression, and UAT layers

Build end‑to‑end API test automation (Python) for RESTful services, including contract tests, negative/fuzz tests, auth/entitlements, and data integrity checks—integrated with GitLab quality gates and IaC-driven ephemeral environments

Production Quality & Monitoring : partner with SRE to convert test signals into production SLOs and alerting; validate audit/telemetry pipelines as part of “definition of done.”

Mentor & Lead : coach teams on test design, flaky-test reduction, and deterministic testing patterns for non-deterministic LLM outputs; advocate for inner‑source contributions to quality tooling

Operationalize non‑functional testing : performance (latency, throughput, cost/efficiency for LLM calls), chaos/resiliency (degradations, timeouts, retries), and observability-driven validation

Qualification

Test automationAPI testingPythonCI/CD pipelinesCloud NativeAI technologiesPerformance monitoringMentoring

Required

5+ years of experience creating test automation (functional, integration, and load) using Python required

3+ years of demonstratable experience with automated testing for APIs and infrastructure required

Preferred

Hands-on experience with code management and CI/CD pipelines (GitLab Preferred)

Practical knowledge of Cloud Native and serverless and services (AWS preferred)

Bachelor's degree in computer science, electrical engineering or related field preferred

Familiarity with AI / GenAI technologies

Experience with synthetic data generation, de‑identification/masking strategies, and validation of audit trails

Experience with tools like CloudWatch, Datadog, or Prometheus for performance monitoring

Ability to mentor engineers, lead technical discussions, and influence architectural decisions

AI First Mindset: Desire to infuse AI into all steps of the engineering process

Benefits

Time Away: Program starts at 20 paid time off days in addition to 11 paid holidays and 8 hours of volunteer time off yearly (time off days are prorated based on start date and program varies based on full or part-time status and management level).

Planning for the Future: plan for the near and long term with an industry-leading 401K retirement savings plan with matching and company contributions, student loan pay downs and 529 educational save up assistance programs, tuition reimbursement, employee stock purchase plan, and financial learning center and financial coach access.

Supporting your Health & Well-being: flexible health and insurance options including medical, dental and vision, employee, spouse and child life insurance, short- and long-term disability, pre-tax Health Savings Account with employer contributions, Healthcare FSA, critical illness, accident & hospital indemnity insurance, and a total well-being program that helps you and your family stay on track physically, socially, emotionally, and financially.

Building a Family: adoption, surrogacy and fertility assistance as well as paid parental and caregiver leave, Dependent Day Care FSA back-up child and adult/elder care days and childcare discounts.

Work-Life Integration: other benefits including Mentally Fit Employee Assistance Program, subsidized and discounted Weight Watchers® program and other employee discount programs.

Other compensations: depending on the role for which you are considered, you may be eligible for travel allowances, relocation assistance, a signing bonus and/or equity.