Apply on Employer Site

Ally · 7 hours ago

Principal - Software Engineer

Charlotte, NC

Full-time

Onsite

Senior Level, Lead/Staff

$110K/yr - $180K/yr

5+ years exp

Ally Financial is a customer-centric, leading digital financial services company focused on innovative solutions. They are seeking a Principal Software Engineer to lead the design and development of a self-hosted AI Agent Platform on AWS, blending hands-on engineering with strategic technical leadership.

AutomotiveFinanceFinancial Services

No H1B

Responsibilities

Architect and evolve a self-hosted, AWS-based AI Agent Platform using ECS/Fargate, Lambda, API Gateway, ALB, S3, KMS, CloudWatch

Design scalable, modular infrastructure supporting multiple agent frameworks (LangGraph, OpenAI Agent SDK, Autogen)

Define patterns for agent deployment, orchestration, and multi-tenant scaling in containerized environments

Build intelligent multi-agent workflows with complex reasoning and tool orchestration

Develop reusable SDKs, templates, and developer tooling for faster adoption

Integrate agents with enterprise systems such as ServiceNow, Salesforce, Snowflake, Confluence, Okta, GRC platforms

Implement authentication and authorization using Okta OIDC, JWT, and fine-grained tool policies

Establish observability standards including logging, metrics, tracing, and governance dashboards

Ensure compliance with enterprise AI governance and risk management frameworks

Mentor senior engineers and act as technical thought leader across teams

Collaborate with cross-functional stakeholders to drive enterprise-wide platform adoption

Qualification

AWSAI platformsPythonContainer orchestrationCI/CD pipelinesAI agent frameworksCloud securityCommunicationStrategic thinkerProblem-solving

Required

5+ years of software engineering experience required

Proven experience architecting and scaling distributed systems and AI platforms on AWS

Strong Python skills and familiarity with async frameworks like FastAPI and asyncio

Experience with AI agent frameworks (LangGraph, Autogen, OpenAI SDK, MCP)

Knowledge of LLM orchestration, vector databases, retrieval augmentation, prompt patterns required

Excellent communication skills and ability to influence technical and executive stakeholders

Strategic thinker with hands-on problem-solving skills

Proven record of building platforms or frameworks adopted at scale

Preferred

Bachelor's or Master's in Computer Science, AI/ML, Data Science, or related experience preferred

3+ years in senior or principal roles preferred

Expertise in container orchestration, serverless architectures, and CI/CD pipelines (GitLab, Terraform) preferred

Familiarity with cloud security, IAM, networking, and enterprise authentication (Okta) preferred

Benefits

Time Away: Program starts at 20 paid time off days in addition to 11 paid holidays and 8 hours of volunteer time off yearly (time off days are prorated based on start date and program varies based on full or part-time status and management level).

Planning for the Future: plan for the near and long term with an industry-leading 401K retirement savings plan with matching and company contributions, student loan pay downs and 529 educational save up assistance programs, tuition reimbursement, employee stock purchase plan, and financial learning center and financial coach access.

Supporting your Health & Well-being: flexible health and insurance options including medical, dental and vision, employee, spouse and child life insurance, short- and long-term disability, pre-tax Health Savings Account with employer contributions, Healthcare FSA, critical illness, accident & hospital indemnity insurance, and a total well-being program that helps you and your family stay on track physically, socially, emotionally, and financially.

Building a Family: adoption, surrogacy and fertility assistance as well as paid parental and caregiver leave, Dependent Day Care FSA back-up child and adult/elder care days and childcare discounts.

Work-Life Integration: other benefits including Mentally Fit Employee Assistance Program, subsidized and discounted Weight Watchers® program and other employee discount programs.

Other compensations: depending on the role for which you are considered, you may be eligible for travel allowances, relocation assistance, a signing bonus and/or equity.