Apply on Employer Site

FINRA · 1 day ago

Machine Learning Senior Software Engineer (AWS, LLMs, Python)

Rockville, MD

Full-time

Hybrid

Mid, Senior Level

$110K/yr - $206K/yr

5+ years exp

FINRA is seeking a highly skilled Machine Learning Engineer with strong experience in AWS and Large Language Models. The role involves designing, building, and deploying scalable ML systems, integrating generative AI capabilities, and supporting end-to-end model lifecycle workflows in production.

FinanceFinancial ServicesNon Profit

Culture & Values

H1B Sponsor Likely

Responsibilities

Design, build, and deploy machine learning models and pipelines using Python, AWS services, and Amazon Bedrock

Develop scalable APIs and microservices to expose ML/LLM capabilities using FastAPI

Build automated CI/CD pipelines using Jenkins or GitLab CI/CD for model training, testing, and deployment with robust monitoring, logging, and alerting for ML systems in production

Optimize ML workloads using AWS services such as SageMaker, Lambda, ECS/EKS, Step Functions, and KMS

Familiarity with containerization using Docker and orchestration with ECS, EKS, or Kubernetes

Experience implementing RAG pipelines with vector databases (e.g., OpenSearch, Pinecone, DynamoDB, Aurora PostgreSQL + pgvector)

Knowledge of modern MLOps tools (MLflow, SageMaker Pipelines, Weights & Biases)

Experience working with API frameworks (FastAPI, Flask)

Background in security, compliance, or responsible AI principles

Qualification

AWSLarge Language ModelsPythonCI/CD pipelinesFastAPIDockerMLOps toolsAPI frameworksObject-oriented developmentCloud technologiesData storage technologiesPerformance tuningDevOpsTest automationSoftware securitySecurity compliance

Required

Bachelor's degree in Computer Science, Information Systems or related discipline with at least 5 years of related experience, or equivalent training and/or work experience

Strong experience in AWS

Strong experience in Large Language Models (LLMs)—especially Amazon Bedrock

Strong experience in Python

Strong experience in object-oriented development

Strong experience with cloud technologies

Strong experience in data storage technologies

Experience in performance tuning and optimization

Experience in DevOps and CI/CD technologies

Experience in test automation and unit testing

Experience in software security

System design experience

Familiarity with containerization using Docker and orchestration with ECS, EKS, or Kubernetes

Experience implementing RAG pipelines with vector databases (e.g., OpenSearch, Pinecone, DynamoDB, Aurora PostgreSQL + pgvector)

Knowledge of modern MLOps tools (MLflow, SageMaker Pipelines, Weights & Biases)

Experience working with API frameworks (FastAPI, Flask)

Background in security, compliance, or responsible AI principles

Benefits

Comprehensive health, dental and vision insurance

Basic life, accidental death and dismemberment, supplemental life, spouse/domestic partner and dependent life, and spouse/domestic partner and dependent accidental death and dismemberment, short- and long-term disability, long-term care, business travel accident, disability and legal

401(k) plan with company match and eligibility for participation in an additional FINRA-funded retirement contribution

Tuition reimbursement

Commuter benefits

Adoption assistance

Backup family care

Surrogacy benefits

Employee assistance

Wellness programs

15 days of paid time off

5 personal days

9 sick days

Two volunteer service days

Military leave

Jury duty leave

Bereavement leave

Voting and election official leave for federal, state or local primary and general elections

Care of a family member leave (available after 90 days of employment)

Childbirth and parental leave (available after 90 days of employment)

Nine paid holidays

Company

FINRA

Glassdoor4.0

The Financial Industry Regulatory Authority (FINRA) is an independent regulator for securities firms doing business in the U.S. It is a sub-organization of Thrivent.

Founded in 2007

Washington, District of Columbia, USA

1001-5000 employees

http://www.finra.org

H1B Sponsorship

FINRA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (59)

2024 (43)

2023 (35)

2022 (56)

2021 (27)

2020 (37)