Apply on Employer Site

AIG · 1 week ago

Senior Python / PySpark Engineer - GenAI

Atlanta, GA

Full-time

Onsite

Senior Level

7+ years exp

AIG is a leading global insurance organization providing a wide range of property casualty insurance and other financial services. As a Senior Engineer for GenAI, you will lead the design, development, and operationalization of cutting-edge cloud-native big data solutions that enable innovative AI models and analytics.

BankingFinancial ServicesInsurance

H1B Sponsor Likely

Responsibilities

Collaborating with stakeholders to identify and deliver innovative data solutions that meet the evolving needs of the business

Building and maintaining cloud-native big data solutions, advanced analytics products and GenAI models

Partnering with data architects and senior engineers to implement best practices, ensuring sustainable and scalable technical designs

Working closely with analytics, application development, and data science teams to foster collaboration and drive innovation

Delivering on-time, high-quality results on fast-paced schedules while maintaining rigorous standards for development and code management

Qualification

PythonPySparkCloud-native platformsData processing pipelinesContainerization technologiesCI/CD pipelineAPI developmentTypeScriptTesting frameworksPerformance optimizationCode reviews

Required

Minimum of 7 years of professional software development experience

Strong proficiency in Python (7+ years), hands-on experience with Apache Spark and PySpark for large-scale data processing

Strong proficiency in PySpark (3+ years)

Write clean, efficient, and well-documented Python and TypeScript code

Experience with testing frameworks (pytest, unittest)

Design, develop and implement data processing pipelines using Python and Spark

You are proficient in cloud-native platforms and tools, including Hadoop, HDFS, Spark, Kubernetes, and ElasticSearch, to deliver high-performance data solutions

Experience with containerization technologies (Docker) and orchestration tools (Kubernetes, Docker Compose) to enable parallel executions of tasks

You have a strong background in deploying and maintaining AI/ML models, with hands-on experience using platforms like Palantir Foundry, Snowflake, and AWS SageMaker

Build and maintain scalable and reliable APIs to expose data and functionalities to other services and applications

Identify and implement performance optimization for existing code and data processing workflows, including leveraging containerization technologies for parallel execution

Contribute to the design and architecture of our data platform and applications

Participate in code reviews to ensure code quality and adherence to best practices

Experience with CI/CD pipeline, including containerized application, code versioning capabilities such as GitHub and Jenkins

Experience setting up E2E Engineering pipeline, monitoring, and troubleshooting

Benefits

Comprehensive benefits package

Health, wellbeing and financial security

Professional development

Company

AIG

Glassdoor3.7

AIG is a global insurance company providing insurance products to support clients in business and in life.

Founded in 1919

New York, New York, USA

10001+ employees

https://www.aig.com/

H1B Sponsorship

AIG has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (2)

2024 (2)

2023 (4)

2022 (23)

2021 (5)

2020 (13)