NTT DATA North America ยท 1 week ago
Senior Python Lead and Developer - Onsite
NTT DATA North America is a leading business and technology services provider, seeking a Senior Python Lead and Developer to join their team. This role involves delivering major data engineering initiatives, focusing on building and maintaining data pipelines and leading a team of engineers.
ConsultingDigital MarketingInformation ServicesInformation TechnologyIT Management
Responsibilities
Data Engineering: Design, develop, and optimize scalable data pipelines using Python and PySpark for batch and streaming workloads
Workflow Orchestration: Build, schedule, and monitor complex workflows using Airflow, ensuring reliability and maintainability
CI/CD Pipeline Development: Architect and implement CI/CD pipelines for data engineering projects using GitHub, Docker, and cloud-native solutions
Testing & Quality: Apply test-driven development (TDD) practices and automate unit/integration tests for data pipelines
Secure Development: Implement secure coding best practices and design patterns throughout the development lifecycle
Collaboration: Work closely with Data Architects, QA teams, and business stakeholders to translate requirements into technical solutions
Documentation: Create and maintain technical documentation, including process/data flow diagrams and system design artifacts
Mentorship: Lead and mentor junior engineers, providing guidance on coding, testing, and deployment best practices
Troubleshooting: Analyze and resolve technical issues across the data stack, including pipeline failures and performance bottlenecks
Qualification
Required
Minimum 8-10 years of practical experience for the below-mentioned points
Minimum 8+ years of practical experience building production-grade data pipelines using Python and PySpark
Proven track record of designing, deploying, and managing Airflow DAGs in enterprise environments
Ability to build and maintain CI/CD pipelines for data engineering workflows, including automated testing and deployment
Experience with containerization (Docker) and cloud platforms (GCP) for data engineering workloads
Ability to write object-oriented Python code, manage dependencies, and follow industry best practices
Proficiency with Git for source code management and collaboration (commits, branching, merging, GitHub/GitLab workflows)
Strong command-line skills in Unix-like environments
Solid understanding of SQL for data ingestion and analysis
Comfortable with code reviews, pair programming, and using remote collaboration tools effectively
Writes code with an eye for maintainability and testability; excited to build production-grade software
Bachelor's or graduate degree in Computer Science, Data Analytics or related field, or equivalent work experience
Graduate degree in a related field, such as Computer Science or Data Analytics
Familiarity with Test-Driven Development (TDD)
Minimum of 10+ years overall IT experience
Experienced in waterfall, iterative, and agile methodologies
Preferred
A high tolerance for OpenShift, Cloudera, Tableau, Confluence, Jira, and other enterprise tools
Company
NTT DATA North America
NTT DATA, Inc. is a trusted global innovator of business and technology services.
H1B Sponsorship
NTT DATA North America has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (144)
2024 (182)
2023 (257)
2022 (871)
2021 (809)
2020 (1266)
Funding
Current Stage
Late StageRecent News
2025-12-05
Company data provided by crunchbase