CGI · 3 hours ago
Tech Lead - Data Engineering
Pittsburgh, PA
Full-time
Onsite
Lead/Staff
$71K/yr - $157K/yr
8+ years expCGI Group, Inc. is looking for a Lead Data Engineer to join their team on-site. The role involves managing and coordinating with an offshore team, building and optimizing data processing applications, and ensuring compliance with data security practices.
AnalyticsApplication Performance ManagementBusiness IntelligenceConsultingCyber SecurityFinanceInformation TechnologyTechnical Support
Responsibilities
Manage and coordinate with the offshore team to ensure deliverables are met
Interact with project stakeholders on a day-to-day basis and report on project status to the Client Management team
Build and optimize Spark Streaming applications for real-time ingestion, transformation, and event-driven processing using Kafka or other messaging systems
Excellent communication skills and work independently
Provide insights to the team on value adds and process efficiencies
The candidate should have hands-on experience with the Kafka streaming platform and the ELK (Elastic) stack
Build CI/CD workflows using Git, Jenkins, and Bitbucket for automated deployments and version control
Collaborate with cross-functional teams to troubleshoot, monitor, and improve data pipelines in production environments
Ensure compliance with data security, governance, and access control practices
The ideal candidate will have a can-do attitude, passion for technology, extensive analysis coding. This candidate will serve as a technical expert of a large-scale digital development project consisting of both on-shore and off-shore developers
Qualification
Required
8+ yrs of professional experience in software development and/or data engineering
5+ yrs of hands-on experience working with relational databases, including Oracle, Teradata, and MySQL
6+ yrs of hands-on experience with Python and PySpark development. (Mandatory)
3+ yrs Hands-on Experience with Kafka Streaming Platform (Mandatory)
3+ yrs Hands-on Experience with Elastic Search (ELK Stack) and building reporting dashboards (ELK) (Mandatory)
Experience in Data Analysis
Experience with Hadoop ecosystem, i.e., Hadoop, Hive, Spark, Scala, Sqoop, Flume
Knowledge on Banking Domain/Products
Experience with modern workflow/orchestration tools (e.g., Apache Airflow, Oozie, etc.)
Experience working with Data Observability within a streaming platform would be a plus
Experience with containerization and orchestration (e.g., Docker, Kubernetes) is an advantage
Knowledge of CI/CD tools like Git, Jenkins, and Bitbucket
Understanding of job monitoring, logging, and performance tuning for both batch and streaming workloads
Strong analytical abilities
Agile experience is required with Jira tool expertise
Provide hands-on technical solutions to business challenges & translate them into process/technical solutions
Good knowledge of CI/CD and DevOps principles
Learning knowledge in GenAI, Azure OpenAI, and GPT
Deliver high-quality work and adapt to new challenges, as an individual or as part of a team
Excellent communication and thought leadership skills
Excellent interpersonal skills, including the ability to work with diverse personality types and understand technical issues
Knowledge of Banking Domain
Knowledge of streaming platforms
Knowledge of BIAN standards
Benefits
Competitive compensation
Comprehensive insurance options
Matching contributions through the 401(k) plan and the share purchase plan
Paid time off for vacation, holidays, and sick time
Paid parental leave
Learning opportunities and tuition assistance
Wellness and Well-being programs
Company
CGI
CGI is an IT and business consulting services firm that offers consulting, cyber security, cloud, and IT services.
10001+ employees
H1B Sponsorship
CGI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (775)
2024 (762)
2023 (795)
2022 (940)
2021 (846)
2020 (582)
Funding
Current Stage
Public CompanyTotal Funding
$1.2B2025-03-12Post Ipo Debt· $650M
2024-09-03Post Ipo Debt· $550.87M
1998-10-06IPO
Leadership Team
François Boulanger
President and Chief Executive Officer at CGI
Raymond McMann
VP, Global Oil & Gas Industry
Recent News
2026-01-22
Digital Journal
2026-01-22
Company data provided by crunchbase