Principal Consultant - Pyspark and Databricks jobs in United States
cer-icon
Apply on Employer Site
company-logo

Infosys · 18 hours ago

Principal Consultant - Pyspark and Databricks

Infosys is a global leader in next-generation digital services and consulting. They are seeking a highly skilled Principal Consultant with experience in Databricks, PySpark, AWS, and Snowflake to lead the design and development of scalable data solutions for clients.

ConsultingInformation ServicesInformation TechnologyIT ManagementSoftware
badNo H1Bnote

Responsibilities

Lead the overall solution of design/development of scalable data solutions tailored for the clients of Infosys
Focus on designing the robust data pipelines and platforms that support reading data from external 3rd Party Sources
Design and implement scalable data pipelines to process data from various 3rd Party Sources and move it to cloud storage like S3 and Snowflake
Build, optimize and monitor the applications using Databricks and PySpark for batch and real-time processing
Collaborate with client stakeholders to deliver data solutions aligned with business goals
Ensure data quality, lineage, and governance in compliance with the client requirements
Lead and mentor a team of data engineers, promoting the best practices in coding, testing, and documentation

Qualification

DatabricksPySparkAWSSnowflakeData engineeringData platform transformationPythonSQLAgile frameworksCommunication skillsTeam leadership

Required

Candidate must be located within commuting distance of Hartford, CT or be willing to relocate to the area. This position may require travel to project locations
Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education
At least 11 years of experience in Information Technology
Strong hands-on experience with Databricks, PySpark, and AWS data services
Strong experience in data engineering, preferably in the insurance or financial services domain
Experience in leading the response to RFPs, RFIs, and proactive proposals. Coordinate with pre-sales, solution architects, and delivery teams to craft compelling, customized proposals that align with client expectations
Managed client relationships at Director/GM at customer organization
Able to lead the team at customer location and experience in managing large teams in a global delivery model
Experience in data platform transformation/migration to cloud platforms (Azure, AWS, GCP, Databricks/Snowflake)
Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time

Preferred

Strong knowledge of Snowflake architecture, performance tuning, and cost optimization
Proficiency in Python, SQL, and data modeling techniques
Experience in solving business problem in the relevant industry, understanding of E2E functional flows of the customer business
Able to create a Business Plan for expanding business – with a good understanding of potential business opportunities, competition strengths and weaknesses
Continuous improvement, Innovation, and growth Mindset
Good communication, articulation, and presentation skills
Good understanding of solutions, accelerators and value proposition in Data, Analytics and AI
Learnability and focus on new / emerging areas
Good understanding of Agile software development frameworks
Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams
Experience and desire to work in a global delivery environment

Benefits

Medical/Dental/Vision/Life Insurance
Long-term/Short-term Disability
Health and Dependent Care Reimbursement Accounts
Insurance (Accident, Critical Illness , Hospital Indemnity, Legal)
401(k) plan and contributions dependent on salary level
Paid holidays plus Paid Time Off

Company

Infosys is a technology company that offers consulting, outsourcing, cloud infrastructure, program management, and software services.

Funding

Current Stage
Public Company
Total Funding
$200M
Key Investors
ChrysCapital
2012-12-12IPO
2008-07-10Post Ipo Equity· $200M

Leadership Team

leader-logo
Salil Parekh
Chief Executive Officer and Managing Director
linkedin
leader-logo
Anant Adya
Executive Vice President
linkedin
Company data provided by crunchbase