VARITE INC ยท 1 month ago
USA_Enterprise Architect
VARITE INC is a company seeking a Bigdata Spark Developer to join their team. The role involves direct client interactions, designing and maintaining data management systems, and migrating legacy applications to the Azure Cloud Platform.
Information Technology & Services
Responsibilities
Direct client meetings and requirement gathering
Designing, creating, testing and maintaining the complete data management & processing systems
Requirement document review, test plan preparation and its review, production roll out
Migrating legacy application running in on-prem to Azure Cloud Platform
Design and develop data processing frameworks using Hadoop, Big Data, Spark, Scala, Hive etc
Use agile methodology to break down project to several sprints and track tasks on a regular basis
Implement Spark best practices to efficiently process data to meet SLAs by utilizing features like partitioning, resource tuning, memory management and checkpointing
Do R & Ds for investigating technical feasibility of various tools and features
Participate in technical system design such as creating flow diagrams sequence, LLD, HLD, SRS, BRD and analysing the impact to the current business functionalities which are affected/enhanced
Help & guide the offshore/onsite teams for any problems faced by them and provide solutions with the gained business/technical development/business knowledge
Provide PRE/PROD technical development support whenever required for every release
Use Integrated Project Management System (IPMS) for project financials, time tracking, customer management, quality management, risk management, metrics and other project related reports which are generated to track all associates who are in compliance status and there shouldn't be any leakage on the allocations, budget/revenues between Client and ***
Utilize Integrated Quality Management System (IQMS) to review quality processes, guidelines, audits and project management reviews within Client
Keeping track of tasks/bugs to reduce downtime, increase productivity and communication
Qualification
Required
7+ years of experience
Direct client meetings and requirement gathering
Designing, creating, testing and maintaining the complete data management & processing systems
Requirement document review, test plan preparation and its review, production roll out
Migrating legacy application running in on-prem to Azure Cloud Platform
Design and develop data processing frameworks using Hadoop, Big Data, Spark, Scala, Hive etc
Use agile methodology to break down project to several sprints and track tasks on a regular basis
Implement Spark best practices to efficiently process data to meet SLAs by utilizing features like partitioning, resource tuning, memory management and checkpointing
Do R & Ds for investigating technical feasibility of various tools and features
Participate in technical system design such as creating flow diagrams sequence, LLD, HLD, SRS, BRD and analysing the impact to the current business functionalities which are affected/enhanced
Help & guide the offshore/onsite teams for any problems faced by them and provide solutions with the gained business/technical development/business knowledge
Provide PRE/PROD technical development support whenever required for every release
Use Integrated Project Management System (IPMS) for project financials, time tracking, customer management, quality management, risk management, metrics and other project related reports
Utilize Integrated Quality Management System (IQMS) to review quality processes, guidelines, audits and project management reviews within Client
Keeping track of tasks/bugs to reduce downtime, increase productivity and communication