Alpha Consulting Corp. · 3 days ago
Technology Lead | Big Data - Data Processing | Spark
Alpha Consulting Corp. is a consulting firm specializing in technology solutions, and they are seeking a Technology Lead for Big Data processing using Spark. The role involves designing and developing large scale data processing pipelines and collaborating with various teams to troubleshoot and resolve data issues.
ConsultingPharmaceuticalStaffing Agency
Responsibilities
Able to write clean, maintainable and efficient Scala code following best practices
Good knowledge on the fundamental Data Structures and their usage
Having expertise in Spark Core, Spark SQL and Spark Streaming
Experience with Hadoop, HDFS, Hive and other BigData technologies
Familiarity with Data warehousing and ETL concepts and techniques
Having expertise in Database concepts and SQL/NoSQL operations
UNIX shell scripting will be an added advantage in scheduling/running application jobs
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives
Understand project requirements and translate them into technical solutions which meets the project quality standards
Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues
Strong problem solving and Good Analytical skills
Excellent verbal and written communication skills
Experience and desire to work in a Global delivery environment
Stay up to date with new technologies and industry trends in Development
Qualification
Required
At least 8+ years of experience and strong knowledge in Scala programming language
Able to write clean, maintainable and efficient Scala code following best practices
Good knowledge on the fundamental Data Structures and their usage
At least 8+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies
Having expertise in Spark Core, Spark SQL and Spark Streaming
Experience with Hadoop, HDFS, Hive and other BigData technologies
Familiarity with Data warehousing and ETL concepts and techniques
Having expertise in Database concepts and SQL/NoSQL operations
UNIX shell scripting will be an added advantage in scheduling/running application jobs
At least 8 years of experience in Project development life cycle activities and maintenance/support projects
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives
Understand project requirements and translate them into technical solutions which meets the project quality standards
Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues
Strong problem solving and Good Analytical skills
Excellent verbal and written communication skills
Experience and desire to work in a Global delivery environment
Stay up to date with new technologies and industry trends in Development
Minimum Years of Experience: 8 years
Certifications Needed: Karat assessment
Preferred
Spark Streaming
Hadoop
Hive
SQL
Sqoop
Impala
Company
Alpha Consulting Corp.
Alpha Consulting Corp. has been exceeding expectations in the IT, pharmaceutical, and clinical staffing business since 1994.
H1B Sponsorship
Alpha Consulting Corp. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (4)
2023 (3)
2021 (4)
2020 (6)
Funding
Current Stage
Growth StageCompany data provided by crunchbase