SIGN IN
Technology Lead | Big Data - Data Processing | Spark jobs in United States
cer-icon
Apply on Employer Site
company-logo

Alpha Consulting Corp. · 3 days ago

Technology Lead | Big Data - Data Processing | Spark

Alpha Consulting Corp. is a consulting firm specializing in technology solutions, and they are seeking a Technology Lead for Big Data processing using Spark. The role involves designing and developing large scale data processing pipelines and collaborating with various teams to troubleshoot and resolve data issues.
ConsultingPharmaceuticalStaffing Agency
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Able to write clean, maintainable and efficient Scala code following best practices
Good knowledge on the fundamental Data Structures and their usage
Having expertise in Spark Core, Spark SQL and Spark Streaming
Experience with Hadoop, HDFS, Hive and other BigData technologies
Familiarity with Data warehousing and ETL concepts and techniques
Having expertise in Database concepts and SQL/NoSQL operations
UNIX shell scripting will be an added advantage in scheduling/running application jobs
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives
Understand project requirements and translate them into technical solutions which meets the project quality standards
Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues
Strong problem solving and Good Analytical skills
Excellent verbal and written communication skills
Experience and desire to work in a Global delivery environment
Stay up to date with new technologies and industry trends in Development

Qualification

SparkScalaSpark StreamingHadoopSQLHiveData StructuresETL conceptsUNIX shell scriptingAgile methodologyAnalytical skillsProblem solvingCommunication skills

Required

At least 8+ years of experience and strong knowledge in Scala programming language
Able to write clean, maintainable and efficient Scala code following best practices
Good knowledge on the fundamental Data Structures and their usage
At least 8+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies
Having expertise in Spark Core, Spark SQL and Spark Streaming
Experience with Hadoop, HDFS, Hive and other BigData technologies
Familiarity with Data warehousing and ETL concepts and techniques
Having expertise in Database concepts and SQL/NoSQL operations
UNIX shell scripting will be an added advantage in scheduling/running application jobs
At least 8 years of experience in Project development life cycle activities and maintenance/support projects
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives
Understand project requirements and translate them into technical solutions which meets the project quality standards
Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues
Strong problem solving and Good Analytical skills
Excellent verbal and written communication skills
Experience and desire to work in a Global delivery environment
Stay up to date with new technologies and industry trends in Development
Minimum Years of Experience: 8 years
Certifications Needed: Karat assessment

Preferred

Spark Streaming
Hadoop
Hive
SQL
Sqoop
Impala

Company

Alpha Consulting Corp.

twittertwitter
company-logo
Alpha Consulting Corp. has been exceeding expectations in the IT, pharmaceutical, and clinical staffing business since 1994.

H1B Sponsorship

Alpha Consulting Corp. has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (4)
2023 (3)
2021 (4)
2020 (6)

Funding

Current Stage
Growth Stage
Company data provided by crunchbase