IMCS Group ยท 2 months ago
Technology Architect | Big Data - Data Processing | Spark
Sunnyvale, CA
Full-time
Onsite
Senior Level, Lead/Staff
8+ years expIMCS Group is one of the fastest growing MWBE staffing firms in the U.S. They are seeking a Technology Architect specializing in Big Data and Data Processing using Spark. The role involves designing and optimizing big data solutions, creating scalable data pipelines, and collaborating with various teams to ensure data quality and performance.
Staffing & Recruiting
Responsibilities
Design, develop, and optimize data processing pipelines and applications using Apache Spark
Build scalable and efficient systems to handle large volumes of data
Integrate and process data from various sources, ensuring data quality and reliability
Optimize Spark jobs for performance and cost-efficiency
Collaborate with data scientists, engineers, and other stakeholders to understand data requirements
Monitor and troubleshoot performance issues within Spark applications
Implement best practices for data security and compliance
Develop and maintain ETL (Extract, Transform, Load) processes
Write clean, efficient, and well-documented code
Participate in code reviews and ensure code quality
Stay updated with the latest trends in big data and Apache Spark
Qualification
Required
Top 3 Required skills: Spark, Scala, Big Data
Years of experience in each of the must-have skills: 8+ Years
Any Certifications required: No
Qualifications often include a relevant degree
Proficiency in programming languages like Scala or Python
Experience with distributed computing frameworks
Company
IMCS Group
IMCS Group is an IT, Healthcare, and Professional Staffing Company that helps Enterprises optimize the business value of their Staffing investments and enables them to achieve world-class business performance.
201-500 employees
H1B Sponsorship
IMCS Group has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (16)
2023 (33)
2022 (32)
2021 (47)
2020 (82)
Funding
Current Stage
Growth StageLeadership Team
Satish G Kumar
Founder and CEO
Kathleen Thompson
Diretor Client Partnership
Company data provided by crunchbase