Big Data Consultant jobs in United States
cer-icon
Apply on Employer Site
company-logo

LanceSoft, Inc. ยท 2 hours ago

Big Data Consultant

LanceSoft, Inc. is seeking a Big Data Engineer for their Wealth Management Framework CoE team. The role involves designing and developing automation frameworks for ETL processing, supporting existing frameworks, and collaborating with various teams to enhance performance and process optimization.

Information Technology
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Drishti Pal
linkedin

Responsibilities

Design & Develop new automation framework for ETL processing
Support existing framework and become technical point of contact for all related teams
Enhance existing ETL automation framework as per user requirements
Performance tuning of spark, snowflake ETL jobs
New technology POC and suitability analysis for Cloud migration
Process optimization with the help of automation and new utility development
Work in collaboration for any issues and new features
Support any batch issue
Support application team teams with any queries

Qualification

Data engineeringPythonSparkSQLUNIX ShellHDFS/Hive/ImpalaGitHubDevOpsTask prioritizationSnowflakeETL toolsCollaboration skillsCommunication skillsTeam-player skills

Required

7+ years of Data engineering experience
Must be strong in UNIX Shell, Python scripting knowledge
Must be strong in Spark
Must have strong knowledge of SQL
Hands-on knowledge on how HDFS/Hive/Impala/Spark works
Strong in logical reasoning capabilities
Should have working knowledge of Github, DevOps, CICD/ Enterprise code management tools
Strong collaboration and communication skills
Must possess strong team-player skills and should have excellent written and verbal communication skills
Ability to create and maintain a positive environment of shared success
Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor

Preferred

Good to have working experience on snowflake & any data integration tool i.e. informatica cloud
Snowflake/Azure/AWS any cloud
IDMC/any ETL tool

Company

LanceSoft, Inc.

company-logo
Established in 2000, LanceSoft is a pioneer in delivering top-notch Global Workforce Solutions and IT Services to a diverse clientele.

H1B Sponsorship

LanceSoft, Inc. has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (55)
2024 (32)
2023 (23)
2022 (25)
2021 (60)
2020 (80)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Ram Karuppusamy
Chairman & CEO
linkedin
leader-logo
Simon Dealy
Chief Financial Officer
linkedin
Company data provided by crunchbase