Veterans Sourcing Group, LLC · 1 day ago
Big Data Sr. Big Data Engineer (Framework CoE)
Alpharetta, GA
Full-time
Hybrid
Senior Level
7+ years expVeterans Sourcing Group, LLC is seeking a Senior Big Data Engineer to support their Wealth Management's Framework CoE team. The role involves working on existing Hadoop production and enhancing frameworks for Hadoop to Snowflake migration, requiring strong ownership and technical skills in automation, coding, and architecture.
Human ResourcesRecruitingStaffing Agency
No H1B
U.S. Citizen Only
Responsibilities
Design & develop new automation framework for ETL processing
Support the existing framework; become technical POC for related teams
Enhance ETL automation framework based on requirements
Performance tuning for Spark and Snowflake ETL jobs
Run POCs and suitability analysis for cloud migration
Process optimization through automation + utility development
Partner with teams on issues and new features
Support batch issues and application team queries
Qualification
Required
Bachelor's degree required
Hadoop / Big Data experience
Hands-on Apache Spark
Strong UNIX + Python & Shell scripting
Strong hands-on SQL (querying + optimization)
Working knowledge of GitHub, DevOps, and CI/CD pipelines
7+ years data engineering experience
Strong in UNIX Shell + Python scripting
Strong in Spark
Strong SQL
Hands-on knowledge: HDFS / Hive / Impala / Spark
Logical reasoning + problem-solving mindset
Familiar with GitHub, DevOps, CI/CD / enterprise code management tools
Strong communication + collaboration
Self-driven; able to prioritize and resolve issues with minimal supervision
Preferred
7+ years of experience
Snowflake and/or AWS exposure
IDMC (Informatica Cloud) or any ETL/Data Integration tool
Financial Services experience (highly desirable)
Good to have: Snowflake + any integration tool (ex: Informatica Cloud)
Desired Skills: Snowflake / Azure / AWS (any cloud)
IDMC / any ETL tool
Company
Veterans Sourcing Group, LLC
Welcome to the Veterans Souring Group company profile. Veterans Sourcing Group (VSG) is a “Service Disabled Veteran Owned Small Business – SDVOSB”.
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase