SIGN IN
Lead Data Enginee jobs in United States
cer-icon
Apply on Employer Site
company-logo

VySystems · 11 hours ago

Lead Data Enginee

positionUnited States
timeFull-time
remoteRemote
senioritySenior Level, Lead/Staff
VySystems is a company seeking a Lead Data Engineer. The role involves programming, data transformation, and orchestration using various tools and cloud platforms.
AppsConsultingDigital MarketingInformation TechnologyInfrastructureIT InfrastructureIT ManagementWeb Development
Hiring Manager
Palanikumar (Kumar) Shanmugan
linkedin

Responsibilities

Python: Programming, ETL scripting, business logic implementation, and experience with data manipulation libraries (pandas, NumPy)
PL/SQL: Data transformation, view/table creation, and persistence layer interactions
Data Transformation Tools: DBT (Data Build Tool) for creating models and documentation
Orchestration and Data Processing Tools
Orchestration: Airflow, Dataflow, and Cloud Composer
Data Ingestion: Cloud Functions, Cloud Run, SFTP mechanisms, and Falcon (for database connections)
Cloud Platform:
Google Cloud Platform (GCP) and BigQuery experience
Experience with cloud-native data processing
Understanding of householding and data segmentation logic
Ability to work with streaming and batch data
Experience with data integration from multiple sources (e.g., Reltio, external databases)

Qualification

PythonPL/SQLGoogle Cloud PlatformData Transformation ToolsOrchestration ToolsData IngestionData Segmentation LogicStreaming DataData Integration

Required

Python: Programming, ETL scripting, business logic implementation, and experience with data manipulation libraries (pandas, NumPy)
PL/SQL: Data transformation, view/table creation, and persistence layer interactions
Data Transformation Tools: DBT (Data Build Tool) for creating models and documentation
Orchestration: Airflow, Dataflow, and Cloud Composer
Data Ingestion: Cloud Functions, Cloud Run, SFTP mechanisms, and Falcon (for database connections)
Google Cloud Platform (GCP) and BigQuery experience
Experience with cloud-native data processing

Preferred

Understanding of householding and data segmentation logic
Ability to work with streaming and batch data
Experience with data integration from multiple sources (e.g., Reltio, external databases)

Company

VySystems

twittertwittertwitter
company-logo
Vy Systems is a part of vy.ventures and is in the business of Technology consulting, Solutions, and Managed Services, providing invaluable services across many countries since 2002.
dateFounded in 2000
location
Santa Clara, California, USA
people-size501-1000 employees
web-link
https://vysystems.com/

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Ramesh Santhanam
Founder and CSO
Company data provided by crunchbase