ApTask ยท 4 months ago
Lead Data Engineer with (Kafka, Snowflake, Python and Capital banking)
NY
Full-time
Onsite
Lead/Staff
$600/d - $700/dApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. They are seeking a Lead Data Engineer to develop and optimize data pipelines and architect data integration solutions in the financial services domain.
Human ResourcesInformation TechnologySmall and Medium BusinessesStaffing Agency
Responsibilities
Lead the development and optimization of batch and real-time data pipelines, ensuring scalability, reliability, and performance
Architect, design, and deploy data integration, streaming, and analytics solutions leveraging Spark, Kafka, and Snowflake
Ability to help voluntarily and proactively, and support Team Members, Peers to deliver their tasks to ensure End-to-end delivery
Evaluates technical performance challenges and recommend tuning solutions
Hands-on knowledge of Data Service Engineer to design, develop, and maintain our Reference Data System utilizing modern data technologies including Kafka, Snowflake, and Python
Qualification
Required
Proven experience in building and maintaining data pipelines, especially using Kafka, Snowflake, and Python
Strong expertise in distributed data processing and streaming architectures
Experience with Snowflake data warehouse platform: data loading, performance tuning, and management
Proficiency in Python scripting and programming for data manipulation and automation
Familiarity with Kafka ecosystem (Confluent, Kafka Connect, Kafka Streams)
Knowledge of SQL, data modeling, and ETL/ELT processes
Domain Knowledge in Trade Processing, Settlement, Reconciliation, and related back/middle-office functions within financial markets (Equities, Fixed Income, Derivatives, FX, etc.)
Strong understanding of trade lifecycle events, order types, allocation rules, and settlement processes
Funding Support, Planning & Analysis, Regulatory reporting & Compliance. Knowledge of regulatory standards (such as Dodd-Frank, EMIR, MiFID II) related to trade reporting and lifecycle management
Preferred
Understanding of cloud platforms (AWS, Azure, GCP) is a plus
Company
ApTask
ApTask is a staffing and recruiting company offering staffing, project, and workforce solutions.
Founded in 2010
201-500 employees
H1B Sponsorship
ApTask has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (1)
2020 (1)
Funding
Current Stage
Growth StageLeadership Team
Taj Haslani
Founder
Recent News
Company data provided by crunchbase