Scalence L.L.C. · 1 month ago
ata Engineer / Support Analyst - Databricks
Hamilton Township, NJ
Full-time
Onsite
Senior Level, Lead/Staff
10+ years expScalence L.L.C. is a company that offers an inclusive and diverse work environment, and they are seeking a Data Engineer / Support Analyst with expertise in Databricks. The role involves managing and supporting data pipelines, integrating market data feeds, and collaborating with various teams to enhance data workflows.
Information Technology & Services
No H1B
Responsibilities
Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory
Integrate and process Bloomberg market data feeds and files into trading or analytics platforms
Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion
Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL
Manage FTP/SFTP file transfers between internal systems and external vendors
Ensure data quality, completeness, and timeliness for downstream trading and reporting systems
Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows
Qualification
Required
Applicants must be able to work directly for Artech on W2
10 years of experience in data engineering or production support within financial services or trading environments
Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Storage, Logic Apps, Fabric
Strong Python and SQL programming skills
Experience with Bloomberg data feeds (BPIPE, TSIP, SFTP)
Experience with Git, CI/CD pipelines, and Azure DevOps
Proven ability to support batch jobs, troubleshoot failures, and manage job scheduling
Experience handling FTP/SFTP file transfers and automation
Solid understanding of equities trading, fixed income trading, trading workflows, and financial instruments
Excellent communication, problem-solving, and stakeholder management skills
Preferred
Experience with Power BI or other visualization tools
Familiarity with Kafka, Event Hubs, or real-time streaming architectures
Knowledge of ITIL / incident management best practices
Knowledge of building AI Agents and LLMs
Benefits
Inclusive and diverse work environment.
Opportunities for professional growth and development.
Comprehensive benefits package.
Company
Scalence L.L.C.
In today’s dynamic and competitive market, success hinges on mastering three key areas: Data Intelligence, Business Resilience, and Digital Experience.
501-1000 employees
Funding
Current Stage
Late StageCompany data provided by crunchbase