Alpha Consulting Corp. ยท 1 month ago
ata Engineer / Support Analyst - Databricks
Hamilton Township, NJ
Full-time
Onsite
Senior Level, Lead/Staff
10+ years expAlpha Consulting Corp. is a company that provides consulting services and is currently seeking a Data Engineer / Support Analyst with expertise in Databricks. The primary responsibilities include managing and supporting data pipelines, integrating Bloomberg data feeds, and ensuring data quality for trading applications.
ConsultingPharmaceuticalStaffing Agency
No H1B
Responsibilities
Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory
Integrate and process Bloomberg market data feeds and files into trading or analytics platforms
Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion
Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL
Manage FTP/SFTP file transfers between internal systems and external vendors
Ensure data quality, completeness, and timeliness for downstream trading and reporting systems
Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows
Qualification
Required
Applicants must be able to work directly for Artech on W2
10 years of experience in data engineering or production support within financial services or trading environments
Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Storage, Logic Apps, Fabric
Strong Python and SQL programming skills
Experience with Bloomberg data feeds (BPIPE, TSIP, SFTP)
Experience with Git, CI/CD pipelines, and Azure DevOps
Proven ability to support batch jobs, troubleshoot failures, and manage job scheduling
Experience handling FTP/SFTP file transfers and automation
Solid understanding of equities trading, fixed income trading, trading workflows, and financial instruments
Excellent communication, problem-solving, and stakeholder management skills
Preferred
Experience with Power BI or other visualization tools
Familiarity with Kafka, Event Hubs, or real-time streaming architectures
Knowledge of ITIL / incident management best practices
Knowledge of building AI Agents and LLMs
Benefits
Inclusive and diverse work environment.
Opportunities for professional growth and development.
Comprehensive benefits package.
Company
Alpha Consulting Corp.
Alpha Consulting Corp. has been exceeding expectations in the IT, pharmaceutical, and clinical staffing business since 1994.
201-500 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase