SPECTRAFORCE · 7 hours ago
Data Engineer
SPECTRAFOR is seeking a highly skilled and motivated Senior Software Engineer specializing in Data Engineering to join their growing team. This critical role will focus on designing, developing, and optimizing data infrastructure within the Azure cloud environment, enabling data-driven insights for the business.
ConsultingCRMInformation TechnologyLegal
Responsibilities
Design, develop, and optimize scalable and efficient data processing pipelines and architectures within Azure Data Lake and Databricks
Implement and manage complex ETL (Extract, Transform, Load) processes to integrate data from diverse sources into Azure Data Lake
Develop and maintain interactive dashboards and reports using SAP Business Objects and Power BI
Leverage Azure Data Factory for data orchestration, workflow automation, and scheduling
Implement and maintain Azure Security & Governance policies to ensure data protection
Optimize data storage and retrieval mechanisms within Azure, including performance tuning of Databricks clusters
Collaborate effectively with cross-functional teams to understand business requirements and translate them into technical solutions
Implement data quality checks and validation rules throughout the data pipeline
Monitor, troubleshoot, and enhance existing data solutions, identifying and resolving performance bottlenecks
Create and maintain comprehensive technical documentation to facilitate knowledge sharing
Qualification
Required
Bachelor's degree in Computer Science, Engineering, or a related field
10 years of hands-on experience in data engineering, data warehousing, and cloud-based data platforms
Deep expertise in Azure Data Lake, Azure Data Factory, Azure Security & Governance, Databricks
Strong techno-functional experience with SAP Business Objects
Strong proficiency in SQL, including complex query writing and performance tuning
Proven experience in developing and maintaining Power BI dashboards and reports
Hands-on experience with Azure services such as Azure Synapse Analytics and Azure SQL Database
Solid understanding of data modeling concepts, ETL processes, and big data
Experience in optimizing and managing large-scale datasets in cloud environments
Strong analytical and problem-solving skills with attention to detail
Excellent communication and collaboration skills
Preferred
Master's degree in a relevant field
Understanding of DevOps practices and CI/CD pipelines for data applications
Company
SPECTRAFORCE
Welcome to SPECTRAFORCE, your gateway to NEWJOBPHORIA™! Established in 2004, SPECTRAFORCE is now one of the largest and fastest growing U.S.
H1B Sponsorship
SPECTRAFORCE has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
2024 (6)
2023 (1)
2022 (6)
2021 (8)
2020 (7)
Funding
Current Stage
Late StageCompany data provided by crunchbase