SPECTRAFORCE · 2 days ago
Data Engineer
SPECTRAFOR is seeking a Data Engineer II to contribute to optimizing data architecture and data pipeline processes. The role involves supporting data initiatives, ensuring optimal data delivery, and engaging in the entire project lifecycle from data mapping to data consumption.
Responsibilities
Build, Maintain and Support Databricks compute and storage
Solves simple to moderate application errors, resolves application problems, following up promptly with all appropriate customers and IT personnel
Reviews and contributes to QA test plans and supports QA team during test execution
Participates in developing data transformation and data pipelines
Ensures change control and change management procedures are followed within the program/project as they relate to requirements
Develops BI datasets, reports, dashboards to support decision-making within the business and IT
Able to interpret requirement documents, contributes to creating functional design documents as a part of data development life cycle
Documents all phases of work including gathering requirements, joining relationship diagrams, creating database diagrams, report layouts and other program technical specifications using current specified design standards for new or revised solutions
Relates information from various sources to draw logical conclusions
Conducts unit testing on ELT and report development
Conducts data lineage and impact analysis as a part of the change management process
Conducts data analysis (SQL, Excel, Data Discovery, etc.) on legacy systems and new data sources
Contributes to documenting reporting requirements through engagement with business process SMEs
Creates source to target data mappings for data pipelines and integration activities
Assists in identifying the impact of proposed application development/enhancements projects
Performs data profiling and process analysis to understand key source systems and uses knowledge of application features and functions to assess scope and impact of business needs
Works with business users to design, develop, test, and implement business intelligence solutions in the Data & Analytics Platform
Implement and maintain data governance policies and procedures to ensure data quality, security and compliance
Ensure operational stability of a 24/7/365 grocery retail environment by providing technical support, system monitoring, and issue resolution which may be required during off-hours, weekends, and holidays as needed
Qualification
Required
Bachelors Degree in Computer Science or Technical field; equivalent trainings/certifications/experience equivalency will be considered
3 or more years of equivalent experience in relevant job or field of technology
3+ years of Databricks
3+ years of Terraform
Preferred
Masters Degree in relevant field of study preferred; Additional trainings or certifications in relevant field of study preferred
Experience in Agile teams and or Product/Platform based operating model
Experience in retail or grocery preferred
Company
SPECTRAFORCE
Welcome to SPECTRAFORCE, your gateway to NEWJOBPHORIA™! Established in 2004, SPECTRAFORCE is now one of the largest and fastest growing U.S.
H1B Sponsorship
SPECTRAFORCE has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
2024 (6)
2023 (1)
2022 (6)
2021 (8)
2020 (7)
Funding
Current Stage
Late StageCompany data provided by crunchbase