EDI Staffing, an EDI Specialists Company ยท 1 day ago
Data Engineer II
EDI Staffing is an EDI Specialists Company looking for a Data Engineer II who will contribute to optimizing data architecture and pipelines. The role involves supporting data needs across multiple teams and ensuring optimal data delivery architecture for ongoing projects.
ConsultingHuman ResourcesInformation TechnologyStaffing Agency
Responsibilities
Build, Maintain and Support Databricks compute and storage
Solves simple to moderate application errors, resolves application problems, following up promptly with all appropriate customers and IT personnel
Reviews and contributes to QA test plans and supports QA team during test execution
Participates in developing data transformation and data pipelines
Ensures change control and change management procedures are followed within the program/project as they relate to requirements
Develops BI datasets, reports, dashboards to support decision-making within the business and IT
Able to interpret requirement documents, contributes to creating functional design documents as a part of data development life cycle
Documents all phases of work including gathering requirements, joining relationship diagrams, creating database diagrams, report layouts and other program technical specifications using current specified design standards for new or revised solutions
Relates information from various sources to draw logical conclusions
Conducts unit testing on ELT and report development
Conducts data lineage and impact analysis as a part of the change management process
Conducts data analysis (SQL, Excel, Data Discovery, etc.) on legacy systems and new data sources
Contributes to documenting reporting requirements through engagement with business process SMEs
Creates source to target data mappings for data pipelines and integration activities
Assists in identifying the impact of proposed application development/enhancements projects
Performs data profiling and process analysis to understand key source systems and uses knowledge of application features and functions to assess scope and impact of business needs
Works with business users to design, develop, test, and implement business intelligence solutions in the Data & Analytics Platform
Implement and maintain data governance policies and procedures to ensure data quality, security and compliance
Ensure operational stability of a 24/7/365 grocery retail environment by providing technical support, system monitoring, and issue resolution which may be required during off-hours, weekends, and holidays as needed
Qualification
Required
Bachelors Degree in Computer Science or Technical field; equivalent trainings/certifications/experience equivalency will be considered
3 or more years of equivalent experience in relevant job or field of technology
3+ years of Databricks
3+ years of Terraform
Preferred
Masters Degree in relevant field of study preferred; Additional trainings or certifications in relevant field of study preferred
Experience in Agile teams and or Product/Platform based operating model
Experience in retail or grocery preferred