IBSS · 3 days ago
Data Engineer
Wonder how qualified you are to the job?
ConsultingLegal
Insider Connection @IBSS
Responsibilities
Build, test, and maintain transparent, reproducible, efficient, and automated (where practicable) data pipelines from multiple data sources, including "big data” sources
Develop algorithms to transform raw data into useful, actionable data products
Develop workflows to upload/download data products to/from an ERDDAP server
Produce documentation for the new data pipelines, including metadata, tutorials, and standard operating procedure documents
Create tools to acquire and publish metadata to meet Public Access to Research Results (PARR) mandates
Use project management tools to track progress and provide routine updates
Adhere to NOAA IT security policies and standard operating procedures and follow industry best practices
Collaborate with NOAA data specialist colleagues to align activities with standard NOAA communities of practice
Assist with assimilation of new data streams into ecosystem based management and integrated ecosystem assessment products produced at the Northeast Fisheries Science Center
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
A degree or extensive experience in data science, data analytics, computer science
Extensive experience with cronjobs and GitHub automation processes
Experience in database design and management, big data tools, various data types (e.g. netcdf, flat, nccsv), data extraction, automated scripting, data security, cloud computing and storage
Knowledge of Open Science principles
Documentation skills and experience developing standard operating procedures
The ability to work independently and collaboratively with an interdisciplinary team
Preferred
Experience managing oceanographic dataset including biogeochemical model output and/or remote sensing datasets
Familiarity with machine learning and data serving systems such as ERDDAP, THREDDS or OPeNDAP
Project management experience
Experience with SQL and coding in R and/or Python
Benefits
Medical, Dental, Vision, and Prescription Drug Coverage
Paid Time Off
Federal Holidays
Matching 401K Plan
Tuition/Professional Development Reimbursement
Flex-Spending (FSA)/Dependent Care Account (DCA) Options