National Center for Biotechnology Information (NCBI) · 3 hours ago
Platform Engineer (DataOps)
Black Canyon Consulting (BCC) is seeking a Platform Engineer (DataOps) to support the National Center for Biotechnology Information (NCBI). The role involves developing and continuously improving a DataOps platform, maintaining tools and libraries, and ensuring compliance with federal application security regulations.
Biotechnology
Responsibilities
Develops and continuously improves DataOps platform
Develops and maintains common tools and libraries
Evaluates new technologies and practices
Helps NCBI developers with adoption of platform
Ensures compliance with the Federal application security regulations and standards by providing automated solutions and compliance pipelines
Embraces agile development and continuous improvement
Encourages growth mindset and offers leadership opportunities at any level
Qualification
Required
Strong coding skills in at least one programming language are required (Python, C++, ...)
Kubernetes, containerization
Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure or equivalent cloud services
Apache Kafka, Google Cloud Pub/Sub or equivalent
Apache AirFlow or equivalent
Experience with data processing applications and modern cloud-based data processing infrastructure
Linux command-line skills
B.S. in a STEM field (Engineering, Computer Science, Mathematics, Physics) or equivalent industry experience in Systems Engineering
Preferred
Google Anthos
Docker
GitOps tools: ArgoCD or equivalent
Infrastructure as code tools: Terraform or equivalent
GitLab, GitHub, Bitbucket, Teamcity, Artifactory, or equivalent products for management of Git source control, CI/CD pipelines and artifact lifecycle management
Modern observability and logging tools: Prometheus, EFK (ElasticSearch, fluentd, Kibana), TIGK (Telegraph, InfluxDB, Graphana, Kapacitor)
DataDog, Sensu, Jaeger, Sentry, OpsGenie, PagerDuty, Splunk, or equivalent
Secret Management tools such as Hashicorp Vault, CyberArk, Azure Key Vault, Google Cloud Secret Manager or equivalent
Data transfer tools: AWS DataSync, Aspera, MinIO, CloudSoda or equivalent
Apache Pulsar, RabbitMQ, Amazon Kinesis, Apache Flume, Apache Storm, Apache Spark Streaming, Google Cloud Pub/Sub
Experience with best-practice design patterns in coding and architecture
Experience working in Agile environment
Benefits
Medical, dental and vision coverage
401k plan with employer contribution
Paid holidays
Vacation
Tuition reimbursement