CoreTek Labs · 5 hours ago
Solution Architect
Albany, NY
Contract
Onsite
Senior Level, Lead/Staff
10+ years expCoreTek Labs is seeking a Solution Architect to develop end-to-end solutions for hybrid cloud environments. The role involves designing and implementing job scheduling strategies, optimizing container performance, and leading the architecture of an enterprise-grade observability stack.
Computer Software
Hiring Manager
Azam Mohammad
Responsibilities
Architecture & Design: Develop end-to-end solutions for hybrid cloud environments, integrating Mirantis Container Cloud with dedicated HPC clusters to balance performance and elasticity
HPC Orchestration: Design and implement job scheduling strategies using tools like Slurm, Volcano, or LAVA to manage high-throughput batch jobs and ensure deterministic resource allocation for AI/ML and scientific simulations
Optimization & Performance Tuning: Implement best practices for container performance, including multi-stage builds, minimal base images (e.g., Alpine), and resource limits (CPU/Memory/GPU) to minimize overhead and prevent noisy neighbor issues
Centralized Observability: Lead the architecture of an enterprise-grade ELK Stack (Elasticsearch, Logstash, Kibana) for real-time monitoring of HPC jobs, utilizing Index Lifecycle Management (ILM) to handle massive log volumes efficiently
Full-Stack Automation: Build robust Infrastructure-as-Code (IaC) pipelines using Terraform and Ansible to automate the deployment of Mirantis Kubernetes Engine (MKE) and integrated HPC schedulers
CI/CD Automation: Implement and manage continuous integration and delivery pipelines using Jenkins, GitLab CI, or Argo Workflows to ensure reliable, automated build and deployment processes
Hybrid Integration: Design bridges between Kubernetes and traditional schedulers, allowing specialized workloads to utilize high-speed interconnects like InfiniBand while maintaining container-native management
Qualification
Required
Develop end-to-end solutions for hybrid cloud environments, integrating Mirantis Container Cloud with dedicated HPC clusters to balance performance and elasticity
Design and implement job scheduling strategies using tools like Slurm, Volcano, or LAVA to manage high-throughput batch jobs and ensure deterministic resource allocation for AI/ML and scientific simulations
Implement best practices for container performance, including multi-stage builds, minimal base images (e.g., Alpine), and resource limits (CPU/Memory/GPU) to minimize overhead and prevent noisy neighbor issues
Lead the architecture of an enterprise-grade ELK Stack (Elasticsearch, Logstash, Kibana) for real-time monitoring of HPC jobs, utilizing Index Lifecycle Management (ILM) to handle massive log volumes efficiently
Build robust Infrastructure-as-Code (IaC) pipelines using Terraform and Ansible to automate the deployment of Mirantis Kubernetes Engine (MKE) and integrated HPC schedulers
Implement and manage continuous integration and delivery pipelines using Jenkins, GitLab CI, or Argo Workflows to ensure reliable, automated build and deployment processes
Design bridges between Kubernetes and traditional schedulers, allowing specialized workloads to utilize high-speed interconnects like InfiniBand while maintaining container-native management
Deep expertise in Docker Runtime, Mirantis Kubernetes Engine (MKE), and Lens Desktop for cluster management
Proven experience with Slurm, PBS, or Kubernetes-native batch schedulers (e.g., Volcano) for managing priority queues and gang scheduling
Advanced knowledge of Logstash pipeline optimization, shard allocation strategies in Elasticsearch, and creating actionable performance dashboards in Kibana
Experience with hardware-software integration tools such as NVIDIA Enroot/Pyxis for running containers on HPC clusters with bare-metal-level performance
Implementation of secure container registries, RBAC, and encrypted communications (TLS) across the entire stack
10+ years in systems architecture, with 5+ years specifically in HPC, Cloud Infrastructure, or DevOps at scale
Familiarity with MPI (Message Passing Interface) and low-latency networking requirements
Preferred
Preferred certifications include Certified Kubernetes Administrator (CKA) or Mirantis-specific technical certifications
AWS experience preferred, especially for HPC or containerized workloads on EKS, Batch, FSx for Lustre, and EC2 GPU instances
Company
CoreTek Labs
CoreTek Labs that specializes in Project Management, Product Engineering, Technology Consulting & Staff Augmentation.
51-200 employees
H1B Sponsorship
CoreTek Labs has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (19)
2024 (26)
2023 (16)
Funding
Current Stage
Growth StageLeadership Team
Pradeep Kanneganti
CEO and Founder
Company data provided by crunchbase