DevOps Engineer

Salary Range (USD)

Negotiable

Location

Hong Kong

Visa Support

Not mentioned

Funding Stage

Unknown

Job Responsibilities

  • • Provision, monitor, and scale high-performance GPU clusters (NVIDIA H100/A100, CUDA/ROCm) for heavy model training and inference workloads
  • • Support model deployment, fine-tuning, and low-latency inference optimization using open LLM ecosystems (e.g., vLLM, Triton Inference Server, Llama, Mistral)
  • • Design, build, and maintain robust CI/CD pipelines for both software services and ML model artifacts using GitHub Actions, GitLab CI, or ArgoCD
  • • Manage cloud resources (AWS, GCP, or Azure) repeatably using tools like Terraform or Pulumi
  • • Deploy, scale, and manage distributed containerized workloads using Kubernetes, Docker, and KubeFlow or Ray
  • • Implement logging, tracing, and metric dashboards (Prometheus, Grafana, OpenTelemetry) to track cluster health, GPU memory/utilization, and inference latency
  • • Enforce DevSecOps practices, secret management (HashiCorp Vault), container image scanning, and access controls tailored for sensitive AI datasets and models

Required Skills

3+ years of experience in DevOps, SRE, or Cloud/Platform EngineeringStrong hands‑on experience with AWS, GCP, or AzureProduction Kubernetes and Docker managementProficiency in Python, Bash/Shell, or Go for automationMastery of Terraform, GitOps workflows, and automated testing/deployment pipelinesFamiliarity with GPU node provisioning, distributed storage for massive datasets, and model serving runtimes

Engineering Culture & Tech Stack

AWSGCPAzureKubernetesDockerPulumiGitHub ActionsGitLab CIArgoCDPrometheusGrafanaOpenTelemetryHashiCorp VaultvLLMTriton Inference ServerLlamaMistralRayKubeFlowPythonGoBash
ownership
automation
collaboration with ML researchers and data scientists

Raw Post

Show original text
DevOps Engineer Hybrid, 3 days a week in the office Hong Kong Full-time We are looking for a DevOps Engineer to own, scale, and secure our cloud and on-premise computing environments. You will work closely with ML researchers, data scientists, and software engineers to streamline model training, optimize GPU cluster utilization, and automate our continuous integration and deployment (CI/CD) pipelines. Core Responsibilities AI & GPU Infrastructure Management: Provision, monitor, and scale high-performance GPU clusters (NVIDIA H100/A100, CUDA/ROCm setups) for heavy model training and inference workloads. MLOps & Model Serving Pipelines: Support model deployment, fine-tuning, and low-latency inference optimization using open LLM ecosystems (e.g., vLLM, Triton Inference Server, Llama, Mistral). CI/CD & Automation: Design, build, and maintain robust CI/CD pipelines for both software services and ML model artifacts using GitHub Actions, GitLab CI, or ArgoCD. Infrastructure as Code (IaC): Manage cloud resources (AWS, GCP, or Azure) repeatably using tools like Terraform or Pulumi. Containerization & Orchestration: Deploy, scale, and manage distributed containerized workloads using Kubernetes (K8s), Docker, and KubeFlow or Ray. Observability & Reliability: Implement logging, tracing, and metric dashboards (Prometheus, Grafana, OpenTelemetry) to track cluster health, GPU memory/utilization, and inference latency. Security & Governance: Enforce DevSecOps practices, secret management (HashiCorp Vault), container image scanning, and access controls tailored for sensitive AI datasets and models. Required Qualifications Experience: 3+ years of experience in DevOps, Site Reliability Engineering (SRE), or Cloud/Platform Engineering, with exposure to MLOps or AI/ML workloads. Cloud & Containers: Strong hands-on experience with AWS, GCP, or Azure, alongside production Kubernetes and Docker management. Scripting & Programming: Proficiency in Python, Bash/Shell, or Go for automation and tooling. IaC & CI/CD: Demonstrated mastery of Terraform, GitOps workflows, and automated testing/deployment pipelines. AI Ecosystem Knowledge: Familiarity with GPU node provisioning, distributed storage for massive datasets, and model serving runtimes. Preferred Qualifications Experience with LLM orchestration frameworks (LangChain, Ray Serve, vLLM). Bachelor's or Master’s degree in Computer Science, Computer Engineering, or a related technical field. Active cloud or Kubernetes certifications (e.g., CKA, AWS/GCP DevOps Engineer). Apply: https://round1.work/listings/listing_tenant_a741427d-313d-41...

AI Risk Insights

No major risk signals detected.

Recent News

No recent updates

Data Source

Content parsed by LLM from Hacker News raw data. Confidence:HIGH

© 2026 Job Signal

Built with ❤️ by Anna4code