跳转到文档内容
版本：v2.4.1

HAMi-core design

Introduction​

HAMi-core is a hook library for CUDA environment, it is the in-container gpu resource controller, it has been adopted by HAMi, volcano

HAMi-core architecture diagram showing GPU resource controller design

Features​

HAMi-core has the following features:

  1. Virtualize device memory

nvidia-smi output showing virtualized GPU memory with HAMi-core

  1. Limit device utilization by self-implemented time shard

  2. Real-time device utilization monitor

Design​

HAMi-core operates by Hijacking the API-call between CUDA-Runtime(libcudart.so) and CUDA-Driver(libcuda.so), as the figure below:

HAMi-core position diagram showing API call interception between CUDA Runtime and Driver

CNCFHAMi 是 CNCF Sandbox 项目