HAMi-core design

Introduction

HAMi-core is a hook library for CUDA environment, it is the in-container gpu resource controller, it has been adopted by HAMi, volcano

Features

HAMi-core has the following features:

1. Virtualize device memory

   

2. Limit device utilization by self-implemented time shard

3. Real-time device utilization monitor

Design

HAMi-core operates by Hijacking the API-call between CUDA-Runtime(libcudart.so) and CUDA-Driver(libcuda.so), as the figure below: