Quick Start and Basic Operation
DGX A100 System
DU-09821-001_v06
| 26
4.7
Running the NGC Containers with
GPU Support
To obtain the best performance when running NGC containers on DGX A100 systems, two
methods of providing GPU support for Docker containers have been developed:
Native GPU support (included in Docker 19.03 and later)
NVIDIA Container Runtime for Docker (nvidia-docker2 package)
The method implemented in your system depends on the DGX OS version installed.
DGX OS Releases
Method included
5.0
Native GPU support
NVIDIA Container Runtime for Docker (deprecated -
availability to be removed in a future DGX OS release)
Each method is invoked by using specific Docker commands, described as follows.
4.7.1
Using Native GPU Support
Use
docker run --gpus
to run GPU-enabled containers.
Example using all GPUs
$ sudo docker run --gpus all ...
Example using two GPUs
$ sudo docker run --gpus 2 ...
Examples using specific GPUs
$ sudo docker run --gpus '"device=1,2"' ...
$ sudo docker run --gpus '"device=UUID-ABCDEF,1"' ...
