User Tools

Site Tools


cluster:187

Warning: Undefined array key -1 in /usr/share/dokuwiki/inc/html.php on line 1458

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
cluster:187 [2019/12/12 10:18]
hmeij07
cluster:187 [2020/08/17 08:01] (current)
hmeij07
Line 1: Line 1:
 \\ \\
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
 +
 +Slurm links:
 +
 +  * https://slurm.schedmd.com/SLUG19/NVIDIA_Containers.pdf
 +  * https://devblogs.nvidia.com/how-to-run-ngc-deep-learning-containers-with-singularity/
 +  * https://devblogs.nvidia.com/automating-downloads-ngc-container-replicator/
 +  * https://devblogs.nvidia.com/docker-compatibility-singularity-hpc/
 +
 +Other useful links.
 +
 +  * https://www.nvidia.com/en-us/gpu-cloud/containers/
 +  * https://docs.nvidia.com/ngc/ngc-user-guide/index.html
 +    *  scheduler wrapper, inside container: NV_GPU=2,3 nvidia-docker run ...
 +    *  (container sees host gpu 2,3 as container gpu 0,1)
 +  * https://ngc.nvidia.com/catalog/containers/
 +  * https://blog.exxactcorp.com/installing-using-docker-nv-docker-centos-7/
 +  * https://github.com/nvidia/nvidia-container-runtime#nvidia_visible_devices 
 +    *   nvidia? or cuda_visible...
  
  
 ==== NGC Docker Containers ==== ==== NGC Docker Containers ====
  
-Trying to understand how to leverage GPU ready applications on the Nvidia NGC web site (Nvidia GPU Cloud). Download docker containers and build your own on premise catalog. Run GPU ready software on compute nodes with docker containers. Can't wrap myself around the problem of how to integrate containers with the Openlava scheduler yet.+Trying to understand how to leverage GPU ready applications on the Nvidia NGC web site (Nvidia GPU Cloud). Download docker containers and build your own on premise catalog. Run GPU ready software on compute nodes with docker containers. Can't wrap myself around the problem of how to integrate containers with the our scheduler yet.
  
   * https://blog.exxactcorp.com/installing-using-docker-nv-docker-centos-7/   * https://blog.exxactcorp.com/installing-using-docker-nv-docker-centos-7/
Line 22: Line 40:
 adduser dockeruser adduser dockeruser
 usermod -aG docker dockeruser usermod -aG docker dockeruser
-# Install NV-DOCKER + 
-GET NVIDIA-DOCKER +get nvidia-docker 
-wget -P /tmp https://github.com/NVIDIA/nvidia-docker/releases/download/v1.0.1/nvidia-docker-1.0.1-1.x86_64.rpm +wget -P /tmp https://github.com/NVIDIA/nvidia-docker/releases/download/v1.0.1/nvidia-docker-1.0.1-1.x86_64.rpm 
-# INSTALL +wget https://github.com/NVIDIA/nvidia-docker/archive/v2.2.2.tar.gz 
-sudo rpm -i /tmp/nvidia-docker*.rpm + 
-Start NV-DOCKER Service+rpm -i /tmp/nvidia-docker*.rpm 
 +make nvidia-docker 
 + 
 +# systemctl 
 +systemctl enable nvidia-docker
 systemctl start nvidia-docker systemctl start nvidia-docker
  
Line 105: Line 127:
 # mount host directory to container location # mount host directory to container location
  
--v /home/hmeij:/tmp/hmeij+-v $HOME:/tmp/$USER
  
 # pull images # pull images
Line 126: Line 148:
 # custom build images ... # custom build images ...
 # looks complex based on Dockerfile config file commands # looks complex based on Dockerfile config file commands
-# see link+# see link 
  
 </code> </code>
cluster/187.1576163932.txt.gz · Last modified: 2019/12/12 10:18 by hmeij07