User Tools

Site Tools


cluster:73

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
cluster:73 [2021/11/04 18:17]
hmeij07 [EasyBuild]
cluster:73 [2021/11/24 19:05]
hmeij07 [EasyBuild]
Line 18: Line 18:
 on either cottontail2 or node n33 located at /share/apps/CENTOS6 \\ on either cottontail2 or node n33 located at /share/apps/CENTOS6 \\
 Some compilations require 7.x and are in /share/apps/CENTOS7 \\ Some compilations require 7.x and are in /share/apps/CENTOS7 \\
 +
 +
 +====== Magenta ======
 +
 +An open source research project exploring the role of machine learning as a tool in the creative process.  Magenta is distributed as an open source Python library, powered by TensorFlow. This library includes utilities for manipulating source data (primarily music and images), using this data to train machine learning models, and finally generating new content from these models.
 +
 +  * https://magenta.tensorflow.org/
 +  * installed in miniconda3's python3
 +  * queues: mwgpu, amber128, exx96
 +  * (MUSC/hgonzalez)
  
 ====== EasyBuild ====== ====== EasyBuild ======
Line 33: Line 43:
     * https://dokuwiki.wesleyan.edu/doku.php?id=cluster:209#astropy     * https://dokuwiki.wesleyan.edu/doku.php?id=cluster:209#astropy
     * contains package mpi4py, multithreading     * contains package mpi4py, multithreading
-    * import erfa (needs to be loaded too)+    * import erfa (needs to be loaded too), added later (pycuda, h5py for helios)
     * to find ''libcuda.so.1'' set export path below     * to find ''libcuda.so.1'' set export path below
   * emcee/2.2.1-foss-2019a   * emcee/2.2.1-foss-2019a
     * https://dokuwiki.wesleyan.edu/doku.php?id=cluster:209#emcee     * https://dokuwiki.wesleyan.edu/doku.php?id=cluster:209#emcee
     * contains package mpi4py, multithreading     * contains package mpi4py, multithreading
 +  * PyCUDA/2020.1-fosscuda-2020b
 +    * 
  
 To use module, discover the modules and load desired module. On ''greentail52'' (debugging) or in submit scripts on queue: exx96 (mwgpu and amber128 nodes do not work) To use module, discover the modules and load desired module. On ''greentail52'' (debugging) or in submit scripts on queue: exx96 (mwgpu and amber128 nodes do not work)
Line 44: Line 56:
  
 # cuda libs location # cuda libs location
-export LD_LIBRARY_PATH=/sanscratch/CENTOS7/easybuild/4.4.2/software/CUDAcore/11.1.1/stubs/lib64:$LD_LIBRARY_PATH+export LD_LIBRARY_PATH=
 +/sanscratch/CENTOS7/easybuild/4.4.2/software/CUDAcore/11.1.1/lib64:
 +/sanscratch/CENTOS7/easybuild/4.4.2/software/CUDAcore/11.1.1/lib:
 +/sanscratch/CENTOS7/easybuild/4.4.2/software/CUDAcore/11.1.1/targets/x86_64-linux/lib/stubs:
 +$LD_LIBRARY_PATH 
  
 # discover all modules # discover all modules
Line 119: Line 136:
  
 </code>  </code> 
 +
 +  * and
 +
 +<code>
 +
 +conda install -c conda-forge gsd
 +
 +
 +The following NEW packages will be INSTALLED:
 +
 +  _openmp_mutex      conda-forge/linux-64::_openmp_mutex-4.5-1_gnu
 +  gsd                conda-forge/linux-64::gsd-2.5.1-py38h6c62de6_0
 +  libgomp            conda-forge/linux-64::libgomp-11.2.0-h1d223b6_11
 +
 +The following packages will be UPDATED:
 +
 +  certifi                          2021.10.8-py38h578d9bd_0 --> 2021.10.8-py38h578d9bd_1
 +  conda                               4.10.3-py38h578d9bd_2 --> 4.10.3-py38h578d9bd_4
 +  libgcc-ng           pkgs/main::libgcc-ng-9.1.0-hdf63c60_0 --> conda-forge::libgcc-ng-11.2.0-h1d223b6_11
 +  openssl                                 1.1.1h-h516909a_0 --> 1.1.1l-h7f98852_0
 +
 +</code>
 +
 +
  
 ====== Miniconda2 ====== ====== Miniconda2 ======
Line 531: Line 572:
     zstd-1.4.5                       h9ceee32_0         619 KB     zstd-1.4.5                       h9ceee32_0         619 KB
  
 +
 +</code>
 +
 +Then
 + --- //[[hmeij@wesleyan.edu|Henk]] 2021/11/24 13:16//
 +
 +<code>
 +
 +# using pip3
 +Successfully installed magenta-2.1.3 python-rtmidi-1.1.2
 +
 +Successfully installed keras-2.7.0 libclang-12.0.0 tensorboard-2.7.0 \
 +tensorflow-2.7.0 tensorflow-estimator-2.7.0 tensorflow-io-gcs-filesystem-0.22.0
  
 </code> </code>
cluster/73.txt · Last modified: 2024/05/15 12:58 by hmeij07