User Tools

Site Tools


cluster:73

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
cluster:73 [2021/11/04 12:07]
hmeij07 [EasyBuild]
cluster:73 [2021/12/06 15:51]
hmeij07 [Hoomd]
Line 18: Line 18:
 on either cottontail2 or node n33 located at /share/apps/CENTOS6 \\ on either cottontail2 or node n33 located at /share/apps/CENTOS6 \\
 Some compilations require 7.x and are in /share/apps/CENTOS7 \\ Some compilations require 7.x and are in /share/apps/CENTOS7 \\
 +
 +
 +====== Magenta ======
 +
 +An open source research project exploring the role of machine learning as a tool in the creative process.  Magenta is distributed as an open source Python library, powered by TensorFlow. This library includes utilities for manipulating source data (primarily music and images), using this data to train machine learning models, and finally generating new content from these models.
 +
 +  * https://magenta.tensorflow.org/
 +  * installed in miniconda3's python3
 +  * queues: mwgpu, amber128, exx96
 +  * (MUSC/hgonzalez)
  
 ====== EasyBuild ====== ====== EasyBuild ======
Line 32: Line 42:
   * astropy/4.2.1-fosscuda-2020b   * astropy/4.2.1-fosscuda-2020b
     * https://dokuwiki.wesleyan.edu/doku.php?id=cluster:209#astropy     * https://dokuwiki.wesleyan.edu/doku.php?id=cluster:209#astropy
 +    * contains package mpi4py, multithreading
 +    * import erfa (needs to be loaded too), added later (pycuda, h5py for helios)
 +    * to find ''libcuda.so.1'' set export path below
   * emcee/2.2.1-foss-2019a   * emcee/2.2.1-foss-2019a
     * https://dokuwiki.wesleyan.edu/doku.php?id=cluster:209#emcee     * https://dokuwiki.wesleyan.edu/doku.php?id=cluster:209#emcee
 +    * contains package mpi4py, multithreading
 +  * PyCUDA/2020.1-fosscuda-2020b
 +    * 
  
 To use module, discover the modules and load desired module. On ''greentail52'' (debugging) or in submit scripts on queue: exx96 (mwgpu and amber128 nodes do not work) To use module, discover the modules and load desired module. On ''greentail52'' (debugging) or in submit scripts on queue: exx96 (mwgpu and amber128 nodes do not work)
  
 <code> <code>
 +
 +# cuda libs location
 +export LD_LIBRARY_PATH=\
 +/sanscratch/CENTOS7/easybuild/4.4.2/software/CUDAcore/11.1.1/lib64:\
 +/sanscratch/CENTOS7/easybuild/4.4.2/software/CUDAcore/11.1.1/lib:\
 +/sanscratch/CENTOS7/easybuild/4.4.2/software/CUDAcore/11.1.1/targets/x86_64-linux/lib/stubs:\
 +$LD_LIBRARY_PATH
 +
  
 # discover all modules # discover all modules
Line 54: Line 78:
 # note that these modules use different python versions # note that these modules use different python versions
 which python which python
 +python
 +>>>help('modules')
  
-# unload all modules+# unload all modules (better to exit shell and start new one, 
 +# purge will also unload system modules...
 module purge module purge
  
Line 93: Line 120:
 cudatoolkit               11.0.221             h6bb024c_0   cudatoolkit               11.0.221             h6bb024c_0  
 hoomd                     2.9.4           gpu_py38h02d30ca_1    conda-forge hoomd                     2.9.4           gpu_py38h02d30ca_1    conda-forge
 +
 +
 +# ahh, hamed found an error
 +conda install -c conda-forge cudatoolkit=10.2
 +
 +The following packages will be DOWNGRADED:
 +
 +  cudatoolkit                           11.0.221-h6bb024c_0 --> 10.2.89-hfd86e86_1
 +  hoomd                            2.9.4-gpu_py38h02d30ca_1 --> 2.9.4-gpu_py38h5bdc439_1
 +
  
 </code> </code>
Line 109: Line 146:
  
 </code>  </code> 
 +
 +  * and
 +
 +<code>
 +
 +conda install -c conda-forge gsd
 +
 +
 +The following NEW packages will be INSTALLED:
 +
 +  _openmp_mutex      conda-forge/linux-64::_openmp_mutex-4.5-1_gnu
 +  gsd                conda-forge/linux-64::gsd-2.5.1-py38h6c62de6_0
 +  libgomp            conda-forge/linux-64::libgomp-11.2.0-h1d223b6_11
 +
 +The following packages will be UPDATED:
 +
 +  certifi                          2021.10.8-py38h578d9bd_0 --> 2021.10.8-py38h578d9bd_1
 +  conda                               4.10.3-py38h578d9bd_2 --> 4.10.3-py38h578d9bd_4
 +  libgcc-ng           pkgs/main::libgcc-ng-9.1.0-hdf63c60_0 --> conda-forge::libgcc-ng-11.2.0-h1d223b6_11
 +  openssl                                 1.1.1h-h516909a_0 --> 1.1.1l-h7f98852_0
 +
 +</code>
 +
 +
  
 ====== Miniconda2 ====== ====== Miniconda2 ======
Line 521: Line 582:
     zstd-1.4.5                       h9ceee32_0         619 KB     zstd-1.4.5                       h9ceee32_0         619 KB
  
 +
 +</code>
 +
 +Then
 + --- //[[hmeij@wesleyan.edu|Henk]] 2021/11/24 13:16//
 +
 +<code>
 +
 +# using pip3
 +Successfully installed magenta-2.1.3 python-rtmidi-1.1.2
 +
 +Successfully installed keras-2.7.0 libclang-12.0.0 tensorboard-2.7.0 \
 +tensorflow-2.7.0 tensorflow-estimator-2.7.0 tensorflow-io-gcs-filesystem-0.22.0
  
 </code> </code>
cluster/73.txt · Last modified: 2024/05/15 12:58 by hmeij07