This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
cluster:73 [2021/09/28 18:27] hmeij07 [Paleogenomics Tools] |
cluster:73 [2021/11/24 19:05] hmeij07 [EasyBuild] |
||
---|---|---|---|
Line 19: | Line 19: | ||
Some compilations require 7.x and are in / | Some compilations require 7.x and are in / | ||
- | ====== Miniconda2 ===== | + | |
+ | ====== Magenta ====== | ||
+ | |||
+ | An open source research project exploring the role of machine learning as a tool in the creative process. | ||
+ | |||
+ | * https:// | ||
+ | * installed in miniconda3' | ||
+ | * queues: mwgpu, amber128, exx96 | ||
+ | * (MUSC/ | ||
+ | |||
+ | ====== EasyBuild ====== | ||
+ | |||
+ | EasyBuild is a software build and installation framework that allows you to manage (scientific) software on High Performance Computing (HPC) systems in an efficient way. | ||
+ | |||
+ | * supports 2469 different software packages (incl. toolchains, bundles) | ||
+ | * local page with lots of details | ||
+ | |||
+ | Easybuild uses '' | ||
+ | |||
+ | **Installed modules** and their dependencies | ||
+ | |||
+ | * astropy/ | ||
+ | * https:// | ||
+ | * contains package mpi4py, multithreading | ||
+ | * import erfa (needs to be loaded too), added later (pycuda, h5py for helios) | ||
+ | * to find '' | ||
+ | * emcee/ | ||
+ | * https:// | ||
+ | * contains package mpi4py, multithreading | ||
+ | * PyCUDA/ | ||
+ | * | ||
+ | |||
+ | To use module, discover the modules and load desired module. On '' | ||
+ | |||
+ | < | ||
+ | |||
+ | # cuda libs location | ||
+ | export LD_LIBRARY_PATH=\ | ||
+ | / | ||
+ | / | ||
+ | / | ||
+ | $LD_LIBRARY_PATH | ||
+ | |||
+ | |||
+ | # discover all modules | ||
+ | module use / | ||
+ | |||
+ | # view availability | ||
+ | module avail | ||
+ | |||
+ | # load | ||
+ | module load module_name | ||
+ | |||
+ | # list modules loaded | ||
+ | module list | ||
+ | |||
+ | # check, start app, import package (by full module name) | ||
+ | # note that these modules use different python versions | ||
+ | which python | ||
+ | python | ||
+ | >>> | ||
+ | |||
+ | # unload all modules (better to exit shell and start new one, | ||
+ | # purge will also unload system modules... | ||
+ | module purge | ||
+ | |||
+ | </ | ||
+ | |||
+ | ====== Hoomd ====== | ||
+ | |||
+ | HOOMD-blue is a Python package that runs simulations of particle systems on CPUs and GPUs. | ||
+ | |||
+ | * https:// | ||
+ | * requires both minconda3 (centos7) **and** cuda-10.2 (so queue exx96 only) | ||
+ | * python3.x included | ||
+ | * starrlab | ||
+ | |||
+ | Set up env for miniconda and cuda | ||
+ | |||
+ | < | ||
+ | |||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | |||
+ | | ||
+ | | ||
+ | | ||
+ | |||
+ | which mpirun python conda | ||
+ | which nvcc | ||
+ | |||
+ | # installation (not sure how this works, does the * not get expanded in shell?) | ||
+ | # seems to have worked forcing gpu package install on greentail52 | ||
+ | conda install -c conda-forge hoomd=*=*gpu* | ||
+ | |||
+ | |||
+ | $ conda list | egrep -i " | ||
+ | cudatoolkit | ||
+ | hoomd | ||
+ | |||
+ | </ | ||
+ | |||
+ | * installed/ | ||
+ | |||
+ | < | ||
+ | |||
+ | ca-certificates-2021.10.8 | ||
+ | certifi-2021.10.8 | ||
+ | conda-4.10.3 | ||
+ | cudatoolkit-11.0.221 | ||
+ | hoomd-2.9.4 | ||
+ | openssl-1.1.1h | ||
+ | tbb-2020.2 | ||
+ | |||
+ | </ | ||
+ | |||
+ | * and | ||
+ | |||
+ | < | ||
+ | |||
+ | conda install -c conda-forge gsd | ||
+ | |||
+ | |||
+ | The following NEW packages will be INSTALLED: | ||
+ | |||
+ | _openmp_mutex | ||
+ | gsd conda-forge/ | ||
+ | libgomp | ||
+ | |||
+ | The following packages will be UPDATED: | ||
+ | |||
+ | certifi | ||
+ | conda | ||
+ | libgcc-ng | ||
+ | openssl | ||
+ | |||
+ | </ | ||
+ | |||
+ | |||
+ | |||
+ | ====== Miniconda2 | ||
* miniconda2 (python 2.7) is hiding in section | * miniconda2 (python 2.7) is hiding in section | ||
Line 341: | Line 483: | ||
numpy | numpy | ||
time 1.8 h516909a_0 | time 1.8 h516909a_0 | ||
+ | astropy | ||
+ | attrs conda-forge/ | ||
+ | click conda-forge/ | ||
+ | coverage | ||
+ | hypothesis | ||
+ | iniconfig | ||
+ | more-itertools | ||
+ | packaging | ||
+ | pluggy | ||
+ | psutil | ||
+ | py | ||
+ | pyparsing | ||
+ | pytest | ||
+ | pytest-arraydiff | ||
+ | pytest-astropy | ||
+ | pytest-astropy-he~ conda-forge/ | ||
+ | pytest-cov | ||
+ | pytest-doctestplus conda-forge/ | ||
+ | pytest-filter-sub~ conda-forge/ | ||
+ | pytest-mock | ||
+ | pytest-openfiles | ||
+ | pytest-remotedata | ||
+ | sortedcontainers | ||
+ | toml | ||
+ | |||
</ | </ | ||
Line 405: | Line 572: | ||
zstd-1.4.5 | zstd-1.4.5 | ||
+ | |||
+ | </ | ||
+ | |||
+ | Then | ||
+ | --- // | ||
+ | |||
+ | < | ||
+ | |||
+ | # using pip3 | ||
+ | Successfully installed magenta-2.1.3 python-rtmidi-1.1.2 | ||
+ | |||
+ | Successfully installed keras-2.7.0 libclang-12.0.0 tensorboard-2.7.0 \ | ||
+ | tensorflow-2.7.0 tensorflow-estimator-2.7.0 tensorflow-io-gcs-filesystem-0.22.0 | ||
</ | </ | ||
Line 471: | Line 651: | ||
* Production version is installed in / | * Production version is installed in / | ||
- | * source / | + | * source / |
< | < | ||
Line 493: | Line 673: | ||
</ | </ | ||
- | * Test version is installed on local disk on host **greentail52** | + | * __Test__ |
* source / | * source / | ||
* Read [[cluster: | * Read [[cluster: |