User Tools

Site Tools


cluster:73

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
cluster:73 [2022/03/02 10:00]
hmeij07 [Magenta]
cluster:73 [2024/05/15 08:58]
hmeij07 [Miniconda3-py311]
Line 3: Line 3:
  
 ====== Software ====== ====== Software ======
 +
 +[[cluster:215|OpenHPC Software]] for **Rocky 8**
 +
 +Below is all centos 6 and/or 7, which may or may not run in 8.
 +
  
 IMPORTANT NOTE: **Since moving to the TrueNAS/ZFS appliance all references to** ''/home/apps'' **should be replaced with** ''/share/apps'' **which points to** ''/zfshomes/apps'' IMPORTANT NOTE: **Since moving to the TrueNAS/ZFS appliance all references to** ''/home/apps'' **should be replaced with** ''/share/apps'' **which points to** ''/zfshomes/apps''
Line 18: Line 23:
 on either cottontail2 or node n33 located at /share/apps/CENTOS6 \\ on either cottontail2 or node n33 located at /share/apps/CENTOS6 \\
 Some compilations require 7.x and are in /share/apps/CENTOS7 \\ Some compilations require 7.x and are in /share/apps/CENTOS7 \\
 +
 +
 +
 +====== Miniconda3-py311 ======
 +
 +  * Starting a new branch, the other Miniconda3 section listed on this is quite loaded
 +  * Python 3.11
 +
 +<code>
 +
 +source /share/apps/CENTOS7/miniconda3-py311/etc/profile.d/conda.sh
 +or
 +export PATH=/share/apps/CENTOS7/miniconda3-py311/bin:$PATH
 +export LD_LIBRARY_PATH=/share/apps/CENTOS7/miniconda3-py311/lib:$LD_LIBRARY_PATH
 +which mpirun python conda
 +conda list
 +
 +export CUDA_HOME=/usr/local/cuda
 +export PATH=/usr/local/cuda/bin:$PATH
 +export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH
 +export LD_LIBRARY_PATH=/usr/local/cuda/lib:$LD_LIBRARY_PATH
 +
 +
 +</code>
 +
 +  * conda install (same as what is listed on openhpc [[https://dokuwiki.wesleyan.edu/doku.php?id=cluster:215#miniconda3-py311|miniconda3-py311]]) page
 +  * cudatoolkit=10.2 cudnn=7 for exx96 queue
 +  * same error, module cudatoolkit not found, but I found Cupy and it does load
 +  * https://docs.cupy.dev/en/stable/overview.html
 +  * thayerlab
 +
 +<code>
 +
 +# pollacklab
 +
 +[hmeij@greentail52 ~]$ source /share/apps/CENTOS7/miniconda3-py311/etc/profile.d/conda.sh
 +
 +[hmeij@greentail52 ~]$ conda activate sage
 +
 +(sage) [hmeij@greentail52 ~]$ sage --version
 +SageMath version 10.0, Release Date: 2023-05-20
 +
 +(sage) [hmeij@greentail52 ~]$ sage
 +┌────────────────────────────────────────────────────────────────────┐
 +│ SageMath version 10.0, Release Date: 2023-05-20                    │
 +│ Using Python 3.11.4. Type "help()" for help.                       │
 +└────────────────────────────────────────────────────────────────────┘
 +
 +sage: exit
 +(sage) [hmeij@greentail52 ~]$ conda deactivate
 +[hmeij@greentail52 ~]$ 
 +
 +</code>
 +
 +  * **mdtraj, matplotlib, pandas**
 +
 +<code>
 +
 +[hmeij@greentail52 ~]$ which python                                                                                      
 +/share/apps/CENTOS7/miniconda3-py311/bin/python
 +                                                                          
 +[hmeij@greentail52 ~]$ python
 +Python 3.11.4 (main, Jul  5 2023, 13:45:01) [GCC 11.2.0] on linux
 +Type "help", "copyright", "credits" or "license" for more information.
 +>>> import mdtraj as mt
 +>>> 
 +
 +</code>
 +
 +  * ** seaborn**
 +  * https://seaborn.pydata.org/index.html
 +  * also in miniconda3/py311 on rock8 module (used pip3)
 +
 +<code>
 +
 +  patsy              conda-forge/noarch::patsy-0.5.4-pyhd8ed1ab_0
 +  seaborn            conda-forge/noarch::seaborn-0.13.0-hd8ed1ab_0
 +  seaborn-base       conda-forge/noarch::seaborn-base-0.13.0-pyhd8ed1ab_0
 +  statsmodels        conda-forge/linux-64::statsmodels-0.14.0-py311h1f0f07a_3
 +
 +</code>
 +
 +  * joblib (thayerlab)
 +
 +<code>
 +
 +  joblib             conda-forge/noarch::joblib-1.4.2-pyhd8ed1ab_0 
 +
 +</code>
 +
 +
 +
 +====== Masurca ======
 +
 +
 +  * module: masurca/4.1.0
 +  * https://github.com/alekseyzimin/masurca/releases
 +  * supports openmp (maybe)
 +  * queues mwgpu, exx96 (centos 7)
 +
 +
 +<code>
 +
 +export PATH=/share/apps/CENTOS7/masurca/4.1.0/bin:$PATH
 +export LD_LIBRARY_PATH=/share/apps/CENTOS7/masurca/4.1.0/lib:$LD_LIBRARY_PATH
 +
 +
 +[hmeij@cottontail2 ~]$ masurca --version
 +version 4.1.0
 +
 +
 +</code>
 +
 +====== Trimmomatic ======
 +
 +  * http://www.usadellab.org/cms/?page=trimmomatic
 +  * binary download and stage
 +  * java -jar trimmomatic-0.39.jar ...
 +
 +<code>
 +
 +/share/apps/CENTOS6/Trimmomatic-0.39/
 +[root@cottontail Trimmomatic-0.39]# ll
 +total 176
 +drwxr-xr-x 2 root root      8 Apr  8  2019 adapters
 +-rw-r--r-- 1 root root  35147 May 16  2018 LICENSE
 +-rw-r--r-- 1 root root 128502 Apr  8  2019 trimmomatic-0.39.jar
 +
 +</code>
  
  
Line 218: Line 352:
 Suite of tools for high-accuracy basecaling, assembly, polishing, and alignment. Installed in a specific miniconda3 environment (see below). Suite of tools for high-accuracy basecaling, assembly, polishing, and alignment. Installed in a specific miniconda3 environment (see below).
  
-  * Requires centos7 so queues mwgpu, amber128, exx96+  * Requires centos7 so queues mwgpu, <del>amber128</del>, exx96
     * debug server greentail52     * debug server greentail52
   * PREFIX=/share/apps/CENTOS7/miniconda3   * PREFIX=/share/apps/CENTOS7/miniconda3
Line 228: Line 362:
 <code> <code>
  
-# environment+# environment for all modules
 source /share/apps/CENTOS7/miniconda3/etc/profile.d/conda.sh source /share/apps/CENTOS7/miniconda3/etc/profile.d/conda.sh
 export PATH=/share/apps/CENTOS7/miniconda3/bin:$PATH export PATH=/share/apps/CENTOS7/miniconda3/bin:$PATH
Line 239: Line 373:
 which conda python pip mpirun gcc cmake which conda python pip mpirun gcc cmake
 python --version python --version
 +
 +/share/apps/CENTOS7/miniconda3/bin/conda
 +/share/apps/CENTOS7/miniconda3/bin/python
 +/share/apps/CENTOS7/miniconda3/bin/pip
 +/share/apps/CENTOS7/miniconda3/bin/mpirun
 +/share/apps/CENTOS7/gcc/9.2.0/bin/gcc
 +/share/apps/CENTOS7/cmake/3.12.1/bin/cmake
 +
  
 </code> </code>
Line 314: Line 456:
 ** Flye ** ** Flye **
  
-  * https://github.com/fenderglass/Flye  +Somewhat annoying, no miniconda3 package, (python 3.9, gcc 9.2). Local building (without installation) on centos7 greentail52
-  * miniconda3  + 
-  * De novo assembler for single molecule sequencing reads using repeat graphs  +  * setup env as for all packages in #3, see top of section 
-  * v2.8.3+  * v2.9.2 (June 2023) 
 +  * python bin/flye 
 +    * change the PATHS accordingly
  
 <code> <code>
  
-# To activate this environment, use +/share/apps/CENTOS7/flye/2.9.2/bin/flye --version 
-#     $ conda activate flye +2.9.2-b1794
-# To deactivate an active environment, use +
-#     $ conda deactivate+
  
 </code> </code>
 +
 +  * v2.9.1 (October 2022)
 +  * python bin/flye
 +    * change the PATHs accordingly
 +
 +<code>
 +
 +/share/apps/CENTOS7/flye/2.9.1/bin/flye --version
 +2.9.1-b1780
 +
 +</code>
 +
 +  * v2.9 (August 2021)
 +  * python bin/flye
 +
 +<code>
 +
 +export PATH=/share/apps/CENTOS7/flye/2.9/bin:$PATH
 +export LD_LIBRARY_PATH=/share/apps/CENTOS7/flye/2.9/lib:$LD_LIBRARY_PATH
 +which flye
 +/share/apps/CENTOS7/flye/2.9/bin/flye
 +flye --version
 +2.9-b1774
 +
 +</code>
 +
 +
  
 ** Filtlong ** ** Filtlong **
Line 358: Line 527:
 </code> </code>
  
 +** BBmap **
 +
 +  * location: /share/apps/CENTOS7/bbmap/39.01
 +  * java programs
 +  * https://sourceforge.net/projects/bbmap/
 +
 +** Pilon **
 +
 +  * location: /share/apps/CENTOS7/pilon/
 +  * just one big jar file
 +  * latest java is in $PATH
 +
 +<code>
 +
 +[hmeij@greentail52 pilon]$ java -jar pilon-1.24.jar --help
 +Pilon version 1.24 Thu Jan 28 13:00:45 2021 -0500
 +
 +    Usage: pilon --genome genome.fasta [--frags frags.bam] [--jumps jumps.bam] [--unpaired unpaired.bam]
 +                 [...other options...]
 +           pilon --help for option details 
 +<snip>
 +
 +</code>
 +
 +** haslr **
 +
 +  * miniconda3 env
 +  * https://github.com/vpc-ccg/haslr
 +  * conda install -c bioconda haslr
 +
 +<code>
 +
 +The following NEW packages will be INSTALLED:
 +
 +  _openmp_mutex      conda-forge/linux-64::_openmp_mutex-4.5-2_gnu
 +  fastutils          bioconda/linux-64::fastutils-0.3-hdcf5f25_4
 +  haslr              bioconda/linux-64::haslr-0.8a1-py39hd65a603_4
 +  k8                 bioconda/linux-64::k8-0.2.5-hdcf5f25_4
 +  libgomp            conda-forge/linux-64::libgomp-13.2.0-h807b86a_2
 +  libzlib            conda-forge/linux-64::libzlib-1.2.13-hd590300_5
 +  minia              bioconda/linux-64::minia-3.2.6-hdcf5f25_3
 +  minimap2           bioconda/linux-64::minimap2-2.26-he4a0461_1
 +  pluggy             conda-forge/noarch::pluggy-1.3.0-pyhd8ed1ab_0
 +  ruamel.yaml        conda-forge/linux-64::ruamel.yaml-0.17.32-py39hd1e30aa_0
 +  ruamel.yaml.clib   conda-forge/linux-64::ruamel.yaml.clib-0.2.7-py39h72bdee0_1
 +  toolz              conda-forge/noarch::toolz-0.12.0-pyhd8ed1ab_0
 +
 +</code>
 +
 +Compiled from source, do **not** source miniconda3, we are using standalone pyhton3
 +
 +<code>
 +
 +export PATH=/share/apps/CENTOS7/gcc/9.2.0/bin:$PATH
 +export LD_LIBRARY_PATH=/share/apps/CENTOS7/gcc/9.2.0/lib64:$LD_LIBRARY_PATH
 +export LD_LIBRARY_PATH=/share/apps/CENTOS7/gcc/9.2.0/lib:$LD_LIBRARY_PATH
 +export PATH=/share/apps/CENTOS7/python/3.8.3/bin:$PATH
 +export LD_LIBRARY_PATH=/share/apps/CENTOS7/python/3.8.3/lib:$LD_LIBRARY_PATH
 +[hmeij@greentail52 20231006]$ which python
 +/share/apps/CENTOS7/python/3.8.3/bin/python
 +
 +[hmeij@greentail52 20231006]$ pwd
 +/share/apps/CENTOS7/haslr/20231006
 +
 +[hmeij@greentail52 20231006]$ ll bin
 +total 11448
 +-rwxr-xr-x 1 hmeij its   123448 Oct  6 15:01 fastutils
 +-rwxr-xr-x 1 hmeij its  3823032 Oct  6 15:04 haslr_assemble
 +-rwxr-xr-x 1 hmeij its    19949 Oct  6 14:48 haslr.py
 +-rwxr-xr-x 1 hmeij its 20969840 Oct  6 14:59 minia
 +-rwxr-xr-x 1 hmeij its    23856 Oct  6 15:01 minia_nooverlap
 +-rwxr-xr-x 1 hmeij its   951922 Oct  6 14:59 minimap2
 +
 +</code>
 +
 +
 +** stLFR **
 +
 +  * same centos 7 environment
 +  * https://github.com/BGI-Qingdao/stLFR_GapCloser
 +
 +<code>
 +
 +cd /share/apps/CENTOS7/stLFR/20230929
 +
 +[hmeij@greentail52 20230929]$ ./Release/stLFR_GapCloser -h
 +Version:
 + 1.00
 +
 +Contact:
 + dengli1@genomics.cn && guolidong@genomics.cn
 +
 +Usage:
 + stLFR_GapCloser [options]
 +...
 +
 +
 +# and another request by Luis
 +# https://sourceforge.net/projects/soapdenovo2/files/SOAPdenovo2
 +
 +[hmeij@greentail52 stLFR]$ pwd 
 +/share/apps/CENTOS7/stLFR
 +[hmeij@greentail52 stLFR]$ ll GapCloser-bin-v1.12-r6/
 +total 175
 +-rwxr-xr-x 1 hmeij its 184713 Jan 11  2013 GapCloser
 +-rw-r--r-- 1 hmeij its  44533 Jan 11  2013 GapCloser_Manual.pdf
 +
 +</code>
 +
 +** BUSCO **
 +
 +  * https://busco.ezlab.org/busco_userguide.html#docker-image
 +  * conda package fails on glib 2.17, weird
 +
 +<code>
 +
 +[hmeij@n79 ~]$ docker images
 +REPOSITORY                         TAG                            IMAGE ID            CREATED             SIZE
 +ezlabgva/busco                     v5.5.0_cv1                     30d3e831aba7        2 months ago        2.88GB
 +
 +
 +[hmeij@n79 busco_wd]$ docker run --rm -v $(pwd):/busco_wd -u $(id -u):$(id -g) ezlabgva/busco:v5.5.0_cv1 busco -i /busco_wd/assembly.fasta -l actinopterygii_odb10 -o Busco_Output -m geno -f
 +2023-10-28 20:30:00 INFO:       ***** Start a BUSCO v5.5.0 analysis, current time: 10/28/2023 20:30:00 *****
 +2023-10-28 20:30:00 INFO:       Configuring BUSCO with local environment
 +2023-10-28 20:30:00 INFO:       Mode is genome
 +2023-10-28 20:30:00 INFO:       'Force' option selected; overwriting previous results directory
 +2023-10-28 20:30:00 INFO:       Downloading information on latest versions of BUSCO data...
 +
 +that's a problem, trying to reach the internet ...
 +
 +</code>
 +
 +** picard **
 +
 +  * https://github.com/broadinstitute/picard
 +  * Warning: using Java 20 but only Java 17 has been tested.
 +
 +<code>
 +
 +picard centos7, weird
 +> Failed to load native library 'libnative-platform.so' for Linux amd64.
 +
 +picard centos8
 +
 +[hmeij@cottontail2 20231108]$ pwd
 +/share/apps/CENTOS8/picard/20231108
 +
 +[hmeij@cottontail2 20231108]$ ls -l build/libs/
 +total 119872
 +-rw-r--r-- 1 hmeij its 62520451 Nov  8 11:46 picard-3.1.0-3-ga9194bd97-SNAPSHOT-all.jar
 +-rw-r--r-- 1 hmeij its  1856980 Nov  8 11:01 picard-3.1.0-3-ga9194bd97-SNAPSHOT.jar
 +-rw-r--r-- 1 hmeij its 62520451 Nov  8 11:46 picard.jar
 +[hmeij@cottontail2 20231108]$ 
 +
 +
 +</code>
 ====== Galario CPU+GPU ====== ====== Galario CPU+GPU ======
  
Line 638: Line 963:
 Using htslib 1.9 Using htslib 1.9
 Copyright (C) 2018 Genome Research Ltd. Copyright (C) 2018 Genome Research Ltd.
 +
 +</code>
 +
 +  * **iqtree** fcohanlab/jwang06
 +
 +<code>
 +
 +[hmeij@greentail52 ~]$ iqtree --version
 +IQ-TREE multicore version 2.0.3 for Linux 64-bit built Dec 20 2020
 +
 +
 +</code>
 +
 +  * https://userguide.mdanalysis.org/stable/installation.html
 +  * calterlab, annika (used pip to install)
 +
 +<code>
 +
 +Successfully installed 
 +GridDataFormats-1.0.1 MDAnalysis-2.3.0 
 +fasteners-0.18 mmtf-python-1.1.3 
 +mrcfile-1.4.3 msgpack-1.0.4 numpy-1.23.4
 +
 +</code>
 +
 +For **Lammps** (starrlab) 23April2023, consult install file
 +
 +  *  /share/apps/CENTOS7/lammps/25Apr2023.install
 +  * make yes-ml-pace
 +  * make yes-gpu
 +  * https://pacemaker.readthedocs.io/en/latest/pacemaker/install/
 +
 +<code>
 +
 +# Note: you must add this line to you env
 +export LD_LIBRARY_PATH=/share/apps/CENTOS7/amber/miniconda3/pkgs/cudatoolkit-11.0.221-h6bb024c_0/lib:$LD_LIBRARY_PATH
 +
 +# Note2: had to install 'conda install cudnn' and make two links 
 +to higher level libraries (a must not do) 
 +for libcudnn.so.8 and libcusolver.so.11
 +
 +[hmeij@greentail52 ~]$ which python
 +/share/apps/CENTOS7/amber/miniconda3/bin/python
 +[hmeij@greentail52 ~]$ pip list | grep tensorflow
 +mesh-tensorflow              0.1.19
 +tensorflow                   2.8.0
 +tensorflow-addons            0.15.0
 +tensorflow-datasets          4.4.0
 +tensorflow-estimator         2.7.0
 +tensorflow-gan               2.1.0
 +tensorflow-hub               0.12.0
 +tensorflow-io-gcs-filesystem 0.32.0
 +tensorflow-metadata          1.4.0
 +tensorflow-probability       0.15.0
 +[hmeij@greentail52 ~]$ which pacemaker
 +/usr/bin/which: no pacemaker in (...failed to install at first, see readme install file)
  
 </code> </code>
Line 652: Line 1033:
   * git clone https://github.com/Amber-MD/pytraj; cd pytra   * git clone https://github.com/Amber-MD/pytraj; cd pytra
   * python ./setup.py install   * python ./setup.py install
-  * requires CentOS7 so queues mwgpu, amber128 and exx96+  * requires CentOS7 so queues mwgpu, <del>amber128</del> and exx96
   * or for debugging use greentail52   * or for debugging use greentail52
   * /share/apps/CENTOS7/amber/pytraj   * /share/apps/CENTOS7/amber/pytraj
Line 692: Line 1073:
 ====== OpenHPC ====== ====== OpenHPC ======
  
-So I remember where I put the repos ''/share/apps/src/greentail52/openhpc''+So I remember where I put the tar repo file
  
-  * whitetail tar ball for centos7/warewulf (no slurm) +  * OpenHPC v2.4 
-  * http://repos.openhpc.community/OpenHPC/2.0RC1/CentOS_8/x86_64+  * Rocky 8.5 
-  * http://repos.openhpc.community/ohpc-1.3/1.3.9/base/CentOS_7/x86_64/ +  * Slurm 20.11.8 
-  * https://github.com/warewulf/warewulf3 (master git zip file)+  * Warewulf 3.9 
 +  * x86_64 
 + 
 +<code> 
 + 
 +[root@cottontail2 ~]# ll /share/apps/src/cottontail2/openhpc/ 
 +total 8290421 
 +-rw------- 1 root root     562276 Mar 17 09:34 Install_guide-Rocky8-Warewulf-SLURM-2.4-x86_64.pdf 
 +-rw-r--r-- 1 root root      10720 Mar 17 09:35 ohpc-release-2-1.el8.x86_64.rpm 
 +-rw-r--r-- 1 root root 8531681280 Mar 17 09:33 OpenHPC-2.4.EL_8.x86_64.tar 
 + 
 + 
 + 
 +# this is all that is needed for ohpc base compute client 
 +# see the recipe for cct2 and follow compute node only ingredients 
 + 
 +[root@cottontail2 ~]# ll /share/apps/src/cottontail2/ohpc-compute
 +total 95196 
 +-rw-r--r-- 1 root root  2696360 Feb 10 09:21 hwloc-ohpc-2.7.0-3.9.ohpc.2.6.x86_64.rpm 
 +-rw-r--r-- 1 root root   266252 Feb 10 09:22 lmod-ohpc-8.7.6-12.3.ohpc.2.6.x86_64.rpm 
 +-rw-r--r-- root root     7268 Feb 10 09:22 ohpc-base-compute-2.6.1-5.1.ohpc.2.6.1.x86_64.rpm 
 +-rw-r--r-- 1 root root     8204 Feb 10 09:23 ohpc-filesystem-2.6-2.3.ohpc.2.6.noarch.rpm 
 +-rw-r--r-- 1 root root    10720 Feb 10 09:23 ohpc-release-2-1.el8.x86_64.rpm 
 +-rw-r--r-- 1 root root     7124 Feb 10 09:27 ohpc-slurm-client-2.6.1-5.1.ohpc.2.6.1.x86_64.rpm 
 +-rw-r--r-- 1 root root 74326532 Feb 10 09:23 singularity-ohpc-3.7.1-5.1.ohpc.2.1.x86_64.rpm 
 +-rw-r--r-- 1 root root    22168 Feb 10 09:24 slurm-contribs-ohpc-22.05.2-14.1.ohpc.2.6.x86_64.rpm 
 +-rw-r--r-- 1 root root   247392 Feb 10 09:24 slurm-example-configs-ohpc-22.05.2-14.1.ohpc.2.6.x86_64.rpm 
 +-rw-r--r-- 1 root root 18764472 Feb 10 09:24 slurm-ohpc-22.05.2-14.1.ohpc.2.6.x86_64.rpm 
 +-rw-r--r-- 1 root root   176480 Feb 10 09:28 slurm-pam_slurm-ohpc-22.05.2-14.1.ohpc.2.6.x86_64.rpm 
 +-rw-r--r-- 1 root root   785112 Feb 10 09:25 slurm-slurmd-ohpc-22.05.2-14.1.ohpc.2.6.x86_64.rpm 
 + 
 +</code>
  
 ====== OneAPI ====== ====== OneAPI ======
Line 907: Line 1319:
  
 </code> </code>
 +
 +  * **mapDamage2**
 +  * https://github.com/ginolhac/mapDamage/issues/25
 +  * docker container is broke
 +  * requires centos6 so queues hp12, mw128  .. may run elsewhere?
 +  * conda install -c 'bioconda' mapdamage2
 +
 +
 +<code>
 +
 +# env
 +export PATH="/share/apps/CENTOS6/miniconda2/bin:$PATH"
 +export LD_LIBRARY_PATH="/share/apps/CENTOS6/miniconda2/lib:$LD_LIBRARY_PATH"
 +
 +The following NEW packages will be INSTALLED:
 +
 +  mapdamage2         bioconda/linux-64::mapdamage2-2.0.6-1
 +  pysam              bioconda/linux-64::pysam-0.16.0.1-py27hc729bab_3
 +  seqtk              bioconda/linux-64::seqtk-1.3-h5bf99c6_3
 +
 +[hmeij@petaltail ~]$ mapDamage --version
 +2.0.6
 +
 +</code>
 +
 +  * **PCAngsd**, requires miniconda3's python
 +  * https://github.com/Rosemeis/pcangsd
 +  * apparently the repo is needed ''/share/apps/CENTOS7/pcangsd/1.1.0''
 +
 +<code>
 +
 +source /share/apps/CENTOS7/amber/miniconda3/etc/profile.d/conda.sh
 +export PATH=/share/apps/CENTOS7/amber/miniconda3/bin:$PATH
 +export LD_LIBRARY_PATH=/share/apps/CENTOS7/amber/miniconda3/lib:$LD_LIBRARY_PATH
 +
 +which pcangsd
 +/share/apps/CENTOS7/amber/miniconda3/bin/pcangsd
 +pcangsd --version
 +pcangsd 1.10
 +
 +</code>
 +
 +  * **angsd**, requires miniconda3, same environment as pcangsd
 +  * http://www.popgen.dk/angsd/index.php/RealSFS
 +  * add location of angsd to PATH env 
 +
 +<code>
 +
 +$ pwd
 +/share/apps/CENTOS7/angsd/0.940/angsd
 +
 +$ ls -l angsd
 +-rwxr-xr-x 1 hmeij its 5517248 Jul  6 14:11 angsd
 +
 +$ ./angsd 
 + -> angsd version: 0.940-dirty (htslib: 1.16) build(Jul  6 2023 14:11:30)
 +
 +</code>
 +
 +  * **Standard RAxML version**
 +  * https://github.com/stamatak/standard-RAxML
 +
 +<code>
 +
 +# add path to $PATH
 +
 +[hmeij@greentail52 tmp]$ ll /share/apps/CENTOS7/raxml/8.2.12/
 +total 3202
 +-rwxr-xr-x 1 hmeij its 1177632 Apr 25 14:49 raxmlHPC-AVX
 +-rwxr-xr-x 1 hmeij its 1177632 Apr 25 14:49 raxmlHPC-AVX2
 +-rwxr-xr-x 1 hmeij its 1152040 Apr 25 14:49 raxmlHPC_serial
 +-rwxr-xr-x 1 hmeij its 1185704 Apr 25 14:49 raxmlHPC-SSE3
 +
 +</code>
 +
 +
 +  * **qualimap **
 +  * http://qualimap.conesalab.org/
 +  * java & R app, probably will work in centos7 and rocky8
 +  * /share/apps/CENTOS7/qualimap/2.3
 +
 +  * **gatk**
 +  * https://github.com/broadinstitute/gatk
 +  * java & R app. probably will work in centos7 and rocky8
 +  *  /share/apps/CENTOS7/gatk/4.4.0.0
 +
 +For both apps above java is v20, developers want and tested v17
 +
 +For both apps you may find R local in operating system or a recent versions at
 +
 +  * (rocky 8) module load R/4.1.2
 +
 +
  
  
Line 1024: Line 1529:
 # drop all the packages in from previous versions # drop all the packages in from previous versions
 https://dokuwiki.wesleyan.edu/doku.php?id=cluster:73#python3 https://dokuwiki.wesleyan.edu/doku.php?id=cluster:73#python3
 +
 +
 +export PATH=/share/apps/CENTOS7/python/3.8.3/bin:$PATH
 +export LD_LIBRARY_PATH=/share/apps/CENTOS7/python/3.8.3/lib:$LD_LIBRARY_PATH
 +which pip3 python3
 +
 +/share/apps/CENTOS7/python/3.8.3/bin/pip3
 +/share/apps/CENTOS7/python/3.8.3/bin/python3
  
 </code> </code>
Line 1267: Line 1780:
 cufflinks                 2.2.1                    py27_2    bioconda cufflinks                 2.2.1                    py27_2    bioconda
 samtools                  1.13                 h8c37831_0     samtools                  1.13                 h8c37831_0    
 +
 +# fcohan lab
 +[hmeij@petaltail ~]$ iqtree --version
 +IQ-TREE multicore version 2.1.4-beta COVID-edition for Linux 64-bit built Jun 24 2021
  
 </code> </code>
 +
 +
  
 **Trinity** assembles transcript sequences from Illumina RNA-Seq data. **Trinity** assembles transcript sequences from Illumina RNA-Seq data.
Line 1904: Line 2423:
  
 [[https://dokuwiki.wesleyan.edu/doku.php?id=cluster:119|GPU version]] [[https://dokuwiki.wesleyan.edu/doku.php?id=cluster:119|GPU version]]
 +
 +  * program v13,2.1 installed
 +
 +  * program v13.2 installed
  
   * program: mcc, math, mathematica (v 12.2)   * program: mcc, math, mathematica (v 12.2)
Line 2101: Line 2624:
  
 ====== LAMMPS CPU/GPU ====== ====== LAMMPS CPU/GPU ======
 +
 +** 7Feb2024 **
 +
 +
 +  * /share/apps/CENTOS7/lammps/7Feb2024 (feature version vs latest stable)
 +  * lmp_serial and lmp_mpi
 +  * 3 cuda versions with 3 different precision settings 
 +  * compiled against cuda 10.2 on exx96, may work in mwgpu cuda-11.2
 +  * notes: /share/apps/CENTOS7/lammps/7Feb2024.install (setup env, look for export statements)
 +  * does **not** support openmp, look for the OpenHPC version for that
 +
 +** 25Apr2023**
 +
 +  * /share/apps/CENTOS7/lammps/25Arp2023
 +  * lmp_serial and lmp_mpi
 +  * 3 cuda versions with 3 different precision settings
 +  * notes: /share/apps/CENTOS7/lammps/25Apr2023.install
 +  * does **not** support openmp, look for the OpenHPC version for that
 +  * 05/24/2023 remade with package CREATION added
 +  * also read miniconda3 section for tensorflow/pacemaker info
 +
 +<code>
 +
 +# CPU
 +
 + export PATH=/share/apps/CENTOS7/gcc/6.5.0/bin/:$PATH
 + export LD_LIBRARY_PATH=/share/apps/CENTOS7/gcc/6.5.0/lib64:$LD_LIBRARY_PATH
 + export PATH=/share/apps/CENTOS7/python/3.8.3/bin:$PATH
 + export LD_LIBRARY_PATH=/share/apps/CENTOS7/python/3.8.3/lib:$LD_LIBRARY_PATH
 + export PATH=/share/apps/CENTOS7/openmpi/4.0.4/bin:$PATH
 + export LD_LIBRARY_PATH=/share/apps/CENTOS7/openmpi/4.0.4/lib:$LD_LIBRARY_PATH
 + which mpirun mpicc python gcc
 +
 +
 +# CPU + GPU (exx96 queue, may run on test and amber128 queues)
 +
 + export CUDA_HOME=/usr/local/cuda
 + export PATH=/usr/local/cuda/bin:$PATH
 + export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH
 + export LD_LIBRARY_PATH=/usr/local/cuda/lib:$LD_LIBRARY_PATH
 + which nvcc
 +
 +# related for starrlab
 +# https://pacemaker.readthedocs.io/en/latest/pacemaker/install/
 +
 +[hmeij@cottontail2 ~]$ module load miniconda3/py39
 +[hmeij@cottontail2 ~]$ which pacemaker
 +/share/apps/CENTOS8/ohpc/software/miniconda3/py39/bin/pacemaker
 +[hmeij@cottontail2 ~]$ pacemaker --version
 +pacemaker/pyace version: 0.2.7+77.g8b40c11
 +ace_evaluator   version: 2022.6.27
 +
 +[hmeij@cottontail2 ~]$ python
 +Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:11) 
 +[GCC 9.4.0] on linux
 +Type "help", "copyright", "credits" or "license" for more information.
 +>>> import pyace as py
 +>>> 
 +
 +
 +</code>
  
 ** USER_QUIP ** ** USER_QUIP **
Line 3158: Line 3742:
  
 ====== Amber ======  ====== Amber ====== 
 +
 +** Amber 22 **
 +
 +Details on how to run on CentOS7 can be found at
 +
 +  * https://dokuwiki.wesleyan.edu/doku.php?id=cluster:214#amber22
  
 ** Amber 20 ** ** Amber 20 **
Line 3585: Line 4175:
  
 <code> <code>
 +
 +# update
 +[hmeij@greentail52 ~]$ java --version
 +java 20.0.2 2023-07-18
 +
 +
 export JAVAHOME=/home/apps/j2sdk1.4.2_17/bin:$PATH export JAVAHOME=/home/apps/j2sdk1.4.2_17/bin:$PATH
 export CLASSPATH=$JAVAHOME/lib:$CLASSPATH export CLASSPATH=$JAVAHOME/lib:$CLASSPATH
Line 3939: Line 4535:
 ====== Matlab ====== ====== Matlab ======
  
 +  * installed R2023a
  
 +  * installed R2022a
 +
 +  * installed R2021a
  
   * program: Matlab, link to binary is 'matlab' in ''/share/apps/bin''   * program: Matlab, link to binary is 'matlab' in ''/share/apps/bin''
Line 3959: Line 4559:
  
 ====== Stata ====== ====== Stata ======
 +
 +  * program stata[-mp|-se] in your $PATH, version 18
 +  * v17 will still run so add '17' to the command like 'stata-mp17'
 +  * so that makes for 12 licenses 8-)
  
   * program: Stata v 17, 6-user network license, includes stata, stata-mp, stata-se    * program: Stata v 17, 6-user network license, includes stata, stata-mp, stata-se 
cluster/73.txt · Last modified: 2024/05/15 08:58 by hmeij07