User Tools

Site Tools


cluster:73

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
cluster:73 [2020/06/18 15:34]
hmeij07 [Miniconda2]
cluster:73 [2020/07/15 18:48]
hmeij07 [LAMMPS CPU/GPU]
Line 15: Line 15:
 Some compilations require 7.x and are in /share/apps/CENTOS7 \\ Some compilations require 7.x and are in /share/apps/CENTOS7 \\
  
-====== Miniconda2 ======+====== Sequencing Tools #2 ====== 
 + 
 +  * macs python package (macs2 see below) 
 +  * http://bowtie-bio.sourceforge.net/bowtie2/index.shtml 
 +  * https://deweylab.github.io/RSEM/ 
 +  * https://broadinstitute.github.io/picard/ 
 +  * https://bedtools.readthedocs.io/en/latest/content/installation.html 
 +  * padillalab 
  
 <code> <code>
Line 21: Line 28:
 export PATH="/share/apps/CENTOS6/miniconda2/bin:$PATH" export PATH="/share/apps/CENTOS6/miniconda2/bin:$PATH"
 export LD_LIBRARY_PATH="/share/apps/CENTOS6/miniconda2/lib:$LD_LIBRARY_PATH" export LD_LIBRARY_PATH="/share/apps/CENTOS6/miniconda2/lib:$LD_LIBRARY_PATH"
-export PATH="/share/apps/CENTOS6/python/3.5.2/samtools-1.9/bin:$PATH" +Successfully installed macs-1.4.3  # notemacs2 Python version must >3.6!
-export PATH="/share/apps/CENTOS6/miniconda2/bowtie2-2.3.5-linux-x86_64:$PATH" +
-export PATH="/share/apps/CENTOS6/miniconda2/jellyfish-2.2.10:$PATH" +
-export PATH="/share/apps/CENTOS6/miniconda2/salmon-0.13.1_linux_x86_64/bin:$PATH" +
-export LD_LIBRARY_PATH="/share/apps/CENTOS6/miniconda2/salmon-0.13.1_linux_x86_64/lib:$LD_LIBRARY_PATH"+
  
-Successfully installed  +# or change python version to 
-MarkupSafe-1.1. +# ls /share/apps/CENTOS6/python/2.7.9/bin/macs2 
-Werkzeug-1.0. +/share/apps/CENTOS6/python/2.7.9/bin/macs2 
-bowtie-0.8. + 
-click-7.1.2  +# or change python version to 
-dnspython-1.16. +which python: /share/apps/CENTOS7/python/3.8.3/bin/python 
-eventlet-0.25.2  +pip list: Package         Version 
-flask-1.1. +--------------- ------- 
-flask-socketio-4.3. +bowtie          0.11.
-future-0.18.2  +MACS2           2.2.7.1 
-greenlet-0.4.16  +numpy           1.18.5 
-itsdangerous-1.1. +picard          2.3.2 
-jinja2-2.11. +scipy           1.4.
-markdown-3.1. + 
-monotonic-1. + 
-msgpack-python-0.5. +export PATH="/share/apps/CENTOS6/sequencingtools/bowtie2-2.4.1-linux-x86_64:$PATH" 
-python-engineio-3.13.0  + 
-python-socketio-4.6.0+export PATH=/share/apps/CENTOS6/gcc/4.8.4/bin:$PATH 
 +export LD_LIBRARY_PATH=/share/apps/CENTOS6/gcc/4.8.4/lib64:/share/apps/CENTOS6/gcc/4.8.4/lib:$LD_LIBRARY_PATH 
 + 
 +which gcc: /share/apps/CENTOS6/gcc/4.8.4/bin/gcc 
 +which python: /share/apps/CENTOS6/miniconda2/bin/python 
 +which perl: /share/apps/CENTOS6/miniconda2/bin/perl 
 + 
 +export PATH=/share/apps/CENTOS6/R/3.6.1b/bin:$PATH 
 +export LD_LIBRARY_PATH=/share/apps/CENTOS6/R/3.6.1b/lib64:$LD_LIBRARY_PATH 
 +export PATH=/home/apps/CENTOS6/R/packages/bin:$PATH 
 +export LD_LIBRARY_PATH=/home/apps/CENTOS6/R/packages/lib:$LD_LIBRARY_PATH 
 +which R: /share/apps/CENTOS6/R/3.6.1b/bin/R 
 +ldd /home/apps/CENTOS6/R/3.6.1b/lib64/R/bin/exec/
 + 
 +java --version: java 12.0.2 2019-07-16 # /share/apps/java/latest -> jdk-12.0.2 
 +java -jar /share/apps/CENTOS6/sequencingtools/picard-2.23.0/picard.jar -h 
 +USAGE: PicardCommandLine <program name> [-h] 
 + 
 +export PATH=/share/apps/CENTOS6/sequencingtools/bedtools-2.29.2/bin:$PATH 
 +bedtools --version: bedtools v2.29.2
  
 </code> </code>
Line 56: Line 78:
     * portainer     * portainer
   * consult [[cluster:193|Docker Containers Usage]]   * consult [[cluster:193|Docker Containers Usage]]
 +  * QAC
  
 ====== Paleogenomics Tools ====== ====== Paleogenomics Tools ======
Line 65: Line 88:
   * BCFtools:Reading/writing BCF2/VCF/gVCF files and calling/filtering/summarising SNP and short indel sequence variants   * BCFtools:Reading/writing BCF2/VCF/gVCF files and calling/filtering/summarising SNP and short indel sequence variants
   * HTSlib: A C library for reading/writing high-throughput sequencing data    * HTSlib: A C library for reading/writing high-throughput sequencing data 
 +  * Archeology (kbrunson)
  
 <code> <code>
Line 112: Line 136:
   * https://openstructure.org/   * https://openstructure.org/
   * recipe at /share/apps/CENTOS6/openstructure/1.9-install.txt   * recipe at /share/apps/CENTOS6/openstructure/1.9-install.txt
 +  * Starrlab
  
 OpenStructure relies on these applications and Python 2.7.15 (see python2 section). OpenStructure relies on these applications and Python 2.7.15 (see python2 section).
Line 166: Line 191:
   * add the bin/ directory to your PATH (see examples on this page)   * add the bin/ directory to your PATH (see examples on this page)
   * http://abacus.gene.ucl.ac.uk/software/paml.html   * http://abacus.gene.ucl.ac.uk/software/paml.html
 +  * fcolanlab (wmei, ndelgaudio)
  
 ====== Spyder ====== ====== Spyder ======
Line 175: Line 201:
 ====== Python3 ====== ====== Python3 ======
  
-Added to both versions\\+  * Python 3.8.3 
 +  * /share/apps/CENTOS7/python/3.8.3  (so queues mwgpu, exx96) 
 +  * most packages found on this page 
 +  * picked up mpirun from miniconda2 apps (that may be a problem) 
 + 
 +<code> 
 + 
 +# needed for _ctypes to compile properly for https retrievals 
 + yum install openssl openssl-devel 
 + yum install yum install libffi-devel libffi 
 + 
 +  tar -xvf ../Python-3.8.3.tgz 
 +  cd Python-3.8.3/ 
 +  ./configure --prefix=/share/apps/CENTOS7/python/3.8.3 --enable-optimizations 
 +  make 
 +  make install 
 +  pip3 install --upgrade pip 
 +# make symbolic links python3->pyhton, pip3->pip 
 +# drop all the packages in from previous versions 
 +https://dokuwiki.wesleyan.edu/doku.php?id=cluster:73#python3 
 + 
 +</code> 
 + 
 + 
 +Added to both 3.5.2 versions\\
 pycuda\\ pycuda\\
  --- //[[hmeij@wesleyan.edu|Henk]] 2020/02/18 08:45//  --- //[[hmeij@wesleyan.edu|Henk]] 2020/02/18 08:45//
Line 376: Line 426:
   * location: /share/apps/FastQC/0.11.8   * location: /share/apps/FastQC/0.11.8
   * https://www.bioinformatics.babraham.ac.uk/projects/fastqc/   * https://www.bioinformatics.babraham.ac.uk/projects/fastqc/
 +  * biolab (jcoolon, tearley)
  
  
Line 496: Line 547:
  
  
-====== Sequencing Tools ======+====== Sequencing Tools #1 ======
  
 All of these are located in /share/apps/CENTOS6/python/3.5.2/ All of these are located in /share/apps/CENTOS6/python/3.5.2/
Line 505: Line 556:
   * deepbinner --help   * deepbinner --help
   * https://github.com/rrwick/Deepbinner   * https://github.com/rrwick/Deepbinner
 +  * fcohanlab (ndelgaudio)
  
 **Canu**: a single molecule sequence assembler for genomes large and small.  **Canu**: a single molecule sequence assembler for genomes large and small. 
Line 613: Line 665:
   * gpu version local to n78   * gpu version local to n78
   * sample programs /home/hmeij/freesurfer   * sample programs /home/hmeij/freesurfer
 +  * mindlab (ploui et al)
  
 ====== FSL ======  ====== FSL ====== 
Line 622: Line 675:
   * gpu version local on n78   * gpu version local on n78
   * sample programs /home/hmeij/fsl   * sample programs /home/hmeij/fsl
 +  * mindlab (ploui et al)
  
 ====== Campari ======  ====== Campari ====== 
Line 691: Line 745:
  
   * www: https://github.com/hpparvi/PyTransit   * www: https://github.com/hpparvi/PyTransit
 +  * astrolab
  
  
Line 795: Line 850:
   * program: see below, binary download, no requirement checks.   * program: see below, binary download, no requirement checks.
   * www: http://www.atnf.csiro.au/computing/software/miriad/INSTALL.html   * www: http://www.atnf.csiro.au/computing/software/miriad/INSTALL.html
 +  * astrolab (kflaherty)
  
 <code> <code>
Line 841: Line 897:
   * program: see below   * program: see below
   * www: http://dan.iel.fm/emcee   * www: http://dan.iel.fm/emcee
 +  * astrolab (kflaherty)
  
 <code> <code>
Line 886: Line 943:
  
 ====== Gromacs ===== ====== Gromacs =====
 +
 +Gromacs-2018 for GPU (RTX2080)
 +  * ''exx96'' queue
 +  * **/zfshomes/hmeij/k20redo/run.rtx sample script**
  
  
Line 993: Line 1054:
 [[https://dokuwiki.wesleyan.edu/doku.php?id=cluster:119|GPU version]] [[https://dokuwiki.wesleyan.edu/doku.php?id=cluster:119|GPU version]]
  
-  * program: mcc, math, mathematica (v 11.0.1) +  * program: mcc, math, mathematica (v 12.1) 
-  * install dir: /share/apps/CENTOS6/mathematica/11.0.1+  * install dir: /share/apps/CENTOS6/mathematica/12.1
   * docs: on the web   * docs: on the web
   * www:  http://www.wolfram.com/mathematica/   * www:  http://www.wolfram.com/mathematica/
 +  * Campus wide license, use any queue.
  
   * Parallel kernels   * Parallel kernels
Line 1003: Line 1065:
     * http://reference.wolfram.com/mathematica/guide/ParallelComputing.html     * http://reference.wolfram.com/mathematica/guide/ParallelComputing.html
  
-Job submissions should go to queue //mathematica// which containes licensed nodes (all the hp12 nodes for now).+
  
 ====== Eigen ===== ====== Eigen =====
Line 1187: Line 1249:
  
 ====== LAMMPS CPU/GPU ====== ====== LAMMPS CPU/GPU ======
 +
 +** CPU ONLY v2 CentOS7 **
 +
 +  * /share/apps/CENTOS7/lammps/3Mar2020
 +    * lmp_serial, lmp_mpi
 +  * latest openmpi version
 +  * consult this file for packages installed and compilations
 +    * /share/apps/CENTOS7/lammps/03Mar2020.install
 +    * should work only on exx96 and mwgpu queues
 +
 +<code>
 + export PATH=/share/apps/CENTOS7/openmpi/4.0.4/bin:$PATH
 + export LD_LIBRARY_PATH=/share/apps/CENTOS7/openmpi/4.0.4/lib:$LD_LIBRARY_PATH
 +</code>
  
 ** CPU ONLY ** ** CPU ONLY **
Line 1205: Line 1281:
     * /share/apps/CENTOS7/lammps/03Mar2020.install     * /share/apps/CENTOS7/lammps/03Mar2020.install
     * CUDA_ARCH = sm_75 (probably only works on queue exx96)     * CUDA_ARCH = sm_75 (probably only works on queue exx96)
-  * sample script in ~hmeij/k20redo/run.rtx.lammps+  * **sample script in ~hmeij/k20redo/run.rtx.lammps**
  
 <code> <code>
cluster/73.txt · Last modified: 2024/05/15 12:58 by hmeij07