User Tools

Site Tools


cluster:126

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision Both sides next revision
cluster:126 [2017/06/01 19:34]
hmeij07 [Description]
cluster:126 [2017/06/01 19:46]
hmeij07 [Our Queues]
Line 51: Line 51:
 ===== Our Queues ===== ===== Our Queues =====
  
-Commercial software has their own queue limited by available licenses (no need to check out licenses). Jobs are processed on the  nodes of hp12, mw256, and mw256fd queues. That can change if we need to.+Commercial software has their own queue limited by available licenses. There are no scheduler license resources, just queue jobs up in appropriate queue. Jobs are processed on the  nodes of hp12, mw256, and mw256fd queues. That can change if we need to.
  
 ^Queue^Nr Of Nodes^Total GB Mem Per Node^Total Cores In Queue^Switch^Hosts^Notes^ ^Queue^Nr Of Nodes^Total GB Mem Per Node^Total Cores In Queue^Switch^Hosts^Notes^
Line 62: Line 62:
 |  hp12  |   32  |  12  |  256  | QDR infiniband  | n1-n32 |  CPU  | |  hp12  |   32  |  12  |  256  | QDR infiniband  | n1-n32 |  CPU  |
 |  bss24  |  42  |  24  |   84  | gigabit ethernet  | b1-b49 |  CPU  | |  bss24  |  42  |  24  |   84  | gigabit ethernet  | b1-b49 |  CPU  |
-|  mw256  |    |  256  |  140  | QDR infiniband  | n33-n37 |  CPU  | +|  mw256  |    |  256  |  80  | QDR infiniband  | n33-n37 |  CPU  | 
-|  mwgpu  |    |  256  |  20  | QDR infiniband  | n33-n37 |  GPU & CPU  |+|  mwgpu  |    |  256  |  40  | QDR infiniband  | n33-n37 |  GPU & CPU  |
 |  mw256fd  |    |  256  |  256  | QDR infiniband  | n38-n45 |  CPU  | |  mw256fd  |    |  256  |  256  | QDR infiniband  | n38-n45 |  CPU  |
-|  tinymem  |   14  |  32  |  560  | gigabit ethernet  | n39-n59 |  CPU  |+|  tinymem  |   14  |  32  |  448  | gigabit ethernet  | n39-n59 |  CPU  |
  
 Some guidelines for appropriate queue usage with detailed page links: Some guidelines for appropriate queue usage with detailed page links:
  
   * hp12 is the default queue   * hp12 is the default queue
-    * for processing lots of small memory footprint jobs+    * for processing lots of small to medium memory footprint jobs
   * bss24, primarily used by bioinformatics group, available to all if needed   * bss24, primarily used by bioinformatics group, available to all if needed
-    * when not in use shut down, email me (hmeij@wes) or PEND jobs (hpcadmin will get notified) +    * when not in use powered off, email me (hmeij@wes) or PEND jobs (hpcadmin will get notified) 
-    * also our Hadoop cluster (access via head node whitetail) [[cluster:115|Use Hadoop Cluster]]+    * also our Hadoop cluster [[cluster:115|Use Hadoop Cluster]]
   * mw256 are for jobs requiring large memory access (up to 24 jobs slots per node)   * mw256 are for jobs requiring large memory access (up to 24 jobs slots per node)
 +    * for exclusive use of a node reserve all memory
   * mwgpu is for GPU enabled software primarily (Amber, Lammps, NAMD, Gromacs, Matlab, Mathematica)   * mwgpu is for GPU enabled software primarily (Amber, Lammps, NAMD, Gromacs, Matlab, Mathematica)
     * be sure to reserve one or more job slot for each GPU used [[cluster:119|Submitting GPU Jobs]]     * be sure to reserve one or more job slot for each GPU used [[cluster:119|Submitting GPU Jobs]]
-    * be sure to use the correct wrapper script for mpirun from mvapich2+    * be sure to use the correct wrapper script to set up mpirun from mvapich2
   * mw256fd  are for jobs requiring large memory access (up to 24 jobs slots per node)    * mw256fd  are for jobs requiring large memory access (up to 24 jobs slots per node) 
     * or requiring lots of threads (job slots) confined to single node (Gaussian, Autodeck)     * or requiring lots of threads (job slots) confined to single node (Gaussian, Autodeck)
-    * or requiring access to /localscratch on these node which is 175 GB on a 15K disk.+    * or requiring access to fast /localscratch which is 175 GB on a 15K disk.
       * you must stage and save results, for an example read [[https://dokuwiki.wesleyan.edu       * you must stage and save results, for an example read [[https://dokuwiki.wesleyan.edu
       * /doku.php?id=cluster:103#submit_2]]       * /doku.php?id=cluster:103#submit_2]]
-    * /localscratch5tb, unique on these nodes, is a Raid 0 file system of 3 disks providing 5 TB local scratch+    * or requiring larger /localscratch5tb, which is a Raid 0 file system of 5 TB 
       * stage temporary data in /localscratch5tb/username/ and it will not be removed       * stage temporary data in /localscratch5tb/username/ and it will not be removed
   * tinymem are for small serial jobs with small memory requirements   * tinymem are for small serial jobs with small memory requirements
-    * has a sataDOM (non spinning 16G device on motherboard) for operating system +    * nodes have a sataDOM (non spinning 16G USB device on motherboard) for operating system 
-    * do not use /localscratch on these nodes +    * do not use /localscratch on these nodes, no no 
-  * test (swallowtail, petaltail, greentail)+  * test (swallowtail, petaltail, cottontail2)
     * wall time of 8 hours of CPU usage     * wall time of 8 hours of CPU usage
  
-**There are no wall time limits in our HPCC except for queue ''test''.** You are responsible for checkpointing though. Consult these pages, all nodes in all queues are BLCR enabled. Logins nodes and storage nodes are on UPS but all compute nodes are on utility power. Crashes do happen, be prepared to restart your long running jobs.+**There are no wall time limits in our HPCC environment except for queue ''test''.** You are responsible for checkpointing though. Consult these pages, all nodes in all queues are BLCR enabled. Logins nodes and storage nodes are on UPS but all compute nodes are on utility power. Crashes do happen, be prepared to restart your long running jobs.
  
   * [[cluster:147|BLCR Checkpoint in OL3]] Serial Jobs   * [[cluster:147|BLCR Checkpoint in OL3]] Serial Jobs
cluster/126.txt · Last modified: 2023/10/23 19:37 by hmeij07