User Tools

Site Tools


using-the-cluster

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
Next revisionBoth sides next revision
using-the-cluster [2013/07/09 08:54] – created aorthusing-the-cluster [2015/09/22 13:59] aorth
Line 1: Line 1:
-====== Using the cluster ======+====== Using the Cluster ======
 ILRI's high-performance computing "cluster" is currently composed of several dedicated machines: ILRI's high-performance computing "cluster" is currently composed of several dedicated machines:
   * hpc - main login node, "master" of the cluster   * hpc - main login node, "master" of the cluster
-  * taurus - good for batch and interactive jobs like BLAST, structure, R, etc+  * taurus,compute2 - good for batch and interactive jobs like BLAST, structure, R, etc
   * mammoth - good for high-memory jobs like genome assembly (mira, newbler, abyss, etc)   * mammoth - good for high-memory jobs like genome assembly (mira, newbler, abyss, etc)
  
-To get access to the cluster you should talk to [[a.orth@cgiar.org|Alan Orth]] (he sits in Lab 2).  Once you have access you should read up on [[UsingSLURM|SLURM]] so you can learn how to submit jobs to the cluster.+To get access to the cluster you should talk to [[a.orth@cgiar.org|Alan Orth]] (he sits in Lab 2).  Once you have access you should read up on [[Using SLURM|SLURM]] so you can learn how to submit jobs to the cluster.
  
-===== Cluster organization =====+===== Cluster Organization =====
 The cluster is arranged in a master/slave configuration; users log into HPC (the master) and use it as a "jumping off point" to the rest of the cluster. Here's a diagram of the topology: The cluster is arranged in a master/slave configuration; users log into HPC (the master) and use it as a "jumping off point" to the rest of the cluster. Here's a diagram of the topology:
 {{ :hpc_topology.png?300 |}} {{ :hpc_topology.png?300 |}}
  
-==== Detailed information ====+==== Detailed Information ====
  
 ^Machine           ^Specifications                ^Uses                 ^1 hour status   ^ ^Machine           ^Specifications                ^Uses                 ^1 hour status   ^
-|taurus|- 128 GB RAM \\ - 64 CPUs |- batch and interactive jobs \\ - Good for BLAST, structure, R, etc.|{{http://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=taurus&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} | +|taurus|- 112 GB RAM \\ - 64 CPUs |- batch and interactive jobs \\ - Good for BLAST, structure, R, etc.|{{http://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=taurus&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} | 
-|mammoth|- 384 GB RAM \\ - 16 CPUs |- batch and high-memory jobs \\ - Good for genome assembly (mira, newbler, abyss, etc)|{{http://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=mammoth&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} |+|mammoth|- 512 GB RAM \\ - 16 CPUs |- batch and high-memory jobs \\ - Good for genome assembly (mira, newbler, abyss, etc)|{{http://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=mammoth&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} | 
 +|compute2|- 128 GB RAM \\ - 16 CPUs |- batch and interactive jobs \\ - Good for BLAST, structure, R, etc.|{{http://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=compute2&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} |
using-the-cluster.txt · Last modified: 2023/01/06 06:14 by aorth