Differences

This shows you the differences between two versions of the page.

--- using-the-cluster [2019/05/31 11:00] – added info about compute05 jean-baka
+++ using-the-cluster [2020/03/19 12:13] – [Using the Cluster] jean-baka
@@ Line 1: / Line 1: @@
 ====== Using the Cluster ======
-ILRI's high-performance computing "cluster" is currently composed of 4 dedicated machines:
+ILRI's high-performance computing "cluster" is currently composed of 7 dedicated machines:
   * hpc: main login node, "master" of the cluster
-  * taurus, compute2, compute04: used for batch and interactive jobs like BLAST, structure, R, etc
+  * taurus, compute2, compute04: used for batch and interactive jobs like BLAST, structure, R, etc (compute04 has lots of disk space under its ''/var/scratch'')
   * mammoth: used for high-memory jobs like genome assembly (mira, newbler, abyss, etc)
   * compute03: fast CPUs, but few of them
-  * compute04: batch jobs, has lots of disk space in ''/var/scratch''
+  * compute05: batch jobs, has the fastest processors (AMD EPYC)
 To get access to the cluster you should talk to Jean-Baka (he sits in BecA). Once you have access you should read up on [[Using SLURM|SLURM]] so you can learn how to submit jobs to the cluster.
@@ Line 11: / Line 11: @@
 ===== Cluster Organization =====
 The cluster is arranged in a master/slave configuration; users log into HPC (the master) and use it as a "jumping off point" to the rest of the cluster. Here's a diagram of the topology:
-{{:infrastructure-2018-fs8.png|}}
+{{:hpc_topology_2019_web.png|}}
 ==== Detailed Information ====
@@ Line 17: / Line 17: @@
 ^Machine           ^Specifications                ^Uses                 ^1 hour status   ^
 |taurus|116 GB RAM \\ 64 CPUs | batch and interactive jobs \\ Good for BLAST, structure, R, admixture, etc.|{{https://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=taurus&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} |
-|mammoth | 516 GB RAM \\ 16 CPUs | batch and high-memory jobs \\ Good for genome assembly (mira, newbler, abyss, etc)|{{https://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=mammoth&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} |
+|mammoth | 516 GB RAM \\ 8 CPUs | batch and high-memory jobs \\ Good for genome assembly (mira, newbler, abyss, etc)|{{https://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=mammoth&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} |
 |compute2| 132 GB RAM \\ 64 CPUs | batch and interactive jobs \\ Good for BLAST, structure, R, etc.|{{https://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=compute2&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} |
 |compute03 | 442 GB RAM \\ 8 CPUs | batch and high-memory jobs \\ Good for genome assembly (mira, newbler, abyss, etc), mothur|{{https://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=compute03&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} |