using-the-cluster
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
using-the-cluster [2015/09/22 13:59] – aorth | using-the-cluster [2019/12/02 12:50] – [Cluster Organization] jean-baka | ||
---|---|---|---|
Line 1: | Line 1: | ||
====== Using the Cluster ====== | ====== Using the Cluster ====== | ||
- | ILRI's high-performance computing " | + | ILRI's high-performance computing " |
- | * hpc - main login node, " | + | * hpc: main login node, " |
- | * taurus, | + | * taurus, compute2, compute04: used for batch and interactive jobs like BLAST, structure, R, etc |
- | * mammoth | + | * mammoth: used for high-memory jobs like genome assembly (mira, newbler, abyss, etc) |
+ | * compute03: fast CPUs, but few of them | ||
+ | * compute04: batch jobs, has lots of disk space in ''/ | ||
+ | * compute05: batch jobs, has the fastest processors (AMD EPYC) | ||
- | To get access to the cluster you should talk to [[a.orth@cgiar.org|Alan Orth]] | + | To get access to the cluster you should talk to Jean-Baka |
===== Cluster Organization ===== | ===== Cluster Organization ===== | ||
The cluster is arranged in a master/ | The cluster is arranged in a master/ | ||
- | {{ :hpc_topology.png?300 |}} | + | {{:hpc_topology_2019_web.png|}} |
==== Detailed Information ==== | ==== Detailed Information ==== | ||
^Machine | ^Machine | ||
- | |taurus|- 112 GB RAM \\ - 64 CPUs |- batch and interactive jobs \\ - Good for BLAST, structure, R, etc.|{{http:// | + | |taurus|116 GB RAM \\ 64 CPUs | batch and interactive jobs \\ Good for BLAST, structure, R, admixture, etc.|{{https:// |
- | |mammoth|- 512 GB RAM \\ - 16 CPUs |- batch and high-memory jobs \\ - Good for genome assembly (mira, newbler, abyss, etc)|{{http:// | + | |mammoth | 516 GB RAM \\ 8 CPUs | batch and high-memory jobs \\ Good for genome assembly (mira, newbler, abyss, etc)|{{https:// |
- | |compute2|- 128 GB RAM \\ - 16 CPUs |- batch and interactive jobs \\ - Good for BLAST, structure, R, etc.|{{http:// | + | |compute2| |
+ | |compute03 | 442 GB RAM \\ 8 CPUs | batch and high-memory jobs \\ Good for genome assembly (mira, newbler, abyss, etc), mothur|{{https:// | ||
+ | |compute04 | 48 GB RAM \\ 8 CPUs \\ 10TB scratch | batch jobs \\ Good for BLAST, structure, R, etc that need lots of disk space |{{https:// | ||
+ | |compute05 | 384 GB RAM \\ 48 CPUs \\ 1.6TB scratch | batch jobs \\ Most recent AMD EPYC CPUs, good for BLAST, structure, R, etc |{{https:// | ||
+ | ===== Backups ===== | ||
+ | At the moment we don't backup users' data in their respective home folders. We therefore advise users to have their own backups. |
using-the-cluster.txt · Last modified: 2023/01/06 06:14 by aorth