User Tools

Site Tools


using-the-cluster

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
using-the-cluster [2023/01/06 06:12] aorthusing-the-cluster [2023/01/06 06:14] (current) aorth
Line 5: Line 5:
   * **compute05**, **compute06**: used for batch and interactive jobs like BLAST, structure, R, etc (compute05 and compute06 have the newest AMD EPYC CPUs)   * **compute05**, **compute06**: used for batch and interactive jobs like BLAST, structure, R, etc (compute05 and compute06 have the newest AMD EPYC CPUs)
   * **compute07**: used for high-memory jobs like genome assembly (mira, newbler, abyss, etc)   * **compute07**: used for high-memory jobs like genome assembly (mira, newbler, abyss, etc)
-  * **compute03**: fast CPUs, but few of them 
  
-To get access to the cluster you should talk to Jean-Baka (he sits in BecA). Once you have access you should read up on [[Using SLURM|SLURM]] so you can learn how to submit jobs to the cluster.+To get access to the cluster you should talk to Alan Orth or Jean-Baka in the Data and Research Methods Unit (Mara House). Once you have access you should read up on [[Using SLURM|SLURM]] so you can learn how to submit jobs to the cluster.
  
  
Line 23: Line 22:
 ==== Microsoft Windows ==== ==== Microsoft Windows ====
  
-If you are running Windows 10, you can access a simple ssh client by [[https://www.howtogeek.com/235101/10-ways-to-open-the-command-prompt-in-windows-10/|launching the "command prompt"]] and then typing in there ''ssh username@hpc.ilri.cgiar.org'', where your replace ''username'' with your own username on the HPC (as communicated by the person who created your HPC account).+If you are running Windows 10+, you can access a simple ssh client by [[https://www.howtogeek.com/235101/10-ways-to-open-the-command-prompt-in-windows-10/|launching the "command prompt"]] and then typing in there ''ssh username@hpc.ilri.cgiar.org'', where your replace ''username'' with your own username on the HPC (as communicated by the person who created your HPC account).
  
  
Line 32: Line 31:
  
 ===== Cluster Organization ===== ===== Cluster Organization =====
-The cluster is arranged in a master/slave configurationusers log into HPC (the master) and use it as a "jumping off point" to the rest of the cluster. Here's a diagram of the topology. For each server, we mention the number of CPUs and the year it was commissioned:+The cluster is arranged in a head/compute configuration whereby users log into HPC (the head) and use it as a "jumping off point" to the rest of the cluster. Here's a diagram of the topology. For each server, we mention the number of CPUs and the year it was commissioned:
 {{:hpc_topology_2019_web.png|}} {{:hpc_topology_2019_web.png|}}
  
Line 38: Line 37:
  
 ^Machine           ^Specifications                ^Uses                 ^1 hour status   ^ ^Machine           ^Specifications                ^Uses                 ^1 hour status   ^
-|compute03 | 442 GB RAM \\ 8 CPUs | batch and high-memory jobs \\ Good for genome assembly (mira, newbler, abyss, etc), mothur|{{https://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=compute03&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} | 
 |compute05 | 384 GB RAM \\ 48 CPUs \\ 1.6TB scratch | batch jobs \\ Most recent AMD EPYC CPUs, good for BLAST, structure, R, etc |{{https://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=compute05&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} | |compute05 | 384 GB RAM \\ 48 CPUs \\ 1.6TB scratch | batch jobs \\ Most recent AMD EPYC CPUs, good for BLAST, structure, R, etc |{{https://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=compute05&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} |
 |compute06|256 GB RAM \\ 64 CPUs | batch and interactive jobs \\ Good for BLAST, structure, R, admixture, etc.|{{https://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=compute06&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} | |compute06|256 GB RAM \\ 64 CPUs | batch and interactive jobs \\ Good for BLAST, structure, R, admixture, etc.|{{https://hpc.ilri.cgiar.org/ganglia/graph.php?g=load_report&z=medium&c=compute&h=compute06&m=os_name&r=hour&s=descending&hc=4&mc=2&.gif?}} |
using-the-cluster.txt · Last modified: 2023/01/06 06:14 by aorth