ILRI Research Computing

User Tools

Site Tools

You are here: start » server_monitoring
server_monitoring

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
Next revisionBoth sides next revision
server_monitoring [2009/11/27 08:38] – alanserver_monitoring [2010/06/16 09:53] – 172.26.15.75
Line 2: Line 2:
   * [[#ganglia|Ganglia]] - Monitors cluster CPU, disk, network usage   * [[#ganglia|Ganglia]] - Monitors cluster CPU, disk, network usage
   * [[#monit|Monit]] - Monitors specific services   * [[#monit|Monit]] - Monitors specific services
-  * [[#nagios|Nagios]] - Monitors services services+  * [[#nagios|Nagios]] - Monitors servers,hosts and services 
 +  * [[#Zabbix|Zabbix]] -Monitor servers,host and services 
  
 ===== Ganglia ===== ===== Ganglia =====
Line 8: Line 10:
 [[http://ganglia.info/|Ganglia]] is a system for measuring, recording, and graphing certain metrics about hosts in a cluster.  Metrics include things like CPU load, network traffic, disk space, RAM utilization, etc.  These metrics are saved and graphed periodically by [[http://oss.oetiker.ch/rrdtool|RRDtool]]. Rocks automatically configures the head node to query the compute nodes and has a web-based interface where you can monitor the health of the cluster. [[http://ganglia.info/|Ganglia]] is a system for measuring, recording, and graphing certain metrics about hosts in a cluster.  Metrics include things like CPU load, network traffic, disk space, RAM utilization, etc.  These metrics are saved and graphed periodically by [[http://oss.oetiker.ch/rrdtool|RRDtool]]. Rocks automatically configures the head node to query the compute nodes and has a web-based interface where you can monitor the health of the cluster.
  
-You can see the ganglia installation here:  http://hpc.ilri.cgiar.org/ganglia (if it's working) +You can see the ganglia installation here:  http://hpc.ilri.cgiar.org/ganglia
- +
-For some reason sometimes the graphs do not draw.  If you reboot the cluster the graphs work for some days and then seem to stop drawing (the graphs appear blank).  However, if you call the script responsible for drawing the graphs with no arguments, you'll see graphs are actually working: http://hpc.ilri.cgiar.org/ganglia/graph.php+
  
 {{:ganglia_diagram_smaller.gif|}} {{:ganglia_diagram_smaller.gif|}}
  
 Interesting documentation: http://www.ibm.com/developerworks/wikis/display/WikiPtype/ganglia Interesting documentation: http://www.ibm.com/developerworks/wikis/display/WikiPtype/ganglia
- 
 ==== Troubleshooting ==== ==== Troubleshooting ====
-When Ganglia has problems displaying nodes it may need to be restarted.  Restart the daemons in this order: +From time to time there are problems with Ganglia's web interface.  You can restart the needed services following this basic procedure: 
-  * Stop data collection daemon on HPC: ''service gmetad stop'' + 
-  * Stop monitoring daemon on HPC: ''service gmond stop'' +  - Stop data collection daemon on HPC: ''service gmetad stop'' 
-  * Stop monitoring daemon on compute nodes: ''rocks run host compute %%'%%service gmond stop%%'%%'' +  - Stop monitoring daemon on compute nodes: ''rocks run host compute %%'%%service gmond stop%%'%%'' 
-  * Start data collection daemon on HPC: ''service gmetad start'' +  - Start data collection daemon on HPC: ''service gmetad start'' 
-  * Star monitoring daemon on HPC: ''service gmond start'' +  - Wait a minute or two 
-  * Start monitoring daemon on compute nodes: ''rocks run host compute %%'%%service gmond start%%'%%''+  - Start monitoring daemon on compute nodes: ''rocks run host compute %%'%%service gmond start%%'%%''
  
 Now go check the Ganglia web interface and see if the nodes have returned. Now go check the Ganglia web interface and see if the nodes have returned.
Line 87: Line 86:
  
 with  username = "nagiosadmin" and password = "nagios" with  username = "nagiosadmin" and password = "nagios"
 +==== Zabbix ====
 +----
 +Installation:
 +
 +RHEL-compatible Linux:
 +<code>sudo echo '[andrewfarley]
 +name=Andrew Farley RPM Repository
 +baseurl=http://repo.andrewfarley.com/centos/$releasever/$basearch/
 +enabled=1
 +gpgcheck=0' > /etc/yum.repos.d/andrewfarley.com.repo</code>
 +
 +
 +
 +And then you can install zabbix agent, zabbix server, zabbix get, or zabbix proxy with…
 +<file>
 +    sudo yum install zabbix-agent
 +    sudo yum install zabbix-server
 +    sudo yum install zabbix-get
 +    sudo yum install zabbix-proxy </file>
 +
 +If it fails to install, you might need to clean the metadata with the following command and try again…
 +
 +    sudo yum clean metadata
 +
 +
 +Debian-Based Linux:
 +----
 +<code>
 +root@simple:~# apt-cache search zabbix 
 +zabbix-agent - network monitoring solution - agent
 +zabbix-frontend-php - network monitoring solution - PHP front-end
 +zabbix-proxy-mysql - network monitoring solution - proxy (using MySQL)
 +zabbix-proxy-pgsql - network monitoring solution - proxy (using PostgreSQL)
 +zabbix-server-mysql - network monitoring solution - server (using MySQL)
 +zabbix-server-pgsql - network monitoring solution - server (using PostgreSQL)
 +root@simple:~# aptitude install zabbix-proxy-mysql zabbix-agent zabbix-server-mysql zabbix-frontend-php
 +</code>
 +
 +=== Accessing Zabbix ===
 +
 +http://172.26.12.29/zabbix
 +username: Admin
 +password: zabbix