Hadoop、HBase配置Ganglia指南（metrics1）

背景：

Hadoop、HBase配置Ganglia指南（metrics1）

Hadoop、HBase配置Ganglia指南（metrics1）

相关阅读：

Ganglia 3.1.x下扩展Python模块（翻译自官方wiki)

使用Ganglia监控Hadoop集群

在VMware Workstation的Ubuntu下安装和配置Hadoop与Ganglia

Ganglia安装部署之一建立Grid

Ganglia 极其简单安装教程yum版

Ganglia快速开始向导（翻译自官方wiki）

CentOS集群上安装Ganglia-3.6.0监控Hadoop-2.2.0和HBase-0.96.0

Server端：
 
yum install rrdtool ganglia ganglia-gmetad ganglia-gmond ganglia-web httpd php
 
Client端：
 
yum install ganglia-gmond
 
创建RRD目录
 
mkdir -p /var/lib/ganglia/rrds
 chown ganglia:ganglia /var/lib/ganglia/rrds
 
编辑/etc/ganglia/gmond.conf
 
cluster {
 
  name = "DFS"
 
  owner = "unspecified"
 
  latlong = "unspecified"
 
  url = "unspecified"
 
}
 
udp_send_channel {
 
  #bind_hostname = yes # Highly recommended, soon to be default.
 
                      # This option tells gmond to use a source address
 
                      # that resolves to the machine's hostname. Without
 
                      # this, the metrics may appear to come from any
 
                      # interface and the DNS names associated with
 
                      # those IPs will be used to create the RRDs.
 
  mcast_join = master.hadoop.test
 
  port = 8649
 
  ttl = 1
 
}
 

/* You can specify as many udp_recv_channels as you like as well. */
 
udp_recv_channel {
 
  port = 8649
 
  bind = master.hadoop.test
 
}
 

/* You can specify as many tcp_accept_channels as you like to share
 
  an xml description of the state of the cluster */
 
tcp_accept_channel {
 
  bind = master.hadoop.test
 
  port = 8649
 
}
 
编辑/etc/ganglia/gmetad.conf
 
data_source "DFS" master.hadoop.test:8649
 

安装ganglia-web
 
cd /var/www/html
 
wget
 
tar zxvf ganglia-web-3.5.7.tar.gz
 
mv ganglia-web-3.5.7 ganglia
 
修改Apache配置
 
vim /etc/httpd/conf.d/ganglia.conf
 
<Location /ganglia>
 
    Order deny,allow
 
    Allow from all
 
</Location>
 
# 开机运行采集进程
 chkconfig --levels 235 gmond on
 # 开机运行数据存储进程
 chkconfig --levels 235 gmetad on
 # 开机运行apache服务
 chkconfig --levels 235 httpd on
 
启动服务
 
service gmond start
 service gmetad start
 service httpd restart
 

修改hadoop配置：
 
vim $HADOOP_HOME/conf/hadoop-metrics.properties
 
# Configuration of the "dfs" context for ganglia
 
dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
 
dfs.period=10
 
dfs.servers=master.hadoop.test:8649