Ganglia的安装

Ganglia是UC Berkeley发起的一个开源集群监视项目&＃xff0c;设计用于测量数以千计的节点。Ganglia的核心包含gmond、gmetad以及一个Web前端。主要是用来监控系统性能&＃xff0c;如&＃xff1a;cpu 、mem、硬盘利用率&＃xff0c; I/O负载、网络流量情况等&＃xff0c;通过曲线很容易见到每个节点的工作状态&＃xff0c;对合理调整、分配系统资源&＃xff0c;提高系统整体性能起到重要作用。

Ganglia的安装&＃xff0c;可以使用yum和rpm来进行&＃xff0c;对于刚装的系统需要分别执行以下几个命令&＃xff0c;来完成初始化安装&＃xff1a;

Java代码  

1. yum install –y wget apr-devel apr-util check-devel cairo-devel pango-devel libxml2-devel rpmbuild glib2-devel dbus-devel freetype-devel fontconfig-devel gcc-c&＃43;&＃43; expat-devel python-devel libXrender-devel rrdtool*  
2.   
3. rpm -ivh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm  
4. rpm -ivh http://rpms.famillecollet.com/enterprise/remi-release-6.rpm  
5.  rpm -ivh http://github.com/downloads/jmxtrans/jmxtrans/jmxtrans-20121016.145842.6a28c97fbb-0.noarch.rpm  
6.   
7. yum install ganglia*  

yum install –y wget apr-devel apr-util check-devel cairo-devel pango-devel libxml2-devel rpmbuild glib2-devel dbus-devel freetype-devel fontconfig-devel gcc-c&＃43;&＃43; expat-devel python-devel libXrender-devel rrdtool*rpm -ivh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm
rpm -ivh http://rpms.famillecollet.com/enterprise/remi-release-6.rpmrpm -ivh http://github.com/downloads/jmxtrans/jmxtrans/jmxtrans-20121016.145842.6a28c97fbb-0.noarch.rpmyum install ganglia*


安装完成后&＃xff0c;即可配置。

1&＃xff0c; 修改ganglia的conf配置&＃xff0c;
    修改 /etc/ganglia/gmetad.conf&＃xff0c;数据源的配置
    data_source "solr cluster" 127.0.0.1
集群IP&＃xff0c;可以设置多个IP地址&＃xff0c;也可以设置多个数据源。


2&＃xff0c;修改 /etc/ganglia/gmond.conf的配置&＃xff0c;把name对应起来
cluster {
  name &＃61; "solr cluster"
  owner &＃61; "unspecified"
  latlong &＃61; "unspecified"
  url &＃61; "unspecified"
}
3&＃xff0c;修改/etc/httpd/conf.d/ganglia.conf&＃xff0c;Apache的配置&＃xff0c;不拦截ganglia的数据包
  Alias /ganglia /usr/share/ganglia

 
    Order deny,allow
    Allow  from all
    Allow from 192.168.46.21
    Allow from ::1
    # Allow from .example.com
 


4&＃xff0c;cd  /var/lib/jmxtrans
配置jmxtrans
添加solr.json

solr.json的配置如下&＃xff1a;

Java代码  

1. {  
2.     "servers" : [  
3.     {  
4.         "host" : "192.168.46.23",  
5.         "alias" : "solr23",  
6.         "port" : "3000",  
7.         "queries" : [  
8.         {  
9.             "obj" : "java.lang:type&＃61;Memory",  
10.             "resultAlias": "solr23.heap",  
11.             "attr" : [ "HeapMemoryUsage", "NonHeapMemoryUsage" ],  
12.             "outputWriters" : [  
13.              {  
14.                  "&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",  
15.                  "settings" : {  
16.                      "groupName" : "Solr-JVM",  
17.                      "host" : "239.2.11.71",  
18.                      "port" : "8649"  
19.                  }  
20.              }]  
21.         },  
22.         {  
23.             "obj" : "java.lang:name&＃61;CMS Old Gen,type&＃61;MemoryPool",  
24.             "resultAlias": "solr23.cmsoldgen",  
25.             "attr" : [ "Usage" ],  
26.             "outputWriters" : [  
27.              {  
28.                  "&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",  
29.                  "settings" : {  
30.                      "groupName" : "Solr-JVM",  
31.                      "host" : "239.2.11.71",  
32.                      "port" : "8649"  
33.                  }  
34.              }]  
35.         },  
36.         {  
37.             "obj" : "java.lang:type&＃61;GarbageCollector,name&＃61;*",  
38.             "resultAlias": "solr23.gc",  
39.             "attr" : [ "CollectionCount", "CollectionTime" ],   
40.             "outputWriters" : [  
41.              {  
42.                  "&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",  
43.                  "settings" : {  
44.                      "groupName" : "Solr-JVM",  
45.                      "host" : "239.2.11.71",  
46.                      "port" : "8649"  
47.                  }  
48.              }]  
49.         },  
50.         {  
51.             "obj" : "java.lang:type&＃61;Threading",  
52.             "resultAlias": "solr23.threads",  
53.             "attr" : [ "DaemonThreadCount", "PeakThreadCount", "ThreadCount", "TotalStartedThreadCount" ],  
54.             "outputWriters" : [  
55.              {  
56.                  "&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",  
57.                  "settings" : {  
58.                      "groupName" : "Solr-JVM",  
59.                      "host" : "239.2.11.71",  
60.                      "port" : "8649"  
61.                  }  
62.              }]  
63.         },  
64.         {  
65.             "obj" : "solr/collection1:type&＃61;queryResultCache,id&＃61;org.apache.solr.search.LRUCache",  
66.             "resultAlias": "solr23.queryCache",  
67.             "attr" : [ "warmupTime","size","lookups","evictions","hits","hitratio","inserts","cumulative_lookups","cumulative_hits","cumulative_hits","cumulative_hitratio","cumulative_inserts","cumulative_evictions" ],  
68.             "outputWriters" : [  
69.             {  
70.                 "&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",  
71.                 "settings" : {  
72.                     "groupName" : "Solr-JVM",  
73.                     "host" : "239.2.11.71",  
74.                     "port" : "8649"  
75.                 }  
76.             }]  
77.         },  
78.         {  
79.             "obj" : "solr/collection1:type&＃61;searcher,id&＃61;org.apache.solr.search.SolrIndexSearcher",  
80.            "resultAlias": "solr23.searcher",  
81.             "attr" : [ "maxDoc","numDocs","warmupTime" ],  
82.             "outputWriters" : [  
83.             {  
84.                 "&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",  
85.                 "settings" : {  
86.                     "groupName" : "Solr-JVM",  
87.                     "host" : "239.2.11.71",  
88.                     "port" : "8649"  
89.                 }  
90.             }]  
91.         }]  
92.     }]  
93. }  

{"servers" : [{"host" : "192.168.46.23","alias" : "solr23","port" : "3000","queries" : [{"obj" : "java.lang:type&＃61;Memory","resultAlias": "solr23.heap","attr" : [ "HeapMemoryUsage", "NonHeapMemoryUsage" ],"outputWriters" : [{"&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter","settings" : {"groupName" : "Solr-JVM","host" : "239.2.11.71","port" : "8649"}}]},{"obj" : "java.lang:name&＃61;CMS Old Gen,type&＃61;MemoryPool","resultAlias": "solr23.cmsoldgen","attr" : [ "Usage" ],"outputWriters" : [{"&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter","settings" : {"groupName" : "Solr-JVM","host" : "239.2.11.71","port" : "8649"}}]},{"obj" : "java.lang:type&＃61;GarbageCollector,name&＃61;*","resultAlias": "solr23.gc","attr" : [ "CollectionCount", "CollectionTime" ], "outputWriters" : [{"&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter","settings" : {"groupName" : "Solr-JVM","host" : "239.2.11.71","port" : "8649"}}]},{"obj" : "java.lang:type&＃61;Threading","resultAlias": "solr23.threads","attr" : [ "DaemonThreadCount", "PeakThreadCount", "ThreadCount", "TotalStartedThreadCount" ],"outputWriters" : [{"&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter","settings" : {"groupName" : "Solr-JVM","host" : "239.2.11.71","port" : "8649"}}]},{"obj" : "solr/collection1:type&＃61;queryResultCache,id&＃61;org.apache.solr.search.LRUCache","resultAlias": "solr23.queryCache","attr" : [ "warmupTime","size","lookups","evictions","hits","hitratio","inserts","cumulative_lookups","cumulative_hits","cumulative_hits","cumulative_hitratio","cumulative_inserts","cumulative_evictions" ],"outputWriters" : [{"&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter","settings" : {"groupName" : "Solr-JVM","host" : "239.2.11.71","port" : "8649"}}]},{"obj" : "solr/collection1:type&＃61;searcher,id&＃61;org.apache.solr.search.SolrIndexSearcher","resultAlias": "solr23.searcher","attr" : [ "maxDoc","numDocs","warmupTime" ],"outputWriters" : [{"&＃64;class" : "com.googlecode.jmxtrans.model.output.GangliaWriter","settings" : {"groupName" : "Solr-JVM","host" : "239.2.11.71","port" : "8649"}}]}]}]
}

配置完成后&＃xff0c;需要依次&＃xff0c;启动如下服务&＃xff1a;

Java代码  

1. service httpd start  //启动apache服务  
2. /etc/init.d/gmetad start   //启动绘图服务  
3. /etc/init.d/gmond start   //启动数据收集服务  
4. 这个放在solr前执行  jmx  
5. /etc/init.d/jmxtrans start  //启动jmx  
6. /home/solr/start-solr.sh  //启动solr   

service httpd start //启动apache服务
/etc/init.d/gmetad start //启动绘图服务
/etc/init.d/gmond start //启动数据收集服务
这个放在solr前执行 jmx
/etc/init.d/jmxtrans start //启动jmx
/home/solr/start-solr.sh //启动solr


注意&＃xff0c;solr启动的jetty的jar需要加上JMX的监控参数&＃xff0c;内容如下&＃xff1a;

Java代码  

1. java -Djava.rmi.server.hostname&＃61;192.168.46.23    -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port&＃61;3000 -Dcom.sun.management.jmxremote.ssl&＃61;false -Dcom.sun.management.jmxremote.authenticate&＃61;false -jar start.jar   

java -Djava.rmi.server.hostname&＃61;192.168.46.23 -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port&＃61;3000 -Dcom.sun.management.jmxremote.ssl&＃61;false -Dcom.sun.management.jmxremote.authenticate&＃61;false -jar start.jar

最后需要注意一点&＃xff0c;为了防止访问apache服务出错&＃xff0c;
如果出现&＃xff1a;There was an error collecting ganglia data (127.0.0.1:8652): fsockopen error: Permission denied  .  错误&＃xff0c;我们需要进行以下的设置&＃xff1a;

Java代码  

1. &＃xff08;1&＃xff09;&＃xff1a;临时可以使用命令setenforce 0来关闭selinux而不需要重启&＃xff0c;刷新页面&＃xff0c;即可访问&＃xff01;  
2. &＃xff08;2&＃xff09;:永久的使用&＃xff0c;需要关闭selinux&＃xff1a;vi /etc/selinux/config&＃xff0c;把SELINUX&＃61;enforcing改成SELINUX&＃61;disable&＃xff1b;需要重启机器。  

&＃xff08;1&＃xff09;&＃xff1a;临时可以使用命令setenforce 0来关闭selinux而不需要重启&＃xff0c;刷新页面&＃xff0c;即可访问&＃xff01;
&＃xff08;2&＃xff09;:永久的使用&＃xff0c;需要关闭selinux&＃xff1a;vi /etc/selinux/config&＃xff0c;把SELINUX&＃61;enforcing改成SELINUX&＃61;disable&＃xff1b;需要重启机器。


一切完成后&＃xff0c;我们就是访问我们本机的ip地址&＃xff0c;看到的界面如下所示&＃xff1a;





到此&＃xff0c;我们的单机监控solr的demo&＃xff0c;就部署成功了&＃xff0c;以同样的方式&＃xff0c;我们还可以对hadoop进行监控&＃xff0c;另外我们还可以配置多个datasource来监控多个应用。