首页    技术博客    PHP教程    数据库技术    前端开发   HTML5    Nginx    php论坛
新用户注册 | 会员登录
加入会员，解锁专属内容
取消
热门标签 | HotTags
当前位置:  开发笔记 > 编程语言 > 正文

比KafkaMangaer更优秀的开源监控工具KafkaEagle

作者：手机用户2502863305 | 来源：互联网 | 2023-08-07 08:30
比KafkaMangaer更优秀的开源监控工具-KafkaEagle作者：尹正杰版权声明：原创作品，谢绝转载！否则将追究法律

　　　　　　　　　　　　　　　　　比Kafka Mangaer更优秀的开源监控工具-Kafka Eagle

　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　作者&＃xff1a;尹正杰

版权声明&＃xff1a;原创作品&＃xff0c;谢绝转载&＃xff01;否则将追究法律责任。

 

　　在Kafka的监控系统中有很多优秀的开源监控系统。比如Kafka-manager&＃xff0c;open-faclcon&＃xff0c;zabbix等主流监控工具均可直接监控kafka。Kafka集群性能监控可以从消息网络传输&＃xff0c;消息传输流量&＃xff0c;请求次数等指标来衡量集群性能。这些指标数据可以通过访问kafka集群的JMX接口获取。

　　由于Kafka Eagle监控系统核心模块采用java编程语言实现&＃xff0c;因此启动Kafka Eagle 监控系统需要依赖Java运行环境&＃xff08;JDK&＃xff09;&＃xff0c;建议使用java 7以上版本&＃xff0c;推荐使用JDK1.8。关于jdk的安装我就不废话了&＃xff0c;大家自行安装一下。

 

一.kafka Eagle简介

1>.kafka Eagle监控系统

　　kafka Eagle监控系统的目标是做一个部署简单&＃xff0c;开发容易&＃xff0c;使用方便的kafka消息监控系统。

2>.Kafka Eagle最新版本的

　　下载地址&＃xff1a;http://download.smartloli.org/

3>.Kafka Eagle 源代码

　　下载地址&＃xff1a;https://github.com/smartloli/kafka-eagle

4>.Kafka Eagle 各个版本

　　下载地址&＃xff1a;https://ke.smartloli.org/5.ChangeLog/1.ChangeLog.html

 

二.安装Kafka Eagle

1>.使用wget工具下载kafka Eagle 软件安装包

[root&＃64;node105 ~]#
[root&＃64;node105 ~]# mkdir -pv /yinzhengjie/kafka-eagle && cd /yinzhengjie/kafka-eagle
mkdir: created directory ‘/yinzhengjie/kafka-eagle’
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]# wget https://github.com/smartloli/kafka-eagle-bin/archive/v1.2.0.tar.gz
--2018-11-14 15:21:20-- https://github.com/smartloli/kafka-eagle-bin/archive/v1.2.0.tar.gz
Resolving github.com (github.com)... 52.74.223.119, 13.250.177.223, 13.229.188.59
Connecting to github.com (github.com)|52.74.223.119|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://codeload.github.com/smartloli/kafka-eagle-bin/tar.gz/v1.2.0 [following]
--2018-11-14 15:21:21-- https://codeload.github.com/smartloli/kafka-eagle-bin/tar.gz/v1.2.0
Resolving codeload.github.com (codeload.github.com)... 13.250.162.133, 54.251.140.56, 13.229.189.0
Connecting to codeload.github.com (codeload.github.com)|13.250.162.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [application/x-gzip]
Saving to: ‘v1.2.0.tar.gz’[ <&＃61;> ] 57,443,692 1.73MB/s in 31s 2018-11-14 15:21:53 (1.79 MB/s) - ‘v1.2.0.tar.gz’ saved [57443692][root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]# ll
total 56100
-rw-r--r--. 1 root root 57443692 Nov 14 15:32 v1.2.0.tar.gz
[root&＃64;node105 kafka-eagle]#

[root&＃64;node105 kafka-eagle]# wget https://github.com/smartloli/kafka-eagle-bin/archive/v1.2.0.tar.gz

2>.解压安装包并创建软连接 

[root&＃64;node105 kafka-eagle]# ll
total 56100
-rw-r--r--. 1 root root 57443692 Nov 14 15:32 v1.2.0.tar.gz
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]# tar -zxf v1.2.0.tar.gz
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]# ll
total 56100
drwxrwxr-x. 2 root root 46 Jan 23 2018 kafka-eagle-bin-1.2.0
-rw-r--r--. 1 root root 57443692 Nov 14 15:32 v1.2.0.tar.gz
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]# tar -zxf kafka-eagle-bin-1.2.0/kafka-eagle-web-1.2.0-bin.tar.gz -C /soft/
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]# ln -s /soft/kafka-eagle-web-1.2.0/ /soft/kafka-eagle
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]# ll /soft/
total 0
lrwxrwxrwx. 1 root root 19 Oct 26 20:10 jdk -> /soft/jdk1.8.0_131/
drwxr-xr-x. 8 root root 255 Oct 26 13:20 jdk1.8.0_131
drwxr-xr-x. 7 root root 101 Oct 26 13:20 kafka
lrwxrwxrwx. 1 root root 28 Nov 14 15:41 kafka-eagle -> /soft/kafka-eagle-web-1.2.0/
drwxr-xr-x. 8 root root 75 Nov 14 15:39 kafka-eagle-web-1.2.0
drwxr-xr-x. 7 root root 126 Oct 26 13:20 kafka-manager
[root&＃64;node105 kafka-eagle]#

3>.为Kafka Eagle配置环境变量&＃xff08;“/etc/profile”&＃xff09; 

[root&＃64;node105 kafka-eagle]# tail /etc/profile
export GOROOT&＃61;/usr/lib/golang
export GOPATH&＃61;/home/yinzhengjie/golang#ADD open-falcon path by yinzhengjie
export FALCON_HOME&＃61;/yinzhengjie/open-falcon/workspace
export WORKSPACE&＃61;/open-falcon#ADD kafka-Eagle path by yinzhengjie
export KE_HOME&＃61;/soft/kafka-eagle
export PATH&＃61;$PATH:$KE_HOME/bin
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]# chmod &＃43;x /soft/kafka-eagle/bin/ -R 　　#这个目录下有2个脚本&＃xff0c;当你启动服务时&＃xff0c;会多处一个ke.pid的文件&＃xff0c;用于存放进程pid的&＃xff0c;这一步必须得做&＃xff0c;没有权限的话&＃xff0c;你没法启动服务哟&＃xff01;
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]# source /etc/profile
[root&＃64;node105 kafka-eagle]#

4>.编辑配置文件&＃xff08;/soft/kafka-eagle/conf/system-config.properties&＃xff09;

[root&＃64;node105 kafka-eagle]# cat /soft/kafka-eagle/conf/system-config.properties
######################################
# 多集群模式配置&＃xff0c;包含多个kafka和zookeeper。
######################################
#kafka.eagle.zk.cluster.alias&＃61;cluster1,cluster2
#cluster1.zk.list&＃61;tdn1:2181,tdn2:2181,tdn3:2181
#cluster2.zk.list&＃61;xdn10:2181,xdn11:2181,xdn12:2181kafka.eagle.zk.cluster.alias&＃61;yinzhengjie-kafka
yinzhengjie-kafka.zk.list&＃61;10.1.2.102:2181,10.1.2.103:2181,10.1.2.104:2181
######################################
# zookeeper客户端连接数限制
######################################
kafka.zk.limit.size&＃61;25######################################
# kafka eagle webui port
######################################
kafka.eagle.webui.port&＃61;8048######################################
# kafka 消费信息存储位置&＃xff0c;用来兼容kafka低版本
######################################
kafka.eagle.offset.storage&＃61;kafka######################################
# kafka eagle 设置告警邮件服务器
######################################
kafka.eagle.mail.enable&＃61;true
kafka.eagle.mail.sa&＃61;alert_sa
kafka.eagle.mail.username&＃61;alert_sa&＃64;163.com
kafka.eagle.mail.password&＃61;mqslimczkdqabbbg
kafka.eagle.mail.server.host&＃61;smtp.163.com
kafka.eagle.mail.server.port&＃61;25######################################
# 管理员删除kafka中topic的口令
######################################
kafka.eagle.topic.token&＃61;keadmin######################################
# kafka 集群是否开启了认证模式
######################################
kafka.eagle.sasl.enable&＃61;false
kafka.eagle.sasl.protocol&＃61;SASL_PLAINTEXT
kafka.eagle.sasl.mechanism&＃61;PLAIN
kafka.eagle.sasl.client&＃61;/hadoop/kafka-eagle/conf/kafka_client_jaas.conf######################################
# kafka eagle 存储监控数据的数据库地址
######################################
kafka.eagle.driver&＃61;com.mysql.jdbc.Driver
kafka.eagle.url&＃61;jdbc:mysql://127.0.0.1:3306/ke?useUnicode&＃61;true&characterEncoding&＃61;UTF-8&zeroDateTimeBehavior&＃61;convertToNull
kafka.eagle.username&＃61;root
kafka.eagle.password&＃61;yinzhengjie[root&＃64;node105 kafka-eagle]#

5>.启动Kafka监控系统&＃xff08;此处需要对ke.sh这个脚本进行修改&＃xff0c; &＃xff09;

[root&＃64;node105 kafka-eagle]# ke.sh start
Starting : KE Service Check ...created: META-INF/inflated: META-INF/MANIFEST.MFcreated: media/created: media/css/created: media/css/fonts/created: media/css/img/created: media/css/plugins/created: media/css/plugins/datatimepicker/created: media/css/plugins/select2/created: media/css/public/created: media/css/public/account/created: media/css/public/images/created: media/img/created: media/js/created: media/js/main/created: media/js/main/account/created: media/js/main/alarm/created: media/js/main/cluster/created: media/js/main/consumer/created: media/js/main/error/created: media/js/main/metrics/created: media/js/main/system/created: media/js/main/topic/created: media/js/plugins/created: media/js/plugins/codemirror/created: media/js/plugins/d3/created: media/js/plugins/datatables/created: media/js/plugins/datatimepicker/created: media/js/plugins/magicsuggest/created: media/js/plugins/select2/created: media/js/plugins/terminal/created: media/js/plugins/tokenfield/created: media/js/public/created: WEB-INF/created: WEB-INF/classes/created: WEB-INF/classes/org/created: WEB-INF/classes/org/smartloli/created: WEB-INF/classes/org/smartloli/kafka/created: WEB-INF/classes/org/smartloli/kafka/eagle/created: WEB-INF/classes/org/smartloli/kafka/eagle/web/created: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/created: WEB-INF/classes/org/smartloli/kafka/eagle/web/dao/created: WEB-INF/classes/org/smartloli/kafka/eagle/web/pojo/created: WEB-INF/classes/org/smartloli/kafka/eagle/web/quartz/created: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/created: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/impl/created: WEB-INF/classes/org/smartloli/kafka/eagle/web/sso/created: WEB-INF/classes/org/smartloli/kafka/eagle/web/sso/filter/created: WEB-INF/classes/org/smartloli/kafka/eagle/web/sso/pojo/created: WEB-INF/lib/created: WEB-INF/views/created: WEB-INF/views/account/created: WEB-INF/views/alarm/created: WEB-INF/views/cluster/created: WEB-INF/views/consumers/created: WEB-INF/views/error/created: WEB-INF/views/main/created: WEB-INF/views/metrics/created: WEB-INF/views/public/created: WEB-INF/views/system/created: WEB-INF/views/topic/inflated: media/css/fonts/fontawesome-webfont.ttfinflated: media/css/fonts/fontawesome-webfont.woffinflated: media/css/fonts/glyphicons-halflings-regular.ttfinflated: media/css/fonts/glyphicons-halflings-regular.woffinflated: media/css/fonts/glyphicons-halflings-regular.woff2inflated: media/css/img/glyphicons-halflings.pnginflated: media/css/plugins/datatimepicker/daterangepicker.cssinflated: media/css/plugins/select2/select2.min.cssinflated: media/css/public/account/hfc.ttfinflated: media/css/public/account/hfd.ttfinflated: media/css/public/account/main.cssinflated: media/css/public/bootstrap-tokenfield.cssinflated: media/css/public/bootstrap-treeview.min.cssinflated: media/css/public/bootstrap.min.cssinflated: media/css/public/codemirror.cssinflated: media/css/public/dataTables.bootstrap.min.cssinflated: media/css/public/font-awesome.min.cssinflated: media/css/public/images/ui-bg_glass_75_e6e6e6_1x400.pnginflated: media/css/public/images/ui-bg_glass_75_ffffff_1x400.pnginflated: media/css/public/images/ui-bg_highlight-soft_75_cccccc_1x100.pnginflated: media/css/public/images/ui-icons_222222_256x240.pnginflated: media/css/public/images/ui-icons_454545_256x240.pnginflated: media/css/public/images/ui-icons_888888_256x240.pnginflated: media/css/public/jquery.terminal.min.cssinflated: media/css/public/magicsuggest.cssinflated: media/css/public/morris.cssinflated: media/css/public/sb-admin.cssinflated: media/css/public/show-hint.cssinflated: media/css/public/tokenfield-typeahead.cssinflated: media/img/favicon.icoinflated: media/img/ke_login.pnginflated: media/js/main/account/signin.jsinflated: media/js/main/alarm/add.jsinflated: media/js/main/alarm/modify.jsinflated: media/js/main/cluster/cluster.jsinflated: media/js/main/cluster/multicluster.jsinflated: media/js/main/cluster/zkcli.jsinflated: media/js/main/consumer/consumers.jsinflated: media/js/main/consumer/offset.consumer.jsinflated: media/js/main/consumer/offset.realtime.jsinflated: media/js/main/error/error.jsinflated: media/js/main/index.jsinflated: media/js/main/metrics/brokers.jsinflated: media/js/main/metrics/trend.jsinflated: media/js/main/system/notice.jsinflated: media/js/main/system/resource.jsinflated: media/js/main/system/role.jsinflated: media/js/main/system/user.jsinflated: media/js/main/topic/create.jsinflated: media/js/main/topic/list.jsinflated: media/js/main/topic/mock.jsinflated: media/js/main/topic/msg.jsinflated: media/js/main/topic/topic.meta.jsinflated: media/js/plugins/codemirror/codemirror.jsinflated: media/js/plugins/codemirror/show-hint.jsinflated: media/js/plugins/codemirror/sql-hint.jsinflated: media/js/plugins/codemirror/sql.jsinflated: media/js/plugins/d3/d3.jsinflated: media/js/plugins/d3/d3.layout.jsinflated: media/js/plugins/datatables/dataTables.bootstrap.min.jsinflated: media/js/plugins/datatables/jquery.dataTables.min.jsinflated: media/js/plugins/datatimepicker/daterangepicker.jsinflated: media/js/plugins/datatimepicker/moment.min.jsinflated: media/js/plugins/magicsuggest/magicsuggest.jsinflated: media/js/plugins/select2/select2.min.jsinflated: media/js/plugins/select2/select2.min.js.bakinflated: media/js/plugins/terminal/jquery.terminal.min.jsinflated: media/js/plugins/tokenfield/bootstrap-tokenfield.jsinflated: media/js/public/bootstrap-treeview.min.jsinflated: media/js/public/bootstrap.min.jsinflated: media/js/public/jquery.jsinflated: media/js/public/morris.min.jsinflated: media/js/public/navbar.jsinflated: media/js/public/raphael.min.jsinflated: WEB-INF/classes/mbean-quartz.xmlinflated: WEB-INF/classes/offsets-quartz.xmlinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/AccountController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/AlarmController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/BaseController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/ClusterController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/ConsumersController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/DashboardController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/ErrorPageController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/MetricsController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/OffsetController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/ResourcesController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/RoleController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/StartupListener$ContextSchema.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/StartupListener$RunTask.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/StartupListener.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/controller/TopicController.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/dao/MBeanDao.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/dao/MBeanDao.xmlinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/dao/ResourcesDao.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/dao/ResourcesDao.xmlinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/dao/RoleDao.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/dao/RoleDao.xmlinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/dao/UserDao.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/dao/UserDao.xmlinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/pojo/Role.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/pojo/RoleResource.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/pojo/Signiner.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/pojo/UserRole.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/quartz/MBeanQuartz.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/quartz/OffsetsQuartz.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/AccountService.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/AlarmService.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/ClusterService.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/ConsumerService.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/DashboardService.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/impl/AccountServiceImpl.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/impl/AlarmServiceImpl.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/impl/ClusterServiceImpl.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/impl/ConsumerServiceImpl.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/impl/DashboardServiceImpl.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/impl/MetricsServiceImpl.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/impl/OffsetServiceImpl.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/impl/ResourceServiceImpl.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/impl/RoleServiceImpl.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/impl/TopicServiceImpl.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/MetricsService.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/OffsetService.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/ResourceService.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/RoleService.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/service/TopicService.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/sso/filter/SSOFilter.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/sso/filter/SSORealm.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/sso/pojo/Resources.classinflated: WEB-INF/classes/org/smartloli/kafka/eagle/web/sso/pojo/SSOAuthenticationToken.classinflated: WEB-INF/classes/shiro-ehcache.xmlinflated: WEB-INF/classes/spring-mvc.xmlinflated: WEB-INF/classes/spring-mybatis.xmlinflated: WEB-INF/classes/spring-shiro.xmlinflated: WEB-INF/lib/activation-1.1.jarinflated: WEB-INF/lib/aopalliance-1.0.jarinflated: WEB-INF/lib/aspectjrt-1.8.10.jarinflated: WEB-INF/lib/aspectjweaver-1.8.10.jarinflated: WEB-INF/lib/c3p0-0.9.1.1.jarinflated: WEB-INF/lib/calcite-core-1.6.0.jarinflated: WEB-INF/lib/calcite-linq4j-1.6.0.jarinflated: WEB-INF/lib/commons-beanutils-1.8.3.jarinflated: WEB-INF/lib/commons-codec-1.2.jarinflated: WEB-INF/lib/commons-compiler-3.0.6.jarinflated: WEB-INF/lib/commons-dbcp-1.2.2.jarinflated: WEB-INF/lib/commons-httpclient-3.0.jarinflated: WEB-INF/lib/commons-io-2.4.jarinflated: WEB-INF/lib/commons-lang-2.6.jarinflated: WEB-INF/lib/commons-lang3-3.5.jarinflated: WEB-INF/lib/commons-logging-1.1.2.jarinflated: WEB-INF/lib/commons-pool-1.3.jarinflated: WEB-INF/lib/dom4j-1.6.1.jarinflated: WEB-INF/lib/druid-1.0.31.jarinflated: WEB-INF/lib/ehcache-core-2.5.3.jarinflated: WEB-INF/lib/eigenbase-properties-1.1.5.jarinflated: WEB-INF/lib/fastjson-1.2.7.jarinflated: WEB-INF/lib/gson-2.2.4.jarinflated: WEB-INF/lib/guava-19.0.jarinflated: WEB-INF/lib/jackson-annotations-2.8.0.jarinflated: WEB-INF/lib/jackson-core-2.8.7.jarinflated: WEB-INF/lib/jackson-core-asl-1.9.13.jarinflated: WEB-INF/lib/jackson-databind-2.8.7.jarinflated: WEB-INF/lib/jackson-mapper-asl-1.9.13.jarinflated: WEB-INF/lib/janino-3.0.6.jarinflated: WEB-INF/lib/jline-0.9.94.jarinflated: WEB-INF/lib/jopt-simple-5.0.3.jarinflated: WEB-INF/lib/jsr305-1.3.9.jarinflated: WEB-INF/lib/jstl-1.2.jarinflated: WEB-INF/lib/junit-3.8.1.jarinflated: WEB-INF/lib/kafka-clients-0.10.2.0.jarinflated: WEB-INF/lib/kafka-eagle-api-1.2.0.jarinflated: WEB-INF/lib/kafka-eagle-common-1.2.0.jarinflated: WEB-INF/lib/kafka-eagle-core-1.2.0.jarinflated: WEB-INF/lib/kafka-eagle-plugin-1.2.0.jarinflated: WEB-INF/lib/kafka_2.11-0.10.2.0.jarinflated: WEB-INF/lib/log4j-1.2.17.jarinflated: WEB-INF/lib/lz4-1.3.0.jarinflated: WEB-INF/lib/mail-1.4.7.jarinflated: WEB-INF/lib/metrics-core-2.2.0.jarinflated: WEB-INF/lib/mybatis-3.2.6.jarinflated: WEB-INF/lib/mybatis-spring-1.2.2.jarinflated: WEB-INF/lib/mysql-connector-java-5.1.30.jarinflated: WEB-INF/lib/netty-3.7.0.Final.jarinflated: WEB-INF/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jarinflated: WEB-INF/lib/quartz-2.2.1.jarinflated: WEB-INF/lib/scala-library-2.11.8.jarinflated: WEB-INF/lib/scala-parser-combinators_2.11-1.0.4.jarinflated: WEB-INF/lib/servlet-api-2.5.jarinflated: WEB-INF/lib/shiro-core-1.3.2.jarinflated: WEB-INF/lib/shiro-ehcache-1.3.2.jarinflated: WEB-INF/lib/shiro-spring-1.3.2.jarinflated: WEB-INF/lib/shiro-web-1.3.2.jarinflated: WEB-INF/lib/slf4j-api-1.6.6.jarinflated: WEB-INF/lib/slf4j-log4j12-1.7.5.jarinflated: WEB-INF/lib/snappy-java-1.1.2.6.jarinflated: WEB-INF/lib/spring-aop-4.1.6.RELEASE.jarinflated: WEB-INF/lib/spring-beans-4.1.6.RELEASE.jarinflated: WEB-INF/lib/spring-context-4.1.6.RELEASE.jarinflated: WEB-INF/lib/spring-context-support-4.1.6.RELEASE.jarinflated: WEB-INF/lib/spring-core-4.1.6.RELEASE.jarinflated: WEB-INF/lib/spring-expression-4.1.6.RELEASE.jarinflated: WEB-INF/lib/spring-jdbc-4.1.6.RELEASE.jarinflated: WEB-INF/lib/spring-oxm-4.1.6.RELEASE.jarinflated: WEB-INF/lib/spring-test-4.1.6.RELEASE.jarinflated: WEB-INF/lib/spring-tx-4.1.6.RELEASE.jarinflated: WEB-INF/lib/spring-web-4.1.6.RELEASE.jarinflated: WEB-INF/lib/spring-webmvc-4.1.6.RELEASE.jarinflated: WEB-INF/lib/sqlite-jdbc-3.20.0.jarinflated: WEB-INF/lib/xml-apis-1.0.b2.jarinflated: WEB-INF/lib/zkclient-0.9.jarinflated: WEB-INF/lib/zookeeper-3.4.8.jarinflated: WEB-INF/views/account/signin.jspinflated: WEB-INF/views/alarm/add.jspinflated: WEB-INF/views/alarm/add_failed.jspinflated: WEB-INF/views/alarm/add_success.jspinflated: WEB-INF/views/alarm/modify.jspinflated: WEB-INF/views/cluster/cluster.jspinflated: WEB-INF/views/cluster/multicluster.jspinflated: WEB-INF/views/cluster/zkcli.jspinflated: WEB-INF/views/consumers/consumers.jspinflated: WEB-INF/views/consumers/offset_consumers.jspinflated: WEB-INF/views/consumers/offset_realtime.jspinflated: WEB-INF/views/error/403.jspinflated: WEB-INF/views/error/404.jspinflated: WEB-INF/views/error/405.jspinflated: WEB-INF/views/error/500.jspinflated: WEB-INF/views/error/503.jspinflated: WEB-INF/views/main/index.jspinflated: WEB-INF/views/metrics/brokers.jspinflated: WEB-INF/views/metrics/trend.jspinflated: WEB-INF/views/public/css.jspinflated: WEB-INF/views/public/kindeditor.jspinflated: WEB-INF/views/public/navbar.jspinflated: WEB-INF/views/public/script.jspinflated: WEB-INF/views/public/tagcss.jspinflated: WEB-INF/views/public/tcss.jspinflated: WEB-INF/views/public/tscript.jspinflated: WEB-INF/views/system/notice.jspinflated: WEB-INF/views/system/resource.jspinflated: WEB-INF/views/system/role.jspinflated: WEB-INF/views/system/user.jspinflated: WEB-INF/views/topic/add_failed.jspinflated: WEB-INF/views/topic/add_success.jspinflated: WEB-INF/views/topic/create.jspinflated: WEB-INF/views/topic/list.jspinflated: WEB-INF/views/topic/mock.jspinflated: WEB-INF/views/topic/msg.jspinflated: WEB-INF/views/topic/topic_meta.jspinflated: WEB-INF/web.xmlcreated: META-INF/maven/created: META-INF/maven/org.smartloli.kafka.eagle/created: META-INF/maven/org.smartloli.kafka.eagle/kafka-eagle-web/inflated: META-INF/maven/org.smartloli.kafka.eagle/kafka-eagle-web/pom.xmlinflated: META-INF/maven/org.smartloli.kafka.eagle/kafka-eagle-web/pom.properties
*******************************************************************
* Kafka Eagle system monitor port successful... *
*******************************************************************
Status Code[0]
[Job done!]
Welcome to__ __ ___ ____ __ __ ___ ______ ___ ______ __ ______/ //_/ / | / __/ / //_/ / | / ____/ / | / ____/ / / / ____// ,___
/_/ |_| /_/ |_|/_/ /_/ |_| /_/ |_| /_____/ /_/ |_|\____/ /_____//_____/
Version 1.2.0
*******************************************************************
* Kafka Eagle Service has started success! *
* Welcome, Now you can visit &＃39;http://:port/ke&＃39; *
* Account:admin ,Password:123456 *
*******************************************************************
* ke.sh [start|status|stop|restart|stats] *
* http://ke.smartloli.org/ *
*******************************************************************
[root&＃64;node105 kafka-eagle]#

[root&＃64;node105 kafka-eagle]# ke.sh start　　　　　　　　#启动Kafka Eagle系统

6>.启动成功的标志

7>.遇到的一系列坑

　　启动时报错如下&＃xff1a;

[root&＃64;node105 kafka-eagle]# ke.sh start
Starting : KE Service Check ...
Error: The JAVA_HOME environment variable is not defined correctly.
Error: This environment variable is needed to run this program.
[root&＃64;node105 kafka-eagle]#

 

　　查看启动脚本&＃xff08;vi /soft/kafka-eagle/bin/ke.sh &＃xff09; 

发现我的java环境已经配置好啦&＃xff5e;可以直接查看相应的环境变量&＃xff5e;

[root&＃64;node105 kafka-eagle]# java -version
java version "1.8.0_131"
Java(TM) SE Runtime Environment (build 1.8.0_131-b11)
Java HotSpot(TM) 64-Bit Server VM (build 25.131-b11, mixed mode)
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]# echo $JAVA_HOME
/soft/jdk
[root&＃64;node105 kafka-eagle]#

　　解决方案如下&＃xff1a;

8>.查看端口是否存在

[root&＃64;node105 kafka-eagle]# hostname
node105.yinzhengjie.org.cn
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]#
[root&＃64;node105 kafka-eagle]# netstat -untalp | grep 8048
tcp6 0 0 :::8048 :::* LISTEN 5184/java
[root&＃64;node105 kafka-eagle]#

9>.访问kafka eagle的webUI服务&＃xff08;用户名&＃xff1a;admin&＃xff0c;密码&＃xff1a;123456&＃xff09;

http://node105.yinzhengjie.org.cn:8048/ke/

10>.登陆成功的界面如下

 

 

三.Kafka Eagle快速入门

　　都已经部署成功了&＃xff0c;剩下给大家介绍界面的功能感觉是多余的&＃xff0c;不过大家也别嫌我啰嗦&＃xff0c;部署成功了&＃xff0c;大家点点鼠标也就知道咋回事了&＃xff5e;其实和Kafka manager差不多多少&＃xff5e;只不过功能要比kafka manager更多一点而已啦&＃xff01;

1>.创建topic

2>.查看topic

 

3>.kafka SQL查询界面&＃xff08;我没咋用过哈&＃xff5e;有时间可以研究研究&＃xff5e;&＃xff09;

 

4>.发送消息到指定的topic

 

　　别忘了启动一个消费者进行测试&＃xff0c;查看是否能拿到数据&＃xff0c;很显然&＃xff0c;我是拿到数据啦&＃xff1a;

5>.查看所有消费者的情况

 

6>.查看正在监控的集群

 

7>.监控多个kafka集群

 

8>.zookeeper客户端操作命令

 

9>.性能指标监控&＃xff08;broker总的流量监控&＃xff09;

 

10>.通过JMX获取数据&＃xff0c;监控Kafka客户端&＃xff0c;生产端&＃xff0c;消息数量&＃xff0c;请求数量&＃xff0c;处理时间和其他数据&＃xff0c;以可视化性能。

11>.kafka系统管理

 

12>.关于kafka Eagle脚本的命令

　　详情请参考官网&＃xff1a;https://ke.smartloli.org/3.Manuals/6.Shell.html。说句实话&＃xff0c;我一般不咋夸人&＃xff0c;这家公司官网的图解做的很好&＃xff0c;在这里&＃xff0c;我本人希望Kafka Eagle功能越来越强&＃xff0c;比如支持微信&＃xff0c;集群压力测试等等。

 

转:https://www.cnblogs.com/yinzhengjie/p/9957389.html



推荐阅读
  • int

    VScode格式化文档换行或不换行的设置方法

    VScode格式化文档换行或不换行的设置方法
    本文介绍了在VScode中设置格式化文档换行或不换行的方法，包括使用插件和修改settings.json文件的内容。详细步骤为：找到settings.json文件，将其中的代码替换为指定的代码。 ... [详细]
  • string

    Go Cobra命令行工具入门教程

    Go Cobra命令行工具入门教程
    本文介绍了Go语言实现的命令行工具Cobra的基本概念、安装方法和入门实践。Cobra被广泛应用于各种项目中，如Kubernetes、Hugo和Github CLI等。通过使用Cobra，我们可以快速创建命令行工具，适用于写测试脚本和各种服务的Admin CLI。文章还通过一个简单的demo演示了Cobra的使用方法。 ... [详细]
  • express

    可见性与scope的命名规范和变量生命周期

    本文介绍了在Go语言中可见性与scope的规则，包括在函数内外声明的可见性、命名规范和命名风格，以及变量声明和短变量声明的语法。同时，还介绍了变量的生命周期，包括包级别变量和局部变量的生命周期，以及变量在堆和栈上分配的规则和逃逸分析的概念。 ... [详细]
  • less

    微软头条实习生分享深度学习自学指南

    微软头条实习生分享深度学习自学指南
    本文介绍了一位微软头条实习生自学深度学习的经验分享，包括学习资源推荐、重要基础知识的学习要点等。作者强调了学好Python和数学基础的重要性，并提供了一些建议。 ... [详细]
  • less

    Webpack5内置处理图片资源的配置方法

    Webpack5内置处理图片资源的配置方法
    本文介绍了在Webpack5中处理图片资源的配置方法。在Webpack4中，我们需要使用file-loader和url-loader来处理图片资源，但是在Webpack5中，这两个Loader的功能已经被内置到Webpack中，我们只需要简单配置即可实现图片资源的处理。本文还介绍了一些常用的配置方法，如匹配不同类型的图片文件、设置输出路径等。通过本文的学习，读者可以快速掌握Webpack5处理图片资源的方法。 ... [详细]
  • int

    在Windows 8上安装gvim中的插件的错误加载问题

    本文讨论了在Windows 8上安装gvim中插件时出现的错误加载问题。作者将EasyMotion插件放在了正确的位置，但加载时却出现了错误。作者提供了下载链接和之前放置插件的位置，并列出了出现的错误信息。 ... [详细]
  • int

    CSS3选择器的使用方法详解，提高Web开发效率和精准度

    CSS3选择器的使用方法详解，提高Web开发效率和精准度
    本文详细介绍了CSS3新增的选择器方法，包括属性选择器的使用。通过CSS3选择器，可以提高Web开发的效率和精准度，使得查找元素更加方便和快捷。同时，本文还对属性选择器的各种用法进行了详细解释，并给出了相应的代码示例。通过学习本文，读者可以更好地掌握CSS3选择器的使用方法，提升自己的Web开发能力。 ... [详细]
  • dagger

    Android Studio Bumblebee | 2021.1.1（大黄蜂版本使用介绍）

    Android Studio Bumblebee | 2021.1.1（大黄蜂版本使用介绍）
    本文介绍了Android Studio Bumblebee | 2021.1.1（大黄蜂版本）的使用方法和相关知识，包括Gradle的介绍、设备管理器的配置、无线调试、新版本问题等内容。同时还提供了更新版本的下载地址和启动页面截图。 ... [详细]
  • string

    知识图谱——机器大脑中的知识库

    知识图谱——机器大脑中的知识库
    本文介绍了知识图谱在机器大脑中的应用，以及搜索引擎在知识图谱方面的发展。以谷歌知识图谱为例，说明了知识图谱的智能化特点。通过搜索引擎用户可以获取更加智能化的答案，如搜索关键词"Marie Curie"，会得到居里夫人的详细信息以及与之相关的历史人物。知识图谱的出现引起了搜索引擎行业的变革，不仅美国的微软必应，中国的百度、搜狗等搜索引擎公司也纷纷推出了自己的知识图谱。 ... [详细]
  • string

    推荐系统遇上深度学习(十七）详解推荐系统中的常用评测指标

    推荐系统遇上深度学习(十七）详解推荐系统中的常用评测指标
    原创：石晓文小小挖掘机2018-06-18笔者是一个痴迷于挖掘数据中的价值的学习人，希望在平日的工作学习中，挖掘数据的价值， ... [详细]
  • int

    Linux下Perl的安装及第一个程序运行

    本文介绍了在Linux下安装Perl的步骤，并提供了一个简单的Perl程序示例。同时，还展示了运行该程序的结果。 ... [详细]
  • ip

    Linux下Kafka单机安装配置方法（实操成功）

    本文介绍了在Linux下安装和配置Kafka的方法，包括安装JDK、下载和解压Kafka、配置Kafka的参数，以及配置Kafka的日志目录、服务器IP和日志存放路径等。同时还提供了单机配置部署的方法和zookeeper地址和端口的配置。通过实操成功的案例，帮助读者快速完成Kafka的安装和配置。 ... [详细]
  • int

    【openwrt】设备mt7628关于wan侧eth0.1 mac地址固定的问题

    本文讨论了在openwrt-17.01版本中，mt7628设备上初始化启动时eth0的mac地址总是随机生成的问题。每次随机生成的eth0的mac地址都会写到/sys/class/net/eth0/address目录下，而openwrt-17.01原版的SDK会根据随机生成的eth0的mac地址再生成eth0.1、eth0.2等，生成后的mac地址会保存在/etc/config/network下。 ... [详细]
  • join

    VueCLI多页分目录打包的步骤记录

    VueCLI多页分目录打包的步骤记录
    本文介绍了使用VueCLI进行多页分目录打包的步骤，包括页面目录结构、安装依赖、获取Vue CLI需要的多页对象等内容。同时还提供了自定义不同模块页面标题的方法。 ... [详细]
  • bash

    Android Studio命令行使用gradle及解决常见问题的方法

    本文介绍了在Android Studio中使用命令行build gradle的方法，并解决了一些常见问题，包括手动配置gradle环境变量和解决External Native Build Issues的方法。同时提供了相关参考文章链接。 ... [详细]
author-avatar
手机用户2502863305
这个家伙很懒，什么也没留下！
Tags | 热门标签
RankList | 热门文章
PHP1.CN | 中国最专业的PHP中文社区 | DevBox开发工具箱 | json解析格式化 |PHP资讯 | PHP教程 | 数据库技术 | 服务器技术 | 前端开发技术 | PHP框架 | 开发工具 | 在线工具
Copyright © 1998 - 2020 PHP1.CN. All Rights Reserved | 京公网安备 11010802041100号 | 京ICP备19059560号-4 | PHP1.CN 第一PHP社区 版权所有