热门标签 | HotTags
当前位置:  开发笔记 > 编程语言 > 正文

报错:Error,CMserverguidupdated,expectedxxxxx,receivedxxxxx(未解决)

报错背景:CDH断电重启后,cloudera-scm-server启动报错,cloudera-scm-server已死,但pid文件仍存由于没有成熟的解决方案,于是我就重新安装了M

报错背景:

CDH断电重启后,cloudera-scm-server启动报错,

cloudera-scm-server 已死,但 pid 文件仍存

由于没有成熟的解决方案,于是我就重新安装了MySQL数据库,

并且重新赋予了各种权限。

这个时候cloudera-scm-server可以启动成功,cloudera-scm-agent也可以启动成功。


报错现象:

此时cloudera-scm-server和cloudera-scm-agent都能启动成功,

但是jps一下,没有服务

明明启动了agent,但是下面的服务都起不来。


报错原因:

这个时候就要看一下日志文件cloudera-scm-agent.log

tail -n 100 /opt/cm-5.15.1/log/cloudera-scm-agent/cloudera-scm-agent.log

看到一行报错


[root@master opt]# tail -n 100 /opt/cm-5.15.1/log/cloudera-scm-agent/cloudera-scm-agent.log
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '4754', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop-0.20-mapreduce/sbin/Linux/task-controller']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml oozie oozie
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml oozie oozie
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/ssl-server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml httpfs httpfs
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'httpfs:httpfs', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.dist/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/server.xml oozie oozie
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml oozie oozie
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/ssl/ssl-server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/server.xml oozie oozie
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/server.xml oozie oozie
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml oozie oozie
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http/conf/ssl/ssl-server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/sqoop2/tomcat-conf.mr1/conf/server.xml sqoop2 sqoop
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'sqoop2:sqoop', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/sqoop2/tomcat-conf.mr1/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/sqoop2/tomcat-conf.mr1/conf/server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/sqoop2/tomcat-conf.mr1/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop hue hue
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'hue:hue', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop 0755
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0755', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml httpfs httpfs
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'httpfs:httpfs', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hadoop-httpfs/tomcat-conf.https/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/server.xml oozie oozie
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https/conf/ssl/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/server.xml oozie oozie
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.https.mr1/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/solr/tomcat-conf.https/conf/server.xml solr solr
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'solr:solr', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/solr/tomcat-conf.https/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/solr/tomcat-conf.https/conf/server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/solr/tomcat-conf.https/conf/server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml oozie oozie
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chown', 'oozie:oozie', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml 0750
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['chmod', '0750', u'/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/oozie/tomcat-conf.http.mr1/conf/ssl/ssl-server.xml']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Ensuring users/groups exist for new parcel KAFKA-3.1.1-1.3.1.1.p0.2.
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kafka']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kafka']
[29/Apr/2019 10:35:14 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kafka', '-K', 'UMASK=022', '--home', '/var/lib/kafka', '--comment', 'Kafka', '--shell', '/sbin/nologin', 'kafka']
[29/Apr/2019 10:35:15 +0000] 2754 MainThread parcel INFO Ensuring correct file permissions for new parcel KAFKA-3.1.1-1.3.1.1.p0.2.
[29/Apr/2019 10:35:15 +0000] 2754 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[29/Apr/2019 10:35:16 +0000] 2754 MainThread client_configs INFO Loaded client config: <90,8014743985700882227>
[29/Apr/2019 10:35:16 +0000] 2754 MainThread client_configs INFO Loaded client config: <92,-2128374979962437415>
[29/Apr/2019 10:35:16 +0000] 2754 MainThread client_configs INFO Loaded client config: <50,-352371731053066898>
[29/Apr/2019 10:35:16 +0000] 2754 MainThread client_configs INFO Loaded client config: <90,-3132036662857147630>
[29/Apr/2019 10:35:16 +0000] 2754 MainThread client_configs INFO Loaded client config: <90,-8675592532172053281>
[29/Apr/2019 10:35:16 +0000] 2754 MainThread agent ERROR Error, CM server guid updated, expected f4ec230a-2f55-460f-b132-cb45a16c3a1b, received 4760feb5-8e8c-416c-8337-2910fef890a0
[29/Apr/2019 10:35:18 +0000] 2754 MainThread agent INFO CM server guid: f4ec230a-2f55-460f-b132-cb45a16c3a1b
[29/Apr/2019 10:35:18 +0000] 2754 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[29/Apr/2019 10:35:18 +0000] 2754 MainThread agent WARNING Expected user root for /opt/cloudera/parcels but was cloudera-scm
[29/Apr/2019 10:35:18 +0000] 2754 MainThread agent WARNING Expected group root for /opt/cloudera/parcels but was cloudera-scm
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Agent does create users/groups and apply file permissions
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Loading parcel manifest for: CDH-5.15.1-1.cdh5.15.1.p0.4
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Loading parcel manifest for: KAFKA-3.1.1-1.3.1.1.p0.2
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Ensuring users/groups exist for new parcel CDH-5.15.1-1.cdh5.15.1.p0.4.
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hadoop']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'flume']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hdfs']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'solr']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'zookeeper']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'llama']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'httpfs']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'mapred']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sqoop']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'yarn']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kms']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hive']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sqoop2']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'oozie']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kudu']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hbase']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sentry']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'impala']
[29/Apr/2019 10:35:18 +0000] 2754 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'spark']
日志文件

意思就是:CM服务器guid更新,期望f4ec230a-2f55-460f-b132-cb45a16c3a1b,收到4760feb5-8e8c-416c-8337-2910fef890a0

一看就是和CM的guid有关系,所以就从这方面着手解决问题。


报错解决:

[root@master var]# find / -name cm_guid     # 找到cm_guid这个文件所在的目录
/opt/cm-5.15.1/lib/cloudera-scm-agent/cm_guid
[root@master var]# rm -rf /opt/cm-5.15.1/lib/cloudera-scm-agent/cm_guid  # 删除这个目录(所有节点)
[root@master var]# /opt/cm-5.15.1/etc/init.d/cloudera-scm-agent restart   # 重启

但是重启之后,jps还是没有各个服务进程

再次查看报错日志

tail -n 100 /opt/cm-5.15.1/log/cloudera-scm-agent/cloudera-scm-agent.log


[29/Apr/2019 11:25:16 +0000] 31741 MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-topics', '/usr/bi-topics', 'bin/kafka-topics', '10', 'False']
[29/Apr/2019 11:25:16 +0000] 31741 MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-consumer-perf-tessr/bin/kafka-consumer-perf-test', 'bin/kafka-consumer-perf-test', '10', 'False']
[29/Apr/2019 11:25:16 +0000] 31741 MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-config', '/usr/bi-config', 'bin/kafka-config', '10', 'False']
[29/Apr/2019 11:25:16 +0000] 31741 MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-consumer-offset-c, '/usr/bin/kafka-consumer-offset-checker', 'bin/kafka-consumer-offset-checker', '10', 'False']
[29/Apr/2019 11:25:16 +0000] 31741 MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-preferred-replicaon', '/usr/bin/kafka-preferred-replica-election', 'bin/kafka-preferred-replica-election', '10', 'False']
[29/Apr/2019 11:25:16 +0000] 31741 MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-producer-perf-tessr/bin/kafka-producer-perf-test', 'bin/kafka-producer-perf-test', '10', 'False']
[29/Apr/2019 11:25:16 +0000] 31741 MainThread parcel INFO Executing command ['/opt/cm-5.15.1/lib64/cmf/service/common/alternatives.sh', 'deactivate', 'kafka-console-producer'/bin/kafka-console-producer', 'bin/kafka-console-producer', '10', 'False']
[29/Apr/2019 11:25:16 +0000] 31741 MainThread agent INFO Active parcel list updated; recalculating component info.
[29/Apr/2019 11:25:16 +0000] 31741 MainThread throttling_logger WARNING CMF_AGENT_JAVA_HOME environment variable host override will be deprecated in future. JAVA_HOME setting configur CM server takes precedence over host agent override. Configure JAVA_HOME setting from CM server.
[29/Apr/2019 11:25:17 +0000] 31741 MainThread throttling_logger INFO Identified java component java8 with full version java version "1.8.0_191" Java(TM) SE Runtime Environment (bui0_191-b12) Java HotSpot(TM) 64-Bit Server VM (build 25.191-b12, mixed mode) for requested version .
[29/Apr/2019 11:25:17 +0000] 31741 MainThread parcel_cache INFO Deleting unmanaged parcel CDH-5.15.1-1.cdh5.15.1.p0.4
[29/Apr/2019 11:25:19 +0000] 31741 MainThread parcel_cache INFO Deleting unmanaged parcel KAFKA-3.1.1-1.3.1.1.p0.2
[29/Apr/2019 11:25:19 +0000] 31741 MainThread client_configs INFO Client configs to delete: set([, , , ])
[29/Apr/2019 11:25:19 +0000] 31741 MainThread client_configs INFO Client configs to deploy: set([])
[29/Apr/2019 11:25:19 +0000] 31741 MainThread client_configs INFO Client configs to update: set([])
[29/Apr/2019 11:25:19 +0000] 31741 MainThread client_configs INFO Removing alternative: kafka-conf, /etc/kafka/conf.cloudera.kafka
[29/Apr/2019 11:25:19 +0000] 31741 MainThread client_configs INFO Removing alternative: hadoop-conf, /etc/hadoop/conf.cloudera.yarn
[29/Apr/2019 11:25:19 +0000] 31741 MainThread client_configs INFO Removing alternative: hbase-conf, /etc/hbase/conf.cloudera.hbase
[29/Apr/2019 11:25:19 +0000] 31741 MainThread client_configs INFO Removing alternative: hive-conf, /etc/hive/conf.cloudera.hive
[29/Apr/2019 11:25:19 +0000] 31741 MainThread client_configs INFO Removing alternative: hadoop-conf, /etc/hadoop/conf.cloudera.hdfs
[29/Apr/2019 11:25:19 +0000] 31741 MainThread agent WARNING Long HB processing time: 8.13849806786
[29/Apr/2019 11:27:22 +0000] 31741 MainThread agent INFO Stopping agent...
[29/Apr/2019 11:27:22 +0000] 31741 MainThread agent INFO No extant cgroups; unmounting any cgroup roots
[29/Apr/2019 11:27:22 +0000] 31741 MainThread agent INFO 2 processes are being managed; Supervisor will continue to run.
[29/Apr/2019 11:27:22 +0000] 31741 MainThread _cplogging INFO [29/Apr/2019:11:27:22] ENGINE Bus STOPPING
[29/Apr/2019 11:27:22 +0000] 31741 MainThread _cplogging INFO [29/Apr/2019:11:27:22] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('master', 9000)) shut down
[29/Apr/2019 11:27:22 +0000] 31741 MainThread _cplogging INFO [29/Apr/2019:11:27:22] ENGINE Stopped thread '_TimeoutMonitor'.
[29/Apr/2019 11:27:22 +0000] 31741 MainThread _cplogging INFO [29/Apr/2019:11:27:22] ENGINE Bus STOPPED
[29/Apr/2019 11:27:22 +0000] 31741 MainThread _cplogging INFO [29/Apr/2019:11:27:22] ENGINE Bus STOPPING
[29/Apr/2019 11:27:22 +0000] 31741 MainThread _cplogging INFO [29/Apr/2019:11:27:22] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('master', 9000)) already shut down
[29/Apr/2019 11:27:22 +0000] 31741 MainThread _cplogging INFO [29/Apr/2019:11:27:22] ENGINE No thread running for None.
[29/Apr/2019 11:27:22 +0000] 31741 MainThread _cplogging INFO [29/Apr/2019:11:27:22] ENGINE Bus STOPPED
[29/Apr/2019 11:27:22 +0000] 31741 MainThread _cplogging INFO [29/Apr/2019:11:27:22] ENGINE Bus EXITING
[29/Apr/2019 11:27:22 +0000] 31741 MainThread _cplogging INFO [29/Apr/2019:11:27:22] ENGINE Bus EXITED
[29/Apr/2019 11:27:22 +0000] 31741 MainThread agent INFO Agent exiting; caught signal 15
[29/Apr/2019 11:27:22 +0000] 31741 Dummy-14 daemonize WARNING Stopping daemon.
[29/Apr/2019 11:27:23 +0000] 15811 MainThread __init__ INFO Agent UUID file was last modified at 2019-04-01 08:40:41.829000
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO ================================================================================
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO SCM Agent Version: 5.15.1
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO Agent Protocol Version: 4
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO Using Host ID: 956d89c6-e7df-48c2-916b-f2eefd5a058f
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO Using directory: /opt/cm-5.15.1/run/cloudera-scm-agent
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO Using supervisor binary path: /opt/cm-5.15.1/lib64/cmf/agent/build/env/bin/supervisord
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTunication. These options can be configured in this agent's config.ini file to enable certificate validation.
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO Agent Logging Level: INFO
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO No command line vars
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using this database type)
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using this database type)
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO Found database jar: /opt/cm-5.15.1/share/cmf/lib/postgresql-42.1.4.jre7.jar
[29/Apr/2019 11:27:23 +0000] 15811 MainThread agent INFO Agent starting as pid 15811 user root(0) group root(0).
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15.1/run/cloudera-scm-agent/cgroups
[29/Apr/2019 11:27:25 +0000] 15811 MainThread cgroups INFO Found existing subsystem blkio at /sys/fs/cgroup/blkio
[29/Apr/2019 11:27:25 +0000] 15811 MainThread cgroups INFO Found existing subsystem cpuacct at /sys/fs/cgroup/cpu,cpuacct
[29/Apr/2019 11:27:25 +0000] 15811 MainThread cgroups INFO Found existing subsystem cpu at /sys/fs/cgroup/cpu,cpuacct
[29/Apr/2019 11:27:25 +0000] 15811 MainThread cgroups INFO Found existing subsystem memory at /sys/fs/cgroup/memory
[29/Apr/2019 11:27:25 +0000] 15811 MainThread cgroups INFO Found cgroups subsystem: cpu
[29/Apr/2019 11:27:25 +0000] 15811 MainThread cgroups INFO Found cgroups subsystem: cpuacct
[29/Apr/2019 11:27:25 +0000] 15811 MainThread cgroups INFO Found cgroups subsystem: memory
[29/Apr/2019 11:27:25 +0000] 15811 MainThread cgroups INFO Found cgroups subsystem: blkio
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Found cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes': 8796093022207, 'default_memory_sof_in_bytes': 8796093022207, 'writable_cgroup_dot_procs': True, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True, 'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_cpuacue, 'has_blkio': True}
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Setting up supervisord event monitor.
[29/Apr/2019 11:27:25 +0000] 15811 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[29/Apr/2019 11:27:25 +0000] 15811 MainThread filesystem_map INFO Using timeout of 2.000000
[29/Apr/2019 11:27:25 +0000] 15811 MainThread filesystem_map INFO Using join timeout of 0.100000
[29/Apr/2019 11:27:25 +0000] 15811 MainThread filesystem_map INFO Using tolerance of 60.000000
[29/Apr/2019 11:27:25 +0000] 15811 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs']
[29/Apr/2019 11:27:25 +0000] 15811 MainThread kt_renewer INFO Agent wide credential cache set to /opt/cm-5.15.1/run/cloudera-scm-agent/krb5cc_cm_agent_0
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Using max_collection_wait_seconds of 10.000000
[29/Apr/2019 11:27:25 +0000] 15811 MainThread metrics INFO Importing tasktracker metric schema from file /opt/cm-5.15.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/c.1-py2.7.egg/cmf/monitor/tasktracker/schema.json
[29/Apr/2019 11:27:25 +0000] 15811 MainThread ntp_monitor INFO Using timeout of 2.000000
[29/Apr/2019 11:27:25 +0000] 15811 MainThread dns_names INFO Using timeout of 30.000000
[29/Apr/2019 11:27:25 +0000] 15811 MainThread __init__ INFO Created DNS monitor.
[29/Apr/2019 11:27:25 +0000] 15811 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880
[29/Apr/2019 11:27:25 +0000] 15811 MainThread __init__ INFO Importing metric schema from file /opt/cm-5.15.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.15.1-py/cmf/monitor/schema.json
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUE: '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/opt/cm-5.15.1/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/opt/cm-5.15.1cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CDH_HUE_PLUGINS_'/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_'/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usrytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/opt/cm-5.15.1/share/cmf/libesql-42.1.4.jre7.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.disat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-or-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'ROOT': '/opt/cm-5.15.1/lib64/cmf', 'COP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/ 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are nothen CDH is installed from parcels.
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15.1/run/cloudera-scm-agent/process
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15.1/run/cloudera-scm-agent/supervisor
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15.1/run/cloudera-scm-agent/flood
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Re-using pre-existing directory: /opt/cm-5.15.1/run/cloudera-scm-agent/supervisor/include
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Supervisor version: 3.0, pid: 3341
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Connecting to previous supervisor: agent-2721-1556504529.
[29/Apr/2019 11:27:25 +0000] 15811 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes.
[29/Apr/2019 11:27:25 +0000] 15811 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes.
[29/Apr/2019 11:27:25 +0000] 15811 MainThread _cplogging INFO [29/Apr/2019:11:27:25] ENGINE Bus STARTING
[29/Apr/2019 11:27:25 +0000] 15811 MainThread _cplogging INFO [29/Apr/2019:11:27:25] ENGINE Started monitor thread '_TimeoutMonitor'.
[29/Apr/2019 11:27:25 +0000] 15811 MainThread _cplogging INFO [29/Apr/2019:11:27:25] ENGINE Serving on master:9000
[29/Apr/2019 11:27:25 +0000] 15811 MainThread _cplogging INFO [29/Apr/2019:11:27:25] ENGINE Bus STARTED
[29/Apr/2019 11:27:25 +0000] 15811 MainThread __init__ INFO New monitor: (,)
[29/Apr/2019 11:27:25 +0000] 15811 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('HostMonitor',)
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Setting default socket timeout to 45
[29/Apr/2019 11:27:25 +0000] 15811 Monitor-HostMonitor network_interfaces INFO NIC iface eth0 doesn't support ETHTOOL (95)
[29/Apr/2019 11:27:25 +0000] 15811 Monitor-HostMonitor throttling_logger ERROR Error getting directory attributes for /opt/cm-5.15.1/log/cloudera-scm-agent
Traceback (most recent call last):
File "/opt/cm-5.15.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.15.1-py2.7.egg/cmf/monitor/dir_monitor.py", line 90, in _get_directory_attributes
name = pwd.getpwuid(uid)[0]
KeyError: 'getpwuid(): uid not found: 1106'
[29/Apr/2019 11:27:25 +0000] 15811 MainThread heartbeat_tracker INFO HB stats (seconds): num:1 LIFE_MIN:0.03 min:0.03 mean:0.03 max:0.03 LIFE_MAX:0.03
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO CM server guid: 4760feb5-8e8c-416c-8337-2910fef890a0
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent WARNING Expected user root for /opt/cloudera/parcels but was cloudera-scm
[29/Apr/2019 11:27:25 +0000] 15811 MainThread agent WARNING Expected group root for /opt/cloudera/parcels but was cloudera-scm
[29/Apr/2019 11:27:25 +0000] 15811 MainThread parcel INFO Agent does create users/groups and apply file permissions
[29/Apr/2019 11:27:25 +0000] 15811 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[29/Apr/2019 11:27:25 +0000] 15811 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[29/Apr/2019 11:27:26 +0000] 15811 MainThread agent INFO Flood daemon (re)start attempt
[29/Apr/2019 11:27:27 +0000] 15811 MainThread agent INFO Triggering supervisord update.
[29/Apr/2019 11:27:28 +0000] 15811 MainThread agent INFO Active parcel list updated; recalculating component info.
[29/Apr/2019 11:27:28 +0000] 15811 MainThread throttling_logger WARNING CMF_AGENT_JAVA_HOME environment variable host override will be deprecated in future. JAVA_HOME setting configur CM server takes precedence over host agent override. Configure JAVA_HOME setting from CM server.
[29/Apr/2019 11:27:29 +0000] 15811 MainThread throttling_logger INFO Identified java component java8 with full version java version "1.8.0_191" Java(TM) SE Runtime Environment (bui0_191-b12) Java HotSpot(TM) 64-Bit Server VM (build 25.191-b12, mixed mode) for requested version .
报错日志

报错信息:ERROR    Error getting directory attributes for /opt/cm-5.15.1/log/cloudera-scm-agent

日志翻译:错误获取/opt/cm-5.15.1/log/cloudera-scm-agent的目录属性时出错

这个报错我找了很多资料也没有解决。

但是我发现一个现象,就是进到CDH的Web界面之后,由于uuid的改变,原来的界面都没有了,需要重新安装各种服务。

我看到这里就崩溃了,重装的CDH。


推荐阅读
  • 本文介绍了如何使用Flume从Linux文件系统收集日志并存储到HDFS,然后通过MapReduce清洗数据,使用Hive进行数据分析,并最终通过Sqoop将结果导出到MySQL数据库。 ... [详细]
  • 在Ubuntu系统中安装Android SDK的详细步骤及解决“Failed to fetch URL https://dlssl.google.com/”错误的方法
    在Ubuntu 11.10 x64系统中安装Android SDK的详细步骤,包括配置环境变量和解决“Failed to fetch URL https://dlssl.google.com/”错误的方法。本文详细介绍了如何在该系统上顺利安装并配置Android SDK,确保开发环境的稳定性和高效性。此外,还提供了解决网络连接问题的实用技巧,帮助用户克服常见的安装障碍。 ... [详细]
  • 本文详细介绍了在Linux系统上编译安装MySQL 5.5源码的步骤。首先,通过Yum安装必要的依赖软件包,如GCC、GCC-C++等,确保编译环境的完备。接着,下载并解压MySQL 5.5的源码包,配置编译选项,进行编译和安装。最后,完成安装后,进行基本的配置和启动测试,确保MySQL服务正常运行。 ... [详细]
  • Presto:高效即席查询引擎的深度解析与应用
    本文深入解析了Presto这一高效的即席查询引擎,详细探讨了其架构设计及其优缺点。Presto通过内存到内存的数据处理方式,显著提升了查询性能,相比传统的MapReduce查询,不仅减少了数据传输的延迟,还提高了查询的准确性和效率。然而,Presto在大规模数据处理和容错机制方面仍存在一定的局限性。本文还介绍了Presto在实际应用中的多种场景,展示了其在大数据分析领域的强大潜力。 ... [详细]
  • 作为软件工程专业的学生,我深知课堂上教师讲解速度之快,很多时候需要课后自行消化和巩固。因此,撰写这篇Java Web开发入门教程,旨在帮助初学者更好地理解和掌握基础知识。通过详细记录学习过程,希望能为更多像我一样在基础方面还有待提升的学员提供有益的参考。 ... [详细]
  • Hadoop 2.6 主要由 HDFS 和 YARN 两大部分组成,其中 YARN 包含了运行在 ResourceManager 的 JVM 中的组件以及在 NodeManager 中运行的部分。本文深入探讨了 Hadoop 2.6 日志文件的解析方法,并详细介绍了 MapReduce 日志管理的最佳实践,旨在帮助用户更好地理解和优化日志处理流程,提高系统运维效率。 ... [详细]
  • Ansible:自动化运维工具详解
    Ansible 是一款新兴的自动化运维工具,基于 Python 开发,集成了多种运维工具(如 Puppet、CFEngine、Chef、Func 和 Fabric)的优点,实现了批量系统配置、程序部署和命令执行等功能。本文将详细介绍 Ansible 的架构、特性和优势。 ... [详细]
  • 本文讨论了在进行 MySQL 数据迁移过程中遇到的所有 .frm 文件报错的问题,并提供了详细的解决方案和建议。 ... [详细]
  • 本文详细介绍了 InfluxDB、collectd 和 Grafana 的安装与配置流程。首先,按照启动顺序依次安装并配置 InfluxDB、collectd 和 Grafana。InfluxDB 作为时序数据库,用于存储时间序列数据;collectd 负责数据的采集与传输;Grafana 则用于数据的可视化展示。文中提供了 collectd 的官方文档链接,便于用户参考和进一步了解其配置选项。通过本指南,读者可以轻松搭建一个高效的数据监控系统。 ... [详细]
  • 如何在Linux服务器上配置MySQL和Tomcat的开机自动启动
    在Linux服务器上部署Web项目时,通常需要确保MySQL和Tomcat服务能够随系统启动而自动运行。本文将详细介绍如何在Linux环境中配置MySQL和Tomcat的开机自启动,以确保服务的稳定性和可靠性。通过合理的配置,可以有效避免因服务未启动而导致的项目故障。 ... [详细]
  • Linux系统中默认安装目录有哪些?Tomcat在Linux下的默认安装路径是什么?
    在Linux系统中,默认安装目录通常包括 `/usr`, `/opt`, 和 `/var` 等。对于Tomcat而言,在Linux下的默认安装路径通常是 `/opt/tomcat` 或者 `/usr/local/tomcat`。具体路径可能会因不同的发行版和配置而有所差异。例如,在Ubuntu Server中,Tomcat的默认安装路径通常是 `/opt/tomcat`。这些目录的选择旨在确保系统的整洁性和可维护性。 ... [详细]
  • 深入解析Struts、Spring与Hibernate三大框架的面试要点与技巧 ... [详细]
  • 服务器部署中的安全策略实践与优化
    服务器部署中的安全策略实践与优化 ... [详细]
  • 为了确保iOS应用能够安全地访问网站数据,本文介绍了如何在Nginx服务器上轻松配置CertBot以实现SSL证书的自动化管理。通过这一过程,可以确保应用始终使用HTTPS协议,从而提升数据传输的安全性和可靠性。文章详细阐述了配置步骤和常见问题的解决方法,帮助读者快速上手并成功部署SSL证书。 ... [详细]
  • 在日常的项目开发中,测试环境和生产环境通常采用HTTP协议访问服务。然而,从浏览器的角度来看,这种访问方式会被标记为不安全。为了提升安全性,当前大多数生产环境已经转向了HTTPS协议。本文将详细介绍如何在Spring Boot应用中配置SSL证书,以实现HTTPS安全访问。通过这一过程,不仅可以增强数据传输的安全性,还能提高用户对系统的信任度。 ... [详细]
author-avatar
牧羊人2602903895
这个家伙很懒,什么也没留下!
PHP1.CN | 中国最专业的PHP中文社区 | DevBox开发工具箱 | json解析格式化 |PHP资讯 | PHP教程 | 数据库技术 | 服务器技术 | 前端开发技术 | PHP框架 | 开发工具 | 在线工具
Copyright © 1998 - 2020 PHP1.CN. All Rights Reserved | 京公网安备 11010802041100号 | 京ICP备19059560号-4 | PHP1.CN 第一PHP社区 版权所有