作者:秋老虎丶_628 | 来源:互联网 | 2023-08-17 14:12
基于nutch的抓取服务,最近把nutch1.13升级到1.16, 升级后本地运行成功,远程运行失败,错误如下:
2019-11-21 16:20:22,452 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.lang.NoSuchMethodError: com.google.common.base.Objects.toStringHelper(Ljava/lang/Object;)Lcom/google/common/base/Objects$ToStringHelper;at org.apache.hadoop.metrics2.lib.MetricsRegistry.toString(MetricsRegistry.java:406)at java.lang.String.valueOf(String.java:2994)at java.lang.StringBuilder.append(StringBuilder.java:131)at org.apache.hadoop.ipc.metrics.RpcMetrics.(RpcMetrics.java:74)at org.apache.hadoop.ipc.metrics.RpcMetrics.create(RpcMetrics.java:80)at org.apache.hadoop.ipc.Server.(Server.java:2218)at org.apache.hadoop.ipc.RPC$Server.(RPC.java:938)at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.(ProtobufRpcEngine.java:534)at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:509)at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:783)at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.createServer(RpcServerFactoryPBImpl.java:169)at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:132)at org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getServer(HadoopYarnProtoRPC.java:65)at org.apache.hadoop.mapreduce.v2.app.client.MRClientService.serviceStart(MRClientService.java:119)at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1107)at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1519)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:422)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515)at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448)
2019-11-21 16:20:22,455 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting with status 1
看了下依赖,
,
确实里面已经没有 ToStringHelper 方法了。
改回之前的版本,
。
编译成功,顺利运行。