hadooptoomanyfiles异常处理

今天 hadoop 集群任务执行失败了。报错信息如下 2013-10-26 08:00:03,229 ERROR server.TThreadPoolServer TThreadPoolServer.java:run182 - Error occurred during processing of message. at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcess

今天hadoop集群任务执行失败了。报错信息如下

2013-10-26 08:00:03,229 ERROR server.TThreadPoolServer &＃40;TThreadPoolServer.java:run&＃40;182&＃41;&＃41; - Error occurred during processing of message.
    at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcessorFactory.getProcessor&＃40;HiveServer.java:553&＃41;
    at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run&＃40;TThreadPoolServer.java:169&＃41;
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask&＃40;ThreadPoolExecutor.java:886&＃41;
    at java.util.concurrent.ThreadPoolExecutor$Worker.run&＃40;ThreadPoolExecutor.java:908&＃41;
    at java.lang.Thread.run&＃40;Thread.java:662&＃41;
    at org.apache.hadoop.hive.ql.session.SessionState.start&＃40;SessionState.java:277&＃41;
    at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.init&＃40;HiveServer.java:136&＃41;
    at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcessorFactory.getProcessor&＃40;HiveServer.java:550&＃41;
    ... 4 more
    at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager&＃40;HiveUtils.java:199&＃41;
    at org.apache.hadoop.hive.ql.session.SessionState.start&＃40;SessionState.java:272&＃41;
    ... 6 more
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: /home/hadoop/hadoop-0.20.205.0/conf/mapred-site.xml &＃40;Too many open files&＃41;
    at org.apache.hadoop.conf.Configuration.loadResource&＃40;Configuration.java:1231&＃41;
    at org.apache.hadoop.conf.Configuration.loadResources&＃40;Configuration.java:1093&＃41;
    at org.apache.hadoop.conf.Configuration.getProps&＃40;Configuration.java:1037&＃41;
    at org.apache.hadoop.conf.Configuration.set&＃40;Configuration.java:438&＃41;
    at org.apache.hadoop.hive.conf.HiveConf.setVar&＃40;HiveConf.java:762&＃41;
    at org.apache.hadoop.hive.conf.HiveConf.setVar&＃40;HiveConf.java:770&＃41;
    at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run&＃40;TThreadPoolServer.java:169&＃41;
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask&＃40;ThreadPoolExecutor.java:886&＃41;
    at java.util.concurrent.ThreadPoolExecutor$Worker.run&＃40;ThreadPoolExecutor.java:908&＃41;
    at java.lang.Thread.run&＃40;Thread.java:662&＃41;
Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: java.io.FileNotFoundException: /home/hadoop/hadoop-0.20.205.0/conf/core-site.xml &＃40;Too many open files&＃41;
    at org.apache.hadoop.hive.ql.session.SessionState.start&＃40;SessionState.java:277&＃41;
    at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.init&＃40;HiveServer.java:136&＃41;
    at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcessorFactory.getProcessor&＃40;HiveServer.java:550&＃41;
    ... 4 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: java.io.FileNotFoundException: /home/hadoop/hadoop-0.20.205.0/conf/core-site.xml &＃40;Too many open files&＃41;
    at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager&＃40;HiveUtils.java:199&＃41;
    at org.apache.hadoop.hive.ql.session.SessionState.start&＃40;SessionState.java:272&＃41;
    ... 6 more

ulimit -HSn 32768

原文地址：hadoop too many files异常处理, 感谢原作者分享。