hadoop运行时偶尔出现的问题 java.lang.Throwable: Child Error

liuscmail 2012-10-22 04:31:32
log.txt:java.lang.Throwable: Child Error
log.txt:Caused by: java.io.IOException: Task process exit with nonzero status of 126.
log.txt:12/10/20 04:35:43 WARN mapred.JobClient: Error reading task outputhttp://hadoop-slave2:50060/tasklog?plaintext=true&attemptid=attempt_201209071933_64238_r_000014_0&filter=stdout
log.txt:12/10/20 04:35:43 WARN mapred.JobClient: Error reading task outputhttp://hadoop-slave2:50060/tasklog?plaintext=true&attemptid=attempt_201209071933_64238_r_000014_0&filter=stderr


在我们的hadoop集群中,偶尔在运行日志中发现这样的错误(并非每天都有,不固定的错误,第二次执行都不一定出现),小弟实在不能发现这个问题到底是什么原因引发的,还请各位大牛帮个忙,给解释一下撒

只知道126其实是hadoop child进程在执行shell脚本时候的退出码
bash的相关资料上给出的126说明,
126 Command invoked cannot execute ; Permission problem or command is not an executable
...全文
1429 3 打赏 收藏 转发到动态 举报
写回复
用AI写文章
3 条回复
切换为时间正序
请发表友善的回复…
发表回复
coolbamboo2008 2014-01-01
  • 打赏
  • 举报
回复
学习了,一楼不错
java8964 2013-12-31
  • 打赏
  • 举报
回复
Negative. The above link is for return code 1. Error code 126 normally means the resource allocation error from system level. I don't know why when people ask for help here, it always is WITHOUT any information about the cluster. You should provide at least following information, so people can help you with more accurate answers: 1) Your hadoop version 2) JDK version 3) Your OS version Without these, I am just guessing now for you: 1) Read this, there is already a Jira ticket for this error on hadoop 1.0.x baseline, but fixed long time ago. https://issues.apache.org/jira/browse/MAPREDUCE-4857 2) Another possible reason: Your "mapred.child.ulimit" is set too low 3) Later version of hadoop (1.1.x) will also see "126 return code" due to another bug, fixed in 1.1.2. See this Jira ticket: https://issues.apache.org/jira/browse/MAPREDUCE-2374
码上富贵 2013-12-30
  • 打赏
  • 举报
回复
http://blog.sina.com.cn/s/blog_b88e09dd01014x2g.html

20,808

社区成员

发帖
与我相关
我的任务
社区描述
Hadoop生态大数据交流社区,致力于有Hadoop,hive,Spark,Hbase,Flink,ClickHouse,Kafka,数据仓库,大数据集群运维技术分享和交流等。致力于收集优质的博客
社区管理员
  • 分布式计算/Hadoop社区
  • 涤生大数据
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧