oozie运行shell时报错

ILeslie_ 2016-10-12 10:10:50
Log Type: stderr
Log Upload Time: 星期三 十月 12 09:53:02 +0800 2016
Log Length: 2065
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "billanalyse.sh" (in directory "/data/yarn/nm/usercache/root/appcache/application_1475922151418_0476/container_1475922151418_0476_02_000002"): error=2, 没有那个文件或目录
java.io.IOException: Cannot run program "billanalyse.sh" (in directory "/data/yarn/nm/usercache/root/appcache/application_1475922151418_0476/container_1475922151418_0476_02_000002"): error=2, 没有那个文件或目录
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
at org.apache.oozie.action.hadoop.ShellMain.execute(ShellMain.java:110)
at org.apache.oozie.action.hadoop.ShellMain.run(ShellMain.java:69)
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:49)
at org.apache.oozie.action.hadoop.ShellMain.main(ShellMain.java:61)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:236)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.io.IOException: error=2, 没有那个文件或目录
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.<init>(UNIXProcess.java:186)
at java.lang.ProcessImpl.start(ProcessImpl.java:130)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
... 17 more

Log Type: stdout
Log Upload Time: 星期三 十月 12 09:53:02 +0800 2016
Log Length: 82829
Showing 4096 bytes of 82829 total. Click here for the full log.
1475922151418_0476/container_1475922151418_0476_02_000002:/etc/hadoop/conf.cloudera.yarn:/var/run/cloudera-scm-agent/process/1942-yarn-NODEMANAGER:/opt/cloudera/parcels/CDH-5.7.2-1.cdh5.7.2.p0.18/lib/hadoop/*:/opt/cloudera/parcels/CDH-5.7.2-1.cdh5.7.2.p0.18/lib/hadoop/lib/*:/opt/cloudera/parcels/CDH-5.7.2-1.cdh5.7.2.p0.18/lib/hadoop-hdfs/*:/opt/cloudera/parcels/CDH-5.7.2-1.cdh5.7.2.p0.18/lib/hadoop-hdfs/lib/*:/opt/cloudera/parcels/CDH-5.7.2-1.cdh5.7.2.p0.18/lib/hadoop-yarn/*:/opt/cloudera/parcels/CDH-5.7.2-1.cdh5.7.2.p0.18/lib/hadoop-yarn/lib/*:/opt/cloudera/parcels/CDH-5.7.2-1.cdh5.7.2.p0.18/lib/hadoop-mapreduce/*:/opt/cloudera/parcels/CDH-5.7.2-1.cdh5.7.2.p0.18/lib/hadoop-mapreduce/lib/*::job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/data/yarn/nm/usercache/root/appcache/application_1475922151418_0476/container_1475922151418_0476_02_000002/*:
STDOUT_LOGFILE_ENV=/data/yarn/container-logs/application_1475922151418_0476/container_1475922151418_0476_02_000002/stdout:
CM_STATUS_CODES=STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE:
SUPERVISOR_ENABLED=1:
HADOOP_CLIENT_OPTS=:
HOME=/home/:
CDH_CRUNCH_HOME=/usr/lib/crunch:
KEYTRUSTEE_SERVER_HOME=/usr/lib/keytrustee-server:
YARN_RESOURCEMANAGER_OPTS=:
HIVE_DEFAULT_XML=/etc/hive/conf.dist/hive-default.xml:
CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.7.2-1.cdh5.7.2.p0.18/lib/hadoop-kms:
WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.7.2-1.cdh5.7.2.p0.18/etc/hive-webhcat/conf.dist/webhcat-default.xml:
HADOOP_JOB_HISTORYSERVER_OPTS=:
CGROUP_ROOT_BLKIO=/cgroup/blkio:
=================================================================

>>> Invoking Shell command line now >>


<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "billanalyse.sh" (in directory "/data/yarn/nm/usercache/root/appcache/application_1475922151418_0476/container_1475922151418_0476_02_000002"): error=2, 没有那个文件或目录
java.io.IOException: Cannot run program "billanalyse.sh" (in directory "/data/yarn/nm/usercache/root/appcache/application_1475922151418_0476/container_1475922151418_0476_02_000002"): error=2, 没有那个文件或目录
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
at org.apache.oozie.action.hadoop.ShellMain.execute(ShellMain.java:110)
at org.apache.oozie.action.hadoop.ShellMain.run(ShellMain.java:69)
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:49)
at org.apache.oozie.action.hadoop.ShellMain.main(ShellMain.java:61)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:236)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.io.IOException: error=2, 没有那个文件或目录
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.<init>(UNIXProcess.java:186)
at java.lang.ProcessImpl.start(ProcessImpl.java:130)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
... 17 more

Oozie Launcher failed, finishing Hadoop job gracefully

Oozie Launcher, uploading action data to HDFS sequence file: hdfs://flowbigdata01-master:8020/user/root/oozie-oozi/0000108-161008182255664-oozie-oozi-W/shell-check-hour--shell/action-data.seq

Oozie Launcher ends
...全文
899 1 打赏 收藏 转发到动态 举报
写回复
用AI写文章
1 条回复
切换为时间正序
请发表友善的回复…
发表回复
sccemstanford 2017-11-13
  • 打赏
  • 举报
回复
我也遇到了这个问题,请问下,是否解决了?

20,807

社区成员

发帖
与我相关
我的任务
社区描述
Hadoop生态大数据交流社区,致力于有Hadoop,hive,Spark,Hbase,Flink,ClickHouse,Kafka,数据仓库,大数据集群运维技术分享和交流等。致力于收集优质的博客
社区管理员
  • 分布式计算/Hadoop社区
  • 涤生大数据
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧