kettle抽取数据输出hdfs报错:Could not close the output stream for file

qq_41346995 2017-12-11 10:17:58
求各位大佬看下到底什么问题,运行环境是在linux(Redhat6.5),账户权限是root,用kettle抽取数据输出到hive外部表(HDFS),格式是txt,数据量大概是60万+,数据可以抽取和输出,但是中间会出现以下错误,然后就任务结束了

2017/12/11 01:25:56 - JSON Input.0 - Finished processing (I=1, O=0, R=1, W=1, U=0, E=0)
2017/12/11 01:25:56 - Hadoop File Output.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Exception trying to close file: org.apache.commons.vfs2.FileSystemException: Could not close the output stream for file "hdfs://hdfs:***@10.38.100.192:8020/nbgj/itf_ins_result_sum/itf_ins_result_sum.txt".
2017/12/11 01:25:56 - Hadoop File Output.0 - Finished processing (I=0, O=1, R=1, W=1, U=0, E=1)
2017/12/11 01:25:56 - nbgj_result_sum - Transformation detected one or more steps with errors.
2017/12/11 01:25:56 - nbgj_result_sum - Transformation is killing the other steps!
2017/12/11 01:25:56 - nbgj_result_sum - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Errors detected!
2017/12/11 01:25:56 - nbgj_for_result_sum_each - Finished job entry [nbgj_result_sum] (result=[false])
2017/12/11 01:25:56 - nbgj_for_result_sum_each - Finished job entry [nbgj_set_each_result_sum_id] (result=[false])
2017/12/11 01:25:56 - nbgj_job_result_sum - Finished job entry [nbgj_for_result_sum_each] (result=[false])
2017/12/11 01:25:56 - nbgj_job_result_sum - Finished job entry [nbgj_result_sum_id] (result=[false])
2017/12/11 01:25:56 - nbgj_result_sum_daily_job - Finished job entry [nbgj_job_result_sum] (result=[false])
2017/12/11 01:25:56 - nbgj_result_sum_daily_job - Finished job entry [nbgj_get_result_sum_daily_id] (result=[false])
2017/12/11 01:25:56 - nbgj_result_sum_daily_job - Finished job entry [get_parameters] (result=[false])
2017/12/11 01:25:56 - nbgj_get_total_daily_job - Finished job entry [nbgj_total_job] (result=[false])
2017/12/11 01:25:56 - nbgj_get_total_daily_job - Job execution finished
2017/12/11 01:25:56 - Kitchen - Finished!
2017/12/11 01:25:56 - Kitchen - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Finished with errors
2017/12/11 01:25:56 - Kitchen - Start=2017/12/11 01:00:03.987, Stop=2017/12/11 01:25:56.506
2017/12/11 01:25:56 - Kitchen - Processing ended after 25 minutes and 52 seconds (1552 seconds total).
...全文
6462 1 打赏 收藏 转发到动态 举报
写回复
用AI写文章
1 条回复
切换为时间正序
请发表友善的回复…
发表回复
造车的小同学 2021-03-23
  • 打赏
  • 举报
回复
问题最后怎么解

7,388

社区成员

发帖
与我相关
我的任务
社区描述
其他数据库开发 数据仓库
社区管理员
  • 数据仓库
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧