kettle抽取数据输出hdfs报错:Could not close the output stream for file

qq_41346995 2017-12-11 10:16:12
求各位大佬看下到底什么问题,运行环境是在linux(Redhat6.5),账户权限是root,用kettle抽取数据输出到hive外部表(HDFS),格式是txt,数据量大概是60万+,数据可以抽取和输出,但是中间会出现以下错误,然后就任务结束了

2017/12/11 01:25:56 - JSON Input.0 - Finished processing (I=1, O=0, R=1, W=1, U=0, E=0)
2017/12/11 01:25:56 - Hadoop File Output.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Exception trying to close file: org.apache.commons.vfs2.FileSystemException: Could not close the output stream for file "hdfs://hdfs:***@10.38.100.192:8020/nbgj/itf_ins_result_sum/itf_ins_result_sum.txt".
2017/12/11 01:25:56 - Hadoop File Output.0 - Finished processing (I=0, O=1, R=1, W=1, U=0, E=1)
2017/12/11 01:25:56 - nbgj_result_sum - Transformation detected one or more steps with errors.
2017/12/11 01:25:56 - nbgj_result_sum - Transformation is killing the other steps!
2017/12/11 01:25:56 - nbgj_result_sum - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Errors detected!
2017/12/11 01:25:56 - nbgj_for_result_sum_each - Finished job entry [nbgj_result_sum] (result=[false])
2017/12/11 01:25:56 - nbgj_for_result_sum_each - Finished job entry [nbgj_set_each_result_sum_id] (result=[false])
2017/12/11 01:25:56 - nbgj_job_result_sum - Finished job entry [nbgj_for_result_sum_each] (result=[false])
2017/12/11 01:25:56 - nbgj_job_result_sum - Finished job entry [nbgj_result_sum_id] (result=[false])
2017/12/11 01:25:56 - nbgj_result_sum_daily_job - Finished job entry [nbgj_job_result_sum] (result=[false])
2017/12/11 01:25:56 - nbgj_result_sum_daily_job - Finished job entry [nbgj_get_result_sum_daily_id] (result=[false])
2017/12/11 01:25:56 - nbgj_result_sum_daily_job - Finished job entry [get_parameters] (result=[false])
2017/12/11 01:25:56 - nbgj_get_total_daily_job - Finished job entry [nbgj_total_job] (result=[false])
2017/12/11 01:25:56 - nbgj_get_total_daily_job - Job execution finished
2017/12/11 01:25:56 - Kitchen - Finished!
2017/12/11 01:25:56 - Kitchen - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Finished with errors
2017/12/11 01:25:56 - Kitchen - Start=2017/12/11 01:00:03.987, Stop=2017/12/11 01:25:56.506
2017/12/11 01:25:56 - Kitchen - Processing ended after 25 minutes and 52 seconds (1552 seconds total).
...全文
2185 回复 打赏 收藏 转发到动态 举报
写回复
用AI写文章
回复
切换为时间正序
请发表友善的回复…
发表回复

246

社区成员

发帖
与我相关
我的任务
社区描述
讨论 Informatica 数据集成相关技术、数据隐私保护相关技术
社区管理员
  • 数据集成社区
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧