Hive 插入数据异常,大家帮忙看下

其实我是真性情 2015-06-26 11:17:47
先说下我的环境吧,用的是CDH-5.3.2,服务器上已经有hadoop跟hbase,我现在是想添加Hive跟Impala
我按照网上的帖子在hadoop的Master机器上部署了Hive。
能够成功运行。
创建表,load data 这些都没问题,我成功的从.txt文件导入了ccc表,我现在想从ccc表把数据导入hbase_table_1

对了,这里我创建hbase_table_1的时候,好像是映射了一张Hbase里的表,我不知道是不是叫映射。语句如下

hive> CREATE TABLE hbase_table_1(key int, value string)
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
> WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
> TBLPROPERTIES ("hbase.table.name" = "xyz");
我的hive里有hbase_table_1表,然后我的hbase里有xyz表。

之后我往hbase_table_1表里插入数据时,出现了问题。

最上边红色的是我执行的命令,首先。表我都是有的,ccc里也是有数据的,就2条


insert overwrite table hbase_table_1 select * from ccc where foo=1;
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
15/06/26 10:42:19 WARN conf.Configuration: file:/tmp/root/hive_2015-06-26_10-42-15_181_1419980750072326454-1/-local-10001/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
15/06/26 10:42:19 WARN conf.Configuration: file:/tmp/root/hive_2015-06-26_10-42-15_181_1419980750072326454-1/-local-10001/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
Execution log at: /opt/logs/hive/root/root_20150626104242_a0ad91f0-0380-46f9-a9f3-562c8ae89d27.log
java.io.FileNotFoundException: File does not exist: hdfs://10.10.92.151:8020/usr/lib/hbase/lib/high-scale-lib-1.1.1.jar
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1093)
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1085)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1085)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:288)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:224)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:93)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestampsAndCacheVisibilities(ClientDistributedCacheManager.java:57)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:267)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:388)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:481)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1295)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1292)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1292)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:564)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:559)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:559)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:550)
at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:420)
at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:740)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Job Submission failed with exception 'java.io.FileNotFoundException(File does not exist: hdfs://10.10.92.151:8020/usr/lib/hbase/lib/high-scale-lib-1.1.1.jar)'
Execution failed with exit status: 1
Obtaining error information

Task failed!
Task ID:
Stage-0

Logs:

/opt/logs/hive/root/hive.log
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

上边是错误,但是我本身装Hive的IP就是151,而151上/usr/lib/hbase/lib/high-scale-lib-1.1.1.jar
这个路径下的.jar包是存在的。
我现在就不知道问题出在哪了,请大家帮我看一看谢谢了
...全文
857 4 打赏 收藏 转发到动态 举报
AI 作业
写回复
用AI写文章
4 条回复
切换为时间正序
请发表友善的回复…
发表回复
qq_33286507 2016-07-07
  • 打赏
  • 举报
回复
楼主解决了吗?怎么解决的?
  • 打赏
  • 举报
回复
没正确答案结贴了
伱oO○祗噵 2015-09-14
  • 打赏
  • 举报
回复
  • 打赏
  • 举报
回复
没有人出现过吗?

20,848

社区成员

发帖
与我相关
我的任务
社区描述
Hadoop生态大数据交流社区,致力于有Hadoop,hive,Spark,Hbase,Flink,ClickHouse,Kafka,数据仓库,大数据集群运维技术分享和交流等。致力于收集优质的博客
社区管理员
  • 分布式计算/Hadoop社区
  • 涤生大数据
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧