Hive 插入数据异常,大家帮忙看下
先说下我的环境吧,用的是CDH-5.3.2,服务器上已经有hadoop跟hbase,我现在是想添加Hive跟Impala
我按照网上的帖子在hadoop的Master机器上部署了Hive。
能够成功运行。
创建表,load data 这些都没问题,我成功的从.txt文件导入了ccc表,我现在想从ccc表把数据导入hbase_table_1
对了,这里我创建hbase_table_1的时候,好像是映射了一张Hbase里的表,我不知道是不是叫映射。语句如下
hive> CREATE TABLE hbase_table_1(key int, value string)
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
> WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
> TBLPROPERTIES ("hbase.table.name" = "xyz");
我的hive里有hbase_table_1表,然后我的hbase里有xyz表。
之后我往hbase_table_1表里插入数据时,出现了问题。
最上边红色的是我执行的命令,首先。表我都是有的,ccc里也是有数据的,就2条
insert overwrite table hbase_table_1 select * from ccc where foo=1;
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
15/06/26 10:42:19 WARN conf.Configuration: file:/tmp/root/hive_2015-06-26_10-42-15_181_1419980750072326454-1/-local-10001/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
15/06/26 10:42:19 WARN conf.Configuration: file:/tmp/root/hive_2015-06-26_10-42-15_181_1419980750072326454-1/-local-10001/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
Execution log at: /opt/logs/hive/root/root_20150626104242_a0ad91f0-0380-46f9-a9f3-562c8ae89d27.log
java.io.FileNotFoundException: File does not exist: hdfs://10.10.92.151:8020/usr/lib/hbase/lib/high-scale-lib-1.1.1.jar
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1093)
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1085)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1085)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:288)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:224)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:93)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestampsAndCacheVisibilities(ClientDistributedCacheManager.java:57)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:267)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:388)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:481)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1295)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1292)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1292)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:564)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:559)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:559)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:550)
at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:420)
at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:740)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Job Submission failed with exception 'java.io.FileNotFoundException(File does not exist: hdfs://10.10.92.151:8020/usr/lib/hbase/lib/high-scale-lib-1.1.1.jar)'
Execution failed with exit status: 1
Obtaining error information
Task failed!
Task ID:
Stage-0
Logs:
/opt/logs/hive/root/hive.log
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
上边是错误,但是我本身装Hive的IP就是151,而151上/usr/lib/hbase/lib/high-scale-lib-1.1.1.jar
这个路径下的.jar包是存在的。
我现在就不知道问题出在哪了,请大家帮我看一看谢谢了