Hive中创建hbase关联表报错
xz43 2014-03-28 05:25:32 我用的hadoop-2.2.0、hbase-0.96.1.1-hadoop2和hive-0.12.0集成了一个3台机器的环境,其中一台namenode,两台datanode。配置完成,把hive的源码拉下来重新编译过,并把生成的jar替换了hive/lib下面的jar,启动metastore service后,hive连接上,创建一般的表都没问题,就是创建和hbase的管理表就报错了,错误如下:
hive> create table hivetest(key int, val string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val") TBLPROPERTIES ("hbase.table.name" = "hivetest");
14/03/28 16:08:15 INFO log.PerfLogger: <PERFLOG method=Driver.run from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 INFO log.PerfLogger: <PERFLOG method=TimeToSubmit from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 INFO log.PerfLogger: <PERFLOG method=compile from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 DEBUG parse.VariableSubstitution: Substitution is on: create table hivetest(key int, val string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val") TBLPROPERTIES ("hbase.table.name" = "hivetest")
14/03/28 16:08:15 INFO log.PerfLogger: <PERFLOG method=parse from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 INFO parse.ParseDriver: Parsing command: create table hivetest(key int, val string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val") TBLPROPERTIES ("hbase.table.name" = "hivetest")
14/03/28 16:08:15 INFO parse.ParseDriver: Parse Completed
14/03/28 16:08:15 INFO log.PerfLogger: </PERFLOG method=parse start=1395994095285 end=1395994095548 duration=263 from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 INFO log.PerfLogger: <PERFLOG method=semanticAnalyze from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 INFO parse.SemanticAnalyzer: Starting Semantic Analysis
14/03/28 16:08:15 INFO parse.SemanticAnalyzer: Creating table hivetest position=13
14/03/28 16:08:15 INFO ql.Driver: Semantic Analysis Completed
14/03/28 16:08:15 DEBUG parse.SemanticAnalyzer: validation start
14/03/28 16:08:15 DEBUG parse.SemanticAnalyzer: not validating writeEntity, because entity is neither table nor partition
14/03/28 16:08:15 INFO log.PerfLogger: </PERFLOG method=semanticAnalyze start=1395994095548 end=1395994095686 duration=138 from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 INFO ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
14/03/28 16:08:15 INFO log.PerfLogger: </PERFLOG method=compile start=1395994095225 end=1395994095701 duration=476 from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 INFO ql.Driver: Concurrency mode is disabled, not creating a lock manager
14/03/28 16:08:15 INFO log.PerfLogger: <PERFLOG method=Driver.execute from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 INFO ql.Driver: Starting command: create table hivetest(key int, val string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val") TBLPROPERTIES ("hbase.table.name" = "hivetest")
Query ID = hadoop_20140328160808_7f47197f-7322-4aa0-8445-eaecdcfa4717
14/03/28 16:08:15 INFO ql.Driver: Query ID = hadoop_20140328160808_7f47197f-7322-4aa0-8445-eaecdcfa4717
14/03/28 16:08:15 INFO log.PerfLogger: </PERFLOG method=TimeToSubmit start=1395994095225 end=1395994095721 duration=496 from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 INFO log.PerfLogger: <PERFLOG method=runTasks from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 INFO log.PerfLogger: <PERFLOG method=task.DDL.Stage-0 from=org.apache.hadoop.hive.ql.Driver>
14/03/28 16:08:15 INFO exec.DDLTask: Use StorageHandler-supplied org.apache.hadoop.hive.hbase.HBaseSerDe for table hivetest
14/03/28 16:08:15 DEBUG security.Groups: Returning fetched groups for 'hadoop'
14/03/28 16:08:15 DEBUG security.Groups: Returning cached groups for 'hadoop'
14/03/28 16:08:15 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no longer has any effect. Use hive.hmshandler.retry.* instead
14/03/28 16:08:15 DEBUG session.SessionState: Session is using authorization class class org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider
14/03/28 16:08:15 DEBUG hive.log: DDL: struct hivetest { i32 key, string val}
14/03/28 16:08:16 DEBUG hbase.HBaseSerDe: HBaseSerDe initialized with : columnNames = [key, val] columnTypes = [int, string] hbaseColumnMapping = :key,cf1:val
14/03/28 16:08:16 DEBUG hive.log: DDL: struct hivetest { i32 key, string val}
14/03/28 16:08:16 DEBUG hbase.HBaseSerDe: HBaseSerDe initialized with : columnNames = [key, val] columnTypes = [int, string] hbaseColumnMapping = :key,cf1:val
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:host.name=testserver4
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_01
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/java/jdk1.7.0_01/jre
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:java.class.path=太长省略
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/home/hadoop/hadoop-2.2.0/lib/native
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-131.0.15.el6.x86_64
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/hadoop
14/03/28 16:08:16 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=javadb11g:2181,java11g2:2181 sessionTimeout=90000 watcher=hconnection-0x2896bed3, quorum=javadb11g:2181,java11g2:2181, baseZNode=/hbase
14/03/28 16:08:16 DEBUG zookeeper.ClientCnxn: zookeeper.disableAutoWatchReset is false
14/03/28 16:08:16 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x2896bed3 connecting to ZooKeeper ensemble=javadb11g:2181,java11g2:2181
14/03/28 16:08:16 INFO zookeeper.ClientCnxn: Opening socket connection to server java11g2/192.168.0.230:2181. Will not attempt to authenticate using SASL (unknown error)
14/03/28 16:08:16 INFO zookeeper.ClientCnxn: Socket connection established to java11g2/192.168.0.230:2181, initiating session
14/03/28 16:08:16 DEBUG zookeeper.ClientCnxn: Session establishment request sent on java11g2/192.168.0.230:2181
麻烦大家帮我看看,是我哪里配置不对,还是替换的编译后的jar包有问题,谢谢。