shark 是否支持cloudrea5.0 beta

wanxiaohun 2014-03-24 08:18:41

最近需要在cloudrea上部署shark用于数据快速检索，在http://cloudera.rst.im/shark/shark-0.9.1-bin-cdh4.6.0-fe75a886.tar.gz中下载了shark，按照如下配置运行shark

export SPARK_MEM=1g

# (Required) Set the master program's memory
export SHARK_MASTER_MEM=1g

# (Required) Point to your Scala installation.
export SCALA_HOME="/home/yiwang/scala/scala-2.10.3"

# (Optional) Specify the location of Hive's configuration directory. By default,
# Shark run scripts will point it to $SHARK_HOME/conf
export HIVE_CONF_DIR="/opt/cloudera/parcels/CDH/lib/hive/conf"
export HIVE_HOME="/opt/cloudera/parcels/CDH/lib/hive"

# For running Shark in distributed mode, set the following:
export HADOOP_HOME="/opt/cloudera/parcels/CDH/lib/hadoop"
export SPARK_HOME="/opt/cloudera/parcels/CDH/lib/spark"
export MASTER="spark://192.168.100.114:7077"

运行如下两条命令：
1. shark> show tables;
OK
json_t1
sample_07
sample_08
test_1
test_2
Time taken: 0.043 seconds

2. select * from test_2;
FAILED: Hive Internal Error: java.lang.RuntimeException(java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Message missing required fields: callId, status; Host Details : local host is: "ipc113/192.168.100.113"; destination host is: "ipc113":8020; )

报错，替换了protbufxxx.jar文件后也不能够解决，求帮助

...全文