hbase启动十几秒后，HMaster和HRegionserver自动关闭

FlyGently 2017-01-06 03:23:47
hbase按照如下配置，搭建完成后执行start-dfs.sh、start-yarn.sh启动HDFS成功，但是执行start-hbase.sh后，HMaster和HRegionServer启动十几秒后自动关闭，master.log出现如下错误：

logs/hbase-root-master-master部分内容如下：


2017-01-06 14:35:21,969 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=/root/Hadoop/hadoop-2.7.3/lib/native

2017-01-06 14:35:21,969 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp

2017-01-06 14:35:21,969 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler=

2017-01-06 14:35:21,969 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux

2017-01-06 14:35:21,969 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64

2017-01-06 14:35:21,969 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.el7.x86_64

2017-01-06 14:35:21,969 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=root

2017-01-06 14:35:21,969 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/root

2017-01-06 14:35:21,969 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/root/Hbase/hbase-1.2.4/logs

2017-01-06 14:35:21,971 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=slave1:2181,slave2:2181,slave3:2181 sessionTimeout=90000 watcher=master:160000x0, quorum=slave1:2181,slave2:2181,slave3:2181, baseZNode=/hbase

2017-01-06 14:35:22,048 INFO [main-SendThread(slave2:2181)] zookeeper.ClientCnxn: Opening socket connection to server slave2/192.168.241.237:2181. Will not attempt to authenticate using SASL (unknown error)

2017-01-06 14:35:22,080 WARN [main-SendThread(slave2:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect

java.net.NoRouteToHostException: No route to host

at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)

at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)

at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)

2017-01-06 14:35:22,230 INFO [main-SendThread(slave1:2181)] zookeeper.ClientCnxn: Opening socket connection to server slave1/192.168.241.236:2181. Will not attempt to authenticate using SASL (unknown error)

2017-01-06 14:35:23,239 WARN [main-SendThread(slave1:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect

java.net.NoRouteToHostException: No route to host

at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)

at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)

at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)

2017-01-06 14:35:23,341 INFO [main-SendThread(slave3:2181)] zookeeper.ClientCnxn: Opening socket connection to server slave3/192.168.241.238:2181. Will not attempt to authenticate using SASL (unknown error)

2017-01-06 14:35:23,342 WARN [main-SendThread(slave3:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect

java.net.NoRouteToHostException: No route to host

at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)

at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)

at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)

......此处省略N次重复

Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: master:160000x0, quorum=slave1:2181,slave2:2181,slave3:2181, baseZNode=/hbase Unexpected KeeperException creating base node

at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.createBaseZNodes(ZooKeeperWatcher.java:206)

at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.(ZooKeeperWatcher.java:187)

at org.apache.hadoop.hbase.regionserver.HRegionServer.(HRegionServer.java:585)

at org.apache.hadoop.hbase.master.HMaster.(HMaster.java:381)

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

at java.lang.reflect.Constructor.newInstance(Constructor.java:423)

at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2419)

... 5 more

Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase

at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)

at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)

at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)

at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.createNonSequential(RecoverableZooKeeper.java:565)

at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.create(RecoverableZooKeeper.java:544)

at org.apache.hadoop.hbase.zookeeper.ZKUtil.createWithParents(ZKUtil.java:1204)

at org.apache.hadoop.hbase.zookeeper.ZKUtil.createWithParents(ZKUtil.java:1182)

at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.createBaseZNodes(ZooKeeperWatcher.java:194)

... 13 more

2017-01-06 14:35:39,329 WARN [main-SendThread(slave1:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect

java.net.NoRouteToHostException: No route to host

at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)

at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)

at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)

master的vim /etc/hostname配置如下
master
master的vim /etc/sysconfig/network配置如下：
# Created by anaconda
NETWORKING=yes
HOSTNAME=master
/etc/hosts配置如下：
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.241.235 master
192.168.241.236 slave1
192.168.241.237 slave2
192.168.241.238 slave3
/etc/profile 增加的配置如下：
78 export JAVA_HOME=/usr/java/jdk1.8.0_112
79 export CLASSPATH=$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib
80 export PATH=$PATH:$JAVA_HOME/bin:$JAVA_HOME/jre/bin
81
82 export HADOOP_HOME=/root/Hadoop/hadoop-2.7.3
83 export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
84
85 export HBASE_HOME=/root/Hbase/hbase-1.2.4
86 export PATH=$PATH:$HBASE_HOME/bin
regionserver配置如下：
master
slave1
slave2
slave3
hbase-env.sh配置**如下：
export JAVA_HOME=/usr/java/jdk1.8.0_112
export HBASE_CLASSPATH=/root/Hadoop/hadoop-2.7.3/etc/hadoop
export HBASE_OPTS="-XX:+UseConcMarkSweepGC"
export HBASE_MANAGES_ZK=true
hbase-site.xml配置如下：

 <configuration>

          <property>

                  <name>hbase.rootdir</name>

                  <value>hdfs://master:9000/hbase</value>

                  <description>hadoop集群地址</description>

          </property>

          <property>

                  <name>hbase.cluster.distributed</name>

                  <value>true</value>

                  <description>是否启动集群模式</description>

          </property>

          <property>

                  <name>hbase.tmp.dir</name>

                  <value>/root/Hbase/hbase-1.2.4/tmp</value>

          </property>

          <property>

                  <name>hbase.master</name> #指定hbase集群主控节点

                  <value>master:60000</value>

          </property>

          <property>

                  <name>hbase.zookeeper.quorum</name>

                  <value>slave1,slave2,slave3</value>

                  <description>zookeeper集群主机名列表</description>

          </property>

          <property>

                  <name>hbase.master.maxclockskew</name>

                  <value>180000</value>

                  <description>Time difference of regionserver from master</description>

          </property>

          <property>

                  <name>hbase.zookeeper.property.dataDir</name>

                  <value>/root/Hbase/hbase-1.2.4/zookeeper_data</value>

          </property>

  </configuration>

...全文
1880 3 打赏 收藏 转发到动态 举报
写回复
用AI写文章
3 条回复
切换为时间正序
请发表友善的回复…
发表回复
FlyGently 2017-01-10
  • 打赏
  • 举报
 回复
要结贴了，回复就给分，来吧
FlyGently 2017-01-10
  • 打赏
  • 举报
 回复
自问自答： 原因是防火墙没有关闭，我用的是CentOS7，iptables service stop命令在CentOS7上不适用，应改成sudo systemctl stop firewalld.service && sudo systemctl disable firewalld.service centos从7开始默认用的是firewalld，这个是基于iptables的，虽然有iptables的核心，但是iptables的服务是没安装的。所以你只要停止firewalld服务即可：sudo systemctl stop firewalld.service && sudo systemctl disable firewalld.service 如果你要改用iptables的话，需要安装iptables服务： sudo yum install iptables-services sudo systemctl enable iptables && sudo systemctl enable ip6tables sudo systemctl start iptables && sudo systemctl start ip6tables
鱿鱼ing 2017-01-10
  • 打赏
  • 举报
 回复
蹭一波分，顺便学习了点经验，目前还停留在centos6.5
大数据之hbase详解
HBase的原型是Google的BigTable论文，受到了该论文思想的启发，目前作为Hadoop的子项目来开发维护，用于支持结构化的数据存储.HBase是一个高可靠性、高性能、面向列、可伸缩的分布式存储系统，利用HBASE技术可在廉价PC Server上搭建起大规模结构化存储集群。本视频从hbase的概述开始,讲解hbase的安装,hbase的shell操作,数据结构和原理到java api操作以及优化,让我们快速上手hbase.
linux关闭HQuorumPeer进程,全分布式HBase启动后HMaster和HRegionServer自动消失
我在三台主机上配置Hadoop 2.2.0和HBase 0.98.3(其自带的hadoop common的jar包就是2.2.0版本的)，一台机器为Debian 7.5, 机器名为psyDebian，运行namenode和datanode，另外两台为centos 6.5, 名字分别为centos1和centos2，运行datanode。Hadoop的hdfs运行良好，但在其基础上运行HBase时，...
【HBase】知识小结+HMaster选举、故障恢复、读写流程
1：什么是HBase HBase是一个高可靠性，高性能，面向列，可伸缩的分布式数据库，提供海量数据存储功能，一个结构化的分布式存储系统，不同于一般的关系型数据库，它适合半结构化和非结构化数据存储。 2：HBase表的特点 大：一个表中可以有数十亿行，上百万列 无模式：每行都有一个可排序的主键和任意多的列，列可以根据需要动态的增加，同一张表中不同的行可以有截然不同的列 面向列：面向列存储和权限控制 ...
stop-hbase.sh关不掉一直点点点......
1重启zookeeper 2到对应的hbase安装目录，执行命令 ./bin/hbase-daemons.sh stop regionserver 注意：在启动hadoop的过程中，需要确保三台主机启动之后离开安全模式才能再开启hbase，不然hbase的相关进程hmaster,hregionserver可能有的节点可能起不来，本人试了三次，第一次只有一台起了hreginserver,后面hmaser没起来，又试了一下，数据终于从ods，到dwd，到dws有了数据，一开始以为是代码的问题，不明所以，实时项目
第一篇 基于hbase2.4.2源码分析 HMaster启动分析
提示：文章写完后，目录可以自动生成，如何生成可参考右边的帮助文档 基于hbase2.4.2源码分析 HMaster启动分析前言一、HMaster类继承关系二、Hmaster入口分析Hmaster.main()入口2.HMaster.run()总结 前言 1.看什么？ 看HMaster类说明 看main()入口 看初始化了哪些重要组件 如何看：看过程中画图，或者把方法的调用关系，对象的调用按照调用关系记录下来，本文按照第二种方式进行编写 提示：以下是本篇文章正文内容，下面案例可供参考 一、HMas
Hadoop生态社区

20,808

社区成员

4,690

社区内容

发帖
与我相关
我的任务
社区描述
Hadoop生态大数据交流社区，致力于有Hadoop，hive，Spark，Hbase，Flink，ClickHouse，Kafka，数据仓库，大数据集群运维技术分享和交流等。致力于收集优质的博客
社区管理员
  • 分布式计算/Hadoop社区
  • 涤生大数据
加入社区
  • 近7日
  • 近30日
  • 至今

加载中

查看更多榜单
社区公告
暂无公告

试试用AI创作助手写篇文章吧

+ 用AI写文章