hadoop-2.7.1配置HA时zkfc启动不了

边城浪子1229 2015-09-07 04:21:23
其他节点都能启动，zkfc不能正常启动，应该怎么解决，求大神们来帮忙解决
错误日志：


2015-09-07 00:59:23,896 WARN org.apache.hadoop.ha.HealthMonitor: Transport-level exception trying to monitor health of NameNode at ubuntu1/192.168.253.129:8020: java.net.ConnectException: Connection refused Call From ubuntu1/192.168.253.129 to ubuntu1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

2015-09-07 00:59:25,900 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: ubuntu1/192.168.253.129:8020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=1, sleepTime=1000 MILLISECONDS)

2015-09-07 00:59:25,901 WARN org.apache.hadoop.ha.HealthMonitor: Transport-level exception trying to monitor health of NameNode at ubuntu1/192.168.253.129:8020: java.net.ConnectException: Connection refused Call From ubuntu1/192.168.253.129 to ubuntu1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

2015-09-07 00:59:27,906 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: ubuntu1/192.168.253.129:8020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=1, sleepTime=1000 MILLISECONDS)

2015-09-07 00:59:27,907 WARN org.apache.hadoop.ha.HealthMonitor: Transport-level exception trying to monitor health of NameNode at ubuntu1/192.168.253.129:8020: java.net.ConnectException: Connection refused Call From ubuntu1/192.168.253.129 to ubuntu1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

2015-09-07 00:59:29,912 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: ubuntu1/192.168.253.129:8020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=1, sleepTime=1000 MILLISECONDS)

2015-09-07 00:59:29,914 WARN org.apache.hadoop.ha.HealthMonitor: Transport-level exception trying to monitor health of NameNode at ubuntu1/192.168.253.129:8020: java.net.ConnectException: Connection refused Call From ubuntu1/192.168.253.129 to ubuntu1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

2015-09-07 00:59:31,918 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: ubuntu1/192.168.253.129:8020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=1, sleepTime=1000 MILLISECONDS)

2015-09-07 00:59:31,919 WARN org.apache.hadoop.ha.HealthMonitor: Transport-level exception trying to monitor health of NameNode at ubuntu1/192.168.253.129:8020: java.net.ConnectException: Connection refused Call From ubuntu1/192.168.253.129 to ubuntu1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

2015-09-07 00:59:33,925 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: ubuntu1/192.168.253.129:8020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=1, sleepTime=1000 MILLISECONDS)

2015-09-07 00:59:35,188 INFO org.apache.hadoop.ha.HealthMonitor: Entering state SERVICE_HEALTHY

2015-09-07 00:59:35,188 INFO org.apache.hadoop.ha.ZKFailoverController: Local service NameNode at ubuntu1/192.168.253.129:8020 entered state: SERVICE_HEALTHY

2015-09-07 00:59:35,196 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=ubuntu1:2181,ubuntu2:2181,ubuntu3:2181 sessionTimeout=5000 watcher=org.apache.hadoop.ha.ActiveStandbyElector$WatcherWithClientRef@1f3f6ff

2015-09-07 00:59:35,196 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ubuntu3/192.168.253.131:2181. Will not attempt to authenticate using SASL (unknown error)

2015-09-07 00:59:35,197 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ubuntu3/192.168.253.131:2181, initiating session

2015-09-07 00:59:35,667 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server ubuntu3/192.168.253.131:2181, sessionid = 0x34fa6cfae140000, negotiated timeout = 5000

2015-09-07 00:59:35,673 INFO org.apache.hadoop.ha.ActiveStandbyElector: Session connected.

2015-09-07 00:59:36,067 FATAL org.apache.hadoop.ha.ActiveStandbyElector: Received create error from Zookeeper. code:NONODE for path /hadoop-ha/mycluster/ActiveStandbyElectorLock

2015-09-07 00:59:36,121 INFO org.apache.zookeeper.ZooKeeper: Session: 0x34fa6cfae140000 closed

2015-09-07 00:59:36,121 FATAL org.apache.hadoop.ha.ZKFailoverController: Fatal error occurred:Received create error from Zookeeper. code:NONODE for path /hadoop-ha/mycluster/ActiveStandbyElectorLock

2015-09-07 00:59:36,122 INFO org.apache.hadoop.ipc.Server: Stopping server on 8019

2015-09-07 00:59:36,122 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8019

2015-09-07 00:59:36,123 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder

2015-09-07 00:59:36,124 INFO org.apache.hadoop.ha.ActiveStandbyElector: Yielding from election

2015-09-07 00:59:36,124 INFO org.apache.hadoop.ha.HealthMonitor: Stopping HealthMonitor thread

2015-09-07 00:59:36,124 FATAL org.apache.hadoop.hdfs.tools.DFSZKFailoverController: Got a fatal error, exiting now

java.lang.RuntimeException: ZK Failover Controller failed: Received create error from Zookeeper. code:NONODE for path /hadoop-ha/mycluster/ActiveStandbyElectorLock

	at org.apache.hadoop.ha.ZKFailoverController.mainLoop(ZKFailoverController.java:369)

	at org.apache.hadoop.ha.ZKFailoverController.doRun(ZKFailoverController.java:238)

	at org.apache.hadoop.ha.ZKFailoverController.access$000(ZKFailoverController.java:61)

	at org.apache.hadoop.ha.ZKFailoverController$1.run(ZKFailoverController.java:172)

	at org.apache.hadoop.ha.ZKFailoverController$1.run(ZKFailoverController.java:168)

	at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:415)

	at org.apache.hadoop.ha.ZKFailoverController.run(ZKFailoverController.java:168)

	at org.apache.hadoop.hdfs.tools.DFSZKFailoverController.main(DFSZKFailoverController.java:181)

2015-09-07 00:59:36,127 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down
...全文
4800 5 打赏 收藏 转发到动态 举报
写回复
5 条回复
切换为时间正序
请发表友善的回复…
发表回复
shuai7boy 2019-09-22
  • 打赏
  • 举报
 回复
引用 4 楼 skyWalker_ONLY 的回复:
[quote=引用 3 楼 zhangph1229 的回复:] [quote=引用 1 楼 sky_walker85 的回复:] 是否在ZooKeeper中创建了相应的znode，可以使用命令hdfs zkfc -formatZK 创建，参考http://blog.csdn.net/skywalker_only/article/details/40300839
在启动之前已经格式化了，但是还是连接不上，是不是跟本地的hosts文件有关系呀？[/quote] 使用zkCli命令查看znode是否创建成功[/quote] 检查了下，创建成功了，但还是报同样的错误
skyWalker_ONLY 2015-09-09
  • 打赏
  • 举报
 回复
引用 3 楼 zhangph1229 的回复:
[quote=引用 1 楼 sky_walker85 的回复:] 是否在ZooKeeper中创建了相应的znode，可以使用命令hdfs zkfc -formatZK 创建，参考http://blog.csdn.net/skywalker_only/article/details/40300839
在启动之前已经格式化了，但是还是连接不上，是不是跟本地的hosts文件有关系呀？[/quote] 使用zkCli命令查看znode是否创建成功
边城浪子1229 2015-09-09
  • 打赏
  • 举报
 回复
引用 1 楼 sky_walker85 的回复:
是否在ZooKeeper中创建了相应的znode，可以使用命令hdfs zkfc -formatZK 创建，参考http://blog.csdn.net/skywalker_only/article/details/40300839
在启动之前已经格式化了，但是还是连接不上，是不是跟本地的hosts文件有关系呀？
边城浪子1229 2015-09-09
  • 打赏
  • 举报
 回复
在启动之前已经格式化了，但是还是连接不上，是不是跟本地的hosts文件有关系呀？
skyWalker_ONLY 2015-09-08
  • 打赏
  • 举报
 回复
是否在ZooKeeper中创建了相应的znode，可以使用命令hdfs zkfc -formatZK 创建，参考http://blog.csdn.net/skywalker_only/article/details/40300839
相关推荐
【精】HDFS的HA系列（三）--- 启动ZKFC初始化zookeeper以及相关回调函数
【精】HDFS的HA系列（三）--- 启动ZKFC初始化zookeeper以及相关回调函数
hadoop集群安装部署（二）
一、配置hadoop集群 一共有7个文件要修改： hadoop-2.7.1/etc/hadoop/hadoop-env.sh hadoop-2.7.1/etc/hadoop/yarn-env.sh hadoop-2.7.1/etc/hadoop/core-site.xml hadoop-2.7.1/etc/hadoop/hdfs-site.xml hadoop-2.7.1/etc/ha
hadoop集群两个standby的解决办法
首先你要确定不用ha的时候你的hadoop集群是正常的，不然找错误的方向就偏离了如果都正常，配置HA 需要zookeeper，先要看看是不是zookeeper没有配置好的问题如果都正常，在hadoop安装目录执行sbin/hadoop-daemon.sh start zkfc，这句是启动zookeeper选举制度，然后执行 hdfs haadmin -transitionToActive nn2 其中nn2是你的namenode中的一个（如果是新配置的HAhadoop集群，可能是zkfc（DFSZKFail
hadoop笔记——HA部署
搭建集群免秘钥的两个需求场景 管理脚本远程管理节点，再集群中随便挑一台，把公钥发给所有 搭建HA时，NameNode的zkfc需要免秘钥，用来管理自己和对方（故障应对） HA配置大体过程 逻辑物理映射 JN相关信息描述 故障发生时免秘钥配置 要点 记得格式化之前启动JN 第一台格式化之后启动，并且让后续NameNode以standby启动，就不用格式化了 配置 部署（启动JN，...
hadoop-2.7.1基于QMJ高可用安装配置
1.修改主机名及hosts文件 10.205.22.185 nn1 （主）作用namenode,resourcemanager,datanode,JournalNode,zk,zkfc(hive,sqoop可选) 10.205.22.186 nn2 （备）作用namenode,resourcemanager,datanode,JournalNode,zk,zkfc 10.205.22.1...
Hadoop生态社区

20,751

社区成员

4,676

社区内容

发帖
与我相关
我的任务
社区描述
Hadoop生态大数据交流社区，致力于有Hadoop，hive，Spark，Hbase，Flink，ClickHouse，Kafka，数据仓库，大数据集群运维技术分享和交流等。致力于收集优质的博客
社区管理员
  • 分布式计算/Hadoop社区
  • 涤生大数据
加入社区
  • 近7日
  • 近30日
  • 至今

加载中

查看更多榜单
社区公告
暂无公告