请教,hadoop集群停止nodemanager失败

谈笑一叶知秋 2017-06-03 09:41:46

环境是一个master主节点(192.168.31.130)和两个slave节点(192.168.31.131/132)

执行stop-all.sh命令时,终端提示如下



hadoop@hadoopmaster pids]$ cd $HADOOP_HOME/sbin

[hadoop@hadoopmaster pids]$ stop-all.sh

This script is Deprecated. Instead use stop-dfs.sh and stop-yarn.sh

Stopping namenodes on [hadoopmaster]

hadoopmaster: stopping namenode

192.168.31.132: stopping datanode

192.168.31.131: stopping datanode

Stopping secondary namenodes [hadoopmaster]

hadoopmaster: stopping secondarynamenode

stopping yarn daemons

stopping resourcemanager

192.168.31.132: stopping nodemanager

192.168.31.131: stopping nodemanager

192.168.31.132: nodemanager did not stop gracefully after 5 seconds: killing with kill -9

192.168.31.131: nodemanager did not stop gracefully after 5 seconds: killing with kill -9

no proxyserver to stop

slave节点记录yarn-hadoop-nodemanager-hadoopslaver01.log如下



2017-06-03 07:03:19,137 INFO org.apache.hadoop.io.retry.RetryInvocationHandler: Exception while invoking ResourceTrackerPBClientImpl.nodeHeartbeat over null. Retrying after sleeping for 30000ms.

java.io.EOFException: End of File Exception between local host is: "hadoopslaver01/192.168.31.131"; destination host is: "hadoopmaster":8031; : java.io.EOFException; For more details see:  http://wiki.apache.org/hadoop/EOFException

	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)

	at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:801)

	at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:765)

	at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1485)

	at org.apache.hadoop.ipc.Client.call(Client.java:1427)

	at org.apache.hadoop.ipc.Client.call(Client.java:1337)

	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:227)

	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116)

	at com.sun.proxy.$Proxy73.nodeHeartbeat(Unknown Source)

	at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.nodeHeartbeat(ResourceTrackerPBClientImpl.java:85)

	at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)

	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

	at java.lang.reflect.Method.invoke(Method.java:498)

	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:398)

	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:163)

	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:155)

	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95)

	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:335)

	at com.sun.proxy.$Proxy74.nodeHeartbeat(Unknown Source)

	at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:766)

	at java.lang.Thread.run(Thread.java:748)

Caused by: java.io.EOFException

	at java.io.DataInputStream.readInt(DataInputStream.java:392)

	at org.apache.hadoop.ipc.Client$IpcStreams.readResponse(Client.java:1786)

	at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1155)

	at org.apache.hadoop.ipc.Client$Connection.run(Client.java:1052)

2017-06-03 07:03:23,452 ERROR org.apache.hadoop.yarn.server.nodemanager.NodeManager: RECEIVED SIGNAL 15: SIGTERM

2017-06-03 07:03:24,458 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hadoopmaster/192.168.31.130:8031. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

2017-06-03 07:03:25,460 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hadoopmaster/192.168.31.130:8031. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

2017-06-03 07:03:26,461 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hadoopmaster/192.168.31.130:8031. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

2017-06-03 07:03:27,462 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hadoopmaster/192.168.31.130:8031. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)