部署HDFS和YARN集群,hdfs和YARN自动切换均成功,HDFS上传文件成功,通过本地分布式计算也成功,在yarn模式下执行失败
节点配置如下:
NodeManager报的警告:
2018-04-27 05:16:37,791 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: couldn't find app application_1530182275331_0001 while processing FINISH_CONTAINERS event
YARN执行时控制台显示的:
2018-06-28 21:44:01,950 INFO mapreduce.Job: Job job_1530191876883_0001 failed with state FAILED due to: Application application_1530191876883_0001 failed 2 times due to Error launching appattempt_1530191876883_0001_000002. Got exception: java.net.ConnectException: Call From webf.com/127.0.0.1 to webf.com:45668 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.GeneratedConstructorAccessor39.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)