Hadoop伪分布

pucheung 2015-05-20 01:38:37
使用Hadoop2.3 JDK1.7 在VMware上安装Centos6.0

jdk的安装位置:/usr/myspace/java/jdk/jdk

Hadoop的安装位置:/usr/myspace/java/hadoop/hadoop-2.3.0

/etc/core-site.xml:
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:8081</value>
<final>true</final>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/myspace/java/hadoop/tmp</value>
</property>


/etc/hdfs-site.xml:
<property>
<name>dfs.http.address</name>
<value>localhost:50070</value>
<description>
The address and the base port where the dfs namenode web ui will listen on.
If the port is 0 then the server will start on a free port.
</description>
</property>

<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>



/etc/mapred-site.xml:
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>hdfs://localhost:9001</value>
</property>



/etc/yarn-site.xml:
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
<description>shuffle service that needs to be set for Map Reduce to run</description>
</property>
<property>
<name>yarn.resourcemanager.hostname</name>
<value>localhost</value>
<description>hostname of Resource Manager</description>
</property>


/etc/hadoop-env.sh
export JAVA_HOME=/usr/myspace/java/jdk/jdk

先使用hdfs namenode -format ---->OK

然后使用 hdfs namenode 出现
se of pending operations
15/05/19 22:19:25 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 8 millisecond(s).
15/05/19 22:24:25 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 300001 milliseconds
15/05/19 22:24:25 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 5 millisecond(s).
15/05/19 22:29:25 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 300001 milliseconds
15/05/19 22:29:25 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 4 millisecond(s).
一直在此停留

使用jps 查看
3423 NameNode
3602 Jps
使用http://localhost:50070 也可以访问到页面


各位大咖帮忙看看这是什么原因????????????????




...全文
324 回复 打赏 收藏 转发到动态 举报
写回复
用AI写文章
回复
切换为时间正序
请发表友善的回复…
发表回复

932

社区成员

发帖
与我相关
我的任务
社区描述
云计算 云存储相关讨论
社区管理员
  • 云存储
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧