云存储
Hadoop伪分布
墨衍会员 · AI 创作全网分发 墨衍智能分发 通过墨衍一键同步至各平台 可同步平台 CSDN微信公众号微博知乎掘金百家号博客园抖音小红书 你的文章也可以这样分发 墨衍会员 ¥399起/年，写一次发全网
我也要 关注 + 加入社区使用Hadoop2.3 JDK1.7 在VMware上安装Centos6.0
jdk的安装位置：/usr/myspace/java/jdk/jdk
Hadoop的安装位置：/usr/myspace/java/hadoop/hadoop-2.3.0
/etc/core-site.xml:
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:8081</value>
<final>true</final>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/myspace/java/hadoop/tmp</value>
</property>
/etc/hdfs-site.xml:
<property>
<name>dfs.http.address</name>
<value>localhost:50070</value>
<description>
The address and the base port where the dfs namenode web ui will listen on.
If the port is 0 then the server will start on a free port.
</description>
</property>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>
/etc/mapred-site.xml:
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>hdfs://localhost:9001</value>
</property>
/etc/yarn-site.xml:
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
<description>shuffle service that needs to be set for Map Reduce to run</description>
</property>
<property>
<name>yarn.resourcemanager.hostname</name>
<value>localhost</value>
<description>hostname of Resource Manager</description>
</property>
/etc/hadoop-env.sh
export JAVA_HOME=/usr/myspace/java/jdk/jdk
先使用hdfs namenode -format ---->OK
然后使用 hdfs namenode 出现
se of pending operations
15/05/19 22:19:25 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 8 millisecond(s).
15/05/19 22:24:25 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 300001 milliseconds
15/05/19 22:24:25 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 5 millisecond(s).
15/05/19 22:29:25 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 300001 milliseconds
15/05/19 22:29:25 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 4 millisecond(s).
一直在此停留
使用jps 查看
3423 NameNode
3602 Jps
使用http://localhost:50070 也可以访问到页面
各位大咖帮忙看看这是什么原因？？？？？？？？？？？？？？？？
jdk的安装位置：/usr/myspace/java/jdk/jdk
Hadoop的安装位置：/usr/myspace/java/hadoop/hadoop-2.3.0
/etc/core-site.xml:
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:8081</value>
<final>true</final>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/myspace/java/hadoop/tmp</value>
</property>
/etc/hdfs-site.xml:
<property>
<name>dfs.http.address</name>
<value>localhost:50070</value>
<description>
The address and the base port where the dfs namenode web ui will listen on.
If the port is 0 then the server will start on a free port.
</description>
</property>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>
/etc/mapred-site.xml:
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>hdfs://localhost:9001</value>
</property>
/etc/yarn-site.xml:
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
<description>shuffle service that needs to be set for Map Reduce to run</description>
</property>
<property>
<name>yarn.resourcemanager.hostname</name>
<value>localhost</value>
<description>hostname of Resource Manager</description>
</property>
/etc/hadoop-env.sh
export JAVA_HOME=/usr/myspace/java/jdk/jdk
先使用hdfs namenode -format ---->OK
然后使用 hdfs namenode 出现
se of pending operations
15/05/19 22:19:25 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 8 millisecond(s).
15/05/19 22:24:25 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 300001 milliseconds
15/05/19 22:24:25 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 5 millisecond(s).
15/05/19 22:29:25 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 300001 milliseconds
15/05/19 22:29:25 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 4 millisecond(s).
一直在此停留
使用jps 查看
3423 NameNode
3602 Jps
使用http://localhost:50070 也可以访问到页面
各位大咖帮忙看看这是什么原因？？？？？？？？？？？？？？？？
...全文
相关推荐
hadoop伪分布式搭建(超级详细)
hadoop伪分布式搭建(从虚拟机设置到搭建完成)，包含每一个步骤，照做即可，内有hadoop2.2.0安装包。
centos搭建Hadoop伪分布
在使用此文档之前，需要获取jdk压缩包及Hadoop压缩包，在以下百度网盘提供下载 jdk下载地址连接链接：https://pan.baidu.com/s/102vK-eAC7nCUs7pPimnqDQ 提取码：6mvo Hadoop下载地址链接：https://pan.baidu.com/s/1ZA7iidcD5uKhC2u0tfwdNQ 提取码：ilju
hadoop伪分布式环境搭建
详细的hadoop2 伪分布式环境搭建以及eclipse部署。demo示例代码测试运行。文中有插件包。资源包等参考链接参考下载。
hadoop伪分布搭建
hadoop伪分布搭建
Hadoop伪分布式安装及配置参考步骤.docx
Linux上的Hadoop伪分布式安装及其相关配置步骤，以及Hadoop3种运行模式的相关知识。该文档摘自：http://public.bigdataedu.org/ ，仅供学习参考！
