集群环境：

1 NameNode(实在主机):

Linux yan-Server 3.4.36-gentoo #3 SMP Mon Apr 1 14:09:12 CST 2013 x86_64 AMD Athlon(tm) X4 750K Quad Core Processor AuthenticAMD GNU/Linux

2 DataNode1(虚拟机):

Linux node1 3.5.0-23-generic #35~precise1-Ubuntu SMP Fri Jan 25 17:13:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

3 DataNode2(虚拟机):

Linux node2 3.5.0-23-generic #35~precise1-Ubuntu SMP Fri Jan 25 17:13:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

4 DataNode3(虚拟机):

Linux node3 3.5.0-23-generic #35~precise1-Ubuntu SMP Fri Jan 25 17:13:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

1.装置VirtualBox虚拟机

Gentoo下直接指令编译装置，或许官网下载二进制装置包直接装置：

emerge -av virtualbox

2.虚拟机下装置Ubuntu 12.04 LTS

运用Ubuntu镜像装置完成后，然后再克隆别的两台虚拟主机（这儿会遇到克隆的主机发动的时分主机名和MAC地址会是相同的，局域网会形成抵触）

主机名修正文件

/etc/hostname

MAC地址修正需求先删去文件

/etc/udev/rules.d/70-persistent-net.rules

然后在发动之前设置VirtualBox虚拟机的MAC地址

发动后会主动生成删去的文件，装备网卡的MAC地址。

为了更便利的在各主机之间同享文件，能够发动主机yan-Server的NFS，将指令参加/etc/rc.local中，让客户端主动挂载NFS目录。

删去各虚拟机的NetworkManager，手动设置静态的IP地址，例如node2主机的/etc/network/interfaces文件装备如下：

autolo
ifaceloinetloopback
autoeth0
ifaceeth0inetstatic
address192.168.137.202
gateway192.168.137.1
netmask255.255.255.0
network192.168.137.0
broadcast192.168.137.255

主机的根本环境设置结束，下面是主机对应的IP地址

为了节约资源，能够设置虚拟机默许发动字符界面，然后经过主机的TERMINAL ssh长途登录。（SSH现已发动服务，答应长途登录，装置办法不再赘述）

设置方法是修正/etc/default/grub文件将下面的一行免除注释

GRUB_TERMINAL=console

然后update-grub即可。

3.Hadoop环境的装备

3.1装备JDK环境（之前就做好了，这儿不再赘述）

3.2在官网下载Hadoop，然后解压到/opt/目录下面（这儿运用的是Hadoop-2.0.4-alpha）

然后进入目录/opt/hadoop-2.0.4-alpha/etc/hadoop，装备hadoop文件

修正文件hadoop-env.sh

exportHADOOP_FREFIX=/opt/hadoop-2.0.4-alpha
exportHADOOP_COMMON_HOME=${HADOOP_FREFIX}
exportHADOOP_HDFS_HOME=${HADOOP_FREFIX}
exportPATH=$PATH:$HADOOP_FREFIX/bin
exportPATH=$PATH:$HADOOP_FREFIX/sbin
exportHADOOP_MAPRED_HOME=${HADOOP_FREFIX}
exportYARN_HOME=${HADOOP_FREFIX}
exportHADOOP_CONF_HOME=${HADOOP_FREFIX}/etc/hadoop
exportYARN_CONF_DIR=${HADOOP_FREFIX}/etc/hadoop
exportJAVA_HOME=/opt/jdk1.7.0_21

修正文件hdfs-site.xml

<configuration>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:/opt/hadoop-2.0.4-alpha/workspace/name</value>
<description>DetermineswhereonthelocalfilesystemtheDFSnamenodeshouldstorethe
nametable.Ifthisisacomma-delimitedlistofdirectories,thennametableis
replicatedinallofthedirectories,forredundancy.</description>
<final>true</final>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>file:/opt/hadoop-2.0.4-alpha/workspace/data</value>
<description>DetermineswhereonthelocalfilesystemanDFSdatanodeshould
storeitsblocks.Ifthisisacomma-delimitedlistofdirectories,thendatawill
bestoredinallnameddirectories,typicallyondifferentdevices.Directoriesthatdonotexistareignored.
</description>
<final>true</final>
</property>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.permission</name>
<value>false</value>
</property>
</configuration>

修正文件mapred-site.xml

<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapreduce.job.tracker</name>
<value>hdfs://yan-Server:9001</value>
<final>true</final>
</property>
<property>
<name>mapreduce.map.memory.mb</name>
<value>1536</value>
</property>
<property>
<name>mapreduce.map.java.opts</name>
<value>-Xmx1024M</value>
</property>
<property>
<name>mapreduce.reduce.memory.mb</name>
<value>3072</value>
</property>
<property>
<name>mapreduce.reduce.java.opts</name>
<value>-Xmx2560M</value>
</property>
<property>
<name>mapreduce.task.io.sort.mb</name>
<value>512</value>
</property>
<property>
<name>mapreduce.task.io.sort.factor</name>
<value>100</value>
</property>
<property>
<name>mapreduce.reduce.shuffle.parallelcopies</name>
<value>50</value>
</property>
<property>
<name>mapred.system.dir</name>
<value>file:/opt/hadoop-2.0.4-alpha/workspace/systemdir</value>
<final>true</final>
</property>
<property>
<name>mapred.local.dir</name>
<value>file:/opt/hadoop-2.0.4-alpha/workspace/localdir</value>
<final>true</final>
</property>
</configuration>

修正文件yarn-env.xml

exportHADOOP_FREFIX=/opt/hadoop-2.0.4-alpha
exportHADOOP_COMMON_HOME=${HADOOP_FREFIX}
exportHADOOP_HDFS_HOME=${HADOOP_FREFIX}
exportPATH=$PATH:$HADOOP_FREFIX/bin