Hadoop2.0 配置yarn成功

Ubuntu 13.04上搭建Hadoop环境

Ubuntu 12.10 +Hadoop 1.2.1版本集群配置

Ubuntu上搭建Hadoop环境（单机模式+伪分布模式）

Ubuntu下Hadoop环境的配置

单机版搭建Hadoop环境图文教程详解

Hadoop LZO 安装教程

Hadoop集群上使用Lzo压缩

--------------------------------------分割线 --------------------------------------
 
core-site.xml:
 
<?xml version="1.0"?>
 <?xml-stylesheet type="text/xsl" href="https://www.linuxidc.com/configuration.xsl"?>
 

<!-- Put site-specific property overrides in this file. -->
 

<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://fc20:9000</value>
    </property>
 

<property>
        <name>hadoop.tmp.dir</name>
        <value>/home/ljq/hadoop/tmp</value>
    </property>
 

<property>
        <name>hadoop.native.lib</name>
        <value>false</value>
        <description>Should native hadoop libraries, if present, be used.</description>
    </property>
 </configuration>
 

hdfs-site.xml:
 
<?xml version="1.0"?>
 <?xml-stylesheet type="text/xsl" href="https://www.linuxidc.com/configuration.xsl"?>
 

<!-- Put site-specific property overrides in this file. -->
 

<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
 

<property>
        <name>dfs.namenode.name.dir</name>
        <value>/home/ljq/hadoop/dfs/name</value>
    </property>
 

<property>
        <name>dfs.datanode.data.dir</name>
        <value>/home/ljq/hadoop/dfs/data</value>
    </property>
 </configuration>
 

mapred-site.xml:
 
<?xml version="1.0"?>
 <?xml-stylesheet type="text/xsl" href="https://www.linuxidc.com/configuration.xsl"?>
 

<!-- Put site-specific property overrides in this file. -->
 

<configuration>
    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>  一定是小写yarn否则出现错误:java.lang.IllegalStateException: Invalid shuffle port number -1
    </property>
 
</configuration>
 

yarn-site.xml: 文件里所有yarn都必须小写,否则相应的端口信息找不到,会在默认端口上启动进程
 
<?xml version="1.0"?>
 <configuration>
 

<!-- Site specific YARN configuration properties -->
 

<property>
        <description>The hostname of the RM.</description>
        <name>yarn.resourcemanager.hostname</name>
        <value>fc20</value>
    </property>
 
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce.shuffle</value>
    </property>
 
    <property>
        <description>The address of the applications manager interface in the RM.</description>
        <name>yarn.resourcemanager.address</name>
        <value>fc20:18004</value>
    </property>
 
    <property>
        <description>The address of the scheduler interface.</description>
        <name>yarn.resourcemanager.scheduler.address</name>
        <value>fc20:18003</value>
    </property>
 
    <property>
        <description>The address of the RM web application.</description>
        <name>yarn.resourcemanager.webapp.address</name>
        <value>fc20:18008</value>
    </property>
 
    <property>
        <description>The address of the resource tracker interface.</description>
        <name>yarn.resourcemanager.resource-tracker.address</name>
        <value>fc20:18006</value>
    </property>
 

</configuration>
 

通过netstat可以看见相应端口已经启动
 
运行wordcount以及自己写的mapreduce可以成功完成!