Linux下Hadoop集群安装详细步骤(3)

.2.jar:/usr/local/hadoop/bin/../lib/paranamer-generator-2.2.jar:/usr/local/hadoop/bin/../lib/qdox-1.10.1.jar:/usr/local/hadoop/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/local/hadoop/bin/../lib/slf4j-api-1.5.11.jar:/usr/local/hadoop/bin/../lib/slf4j-log4j12-1.5.11.jar:/usr/local/hadoop/bin/../lib/xmlenc-0.52.jar:/usr/local/hadoop/bin/../lib/jsp-2.1/*.jar:/usr/local/hadoop/hdfs/bin/../conf:/usr/local/hadoop/hdfs/bin/../hadoop-hdfs-*.jar:/usr/local/hadoop/hdfs/bin/../lib/*.jar:/usr/local/hadoop/bin/../mapred/conf:/usr/local/hadoop/bin/../mapred/hadoop-mapred-*.jar:/usr/local/hadoop/bin/../mapred/lib/*.jar:/usr/local/hadoop/hdfs/bin/../hadoop-hdfs-*.jar:/usr/local/hadoop/hdfs/bin/../lib/*.jar

STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.21 -r 985326; compiled by 'tomwhite' on Tue Aug 17 01:02:28 EDT 2010

************************************************************/

Re-format filesystem in /usr/local/hadoop/tmp/dfs/name ? (Y or N) y

Format aborted in /usr/local/hadoop/tmp/dfs/name

11/06/16 13:04:17 INFO namenode.NameNode: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG: Shutting down NameNode at namenode/172.16.101.251

************************************************************/

k. 启动Hadoop ./bin/start-all.sh
                            This script is Deprecated. Instead use start-dfs.sh and start-mapred.sh

starting namenode, logging to /usr/local/hadoop//logs/hadoop-root-namenode-namenode.out

datanode1: starting datanode, logging to /usr/local/hadoop/bin/../logs/hadoop-root-datanode-datanode1.out

datanode2: starting datanode, logging to /usr/local/hadoop/bin/../logs/hadoop-root-datanode-datanode2.out

datanode3: starting datanode, logging to /usr/local/hadoop/bin/../logs/hadoop-root-datanode-datanode3.out

namenode: starting secondarynamenode, logging to /usr/local/hadoop/bin/../logs/hadoop-root-secondarynamenode-namenode.out

starting jobtracker, logging to /usr/local/hadoop//logs/hadoop-root-jobtracker-namenode.out

datanode3: starting tasktracker, logging to /usr/local/hadoop/bin/../logs/hadoop-root-tasktracker-datanode3.out

datanode2: starting tasktracker, logging to /usr/local/hadoop/bin/../logs/hadoop-root-tasktracker-datanode2.out

datanode1: starting tasktracker, logging to /usr/local/hadoop/bin/../logs/hadoop-root-tasktracker-datanode1.out

启动后用命令JPS查看结果如下:

[root@ hadoop]# jps

1806 Jps

1368 NameNode

1694 JobTracker

1587 SecondaryNameNode

然后到Datanode1/2/3上去查看,执行JPS,结果如下:

[root@datanode2 hadoop]# jps

1440 Jps

1382 TaskTracker

1303 DataNode

[root@datanode2 hadoop]# jps

1382 TaskTracker

1303 DataNode

1452 Jps

说明你成功集群安装了Hadoop

7. HDFS操作
          运行bin/目录的hadoop命令,可以查看Haoop所有支持的操作及其用法,这里以几个简单的操作为例。

建立目录
          [root@ hadoop]# ./bin/hadoop  dfs  -mkdir  testdir

在HDFS中建立一个名为testdir的目录

复制文件
          [root@ hadoop]# ./bin/hadoop  dfs  -put  /home/dbrg/large.zip  testfile.zip

把本地文件large.zip拷贝到HDFS的根目录/user/dbrg/下,文件名为testfile.zip

查看现有文件
          [root@ hadoop]# ./bin/hadoop  dfs  -ls

内容版权声明:除非注明,否则皆为本站原创文章。

转载注明出处:http://127.0.0.1/wyyjfy.html