hadoop压缩包：

链接: https://pan.baidu.com/s/1ZhyJat5XktXykGcNqOg3hw 提取码: ycuw

hadoop解压文件我放在了/opt/soft路径下

一、进入hadoop配置页面进行设置

# 配置文件目录
[root@hadoop hadoop313]# cd ./etc/hadoop

1、修改core-site.xml

添加如下内容：

<configuration><property><name>fs.defaultFS</name><value>hdfs://gree143:9000</value></property><property><name>hadoop.tmp.dir</name><value>/opt/soft/hadoop313/data</value><description>namenode上本地的hadoop临时文件夹</description></property><property><name>hadoop.http.staticuser.user</name><value>root</value></property><property><name>io.file.buffer.size</name><value>131072</value><description>读写队列缓存：128K</description></property><property><name>hadoop.proxyuser.root.hosts</name><value>*</value></property><property><name>hadoop.proxyuser.root.groups</name><value>*</value></property>
</configuration>

2、修改hdfs-site.xml

<configuration><property><name>dfs.replication</name><value>1</value><description>hadoop中每一个block文件的备份数量</description></property><property><name>dfs.namenode.name.dir</name><value>/opt/soft/hadoop313/data/dfs/name</value><description>namenode上存储hdfsq名字空间元数据的目录</description></property><property><name>dfs.datanode.data.dir</name><value>/opt/soft/hadoop313/data/dfs/data</value><description>datanode上数据块的物理存储位置目录</description></property><property><name>dfs.permissions.enabled</name><value>false</value><description>关闭权限验证</description></property>
</configuration>

3、修改mapred-site.xml

<configuration><property><name>mapreduce.framework.name</name><value>yarn</value><description>job执行框架： local, classic or yarn</description><final>true</final></property><property><name>mapreduce.application.classpath</name><value>/opt/soft/hadoop313/etc/hadoop:/opt/soft/hadoop313/share/hadoop/common/lib/*:/opt/soft/hadoop313/share/hadoop/common/*:/opt/soft/hadoop313/share/hadoop/hdfs/*:/opt/soft/hadoop313/share/hadoop/hdfs/lib/*:/opt/soft/hadoop313/share/hadoop/mapreduce/*:/opt/soft/hadoop313/share/hadoop/mapreduce/lib/*:/opt/soft/hadoop313/share/hadoop/yarn/*:/opt/soft/hadoop313/share/hadoop/yarn/lib/*</value></property><property><name>mapreduce.jobhistory.address</name><value>gree143:10020</value></property><property><name>mapreduce.jobhistory.webapp.address</name><value>gree143:19888</value></property><property><name>mapreduce.map.memory.mb</name><value>1024</value></property><property><name>mapreduce.reduce.memory.mb</name><value>1024</value></property></configuration>

4、修改yarn-site.xml

<configuration><!-- Site specific YARN configuration properties --><property><name>yarn.resourcemanager.connect.retry-interval.ms</name><value>20000</value></property><property><name>yarn.resourcemanager.scheduler.class</name><value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler</value></property><property><name>yarn.nodemanager.localizer.address</name><value>gree143:8040</value></property><property><name>yarn.nodemanager.address</name><value>gree143:8050</value></property><property><name>yarn.nodemanager.webapp.address</name><value>gree143:8042</value></property><property><name>yarn.nodemanager.aux-services</name><value>mapreduce_shuffle</value></property><property><name>yarn.nodemanager.local-dirs</name><value>/opt/soft/hadoop313/yarndata/yarn</value></property><property><name>yarn.nodemanager.log-dirs</name><value>/opt/soft/hadoop313/yarndata/log</value></property></configuration>

5、修改hadoop-env.sh

添加JAVA_HOME目录

【注】修改hotname

上面所有配置文件中的【gree143】均为hostname。

修改hostnamed的方式：

# 修改计算机名称：
hostnamectl -sethostname gree143
# 查看当前hostname
hostname
# 刷新
bash

二、profile文件

# 进入profile文件
[root@hadoop etc]# vim /etc/profile# 在profile中添加配置依赖
# JAVA_HOME
export JAVA_HOME=/opt/soft/jdk180
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export PATH=$PATH:$JAVA_HOME/bin# HADOOP_HOME
export HADOOP_HOME=/opt/soft/hadoop313
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$HADOOP_HOME/lib
export HDFS_NAMENODE_USER=root
export HDFS_DATANODE_USER=root
export HDFS_SECONDARYNAMENODE_USER=root
export HDFS_JOURNALNODE_USER=root
export HDFS_ZKFC_USER=root
export YARN_RESOURCEMANAGER_USER=root
export YARN_NODEMANAGER_USER=root
export HADOOP_MAPRED_HOME=$HADOOP_HOME
export HADOOP_COMMON_HOME=$HADOOP_HOME
export HADOOP_HDFS_HOME=$HADOOP_HOME
export HADOOP_YARN_HOME=$HADOOP_HOME
export HADOOP_INSTALL=$HADOOP_HOME
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HADOOP_LIBEXEC_DIR=$HADOOP_HOME/libexec
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop

三、重启服务

# 刷新当前环境
[root@hadoop hadoop]# source /etc/profile# 格式化命令
[root@hadoop hadoop]# hdfs namenode -format# 重启hadoop命令
[root@hadoop hadoop]# start-all.sh# 查看当前进程
[root@hadoop hadoop]# jps

四、远程接入可视化界面

ip地址:端口号
192.168.153.138：9870