SuifengFlying

公告

欢迎来到我的博客，这里记录生活与技术。

了解更多

551 字

3 分钟

Hadoop部署补丁

2026-05-12

BigData

/

Hadoop

/

HA

/

Deployment

Hadoop部署补丁#

1.本文档中的指令全程在hadoop01中输入（除jps验证） 2.需在hadoop01输入如下指令扩容空间 sudo lvextend -r -l +100%FREE /dev/ubuntu-vg/ubuntu-lv

启动hadoop,zookeeper,jobHistory集群#

切换用户

1
su hadooper

加载环境变量

1
cd ../..
2

3
source etc/profile

启动ZooKeeper

1
zkServer.sh start
2

3
ssh hadoop02 "bash -c 'source /etc/profile && zkServer.sh start'"
4

5
ssh hadoop03 "bash -c 'source /etc/profile && zkServer.sh start'"

启动hadoop

1
bash /export/servers/hadoop/sbin/start-all.sh

启动JobHistory

1
mapred --daemon start historyserver
2

3
ssh hadoop02 "bash -c 'source /etc/profile && mapred --daemon start historyserver'"
4

5
ssh hadoop03 "bash -c 'source /etc/profile && mapred --daemon start historyserver'"

清除zookeeper历史残留#

进入 ZooKeeper 客户端

1
zkCli.sh

删除 YARN 的选举锁

1
deleteall /yarn-leader-election

删除 YARN 的状态存储

1
deleteall /rmstore

检查并删除 HDFS 的 HA 状态

1
deleteall /hadoop-ha

退出 ZooKeeper 客户端

1
quit

替换文件#

均为单行指令

将新的yarn-site.xml文件通过ssh工具（finalshell\windterm等）上传到/export/servers/hadoop/etc/hadoop路径下覆盖旧的yarn-site.xml文件或者通过命令行修改，步骤如下：

1
cd /export/servers/hadoop/etc/hadoop
2

3
vim yarn-site.xml

输入ggdG（严格按照大小写）清除原本的内容进入Insert模式将新的内容替换到原文件中保存并退出分发给hadoop02

1
scp /export/servers/hadoop/etc/hadoop/yarn-site.xml hadoop02:/tmp/ && \
2

3
ssh hadoop02 "sudo cp /tmp/yarn-site.xml /export/servers/hadoop/etc/hadoop && sudo rm /tmp/yarn-site.xml"

分发给hadoop03

1
scp /export/servers/hadoop/etc/hadoop/yarn-site.xml hadoop03:/tmp/ && \
2

3
ssh hadoop03 "sudo cp /tmp/yarn-site.xml /export/servers/hadoop/etc/hadoop && sudo rm /tmp/yarn-site.xml"

重启hadoop,zookeeper,jobHistory集群

关闭JobHistory

1
mapred --daemon stop historyserver
2

3
ssh hadoop02 "bash -c 'source /etc/profile && mapred --daemon stop historyserver'"
4

5
ssh hadoop03 "bash -c 'source /etc/profile && mapred --daemon stop historyserver'"

关闭hadoop

1
bash /export/servers/hadoop/sbin/stop-all.sh

关闭ZooKeeper

1
zkServer.sh stop
2

3
ssh hadoop02 "bash -c 'source /etc/profile && zkServer.sh stop'"
4

5
ssh hadoop03 "bash -c 'source /etc/profile && zkServer.sh stop'"

启动ZooKeeper

1
zkServer.sh start
2

3
ssh hadoop02 "bash -c 'source /etc/profile && zkServer.sh start'"
4

5
ssh hadoop03 "bash -c 'source /etc/profile && zkServer.sh start'"

启动hadoop

1
bash /export/servers/hadoop/sbin/start-all.sh

重新初始化ZooKeeper

1
hdfs zkfc -formatZK

重新启动 HDFS 服务

1
stop-dfs.sh
2

3
start-dfs.sh

启动JobHistory

1
mapred --daemon start historyserver
2

3
ssh hadoop02 "bash -c 'source /etc/profile && mapred --daemon start historyserver'"
4

5
ssh hadoop03 "bash -c 'source /etc/profile && mapred --daemon start historyserver'"