11.1.2 hdfs

如果部署新的zk实例选择依赖新的zookeeper(建议部署新的zookeeper)

新实例按照常规部署流程部署,需要修改以下配置

global:

cluster_name (与旧实例不同,推荐easyops-cluster-dev)

znode (共用一个zookeeper时必须与旧实例不同,不同zookeeper不需要修改)

ranger:

ranger_repo_name (与旧实例不同,推荐easyops-cluster-dev)

hdfs-site: (添加以下配置,根据旧实例对应值修改)

dfs.nameservices=easyops-cluster-dev,easyops-cluster (新实例cluster_name,旧实例cluster_name)

dfs.client.failover.proxy.provider.easyops-cluster=org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider

dfs.ha.namenodes.easyops-cluster=nn1,nn2

dfs.namenode.http-address.easyops-cluster.nn1=mammut4-dev.jdlt.163.org:50070

dfs.namenode.http-address.easyops-cluster.nn2=mammut5-dev.jdlt.163.org:50070

dfs.namenode.https-address.easyops-cluster.nn1=mammut4-dev.jdlt.163.org:50470

dfs.namenode.https-address.easyops-cluster.nn2=mammut5-dev.jdlt.163.org:50470

dfs.namenode.rpc-address.easyops-cluster.nn1=mammut4-dev.jdlt.163.org:8020

dfs.namenode.rpc-address.easyops-cluster.nn2=mammut5-dev.jdlt.163.org:8020

dfs.namenode.servicerpc-address.easyops-cluster.nn1=mammut4-dev.jdlt.163.org:8021

dfs.namenode.servicerpc-address.easyops-cluster.nn2=mammut5-dev.jdlt.163.org:8021

dfs.internal.nameservices:easyops-cluster-dev(新实例cluster_name)

为服务增加标签,标识为开发环境服务,

Generated

在配置服务步骤,点击高级选项,填写字段名为cluster_env,字段值为test

点击安装完成即可。

旧实例修改以下配置:

hdfs-site: (添加以下配置,根据新实例对应值修改)

dfs.nameservices=easyops-cluster-dev,easyops-cluster (新实例cluster_name,旧实例cluster_name)

dfs.client.failover.proxy.provider.easyops-cluster-dev=org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider

dfs.ha.namenodes.easyops-cluster-dev=nn1,nn2

dfs.namenode.http-address.easyops-cluster-dev.nn1=mammut4-dev.jdlt.163.org:50070

dfs.namenode.http-address.easyops-cluster-dev.nn2=mammut5-dev.jdlt.163.org:50070

dfs.namenode.https-address.easyops-cluster-dev.nn1=mammut4-dev.jdlt.163.org:50470

dfs.namenode.https-address.easyops-cluster-dev.nn2=mammut5-dev.jdlt.163.org:50470

dfs.namenode.rpc-address.easyops-cluster-dev.nn1=mammut4-dev.jdlt.163.org:8020

dfs.namenode.rpc-address.easyops-cluster-dev.nn2=mammut5-dev.jdlt.163.org:8020

dfs.namenode.servicerpc-address.easyops-cluster-dev.nn1=mammut4-dev.jdlt.163.org:8021

dfs.namenode.servicerpc-address.easyops-cluster-dev.nn2=mammut5-dev.jdlt.163.org:8021

dfs.internal.nameservices:easyops-cluster (旧实例cluster_name)

旧实例重启并同步配置