CC00053.hadoop——|Hadoop&MapReduce.V25|——|Hadoop.v25|Yarn资源调度|多租户|资源隔离配置|
时间:2023-01-01 10:30:00
### --- Yarn多租户资源隔离配置 ~~~ Yarn集群资源设置为A,B两个队列, ~~~ A队列设置占用70%的资源,主要用于运行常规定时任务, ~~~ B队列设置占用资源30%主要运行临时任务, ~~~ 如果A队列资源占满,两个队列之间可以共享资源。B队列资源丰富, ~~~ A队列可以利用B队列的资源,最大限度地利用整体资源. ~~~ 选择使用Fair Scheduler调度策略!!
### --- yarn-site.xml [root@linux121 ~]# vim /opt/yanqi/servers/hadoop-2.9.2/etc/hadoop/yarn-site.xml yarn.resourcemanager.scheduler.class org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler In case you do not want to use the defaultscheduler ### --- 发送到其它节点 [root@linux121 ~]# rsync-script /opt/yanqi/servers/hadoop-2.9.2/etc/hadoop/yarn-site.xml
### --- 创建fair-scheduler.xml文件 ~~~ 在Hadoop安装目录/etc/hadoop创建该文件 ~~~ # 创建fair-scheduler.xml文件 [root@linux121 ~]# vim /opt/yanqi/servers/hadoop-2.9.2/etc/hadoop/fair-scheduler.xml fair * * 9216 mb,4 vcores 100 1024 mb,1vcores 1000 fair 7 * * 4096 mb,4vcores 5 1024 mb, 1vcores 1000 fair 3 ### --- 发送到其它节点 [root@linux121 ~]# rsync-script /opt/yanqi/servers/hadoop-2.9.2/etc/hadoop/fair-scheduler.xml
### --- 重启yarn集群 [root@linux123 ~]# stop-yarn.sh [root@linux123 ~]# start-yarn.sh
