Luminous版本PG 分布调优

Luminous版本PG 分布调优

调优前

集群磁盘分为6TB的SATA和1.4TB的SSD,调优前PG分布情况

ID CLASS WEIGHT  REWEIGHT SIZE    USE     AVAIL   %USE VAR  PGS
 0       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 159
 1       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 139
 2       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 151
 3       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 135
 4       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 137
 5       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 145
 6       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 127
 7       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 136
10       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 151
11       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 141
12       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 152
13       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 133
14       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 148
15       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 117
16       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 143
17       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 156
20       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 163
21       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 123
22       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 167
23       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 151
24       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 139
25       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 156
26       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 150
27       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 137
30       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 143
31       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 142
32       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 153
33       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 155
34       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 141
35       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 155
36       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 158
37       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 135
40       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 143
41       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 145
42       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 117
43       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 141
44       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 148
45       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 134
46       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 144
47       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 146
50       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 130
51       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 143
52       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 149
53       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 151
54       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 153
55       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 158
56       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 136
57       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 136
60       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 133
61       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 152
62       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 145
63       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 145
64       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 121
65       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 138
66       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 144
67       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 156
70       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 155
71       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 132
72       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 131
73       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 148
74       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 142
75       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 154
76       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 148
77       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 146
80       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 126
81       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 160
82       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 136
83       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 158
84       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 141
85       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 155
86       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 141
87       1.00000  1.00000 5.46TiB 1.02GiB 5.46TiB 0.02 0.85 149
 8       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  41
 9       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  45
18       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  42
19       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  55
28       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  29
29       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  44
38       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  38
39       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  47
48       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  41
49       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  47
58       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  44
59       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  39
68       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  48
69       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  47
78       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  38
79       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  40
88       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  37
89       1.00000  1.00000 1.23TiB 1.01GiB 1.23TiB 0.08 3.71  46
                    TOTAL  415TiB 91.3GiB  415TiB 0.02
MIN/MAX VAR: 0.85/3.71  STDDEV: 0.03

调优过程

[root@demo devops]# ceph osd crush set-all-straw-buckets-to-straw2; #设置默认的straw算法版本,必须为straw2才行
[root@demo devops]# ceph osd dump|grep require_min_compat_client;
require_min_compat_client jewel #client的兼容性确认,必须在jewel以上
[root@demo devops]# cd /tmp
[root@demo tmp]# ceph osd getcrushmap -o crush.map; crushtool -d crush.map | grep straw; rm -f crush.map
19
tunable straw_calc_version 1
    alg straw2 #确认当前crushmap的straw版本为straw2
    alg straw2
    alg straw2
    alg straw2
  ......
[root@demo tmp]# ceph mgr module ls #检查mgr启用的模块
{
    "enabled_modules": [
        "balancer", #需要开启
        "restful",
        "status"
    ],
    "disabled_modules": [
        "dashboard",
        "influx",
        "localpool",
        "prometheus",
        "selftest",
        "zabbix"
    ]
}
[root@demo tmp]# ceph mgr module enable balancer #开启balancer模块
[root@demo tmp]# ceph balancer on #启动balancer服务
[root@demo tmp]# ceph balancer mode crush-compat #设置balancer模式为crush-compat
[root@demo tmp]# ceph config-key set "mgr/balancer/max_misplaced": "0.01" #设置最大允许的PG调整百分比
set mgr/balancer/max_misplaced:
[root@demo tmp]#ceph config-key dump #检查配置信息
{
    "mgr/balancer/active": "1",
    "mgr/balancer/max_misplaced:": "0.01",
    "mgr/balancer/mode": "crush-compat"
}
[root@demo tmp]# ceph balancer status #确认balancer服务状态
{
    "active": true,
    "plans": [],
    "mode": "crush-compat"
}
[root@demo tmp]# ceph balancer eval #对集群所有pool进行权重调整计算
current cluster score 0.055880 (lower is better)
[root@demo tmp]# ceph balancer optimize plan1 #生成一个调优配置
[root@demo tmp]# ceph balancer eval plan1 #执行调优计算
plan plan1 final score 0.051269 (lower is better)
[root@demo tmp]# ceph balancer show plan1 #查看调优计算最终的结果
# starting osdmap epoch 133
# starting crush version 19
# mode crush-compat
ceph osd crush weight-set create-compat
ceph osd crush weight-set reweight-compat 0 0.953864
ceph osd crush weight-set reweight-compat 1 1.015576
ceph osd crush weight-set reweight-compat 2 0.979331
ceph osd crush weight-set reweight-compat 3 1.027135
ceph osd crush weight-set reweight-compat 4 1.019382
ceph osd crush weight-set reweight-compat 5 0.997575
ceph osd crush weight-set reweight-compat 6 1.056513
ceph osd crush weight-set reweight-compat 7 1.017608
ceph osd crush weight-set reweight-compat 8 1.025906
ceph osd crush weight-set reweight-compat 9 0.971980
ceph osd crush weight-set reweight-compat 10 0.977721
ceph osd crush weight-set reweight-compat 11 1.010023
ceph osd crush weight-set reweight-compat 12 0.974584
ceph osd crush weight-set reweight-compat 13 1.031186
ceph osd crush weight-set reweight-compat 14 0.987420
ceph osd crush weight-set reweight-compat 15 1.090414
ceph osd crush weight-set reweight-compat 16 1.002817
ceph osd crush weight-set reweight-compat 17 0.967031
ceph osd crush weight-set reweight-compat 18 1.006324
ceph osd crush weight-set reweight-compat 19 0.890982
ceph osd crush weight-set reweight-compat 20 0.944272
ceph osd crush weight-set reweight-compat 21 1.068136
ceph osd crush weight-set reweight-compat 22 0.939127
ceph osd crush weight-set reweight-compat 23 0.976133
ceph osd crush weight-set reweight-compat 24 1.011879
ceph osd crush weight-set reweight-compat 25 0.970162
ceph osd crush weight-set reweight-compat 26 0.976133
ceph osd crush weight-set reweight-compat 27 1.021278
ceph osd crush weight-set reweight-compat 28 1.169907
ceph osd crush weight-set reweight-compat 29 0.977285
ceph osd crush weight-set reweight-compat 30 1.002817
ceph osd crush weight-set reweight-compat 31 1.006391
ceph osd crush weight-set reweight-compat 32 0.971493
ceph osd crush weight-set reweight-compat 33 0.963949
ceph osd crush weight-set reweight-compat 34 1.010023
ceph osd crush weight-set reweight-compat 35 0.962471
ceph osd crush weight-set reweight-compat 36 0.959621
ceph osd crush weight-set reweight-compat 37 1.025203
ceph osd crush weight-set reweight-compat 38 1.046765
ceph osd crush weight-set reweight-compat 39 0.951830
ceph osd crush weight-set reweight-compat 40 1.004613
ceph osd crush weight-set reweight-compat 41 0.994117
ceph osd crush weight-set reweight-compat 42 1.097650
ceph osd crush weight-set reweight-compat 43 1.004613
ceph osd crush weight-set reweight-compat 44 0.989105
ceph osd crush weight-set reweight-compat 45 1.023423
ceph osd crush weight-set reweight-compat 46 0.999298
ceph osd crush weight-set reweight-compat 47 0.994138
ceph osd crush weight-set reweight-compat 48 1.012533
ceph osd crush weight-set reweight-compat 49 0.947047
ceph osd crush weight-set reweight-compat 50 1.045593
ceph osd crush weight-set reweight-compat 51 0.999298
ceph osd crush weight-set reweight-compat 52 0.987480
ceph osd crush weight-set reweight-compat 53 0.977721
ceph osd crush weight-set reweight-compat 54 0.977869
ceph osd crush weight-set reweight-compat 55 0.956697
ceph osd crush weight-set reweight-compat 56 1.021327
ceph osd crush weight-set reweight-compat 57 1.013993
ceph osd crush weight-set reweight-compat 58 0.982837
ceph osd crush weight-set reweight-compat 59 1.032512
ceph osd crush weight-set reweight-compat 60 1.033153
ceph osd crush weight-set reweight-compat 61 0.969951
ceph osd crush weight-set reweight-compat 62 0.995834
ceph osd crush weight-set reweight-compat 63 0.994117
ceph osd crush weight-set reweight-compat 64 1.075335
ceph osd crush weight-set reweight-compat 65 1.021278
ceph osd crush weight-set reweight-compat 66 0.994138
ceph osd crush weight-set reweight-compat 67 0.968586
ceph osd crush weight-set reweight-compat 68 0.937903
ceph osd crush weight-set reweight-compat 69 0.956825
ceph osd crush weight-set reweight-compat 70 0.963949
ceph osd crush weight-set reweight-compat 71 1.039260
ceph osd crush weight-set reweight-compat 72 1.045536
ceph osd crush weight-set reweight-compat 73 0.987420
ceph osd crush weight-set reweight-compat 74 0.999340
ceph osd crush weight-set reweight-compat 75 0.968447
ceph osd crush weight-set reweight-compat 76 0.985758
ceph osd crush weight-set reweight-compat 77 0.992424
ceph osd crush weight-set reweight-compat 78 1.046765
ceph osd crush weight-set reweight-compat 79 1.019053
ceph osd crush weight-set reweight-compat 80 1.063215
ceph osd crush weight-set reweight-compat 81 0.953911
ceph osd crush weight-set reweight-compat 82 1.019454
ceph osd crush weight-set reweight-compat 83 0.964151
ceph osd crush weight-set reweight-compat 84 1.010023
ceph osd crush weight-set reweight-compat 85 0.968499
ceph osd crush weight-set reweight-compat 86 1.001131
ceph osd crush weight-set reweight-compat 87 0.980887
ceph osd crush weight-set reweight-compat 88 1.061885
ceph osd crush weight-set reweight-compat 89 0.961657
[root@demo tmp]#  ceph balancer execute plan1 #根据上面模拟计算的结果,执行最终的权重调整

[root@demo tmp]# ceph balancer reset #如果你对调优后的结果不满意,可以用这个回滚操作
[root@demo cephuser]# ceph balancer off #关闭balancer模块
[root@demo cephuser]# ceph balancer status #查看模块状态
{
    "active": false, #已经关闭
    "plans": [],
    "mode": "crush-compat"
}

调优后的结果

ID CLASS WEIGHT  REWEIGHT SIZE    USE     AVAIL   %USE VAR  PGS
 0       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 144
 1       1.00000  1.00000 5.46TiB 1.12GiB 5.46TiB 0.02 0.87 147
 2       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.87 144
 3       1.00000  1.00000 5.46TiB 1.08GiB 5.46TiB 0.02 0.84 146
 4       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.86 143
 5       1.00000  1.00000 5.46TiB 1.08GiB 5.46TiB 0.02 0.84 144
 6       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.86 143
 7       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.86 144
10       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.87 137
11       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.86 147
12       1.00000  1.00000 5.46TiB 1.12GiB 5.46TiB 0.02 0.87 141
13       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.86 150
14       1.00000  1.00000 5.46TiB 1.12GiB 5.46TiB 0.02 0.87 140
15       1.00000  1.00000 5.46TiB 1.08GiB 5.46TiB 0.02 0.84 144
16       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.86 145
17       1.00000  1.00000 5.46TiB 1.14GiB 5.46TiB 0.02 0.89 149
20       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 141
21       1.00000  1.00000 5.46TiB 1.08GiB 5.46TiB 0.02 0.84 142
22       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 143
23       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 141
24       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.86 144
25       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 141
26       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 152
27       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.87 144
30       1.00000  1.00000 5.46TiB 1.08GiB 5.46TiB 0.02 0.84 146
31       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.85 143
32       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 144
33       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.86 147
34       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.85 141
35       1.00000  1.00000 5.46TiB 1.12GiB 5.46TiB 0.02 0.87 146
36       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.86 143
37       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.87 146
40       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.86 149
41       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 141
42       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 141
43       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.87 148
44       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.87 145
45       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.86 138
46       1.00000  1.00000 5.46TiB 1.08GiB 5.46TiB 0.02 0.84 144
47       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 143
50       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.86 142
51       1.00000  1.00000 5.46TiB 1.12GiB 5.46TiB 0.02 0.87 142
52       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 145
53       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 147
54       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 145
55       1.00000  1.00000 5.46TiB 1.13GiB 5.46TiB 0.02 0.88 144
56       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.86 143
57       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.86 143
60       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.86 142
61       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 144
62       1.00000  1.00000 5.46TiB 1.12GiB 5.46TiB 0.02 0.87 145
63       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.85 145
64       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.87 138
65       1.00000  1.00000 5.46TiB 1.07GiB 5.46TiB 0.02 0.84 146
66       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.85 148
67       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.86 140
70       1.00000  1.00000 5.46TiB 1.12GiB 5.46TiB 0.02 0.87 153
71       1.00000  1.00000 5.46TiB 1.07GiB 5.46TiB 0.02 0.83 142
72       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.86 139
73       1.00000  1.00000 5.46TiB 1.08GiB 5.46TiB 0.02 0.84 145
74       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.86 144
75       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 144
76       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.87 144
77       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.86 146
80       1.00000  1.00000 5.46TiB 1.12GiB 5.46TiB 0.02 0.87 149
81       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.87 144
82       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.87 143
83       1.00000  1.00000 5.46TiB 1.09GiB 5.46TiB 0.02 0.85 148
84       1.00000  1.00000 5.46TiB 1.08GiB 5.46TiB 0.02 0.85 145
85       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.86 141
86       1.00000  1.00000 5.46TiB 1.11GiB 5.46TiB 0.02 0.86 138
87       1.00000  1.00000 5.46TiB 1.10GiB 5.46TiB 0.02 0.86 143
 8       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  43
 9       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  43
18       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  43
19       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  42
28       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  43
29       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  42
38       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  43
39       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  41
48       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  49
49       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  39
58       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  38
59       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  46
68       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  49
69       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  35
78       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  44
79       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  43
88       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  41
89       1.00000  1.00000 1.23TiB 1.02GiB 1.23TiB 0.08 3.52  44
                    TOTAL  415TiB 97.6GiB  415TiB 0.02

总结

Luminous版本开始新增的balancer模块在PG分布优化方面效果非常明显,操作也非常简便,强烈推荐各位在集群上线之前进行这一操作,能够极大的提升整个集群资源的使用率,同时在减少热点数据访问方面也有一定优化,对集群整体的性能提升有一定帮助。

参考资料: http://docs.ceph.com/docs/master/rados/operations/balancer/

原文发布于微信公众号 - Ceph对象存储方案(cephbook)

原文发表时间:2018-09-21

本文参与腾讯云自媒体分享计划,欢迎正在阅读的你也加入,一起分享。

发表于

我来说两句

0 条评论
登录 后参与评论

相关文章

扫码关注云+社区