ceph性能测试
ceph性能测试知道rados bench 测试读写性能
RADOS 性能测试：使用 Ceph 自带的 rados bench 工具
该工具的语法为：rados bench -p <pool_name>
pool_name：测试所针对的存储池
seconds：测试所持续的秒数
<write|seq|rand>：操作模式，write：写，seq：顺序读；rand：随机读
-b：block size，即块大小，默认为 4M
-t：读/写并行数，默认为 16
–no-cleanup 表示测试完成后不删除测试用数据。在做读测试之前，需要使用该参数来运行一遍写测试来产生测试数据，在全部测试结束后可以运行 rados -p <pool_name> cleanup 来清理所有测试数据。
创建测试pool test
[root@node1 ~]# ceph osd pool create test 128
测试写10次 –no-cleanup 测试完不清除，方便测试读性能
[root@node1 ~]# rados bench -p test 10 write –no-cleanup
Maintaining 16 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 10 seconds or 0 objects
Object prefix: benchmark_data_node1_1926338
sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s)
0 0 0 0 0 0 – 0
1 16 40 24 95.9947 96 0.286313 0.506006
2 16 72 56 111.99 128 0.624219 0.470686
3 16 101 85 113.322 116 0.209796 0.4851
4 16 135 119 118.988 136 0.135871 0.478908
5 16 166 150 119.988 124 0.35653 0.496511
6 16 198 182 121.321 128 0.332704 0.500465
7 16 235 219 125.13 148 0.545974 0.488837
8 16 267 251 125.487 128 0.629281 0.496711
9 16 301 285 126.652 136 0.494172 0.488467
10 16 331 315 125.986 120 0.341215 0.493819
Total time run: 10.550521
Total writes made: 332
Write size: 4194304
Object size: 4194304
Bandwidth (MB/sec): 125.871
Stddev Bandwidth: 13.8884
Max bandwidth (MB/sec): 148
Min bandwidth (MB/sec): 96
Average IOPS: 31
Stddev IOPS: 3
Max IOPS: 37
Min IOPS: 24
Average Latency(s): 0.50814
Stddev Latency(s): 0.248969
Max latency(s): 1.55251
Min latency(s): 0.131588
顺序读测试性能
[root@node1 ~]# rados bench -p test 10 seq
sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s)
0 0 0 0 0 0 – 0
1 16 60 44 175.959 176 0.189005 0.247975
2 16 97 81 161.97 148 0.418242 0.336436
3 16 135 119 158.642 152 0.00743956 0.346134
4 16 180 164 163.976 180 0.00991076 0.33824
5 16 219 203 162.377 156 0.469989 0.342445
6 16 262 246 163.978 172 0.417605 0.353643
7 16 301 285 162.836 156 0.491171 0.349316
8 14 332 318 158.98 132 0.457095 0.355688
Total time run: 8.168123
Total reads made: 332
Read size: 4194304
Object size: 4194304
Bandwidth (MB/sec): 162.583
Average IOPS 40
Stddev IOPS: 4
Max IOPS: 45
Min IOPS: 33
Average Latency(s): 0.388643
Max latency(s): 2.67366
Min latency(s): 0.00655002
随机读测试性能
[root@node1 ~]# rados bench -p test 10 rand
sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s)
0 0 0 0 0 0 – 0
1 16 58 42 167.972 168 0.990937 0.255413
2 16 95 79 157.974 148 0.638151 0.34334
3 16 132 116 154.644 148 0.00977287 0.346029
4 16 176 160 159.978 176 0.29202 0.343479
5 16 214 198 158.379 152 0.00865839 0.361457
6 16 257 241 160.646 172 0.347527 0.365519
7 16 292 276 157.695 140 1.63507 0.379619
8 16 326 310 154.982 136 0.258374 0.39007
9 16 376 360 159.981 200 0.00867885 0.386118
10 16 412 396 158.382 144 0.00793857 0.381705
Total time run: 10.480731
Total reads made: 413
Read size: 4194304
Object size: 4194304
Bandwidth (MB/sec): 157.623
Average IOPS: 39
Stddev IOPS: 5
Max IOPS: 50
Min IOPS: 34
Average Latency(s): 0.40097
Max latency(s): 1.80235
Min latency(s): 0.00759585
[root@node1 ~]#