ceph 数据恢复和回填速度 重建osd 加快数据恢复

1. 数据恢复操作的优先级提到最高级别

• 默认

# ceph daemon mon.k003 config show | grep osd_recovery_op_priority
    "osd_recovery_op_priority": "3",
1
2

• 参数设置为 63

# ceph tell osd.* injectargs --osd_recovery_op_priority 63
1

# ceph daemon osd.0 config show | grep osd_recovery_op_priority
    "osd_recovery_op_priority": "63",
1
2

2. 回填并发操作数

• 默认

# ceph daemon mon.k003 config show | grep osd_max_backfills
    "osd_max_backfills": "1",
1
2

• 参数设置为 50

# ceph tell osd.* injectargs --osd_max_backfills 50
1

# ceph daemon osd.0 config show | grep osd_max_backfills
    "osd_max_backfills": "50",
1
2

3. 恢复的并发操作数

• 每个OSD上同时进行的所有PG的恢复操作（active recovery）的最大数量

# ceph daemon mon.k003 config show | grep osd_recovery_max_active
    "osd_recovery_max_active": "3",
1
2

# ceph tell osd.* injectargs --osd_recovery_max_active 50
1

# ceph daemon osd.0 config show | grep osd_recovery_max_active
    "osd_recovery_max_active": "50",
1
2

4. OSD在某个时刻会为一个PG启动恢复操作数

# ceph daemon osd.0 config show | grep osd_recovery_max_single_start
    "osd_recovery_max_single_start": "1",
1
2

# ceph tell osd.* injectargs --osd_recovery_max_single_start 5
1

# ceph daemon osd.0 config show | grep osd_recovery_max_single_start
    "osd_recovery_max_single_start": "5",
1
2

参考

1. 控制数据恢复及回填速度
2. Ceph 业务优先和恢复优先配置