• netapp3210存储更换故障硬盘过程

    1.连好串口线，用超级终端或PUTTY软件登录到存储或者使用telnet登录

    1.  
    2. Data ONTAP (netapp3210B.hangtianjinsui.net)
    3. login: root
    4. Password: 
    5. Sat Nov 26 09:10:38 CST [netapp3210B: telnet_0:info]: root logged in from host

    2.运行disk show –v，查看故障硬盘

    1. netapp3210B> disk show -v
    2.   DISK       OWNER                  POOL   SERIAL NUMBER           HOME                     CHKSUM
    3. ------------ -------------          -----  -------------           -------------            ------
    4. 0b.01.18     netapp3210A(1573857221)    Pool0  JZV95J1J              netapp3210A(1573857221)  Block
    5. 0a.01.15     netapp3210A(1573857221)    Pool0  CZY8DPUN              netapp3210A(1573857221)  Block
    6. 0b.01.20     netapp3210A(1573857221)    Pool0  JZV91WYJ              netapp3210A(1573857221)  Block
    7. 0b.01.16     netapp3210A(1573857221)    Pool0  JZV19P7J              netapp3210A(1573857221)  Block
    8. 0a.01.11     netapp3210A(1573857221)    Pool0  JZV9467J              netapp3210A(1573857221)  Block
    9. 0b.01.8      netapp3210A(1573857221)    Pool0  JZV8XGNJ              netapp3210A(1573857221)  Block
    10. 0a.01.3      netapp3210A(1573857221)    Pool0  JZV91LYJ              netapp3210A(1573857221)  Block
    11. 0a.01.13     netapp3210B(1573852909)    Pool0  JZV9KYJJ              netapp3210B(1573852909)  Block
    12. 0a.01.5                                 FAILED JZV9479J             Block
    13. 0b.01.2      netapp3210A(1573857221)    Pool0  JZV9136J              netapp3210A(1573857221)  Block
    14. 0b.01.10     netapp3210A(1573857221)    Pool0  JZV7SAYJ              netapp3210A(1573857221)  Block
    15. 0a.01.19     netapp3210A(1573857221)    Pool0  JZVA2U2J              netapp3210A(1573857221)  Block
    16. 0b.01.4      netapp3210A(1573857221)    Pool0  JZV8SN4J              netapp3210A(1573857221)  Block
    17. 0a.01.1      netapp3210A(1573857221)    Pool0  JZV74KHJ              netapp3210A(1573857221)  Block
    18. 0a.01.21     netapp3210A(1573857221)    Pool0  JZV7ESAJ              netapp3210A(1573857221)  Block
    19. 0b.01.22     netapp3210A(1573857221)    Pool0  JZV97BSJ              netapp3210A(1573857221)  Block
    20. 0a.01.17     netapp3210A(1573857221)    Pool0  JZV90LGJ              netapp3210A(1573857221)  Block
    21. 0b.01.14     netapp3210B(1573852909)    Pool0  JZV9J0KJ              netapp3210B(1573852909)  Block
    22. 0b.01.12     netapp3210B(1573852909)    Pool0  JZV9KZSJ              netapp3210B(1573852909)  Block
    23. 0a.01.7      netapp3210A(1573857221)    Pool0  JZV8MW4J              netapp3210A(1573857221)  Block
    24. 0b.01.6      netapp3210A(1573857221)    Pool0  JZV95EUJ              netapp3210A(1573857221)  Block
    25. 0b.01.0      netapp3210A(1573857221)    Pool0  JZV7GLUJ              netapp3210A(1573857221)  Block
    26. 0a.01.9      netapp3210A(1573857221)    Pool0  6SLAWVLK0000N636075Q  netapp3210A(1573857221)  Block
    27. 0a.01.23     netapp3210A(1573857221)    Pool0  JZVA2MUJ              netapp3210A(1573857221)  Block

    发现0a.01.5  这块硬盘故障

    备注：上面的硬盘没有显示属于哪个存储控制器的原因是由于在新购硬盘没有到货之前，B控上面还有多余的冗余硬盘，而A控故障一块硬盘之后没有冗余硬盘了，我把B控的冗余硬盘剔除一块，分到A控上作为冗余硬盘，所以出现这个问题。

    具体命令是

    在B控上面 执行 remove [-w]

    在A控上面执行 assign {

    3.aggr status -r 可以清楚的看到硬盘所在的位置，具体到硬盘的物理位置为第几柜子的几号槽位，这个硬盘黄灯会亮 。

    1. N3700A> aggr status -r
    2. Aggregate systemA (online, raid4) (block checksums)
    3.   Plex /systemA/plex0 (online, normal, active)
    4.     RAID group /systemA/plex0/rg0 (normal)
    5.       RAID Disk	Device	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
    6.       ---------	------	------------- ---- ---- ---- ----- --------------    --------------
    7.       parity  	0b.17	0b    1   1   FC:A   -  FCAL 10000 68000/139264000   69536/142410400 
    8.       data    	0b.18	0b    1   2   FC:A   -  FCAL 10000 68000/139264000   69536/142410400 
    9. Aggregate AIXMAIL (online, raid4) (block checksums)
    10.   Plex /AIXMAIL/plex0 (online, normal, active)
    11.     RAID group /AIXMAIL/plex0/rg0 (normal)
    12.       RAID Disk	Device	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
    13.       ---------	------	------------- ---- ---- ---- ----- --------------    --------------
    14.       parity  	0b.37	0b    2   5   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
    15.       data    	0b.36	0b    2   4   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
    16.       data    	0b.45	0b    2   13  FC:A   -  ATA   7200 423111/866531584  423889/868126304 
    17.       data    	0b.34	0b    2   2   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
    18.       data    	0b.33	0b    2   1   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
    19.       data    	0b.32	0b    2   0   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
    20.       data    	0b.39	0b    2   7   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
    21.     RAID group /AIXMAIL/plex0/rg1 (normal)
    22.       RAID Disk	Device	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
    23.       ---------	------	------------- ---- ---- ---- ----- --------------    --------------
    24.       parity  	0b.41	0b    2   9   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
    25.       data    	0b.43	0b    2   11  FC:A   -  ATA   7200 423111/866531584  423889/868126304 
    26.  
    27. Spare disks (empty)
    28.  
    29. Broken disks
    30. RAID Disk	Device	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
    31. ---------	------	------------- ---- ---- ---- ----- --------------    --------------
    32. failed  	    0a.01.5 	0b    2   3   FC:A   -  ATA   7200 423111/866531584  423889/868126304

    清楚知道 0a.01.5 这个硬盘的物理位置为第2柜子的3号槽位.

    4.拔掉故障硬盘，换上新硬盘，运行disk show -v

    1. netapp3210B> disk show -v
    2.   DISK       OWNER                  POOL   SERIAL NUMBER           HOME                     CHKSUM
    3. ------------ -------------          -----  -------------           -------------            ------
    4. 0b.01.18     netapp3210A(1573857221)    Pool0  JZV95J1J              netapp3210A(1573857221)  Block
    5. 0a.01.15     netapp3210A(1573857221)    Pool0  CZY8DPUN              netapp3210A(1573857221)  Block
    6. 0b.01.20     netapp3210A(1573857221)    Pool0  JZV91WYJ              netapp3210A(1573857221)  Block
    7. 0b.01.16     netapp3210A(1573857221)    Pool0  JZV19P7J              netapp3210A(1573857221)  Block
    8. 0a.01.11     netapp3210A(1573857221)    Pool0  JZV9467J              netapp3210A(1573857221)  Block
    9. 0b.01.8      netapp3210A(1573857221)    Pool0  JZV8XGNJ              netapp3210A(1573857221)  Block
    10. 0a.01.5      Not Owned                  NONE   J9YYZDLM             Block
    11. 0a.01.3      netapp3210A(1573857221)    Pool0  JZV91LYJ              netapp3210A(1573857221)  Block
    12. 0a.01.13     netapp3210B(1573852909)    Pool0  JZV9KYJJ              netapp3210B(1573852909)  Block
    13. 0b.01.2      netapp3210A(1573857221)    Pool0  JZV9136J              netapp3210A(1573857221)  Block
    14. 0b.01.10     netapp3210A(1573857221)    Pool0  JZV7SAYJ              netapp3210A(1573857221)  Block
    15. 0a.01.19     netapp3210A(1573857221)    Pool0  JZVA2U2J              netapp3210A(1573857221)  Block
    16. 0b.01.4      netapp3210A(1573857221)    Pool0  JZV8SN4J              netapp3210A(1573857221)  Block
    17. 0a.01.1      netapp3210A(1573857221)    Pool0  JZV74KHJ              netapp3210A(1573857221)  Block
    18. 0a.01.21     netapp3210A(1573857221)    Pool0  JZV7ESAJ              netapp3210A(1573857221)  Block
    19. 0b.01.22     netapp3210A(1573857221)    Pool0  JZV97BSJ              netapp3210A(1573857221)  Block
    20. 0a.01.17     netapp3210A(1573857221)    Pool0  JZV90LGJ              netapp3210A(1573857221)  Block
    21. 0b.01.14     netapp3210B(1573852909)    Pool0  JZV9J0KJ              netapp3210B(1573852909)  Block
    22. 0b.01.12     netapp3210B(1573852909)    Pool0  JZV9KZSJ              netapp3210B(1573852909)  Block
    23. 0a.01.7      netapp3210A(1573857221)    Pool0  JZV8MW4J              netapp3210A(1573857221)  Block
    24. 0b.01.6      netapp3210A(1573857221)    Pool0  JZV95EUJ              netapp3210A(1573857221)  Block
    25. 0b.01.0      netapp3210A(1573857221)    Pool0  JZV7GLUJ              netapp3210A(1573857221)  Block
    26. 0a.01.9      netapp3210A(1573857221)    Pool0  6SLAWVLK0000N636075Q  netapp3210A(1573857221)  Block
    27. 0a.01.23     netapp3210A(1573857221)    Pool0  JZVA2MUJ              netapp3210A(1573857221)  Block

    可以看到新盘没有OWNER，显示为Not Owned

    5.硬盘原属于netapp3210B，而当前操作的也是B控制器，所以直接运行disk assign 0a.01.5，系统会默认把0b.35硬盘分配给当前控制器

    1. netapp3210B> disk assign 0a.01.5
    2. Sat Nov 26 14:20:59 CST [netapp3210B:diskown.changingOwner:info]: changing ownership for disk 0a.01.5 (S/N J9YYZDLM) from unowned (ID 4294967295) to netapp3210B (ID 1573852909)

    6.通过disk show -v 和aggr status -r看看新替换的硬盘是否正常并处于spare disk。

    1. netapp3210B> disk show -v       
    2.   DISK       OWNER                  POOL   SERIAL NUMBER           HOME                     CHKSUM
    3. ------------ -------------          -----  -------------           -------------            ------
    4. 0b.01.18     netapp3210A(1573857221)    Pool0  JZV95J1J              netapp3210A(1573857221)  Block
    5. 0a.01.15     netapp3210A(1573857221)    Pool0  CZY8DPUN              netapp3210A(1573857221)  Block
    6. 0b.01.20     netapp3210A(1573857221)    Pool0  JZV91WYJ              netapp3210A(1573857221)  Block
    7. 0b.01.16     netapp3210A(1573857221)    Pool0  JZV19P7J              netapp3210A(1573857221)  Block
    8. 0a.01.11     netapp3210A(1573857221)    Pool0  JZV9467J              netapp3210A(1573857221)  Block
    9. 0b.01.8      netapp3210A(1573857221)    Pool0  JZV8XGNJ              netapp3210A(1573857221)  Block
    10. 0a.01.3      netapp3210A(1573857221)    Pool0  JZV91LYJ              netapp3210A(1573857221)  Block
    11. 0a.01.13     netapp3210B(1573852909)    Pool0  JZV9KYJJ              netapp3210B(1573852909)  Block
    12. 0a.01.5      netapp3210B(1573852909)    Pool0  J9YYZDLM              netapp3210B(1573852909)  Block
    13. 0b.01.2      netapp3210A(1573857221)    Pool0  JZV9136J              netapp3210A(1573857221)  Block
    14. 0b.01.10     netapp3210A(1573857221)    Pool0  JZV7SAYJ              netapp3210A(1573857221)  Block
    15. 0a.01.19     netapp3210A(1573857221)    Pool0  JZVA2U2J              netapp3210A(1573857221)  Block
    16. 0b.01.4      netapp3210A(1573857221)    Pool0  JZV8SN4J              netapp3210A(1573857221)  Block
    17. 0a.01.1      netapp3210A(1573857221)    Pool0  JZV74KHJ              netapp3210A(1573857221)  Block
    18. 0a.01.21     netapp3210A(1573857221)    Pool0  JZV7ESAJ              netapp3210A(1573857221)  Block
    19. 0b.01.22     netapp3210A(1573857221)    Pool0  JZV97BSJ              netapp3210A(1573857221)  Block
    20. 0a.01.17     netapp3210A(1573857221)    Pool0  JZV90LGJ              netapp3210A(1573857221)  Block
    21. 0b.01.14     netapp3210B(1573852909)    Pool0  JZV9J0KJ              netapp3210B(1573852909)  Block
    22. 0b.01.12     netapp3210B(1573852909)    Pool0  JZV9KZSJ              netapp3210B(1573852909)  Block
    23. 0a.01.7      netapp3210A(1573857221)    Pool0  JZV8MW4J              netapp3210A(1573857221)  Block
    24. 0b.01.6      netapp3210A(1573857221)    Pool0  JZV95EUJ              netapp3210A(1573857221)  Block
    25. 0b.01.0      netapp3210A(1573857221)    Pool0  JZV7GLUJ              netapp3210A(1573857221)  Block
    26. 0a.01.9      netapp3210A(1573857221)    Pool0  6SLAWVLK0000N636075Q  netapp3210A(1573857221)  Block
    27. 0a.01.23     netapp3210A(1573857221)    Pool0  JZVA2MUJ              netapp3210A(1573857221)  Block
    28. netapp3210B> aggr status -r
    29. Aggregate aggr0 (online, raid_dp) (block checksums)
    30.   Plex /aggr0/plex0 (online, normal, active, pool0)
    31.     RAID group /aggr0/plex0/rg0 (normal, block checksums)
    32.  
    33.       RAID Disk	Device  	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
    34.       ---------	------  	------------- ---- ---- ---- ----- --------------    --------------
    35.       dparity 	0b.01.12	0b    1   12  SA:A   0   SAS 15000 560000/1146880000 560879/1148681096 
    36.       parity  	0a.01.13	0a    1   13  SA:B   0   SAS 15000 560000/1146880000 560879/1148681096 
    37.       data    	0b.01.14	0b    1   14  SA:A   0   SAS 15000 560000/1146880000 560879/1148681096 
    38.  
    39.  
    40. Pool1 spare disks (empty)
    41.  
    42. Pool0 spare disks
    43.  
    44. RAID Disk	Device  	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
    45. ---------	------  	------------- ---- ---- ---- ----- --------------    --------------
    46. Spare disks for block checksum
    47. spare   	0a.01.5 	0a    1   5   SA:B   0   SAS 15000 560000/1146880000 560879/1148681096 
    48.  
    49. Partner disks
    50.  
    51. RAID Disk	Device  	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
    52. ---------	------  	------------- ---- ---- ---- ----- --------------    --------------
    53. partner 	0a.01.23	0a    1   23  SA:B   0   SAS 15000 0/0               560879/1148681096 
    54. partner 	0b.01.22	0b    1   22  SA:A   0   SAS 15000 0/0               560879/1148681096 
    55. partner 	0b.01.0 	0b    1   0   SA:A   0   SAS 15000 0/0               560879/1148681096 
    56. partner 	0b.01.6 	0b    1   6   SA:A   0   SAS 15000 0/0               560879/1148681096 
    57. partner 	0a.01.9 	0a    1   9   SA:B   0   SAS 15000 0/0               560208/1147307688 
    58. partner 	0a.01.1 	0a    1   1   SA:B   0   SAS 15000 0/0               560879/1148681096 
    59. partner 	0a.01.7 	0a    1   7   SA:B   0   SAS 15000 0/0               560879/1148681096 
    60. partner 	0a.01.3 	0a    1   3   SA:B   0   SAS 15000 0/0               560879/1148681096 
    61. partner 	0b.01.18	0b    1   18  SA:A   0   SAS 15000 0/0               560879/1148681096 
    62. partner 	0a.01.21	0a    1   21  SA:B   0   SAS 15000 0/0               560879/1148681096 
    63. partner 	0b.01.2 	0b    1   2   SA:A   0   SAS 15000 0/0               560879/1148681096 
    64. partner 	0a.01.17	0a    1   17  SA:B   0   SAS 15000 0/0               560879/1148681096 
    65. partner 	0b.01.16	0b    1   16  SA:A   0   SAS 15000 0/0               560879/1148681096 
    66. partner 	0a.01.11	0a    1   11  SA:B   0   SAS 15000 0/0               560879/1148681096 
    67. partner 	0b.01.4 	0b    1   4   SA:A   0   SAS 15000 0/0               560879/1148681096 
    68. partner 	0a.01.19	0a    1   19  SA:B   0   SAS 15000 0/0               560879/1148681096 
    69. partner 	0b.01.10	0b    1   10  SA:A   0   SAS 15000 0/0               560879/1148681096 
    70. partner 	0b.01.8 	0b    1   8   SA:A   0   SAS 15000 0/0               560879/1148681096 
    71. partner 	0b.01.20	0b    1   20  SA:A   0   SAS 15000 0/0               560879/1148681096 
    72. partner 	0a.01.15	0a    1   15  SA:B   0   SAS 15000 0/0               560879/1148681096 
    73. netapp3210B> disk show -v
    74.   DISK       OWNER                  POOL   SERIAL NUMBER           HOME                     CHKSUM
    75. ------------ -------------          -----  -------------           -------------            ------
    76. 0b.01.18     netapp3210A(1573857221)    Pool0  JZV95J1J              netapp3210A(1573857221)  Block
    77. 0a.01.15     netapp3210A(1573857221)    Pool0  CZY8DPUN              netapp3210A(1573857221)  Block
    78. 0b.01.20     netapp3210A(1573857221)    Pool0  JZV91WYJ              netapp3210A(1573857221)  Block
    79. 0b.01.16     netapp3210A(1573857221)    Pool0  JZV19P7J              netapp3210A(1573857221)  Block
    80. 0a.01.11     netapp3210A(1573857221)    Pool0  JZV9467J              netapp3210A(1573857221)  Block
    81. 0b.01.8      netapp3210A(1573857221)    Pool0  JZV8XGNJ              netapp3210A(1573857221)  Block
    82. 0a.01.3      netapp3210A(1573857221)    Pool0  JZV91LYJ              netapp3210A(1573857221)  Block
    83. 0a.01.13     netapp3210B(1573852909)    Pool0  JZV9KYJJ              netapp3210B(1573852909)  Block
    84. 0a.01.5      netapp3210B(1573852909)    Pool0  J9YYZDLM              netapp3210B(1573852909)  Block
    85. 0b.01.2      netapp3210A(1573857221)    Pool0  JZV9136J              netapp3210A(1573857221)  Block
    86. 0b.01.10     netapp3210A(1573857221)    Pool0  JZV7SAYJ              netapp3210A(1573857221)  Block
    87. 0a.01.19     netapp3210A(1573857221)    Pool0  JZVA2U2J              netapp3210A(1573857221)  Block
    88. 0b.01.4      netapp3210A(1573857221)    Pool0  JZV8SN4J              netapp3210A(1573857221)  Block
    89. 0a.01.1      netapp3210A(1573857221)    Pool0  JZV74KHJ              netapp3210A(1573857221)  Block
    90. 0a.01.21     netapp3210A(1573857221)    Pool0  JZV7ESAJ              netapp3210A(1573857221)  Block
    91. 0b.01.22     netapp3210A(1573857221)    Pool0  JZV97BSJ              netapp3210A(1573857221)  Block
    92. 0a.01.17     netapp3210A(1573857221)    Pool0  JZV90LGJ              netapp3210A(1573857221)  Block
    93. 0b.01.14     netapp3210B(1573852909)    Pool0  JZV9J0KJ              netapp3210B(1573852909)  Block
    94. 0b.01.12     netapp3210B(1573852909)    Pool0  JZV9KZSJ              netapp3210B(1573852909)  Block
    95. 0a.01.7      netapp3210A(1573857221)    Pool0  JZV8MW4J              netapp3210A(1573857221)  Block
    96. 0b.01.6      netapp3210A(1573857221)    Pool0  JZV95EUJ              netapp3210A(1573857221)  Block
    97. 0b.01.0      netapp3210A(1573857221)    Pool0  JZV7GLUJ              netapp3210A(1573857221)  Block
    98. 0a.01.9      netapp3210A(1573857221)    Pool0  6SLAWVLK0000N636075Q  netapp3210A(1573857221)  Block
    99. 0a.01.23     netapp3210A(1573857221)    Pool0  JZVA2MUJ              netapp3210A(1573857221)  Block

    显示新更换的硬盘已经成为spare disk，即完成故障硬盘更换。 

    7.如果在换盘之后，硬盘出现bad label

    1. RAID Disk       Device  HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
    2. ---------       ------  ------------- ---- ---- ---- ----- --------------    --------------
    3. bad label       0b.44   0b    2   12  FC:A   -  FCAL 15000 272000/557056000  280104/573653840

    执行如下命令： 

    1. priv set advanced  #进入高级维护模式
    2.  
    3. disk unfail -s 0b.44  #处理bad label错误

    8.如果换盘之后出现 Not zeroed，执行如下命令

    disk zero spares

    这时没有零化的热备盘会开始零化，这可能需要一段时间，可通过vol status -s监控

  • 相关阅读:
    ts重点学习111-类的兼容性
    C++11相较于C++98 标准新增内容：包装器
    Vue3 自定义渲染器 API createRenderer()（七）
    如何一键查询全部物流信息标记未签收单号
    指针和数组试题解析（5）二维数组部分
    NTFS安全权限
    第一章：最新版零基础学习 PYTHON 教程（第七节 - Python 中的语句、缩进和注释）
    深入解析spring boot配置加载原理，配置文件的加载顺序是怎么实现的？
    如何实时计算日累计逐单资金流
    Mybatis总结--传参二
  • 原文地址：https://blog.csdn.net/rendongxingzhe/article/details/128047727