Note: If FCM drive firmware is not at the proper level, do not attempt to update the FCM drive
firmware and contact IBM support.
9. Verify that the drives are formatted correctly. The format column for the newly added drives must
show 4 KiB + 0 B. You must reformat the added drives if the drives are formatted as 4 KiB + 8 B. To
format added drives as 4 KiB + 0 B, see “Formatting drives example” on page 27.
Note: The
Format
column for the newly added drives must show 4 KiB + 0 B (for FCM drives, the
format must show 512 B + 0 B).
# nvme list
A sample output is as follows:
# nvme list
Node SN Model Namespace Usage Format FW Rev
---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- --------
/dev/nvme0n1 2024296F1E08 Micron_7300_MTFDHBA960TDF 1 960.20 GB / 960.20 GB 4 KiB + 0 B 95420100
/dev/nvme10n1 S54KNE0NA00461 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme11n1 S54KNE0NA00537 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme12n1 S54KNE0NA00247 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme13n1 S54KNE0NA00465 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme14n1 S54KNE0NA00117 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme15n1 S54KNE0NA00113 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 8 B SN5ASN5A
/dev/nvme16n1 S54KNE0NA00135 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 8 B SN5ASN5A
/dev/nvme17n1 S54KNE0NA00127 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 8 B SN5ASN5A
/dev/nvme18n1 S54KNE0NA00412 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 8 B SN5ASN5A
/dev/nvme19n1 S54KNE0NA00118 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 8 B SN5ASN5A
/dev/nvme1n1 202228CD166E Micron_7300_MTFDHBA960TDF 1 960.20 GB / 960.20 GB 4 KiB + 0 B 95420100
/dev/nvme20n1 S54KNE0NA00153 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 8 B SN5ASN5A
/dev/nvme21n1 S54KNE0NA00159 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 8 B SN5ASN5A
/dev/nvme22n1 S54KNE0NA00307 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 8 B SN5ASN5A
/dev/nvme23n1 S54KNE0NA00156 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 8 B SN5ASN5A
/dev/nvme24n1 S54KNE0NA00141 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 8 B SN5ASN5A
/dev/nvme25n1 S54KNE0NA00131 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 8 B SN5ASN5A
/dev/nvme2n1 S54KNE0NA00269 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme3n1 S54KNE0NA00259 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme4n1 S54KNE0NA00485 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme5n1 S54KNE0NA00255 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme6n1 S54KNE0NA00256 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme7n1 S54KNE0NA00459 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme8n1 S54KNE0NA00532 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
/dev/nvme9n1 S54KNE0NA00246 3.84TB NVMe Tier-1 Flash 1 3.84 TB / 3.84 TB 4 KiB + 0 B SN5ASN5A
10. Issue
essinstallcheck
command for both canisters to ensure that firmware levels are as
expected.
# essinstallcheck -N <node list>
11. To get the node class name and recovery group name, issue the following command:
# mmvdisk nodeclass list
Issue the following command against the affected recovery group. This command adds the new
capacity and begins re-balancing data onto the new disks.
# mmvdisk recoverygroup resize --recovery-group <recoverygroup name>
Example
# mmvdisk recoverygroup resize --recovery-group ess3200_78E400K
mmvdisk: Obtaining pdisk information for recovery group 'ess3200_78E400K'.
mmvdisk: Analyzing disk topology for node 'ess3200rw3a-hs.gpfs.ess'.
mmvdisk: Analyzing disk topology for node 'ess3200rw3b-hs.gpfs.ess'.
mmvdisk: Validating existing pdisk locations for recovery group 'ess3200_78E400K'.
mmvdisk: The resized server disk topology is 'ESS 3200 FN1 24 NVMe'.
mmvdisk: Validating declustered arrays for recovery group 'ess3200_78E400K'.
mmvdisk: Adding new pdisks to recovery group 'ess3200_78E400K'.
mmvdisk: Updating declustered array attributes for recovery group 'ess3200_78E400K'.
mmvdisk: Successfully resized recovery group 'ess3200_78E400K'.
Note: Use the
mmvdisk recoverygroup list
command to determine the proper recovery group.
12. Update the node class server configuration for 24 drives by issuing the following command:
# mmvdisk server configure --update --node-class <node class name> --recycle 1
Example
mmvdisk server configure --update --node-class ess3200_x86_64_mmvdisk_78E400K --recycle 1
mmvdisk: Recording pre-conversion cluster configuration in /var/mmfs/tmp/
mmvdisk.configure.before.20210816
24 IBM Elastic Storage System 3200: Service Guide
Summary of Contents for Elastic Storage System 3200
Page 1: ...IBM Elastic Storage System 3200 6 1 3 Service Guide IBM SC27 9862 00 ...
Page 4: ...iv ...
Page 8: ...viii ...
Page 12: ...xii IBM Elastic Storage System 3200 Service Guide ...
Page 42: ...30 IBM Elastic Storage System 3200 Service Guide ...
Page 46: ...34 IBM Elastic Storage System 3200 Service Guide ...
Page 50: ...38 IBM Elastic Storage System 3200 Service Guide ...
Page 58: ...46 IBM Elastic Storage System 3200 Service Guide ...
Page 60: ...48 IBM Elastic Storage System 3200 Service Guide ...
Page 62: ...50 IBM Elastic Storage System 3200 Service Guide ...
Page 63: ......
Page 64: ...IBM Product Number 5765 DME 5765 DAE SC27 9862 00 ...