background image

 

 

 
 
 
 

NEC Storage S2900 

NF2900-SR40E 

Disk Array Unit 

User's Guide 

 

 

NOTE: 

Read this manual carefully before using the unit. Keep 

this manual nearby as a handy reference and refer to 

the "CAUTION" and "WARNING" statements whenever 

necessary. 

All rights reserved by NEC Corporation. This document 

must be used solely for the purpose for which it was 

furnished by NEC Corporation. No part of this document 

may be reproduced or disclosed to others, in any form,

without the prior written permission of NEC Corporation. 

856-850822-101-A 

Summary of Contents for NF2900-SR40E

Page 1: ...nce and refer to the CAUTION and WARNING statements whenever necessary All rights reserved by NEC Corporation This document must be used solely for the purpose for which it was furnished by NEC Corporation No part of this document may be reproduced or disclosed to others in any form without the prior written permission of NEC Corporation 856 850822 101 A ...

Page 2: ...their respective trademark owners Remarks 1 No part of this manual may be photocopied in any form without prior written consent from NEC 2 The information in this manual is subject to change without notice 3 All possible efforts are being made to ensure the accuracy of this manual but in the event that any technical or editorial errors or omissions are found contact your dealer 4 Save this manual ...

Page 3: ...ergy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at their own expense Momentary voltage drop prevention This network storage unit may be affected by a momentar...

Page 4: ...G Indicates there is a risk of death or serious injury CAUTION Indicates there is a risk of burn or injury Risks and the necessary actions to reduce risks are indicated individually by the following symbols Indicates the risk of smoke emission or fire outbreak Indicates the risk of electric shock Indicates required general actions for operators Indicates instructions to pull out the plug of a powe...

Page 5: ...um battery Do not remove the lithium battery The lithium battery may explode when it is brought close to fire or when immersed in water Dispose of the controller according to local ordinances Contact your local government for details If the disk array unit does not operate normally due to the life of the lithium batteries contact your service representative Do not disassemble the controller or rep...

Page 6: ...radius of optical fiber shall be 30 mm Dust and or dirt may attenuate the optical power of optical fiber causing data errors to occur Clean any optical fiber cable whenever it is inserted into the mating connector with the following procedure 1 Blow parts cleaning gas e g compressed air to the connector of the optical fiber cable for several seconds 2 Wipe the connector with a non woven cloth soak...

Page 7: ...disk array unit that pose a possible danger and to inform the user that a hazardous situation may arise when operating the disk array unit Do not intentionally remove or damage any of the labels If you find any labels totally partially removed or illegible due to damage contact your sales representative ...

Page 8: ...v ...

Page 9: ...vi ...

Page 10: ...vii ...

Page 11: ...nit as well as the manual of the operating system in use NEC Storage BaseProduct software needs to be purchased separately before using the disk array unit Various options such as the FC disk drive option which enables extension of equipment capacity the cache extension memory option which enables extension of the cache memory capacity the Disk Expansion port option which enables extension of the ...

Page 12: ... any repairs 2 Inspection After unpacking check that all the components listed in the table below are provided If any of the components is missed contact your sales representative Next inspect the disk array unit and accessories If any of the components is damaged contact your sales representative No Product name Remarks Qty 1 NEC Storage S2900 1 2 Front bezel For NEC Storage S2900 with security k...

Page 13: ...x NF2900 SR40E ...

Page 14: ... User s Guide also uses the following symbol Symbol Description Supplement of the text This User s Guide uses the following terms to indicate specific devices Disk array unit NF2900 SR40E Array controller The NEC Storage S2900 FC Disk enclosure The NEC Storage S2900 FC disk enclosure sold separately SATA Disk enclosure The NEC Storage S2900 SATA disk enclosure sold separately Disk drive The hard d...

Page 15: ... Connection Procedures 23 4 1 Installation and Connection Procedures 23 5 Connection of the Disk Array Unit 25 5 1 Notes on Connection of the Disk Array Unit 27 5 2 Connection of the Disk Array Unit 28 5 3 Connection of the Disk Array Unit as Additional Unit 36 5 4 Connection of the Ethernet Cable 40 5 5 Connection of the Power Cords 41 6 The Addition of Optional Devices 44 6 1 Addition of a Disk ...

Page 16: ...tal Conditions 99 9 4 Power Specification 99 9 5 External Dimensions and Weight 99 9 6 Life Expectancies of Components 99 Appendix A Features of the Disk Array Unit 100 1 Battery Backup 100 2 Repair Time 100 3 Logical Disk Capacity 100 3 1 Arbitrary Logical Disk Capacity 100 3 2 Maximum Logical Disk Capacity 100 4 Access Control 101 4 1 Port Mode 101 4 2 WWN Mode 101 5 Dynamic Data Replication 101...

Page 17: ...duct Setting 120 2 3 Activation on Modification of FC Port Configuration 121 Appendix D Installing Unit into a Rack 122 1 Installing the Rack mount Kit Accessory into an NEC Storage Rack 122 1 1 Installing Unit on New Universal Rack Mount Kit 122 1 2 Installing Unit on Universal Rack Mount Kit 126 1 2 1 Angle Hole Fitting Rail 127 1 2 2 Round Hole Fitting Rail 133 2 Installing Unit into an HP Rack...

Page 18: ...stallation and Handling of the Disk Array Unit 1 1 Note on Carrying Disk Array Unit Be sure to support the bottom of the disk array unit when carrying it Hold the front or side bottom of the disk array unit when possible ...

Page 19: ...rea of high humidity If so a fault or electrical shock may occur Do not install the disk array unit in an environment of chemical steam emission or an area where the disk array unit may come in contact with inflammable substances If so a fault fire or an explosion may occur Do not install the disk array unit in a dirty or dusty environment If so a fault may occur Do not install the disk array unit...

Page 20: ...c shock and or fire may occur The disk array unit can accept power between 100 240 VAC 50 60 Hz Using power of different voltage may cause electric shock smoke and or fire to occur Do not install the disk array unit and the power cords in an area of direct sunshine or near any apparatus generating heat such as a heater If so a fault may occur Further the insulating coating of the power cord may be...

Page 21: ...ersonal injury or failure of the unit Do not let any liquids such as water into the disk array unit If so you may be electrically shocked or the unit may become defective If liquids do enter into the disk array unit turn off the power and contact your sales representative or maintenance engineer If the disk array unit seems dry remember that only a small amount of liquid remaining may cause the un...

Page 22: ...colored In addition note that spraying insecticide on any surface may cause the surface to become deformed or discolored It is recommended to clean the inside of the disk array unit periodically This is because dust may accumulate after the disk array unit has been used for a long time Contact your maintenance engineer for the cleaning of the inside of the disk array unit Users must not disassembl...

Page 23: ...s it is recommended to contact your maintenance engineer for inspection and or repair The array controller and the disk enclosure weigh 34 kg or more Hold the array controller and disk enclosure firmly using at least three people to carry it Carrying the devices by two or less people may Cause personal injury Do not hold the protrusions from the power supply or controller Doing so applies excessiv...

Page 24: ...7 ...

Page 25: ... spare disk The use of this hot spare feature as well as the auto repair feature allows the data in the defected disk drive to be automatically recovered in the spare disk as soon as a disk drive becomes defective This improves the system reliability The disk array unit has a cache memory data hold function made available by the cache memory power supply and battery backup unit The function allows...

Page 26: ...12 PDN12 PDN11 PDN11 PDN11 PDN10 PDN10 PDN10 PDN9 PDN9 PDN9 PDN8 PDN8 PDN8 PDN7 PDN7 PDN7 PDN6 PDN6 PDN6 PDN5 PDN5 PDN5 PDN4 PDN4 PDN4 PDN3 PDN3 PDN3 PDN2 LDN0 RAID5 PDN2 LDN0 RAID5 PDN2 LDN0 RAID5 Spare Disk PDN1 PDN1 PDN1 PDN0 PDN0 PDN0 Failure in PDN1 Recovery of data in spare disk Replacement of PDN 1 PDN Physical Disk Number Disk drive LDN Logical Disk Number Logical Disk Number Do not move a...

Page 27: ...ng table shows the backup time when two battery backup units are installed and they are both fully charged The following conditions are imposed to make the write cache preservation feature effective Two controllers one or more battery backup units and power supplies for the battery backup unit PS0 for BBU0 PS1 for BBU1 are installed and operating normally The battery backup units are fully charged...

Page 28: ...y unit in a real time mode NEC Storage Manager also enables you to set the following parameters through the host computer Setting of the RAID configuration RAID 1 5 6 10 50 and hot spare disk Resetting of the RAID configuration Maintenance of an error log Before the disk array unit can be used to store data the license lock must be released by using the license code provided with the NEC Storage B...

Page 29: ...same rotational speed is required for configuring logical drives 1 Two modes 66 mode and 80 mode can be selected according to capacity efficiency The RAID levels have the following characteristics Level Function Advantage Disadvantage RAID1 Mirroring High reliability High cost RAID5 Striping of data and redundant data High capacity efficiency Low speed data writing RAID6 Striping of data and redun...

Page 30: ...ng the lock with the accessory key and pulling out toward you with your hands hooked on the both sides of the bezel In this state the accessory key cannot be pulled out To pull the key out from the front bezel you must set the key at the lock position Removing the front bezel you can view the battery cover shown in the figure below 5 SHUTDOWN switch 1 POWER LED 2 SERVICE LED 5 SHUTDOWN switch 3 Ba...

Page 31: ...backup units installed in the disk array unit 4 Battery Backup Units BBU0 BBU1 The battery backup units are installed to protect the data remaining in the cache memory at the occurrence of a power interruption See Section 3 3 Battery Backup Unit for details 5 SHUTDOWN switch Use this switch to turn off the disk array unit Using this switch starts writing any cache ddata remaining in the array cont...

Page 32: ...rray controller See Section 3 4 Power Supply for the Array Controller for details 2 Controllers CONT0 CONT1 The array controller boards are provided to control the disk array unit See Section 3 5 Controller for details 1 Power supply for array controller PS1 1 Power supply for array controller PS0 2 Controller CONT1 2 Controller CONT0 ...

Page 33: ...he occurrence of a power interruption Turning off the battery backup unit disables write cache feature 2 Check terminal The check terminal is provided for maintenance inspection of the battery backup unit Note This terminal is exclusively used for maintenance 3 Handle Hold the handle to pull out the battery backup unit when it is replaced due to failure or the end of the battery s service life Whe...

Page 34: ... down by a single failure To ensure this functionality connect two power cords at the rear of the array controller 2 Power switch The power switch is used to turn On Off the power of the array controller The array controller has a redundant power configuration to prevent the entire disk array unit from shutting down due to a single failure Therefore turn On Off both of the two power switches when ...

Page 35: ...ghts green when the AC power is supplied to the array controller and the power switch is set to ON The LED is off if the power switch is set to OFF or should a fault occur in the power supply 5 POWER FAIL LED orange The POWER FAIL LED lights if a fault occurs in the power supply 6 BBU FAIL LED orange The BBU FAIL LED lights when the respective battery backup unit is installed and a fault occurs in...

Page 36: ...guarantee the proper operation of the disk array unit replace the controller cooling fan immediately if a fan failure occurs 2 FAN LED FAN0 FAN1 orange The FAN LED lights orange if the cooling fan for the respective controller is not installed or a fault occurs in the fan The LED is off while the respective fan operates normally 16 Slot for NF2800 Event Logging Tool 17 MC ACS LED 15 MODEM connecto...

Page 37: ...reen in normal operation The LED will not blink if there is a problem or during the power on initialization sequence 7 FC connector for connection of a disk enclosure DP0 DP1 The FC connectors are used to connect the array controller with the disk enclosure See Chapter5 Connection of the Disk Array Unit for the cable connections 8 FC connector for connection of host bus adapter HP0 HP1 HP2 HP3 The...

Page 38: ...M connector The MODEM connector is used to connect a modem for fault notification 16 Slot for NF2900 Event Logging Tool Use this slot to insert the SD card which stores the events logged by the controller 17 MC ACS LED The MC ACS LED lights when the NF2900 Event Logging Tool SD card is accessed 18 Ejector The ejector is used to install or remove the controller Loosen the screw before using the eje...

Page 39: ...connection 2 LINKUP LED DL2 DL3 A LINKUP LED lights green if the respective FC connector FC port becomes operable links up These LEDs flash during the self test or initialization sequence just after power on When inserting the DE port into the controller push it as far as it will go and then secure it with the screws Incorrect insertion may cause a malfunction 2 LINKUP LED DL2 DL3 1 FC connectors ...

Page 40: ...s Check of components in package Check the components in the package following Check of Components in Package If any component is missing contact your sales representative Connection of Host Bus Adapter Connect the host bus adapter HBA according to the manual provided with the host system or host bus adapter And install the proper driver Connection of FC cable Use the cable compatible with the dis...

Page 41: ...y parameters For setting parameters including RAID level and disk assignment use the NEC Storage Manager or contact your maintenance service representative Check the resource status for disk array unit Before using the disk array unit check the Resource Status including the controller power supply battery backup unit controller cooling fans and disk drives by using the NEC Storage Manager software...

Page 42: ...ct angle Proper insertion allows the connector to be inserted to the mating connector smoothly without excessive force If the connector cannot be inserted smoothly do not insert it by force but check the alignment of the connector again Make sure that cable damages such as buckling dust adhesion and dirt are not found on the connector and contact before connection Treat all connectors carefully so...

Page 43: ...26 ...

Page 44: ...nect the array controller with a disk enclosure be sure to use the CONT DE cable provided with the disk enclosure or the NEC specified CONT DE cable NF9120 SJ34E 2 Cable length limit It is important to note that exceeding the recommended maximum cable length can significantly impact data integrity NEC recommends the following cable length limits FC optical cable for operating the host interface at...

Page 45: ...ct two host bus adapters with the host system Two LC LC cables or two SC SC cables and two FC conversion cables are necessary for connecting the host bus adapters a With the host bus adapter connectors of the LC type The FC disk enclosure SATA disk enclosure is optional See Section 6 1 Addition of a Disk Enclosure HSSDC HSSDC cable FC cable LC LC cable ...

Page 46: ...The FC disk enclosure SATA disk enclosure is optional See Section 6 1 Addition of a Disk Enclosure Connect the disk array unit with the host unit by using an FC cable in the following procedure FC conversion cable Relay connector SC SC cable HSSDC HSSDC cable ...

Page 47: ... that the power switch on the disk array unit and those on the host system are set to OFF and the plugs of the power cords are removed from AC outlets a Power supply for array controller OFF ON b Power supply for the disk enclosure OFF ON ...

Page 48: ...dapter or the FC AL switch connectors of the SC type Use the available optionally FC conversion cable NF9310 SJ10E The cable has different size connectors at the ends Push the smaller connector into the FC connector HPx for the host bus adapter of either controller CONT0 or CONT1 until a click is heard Pushing any connector excessively may damage the tip and decrease the optical intensity which wi...

Page 49: ...the other FC disk enclosure SATA disk enclosure If you have attached the DE port NF2900 SP02E to the NF2900 SR40E use the FC cable HSSDC HSSDC provided with the DE port or available optionally CONT DE cable NF9120 SJ43E Push the connector at one end of the cable into the FC connector DP2 of the disk enclosure on the DE port of Controller 0 CONT0 until a click is heard Push the connector at the oth...

Page 50: ...tion order When the ENC ID switches of the left and right adapters are set differently the FAULT LEDs on the adapters flash and the disk enclosure is not started If different values are set for the ENC ID switches turn off the power of the system including the disk enclosure reset the ENC ID values properly and turn on the power again The outline of cable connections and the settings of ENC ID swi...

Page 51: ...34 Outline of cable connections and settings of the ENC ID switches Sample configuration 1 NF2900 SR40E 1 NF2500 SE42E 8 ...

Page 52: ...35 Sample configuration 1 NF2900 SR40E NF2900 SP02E NF2500 SE42E 16 ...

Page 53: ...ervice Engineer or NEC trained maintenance service representative who has expert knowledge of the disk array unit To make any of the sample connections you need to connect two host bus adapters installed in the host system and two FC AL switches Six LC LC cables or six SC SC cables and four FC conversion cables are necessary for connecting the FC AL switch and host bus adapters a If the host bus a...

Page 54: ...ing a FC cable in the following procedure 1 Check of the power supply Make sure that the power switch of the disk array unit and that of the host unit are set to OFF and that the plugs of the power cords are removed from AC outlets SC SC cable FC AL switch FC conversion cable and SC SC cable FC conversion cable and SC SC cable FC AL switch ...

Page 55: ...lso connect the other host bus adapter in the host system to the FC AL switch via the FC cable b If the host bus adapter connectors and FC AL switch connectors are of the SC type Use the available optionally FC conversion cable NF9310 SJ10E The cable has different size connectors at the ends Push the smaller connector into the FC connector HPx for the host bus adapter of either controller CONT0 or...

Page 56: ...d disk enclosures in Section 5 2 for the procedure 4 Settings of switches Connect the maintenance PC and set an AL PA for each controller Also set an enclosure ID by using the ENC ID switch on each disk enclosure For the setting procedure see 4 Setting of switches in Section 5 2 Use of Maintenance PC in Appendix C and the NF2500 SE42E FC Disk Enclosure User s Guide ...

Page 57: ...EC Storage Manager management software is installed to Ethernet Notes regarding LAN cables for use with NEC Storage Manager and the maintenance PC Use a straight through Shielded Twisted Pair STP cable if the controller and PC are connected through a hub Use a crossover STP cable if the controller and PC are connected directly Connecting the Ethernet cable to the controller is just the first step ...

Page 58: ...ou may be electrically shocked The disk array unit has a redundant power configuration to prevent the entire unit from shutting down due to a single failure Therefore connect two power cords to both the array controller and the disk enclosure when operating the disk array unit Connect the power cords in the following procedure 1 Check of power supply Check that the power switch on the disk array u...

Page 59: ...g screw as shown in the figure below Insert the power cord and then secure the power cord by firmly fitting the power cord stopper into the receptacle of the power cord When connecting the power supply of the disk enclosure insert the power cord and then secure the power cord by firmly fitting the power cord stopper into the receptacle of the power cord Fixing screw ...

Page 60: ... 3 Connection of power plug Insert the plug of the power cord to an AC outlet Because the plug has a grounding pin use an AC outlet with grounding terminals for the connection as shown in the figure below ...

Page 61: ...of a DE port NF2900 SP02E up to 16 disk enclosures and up to 240 disk drives may be installed Product name FC disk enclosure NEC Part number NF2500 SE42E SATA disk enclosure NEC Part number NF2500 SE82E Be sure to install disk drives into slots PD00 PD01 PD02 and PD03 of the first FC disk enclosure DP0 can contain up to four FC Disk Enclosures DP1 DP2 and DP3 can contain up to four FC and SATA Dis...

Page 62: ...3 Up to 4DES four each PORT Extended Disk Port Base Disk Port Extended Disk Port DP Extended DE FC or SATA Extended DE FC or SATA Extended DE FC or SATA Extended DE FC Extended DE FC or SATA Extended DE FC or SATA Extended DE FC or SATA DE Disk Enclosure DP 1 DP 2 DP 3 CONT 0 CONT 1 Extended DE FC ...

Page 63: ...array unit to the FC IN connector on Adapter 1 ADP1 of the FC disk enclosure NOTES Extension of the disk port is required for the connections with DP 2 3 by extension of the option Connection of a SATA disk enclosure NF2500 SE82E Push the connector of the FC cable HSSDC HSSDC provided with the FC disk enclosure or the optional DE HSSDC cable NF9120 SJ34E into the SATA connector DP1 2 3 for the SAT...

Page 64: ...must be set a Setting of the ENC ID switch on FC SATA disk enclosure Set an ENC ID by using the ENC ID switch on each adapter of the FC SATA disk enclosure The ENC ID switches on both adapters are factory set to 0 Set an ENC ID so that it will be different from the ENC IDs of other FC SATA disk enclosures in the same FC loop Set 0 for the ENC ID switches on both adapters in the first FC SATA disk ...

Page 65: ...48 capacity and rotational speed be used together ...

Page 66: ...eceived with the disk enclosure into the power plug of the power supply of the disk enclosure Extend the clamp section of the AC cable clamp fit it to the AC cord and lock the clamp section lightly Then move the clamp section toward the receptacle of the power cord to make a clamp at a point near the end of the plug Securely lock the clamp section to avoid disconnection ...

Page 67: ...y unit will not recognize the disk enclosure just because cabling has been connected between the units Provide the proper settings for the disk enclosure through the maintenance PC Or contact your service engineer or an NEC trained service engineer for assistance in configuring your disk enclosure See Appendix C for instructions on the use of the maintenance PC 9 Power on of a disk enclosure Turn ...

Page 68: ...at the inside of the Disk Array unit has sharp edges electrical connections and other potential dangers to your hands and fingers Do not disassemble or modify the additional DE port Doing so may cause the device to become defective The standard disk array unit can be configured with up to eight disk enclosures For larger capacity installing an additional DE port allows disk enclosures to be added ...

Page 69: ... a new DE port in this state the data remaining in the cache memory will be lost Perform the procedure explained in Section 7 2 2 Notes on turning off the AC power so as not to leave any unwritten data in the cache memory of the array controller After that add the new DE port 2 Disconnection of host unit for offline addition Disconnect the host unit that is connected to the controller to be added ...

Page 70: ...tached to the upper part of the DPE stack connector Be sure to keep removed blank panel in a safe place After removing a DE port from the unit be sure to install a blank panel into the slot If using the unit without a blank panel being installed the cooling effect on the array controller lowers and causes heat generation Heat generation increases the failure rate and at its worst it may cause data...

Page 71: ...til fitting in the connector firmly After confirming that the connector is fit in firmly secure the DE port with three screws two screws you removed in 5 Removal of blank panel and one screw provided with the DE port Fasten the screws of the front panel while pushing them from the top so that the hatched faces will be aligned When installing the DE port to the controller push it as far as it will ...

Page 72: ...the cables removed from the controller in Step 3 Removal of cables to the mating connectors as before Close the ejector after connecting the cables Firmly push the ejector the part indicated by the arrow in the figure until the controller is seated firmly and then secure the ejector with the screw When inserting the controller into the array controller push it as far as it will go and then secure ...

Page 73: ...he disk array unit a label indicating the options available for installation is placed to allow any installed options to be known by an external view If the DE port is added write a round mark at the corresponding field on the label to indicate the addition as shown in the figure below EXTENSION UNIT NF2900 SP02 E NF2900 SC01 E NF2900 SC02 E NF2900 SC03 E Write a round mark at this field ...

Page 74: ...ed with two 1GB cache memory cards on each controller To use a larger quantity of cache memory for improving the performance features of the disk array unit up to four cache memory cards can be added for each controller Product name Additional 1GB cache memory Part number NF2900 SC01E 2GB PKG 4GB PKG Product name Additional 2GB cache memory Part number NF2900 SC02E 2GB PKG 8GB PKG Product name Add...

Page 75: ...ve If you add a new DE port in this state the data remaining in the cache memory will be lost Perform the procedure explained in Section 7 2 2 Notes on turning off the AC power so as not to leave any unwritten data in the cache memory of the array controller After that add the new cache memory 2 Disconnection of host unit for offline addition Disconnect the host unit that is connected to the contr...

Page 76: ...59 Be careful as this may be hot ...

Page 77: ...s of the socket Confirm that they are seated properly Until the cache memory is secured by the levers push the cache memory along the connector rail as far as it will go Be careful not to apply excess force to the cache memory in doing so When the levers fit into the notches of the cache memory secure it When installing the additional cache memory into the controller push it as far as it will go a...

Page 78: ...r Connect the cables removed from the controller in Step 3 Removal of Cables to the mating connectors as before Close the ejector after connecting the cables Firmly push the ejector the part indicated by the arrow in the figure until the controller is properly seated and secure the ejector with the screw When inserting the controller into the array controller push it as far as it will go and then ...

Page 79: ...9 Updating the Option label On the disk array unit a label indicating the options available for installation is placed to allow any installed options to be known by an external view If additional cache memory is added write a round mark at the corresponding field on the label to indicate the addition as shown in the figure below EXTENSION UNIT NF2900 SP02 E NF2900 SC01 E NF2900 SC02 E NF2900 SC03 ...

Page 80: ...63 Note The figure above indicates the addition of NF2900 SC01E ...

Page 81: ...ccess operation is indicated at the host system do not apply vibrations and or shock to the disk array unit Because the disk array unit is a precision device it should not be subject to any hard vibration or shock The reliability features of the disk array unit are effective only in the case of a hardware failure e g the hard disk becomes physically damaged or inoperative Any software failure e g ...

Page 82: ...urn on the two power switches at the rear of the disk array unit Alternatively turn on the disk array unit and all the additional FC or SATA disk enclosures connected with the disk array unit at the same time When turning on the power switches confirm that the POWER GOOD LED green of the power supply and the POWER LED green on the front panel of the disk array unit and any additional FC or SATA di...

Page 83: ...66 3 Host system 2 Power switches of array controller May be turned on at the same time the power switches of disk enclosures are turned on ...

Page 84: ...l the data remaining in cache memory in the disk array unit onto the disk drive according to the following procedure Then turn off the AC power according to the procedure explained in 3 Turning off the AC power 1 Turn off the power of the host system and the host bus adapter or the FC AL switch Alternatively offline all the paths connected to the host system that is connected with the disk array u...

Page 85: ...em is shut down it writes the remaining cache data into the disk array unit Before turning OFF the power of the disk array unit confirm that no cache data remains on the host system and no data remains in the cache memory of the disk array unit To check if data remains in the cache memory of the disk array unit watch the hard disk drive READY LED after shutting down the host system If the hard dis...

Page 86: ...losures Alternatively turn off the array controller and all the FC disk enclosures connected with the array controller at the same time The disk array unit has a redundant power configuration to prevent the entire unit from shutting down due to a single failure Therefore when turning off the disk array unit turn off all the power switches of the array controller and disk enclosures at the rear of ...

Page 87: ...n only be set in RAID levels 1 5 6 10 or 50 Set the spare disk by using the NEC Storage Manager or contact your Service Engineer or NEC trained maintenance service representative who has expert knowledge of the disk array unit When you change a failing disk to a spare disk confirm the capacity and rotational speed of the spare disk are equal to that of the failing disk If your disk array unit cont...

Page 88: ...ng fans is found turn off the power and disconnect the power plugs from the AC outlets Then ask your maintenance engineer to inspect and repair the disk array unit immediately Using the disk array unit as it is may cause electric shock or fire to occur The user must never repair the disk array unit because that is dangerous CAUTION Note that the inside of the Disk Array unit has sharp edges electr...

Page 89: ...us adapter connected with the FC cable does not light Cause Countermeasures The FC cable is not connected correctly Insert the connector of the FC cable until a click is heard See Chapter 5 Connection of Disk Array Unit The length of the FC cable exceeds the rating value See Chapter 5 Connection of Disk Array Unit The setting of the host bus adapter or that of the FC AL switch is not correct Provi...

Page 90: ... area in which it easily suffers vibration and or shocks Install the disk array unit referring to Chapter 1 Notes on Installation and Handling of Disk Array Unit The power is turned off or the reset button on the host system is pressed with the ACCESS LED green being on Contact your service representative The logical disk of the disk array unit is not assigned Assign the logical disk number approp...

Page 91: ...s orange The array controller power supply with the POWER FAIL LED being on is defective The BBU FAIL LED on an array controller power supply lights orange The battery backup unit corresponding to the BBU FAIL LED being on BBU0 for PS0 or BBU1 for PS1 is defective The SERVICE LED on the disk enclosure lights orange and also the FAULT LED on the disk drive lights orange The disk drive with the FAUL...

Page 92: ...ace all the cache memories and DE ports as well as the controller or contact your maintenance service representative to identify the defective unit for replacement Replacement procedure 1 Identify the defected controller with the FAULT LED on the controller being lit Remove all the cables connected to the defective controller Write down the connections between the cables to be removed and the mati...

Page 93: ...s that of the defective controller 4 Open the ejectors of the controller for replacement insert the controller into the slot until firmly seated The lock of the protection shutter that closed when the controller was pulled out is automatically released by inserting the controller ...

Page 94: ...At the startup immediately after replacement write back the IP address of the old controller to the new controller If the controller was replaced with a new one the system starts using the IP address specified for the new controller Therefore a maintenance PC and NEC Storage Manager cannot connect with the old IP address To connect with a maintenance PC and NEC Storage Manager perform either of th...

Page 95: ... cooling fan is FAN0 or FAN1 depending on the FAN LED being on 2 Loosen the two set screws at the upper right and lower left corners of the defective controller cooling fan to pull it out from the slot Note that the fan may be rotated by inertia 3 Insert the controller cooling fan for replacement into the slot 4 Fasten the two set screws at the upper right and lower left corners of the controller ...

Page 96: ...ective power supply may be replaced with the other power supply remaining ON Replacement procedure 1 Identify the defective power supply by the POWER FAIL LED of the power supply 2 Set the switch of the defected power supply to OFF and pull out the power cord from the power plug OFF ON 3 Loosen the screw fixing the power supply and slide the removal protection mechanism inward as shown in the figu...

Page 97: ... 5 Make sure that the switch of the power supply for replacement is set to OFF and the power cord is removed from the power plug 6 Slide the removal protection mechanism inward as shown in the figure below and insert the replacement power supply into the slot securely ...

Page 98: ...he array controller push it as far as it will go and then secure it with the screw Incorrect insertion may cause a malfunction 8 Insert the power cord into the power plug of the replaced power supply and insert the power cord stopper into the power cord to secure the power cord Then set the power switch to ON Fixing screw ...

Page 99: ...controller 2 Loosen the three screws securing the battery cover of the array controller to remove the cover 3 Set the battery switch of the defected battery backup unit to OFF 4 Loosen the two set screws of the defective battery backup unit and pull out the battery backup unit from the slot Because the battery backup unit has a drop protection mechanism it cannot be pulled out simply by pulling it...

Page 100: ...the notch on the chassis slide the unit to the left and insert it slowly When inserting the battery backup unit into the array controller push it as far as it will go and then secure it with the screws Incorrect insertion may cause amalfunction 7 Set the battery switch of the replaced battery backup unit to ON 8 Install the battery cover on the array controller 9 Install the front bezel on the arr...

Page 101: ...se data to be lost due to interruption of redundancy Except in a RAID6 environment where 3 disk drives wold need to fail If the FAULT LED on a disk drive lights replace the disk drive immediately Perform the replacement job as quickly as possible Operating the disk enclosure for a long time with a disk drive removed is very risky Always replace a defective disk drive with a disk drive having the s...

Page 102: ...at is provided with the replacement disk drive and then put the label on the replacement disk drive Location label 4 With the ejector of the new disk drive opened engage the guides on the top and bottom faces of the disk drive with the guide grooves on the disk enclosure and insert the disk drive until it is properly seated ...

Page 103: ...y If the Auto Repair feature is set to OFF issue a recovery instruction from the management software in manual mode to start data recovery Otherwise the reduced state reduce shown as the logical disk status remains Setting the Auto Repair feature to ON in while in the recovery wait state will not start the data recovery The setting is enabled starting with the next recovery 6 The FC SATA disk encl...

Page 104: ...lacing a power supply for the disk enclosure prepare the new power supply before removing the old one and then replace it within about 3 minutes The following units of the FC disk enclosure generate heat while operating A Disk drives B Power supplies for the disk enclosure The fans in the power supplies for the disk enclosure serve as cooling fans for both of the above Therefore do not leave the d...

Page 105: ... power cord Then pull out the receptacle of the power cord from the power plug of the power supply for the disk enclosure 3 Loosen the screw securing the ejector put your finger on the protrusion shown in the figure below of the ejector and pull it toward you Cable clamp Protrusion Release Open Release Clamp Power cord ...

Page 106: ...fective power supply When the defective power supply comes out guide it with both hands and slowly remove it 4 Confirm that the power switch of the new power supply for the disk enclosure is OFF and the power cord is disconnected from the power plug ...

Page 107: ...r pulled toward you hold the new power supply for the disk enclosure with both hands and insert it into the slot 6 Push the protrusion shown in the figure of the ejector to turn the ejector and push in the new power supply ...

Page 108: ...he screws Incorrect insertion may cause a nother power supply failure 8 Insert the receptacle of the power cord shipped with the FC SATA disk enclosure into the power plug of the power supply for the disk enclosure Extend the clamp section of the AC cable clamp fit it to the AC cord and lock the clamp section lightly Then move the clamp section toward the receptacle of the power cord to make a cla...

Page 109: ...of the array controller and disk enclosure remain ON Replacement procedure 1 Identify the defective adapter with the FAULT LED on the adapter being lit Remove all the cables connected to the defective adapter Write down the connections between the cables to be removed and the mating connectors 2 Loosen the screw securing the ejector put your finger on the protrusion shown in the figure of the ejec...

Page 110: ... adapter for replacement is set to the same value as that of the defective adapter If the adapter is installed with a different ENC ID setting a link failure may occur in the worst case 5 Insert the replacement adapter to the slot with the ejector remaining opened until the adapter is properly seated 6 Insert the adapter as far as it will go and close the ejector ...

Page 111: ...ter is seated properly and secure the ejector with the screw When inserting the adapter into the disk enclosure push it as far as it will go and then secure it with the screws Incorrect insertion may cause a malfunction 8 Connect the cables removed in step 1 to the mating connectors as before ...

Page 112: ...umber of the disk array unit are shown at the locations in the figure below Manufacturing number label of array controller Manufacturing number label of power supply for array controller Manufacturing number label of controller Manufacturing number label of battery backup unit ...

Page 113: ...operating environment Therefore the components should be replaced periodically For their replacement contact your maintenance service representative Service life of the disk array unit 5 years 1 Repair service period 5 years after production ends Note that the following disk array units may not be repaired Units stained damaged due to dropping incorrect handling etc Units modified by the customer ...

Page 114: ...rray Unit The table below shows the basic specifications of the disk array unit Hot spare feature Provided Host interface specification FC AL Optical Data transfer rate of host interface 400 MB S or 200 MB S or 100 MB S Disk drive interface specification FC AL Copper ...

Page 115: ... disk drive 300GB 10 000rpm NF2500 SM423E Additional FC disk drive 1 73GB 15 000rpm NF2500 SM424E Additional FC disk drive 1 147GB 15 000rpm NF2500 SM802E Additional SATA disk drive 1 400GB 7200rpm NF2500 SM803E Additional SATA disk drive 1 500GB 7200rpm NF9120 SJ34E DE cable 1 HSSDC HSSDCC cable 5m 2 NF9100 SK02E Rack mount kit 1 For Sun StorEdge rack NF9100 SK03E Rack mount kit 1 For Express rac...

Page 116: ... 9 4 Power Specifications The table below shows the power specifications of the disk array unit Array controller Disk enclosure Input voltage 100 to 240 VAC 10 50 60 Hz Maximum power consumption 330 VA 520 VA 9 5 External Dimensions and Weight The table below shows the external dimensions and weight of the disk array unit Array controller Disk enclosure Width 482 mm 482 mm Height 131 mm 3U 131 mm ...

Page 117: ...er off once and then on again 2 Repair Time The repair time is set to 12 hours by default The repair time can be set in the range from 0 fastest to 24 hours Depending on the disk capacity the repairs may not terminate within the defined time See Individual Settings Bind Unbind of Logical Disk in NEC Storage Series Configuration Guide for the use of the management software NEC Storage Manager 3 Log...

Page 118: ...may provide the installation service at an additionall charg for releasing the license lock and making settings Contact your maintenance service representative if necessary 4 1 Port Mode Accessible logical disks are set in ports in the port mode The access control in the port mode has the following features Conversion between logical disk number for management in system and that on host interface ...

Page 119: ... destination disk To use this feature the specific software Remote DataReplication NEC Storage S2900 sold separately is required Refer to the User s Guide provided with the software Before the Dynamic Data Replication can be used on this disk array unit the license lock must be released by using the license key provided with the software You can release the license lock and make setting changes by...

Page 120: ... first step No status change Res SYNCING Restore SYNCED Change to fault state and abort of copy operation Any pair in which a fault has occurred is recovered by the following operation 1 Issues Forced Separate in the RV target 2 Executes the commands in the previous state again Replicate Separate or Restore The copy operation started again for the entire logic 10 Setting of the OS Type The OS type...

Page 121: ...d will not function properly Other NEC software products are available for the disk array unit ask your sales representative For more information 12 Updating of Control Software When you update the control software such as adding Dynamic Data Replication Remote Data Replication you must always update the software version of the application server where the software is stored as well You can update...

Page 122: ...he license lock and changing settings Contact your maintenance service representative if necessary 13 1 Note on Using Snap Shot SnapShot manages the difference data between the logical disk as the copy source and the virtual copy as a map in the cache memory Thus if the disk array unit is turned OFF and the time limit for holding data by batteries is exceeded processing for creating the management...

Page 123: ...ion of a RAID level Select the RAID level carefully because it has certain influences on system performance and capacity See Section 2 4 RAID Configuration for details The LD bind requires the specification of capacity The specified capacity defines the number of logical disks in a single POOL Select the capacity carefully because the unused area remaining may affect the performance of the RAID Se...

Page 124: ...erface and Internet Explorer Version5 0 or higher 2 Connect the PC to NF2900 in the one to one mode Connection via a hub may be possible However because the IP and MAC addresses are fixed a connection to such an environment as LAN may cause a malfunction to occur 3 Set the PC on network 10 1 0 xxx 255 255 255 0 xxx should be set 1 254 decimal value except for 10 or 11 For the setting use the Inter...

Page 125: ...ser All the features on the left side of the screen will become available Notes 1 Because the IP and MAC addresses of the MNT s Ether port are set as described above do not connect the port to any LAN and WAN 2 The amber LED to the right of the Ether port is lit when the port is in the TCP connection state If theMaintenance PC does not connect please check the items below The correct IP Address ha...

Page 126: ...tion Select 4 Configuration 1 Control Configuration Then set the following items Date Current year month and date Format YY MM DD Time Current time Format HH MM SS Unit Name Unit name After changing the unit name refresh the browser The unit name on the screen and those of network properties SNMP Property 0 and SNMP Property 1 will be changed To make SNMP Property 0 and SNMP Property 1 different f...

Page 127: ...ort Configuration Select 4 Configuration 4 Port Configuration Then set the following items Port Port position Host type Host type to be selected from the pull down list Click the SET button to determine the selection 00 Default 01 ACOS4 A4 02 ACOS2 A2 80 Windows WN 81 Windows WN 88 Solaris CX 89 Linux LX 8A AIX AX 8B HP UX NX 8D SUPER UX SX Select 80 Windows for Windows Do not use 81 Windows ...

Page 128: ...111 1 2 3 FC Port Configuration Select 4 Configuration 5 FC Port Configuration to set the following items When WWN is not defined When WWN is defined ...

Page 129: ... hexadecimal number The following two modes can be set currently Set either one Host Director Port 0000 Replication Director Port 0040 Switch Provide a setting for your Switch See Table 1 2 2 for the additional rule on loop ID See Table 1 2 1 for the relation between the Switch setting value and AL_PA Data Rate Set the data rate of the FC link Select a proper value from the pull down menu 0 Auto N...

Page 130: ...4C 4B 4A 49 47 46 45 43 3C 3A 39 36 42 43 44 45 46 47 48 49 4A 4B 4C 4D 4E 4F 50 51 52 53 54 55 56 57 58 59 5A 5B 5C 5D 5E 5F 60 61 62 35 34 33 32 31 2E 2D 2C 2B 2A 29 27 26 25 23 1F 1E 1D 1B 18 17 10 0F 08 04 02 01 00 63 64 65 66 67 68 69 6A 6B 6C 6D 6E 6F 70 71 72 73 74 75 76 77 78 79 7A 7B 7C 7D 7E 7F If an AL_PA value you set cannot be acquired due to incorrect setting set the SWITCH value aga...

Page 131: ...dows2000 Solaris Linux AIX Basic value 10h Set to 1 if loop duplication occurs Miscellaneous Conforms to the additional rule in the server if any The basic value is 10h if no additional rule is defined in the server Set to 1 if loop duplication occurs The rule above may be changed depending on the system configuration on the user side Set the controller s AL PA so that it is different from the AL ...

Page 132: ...screen can be used to set the resource type On the DE columns set the locations of all installed DEs disk enclosures The information on the DEs with their check buttons checked is only set Select the PCC mode No Present UPS IF Only UPS IF AOC IF or UPS IF AOC IF SCBI in the PCC field See the DE location view on the next page for the DE locations DE00 DE0F DE number PCC PCC mode 0 No present 3 UPS ...

Page 133: ...116 DE Location View DE00 DE01 DE05 DE09 DE0 DE0 DE04 DE08 DE03 DE07 DE0 DE0 DE02 DE06 DE0 DE0 ...

Page 134: ...117 1 2 5 Network Property Select 4 Configuration 7 Network Property to set the following items ...

Page 135: ...ake accessible from iSM without manager registration SNMP Valid Makes SNMP effective ON if checked Community Name Read permission for SNMP and community name of trap default value public 0 0 0 0 0 Registers accessible managers up to 8 SNMP Check this to make accessible from SNMP manager TRAP Check this to report SNMP trap SCSI Check this to make accessible from iSM THRESHOLD Set the threshold of S...

Page 136: ...t the Maintenance PC according to Section 1 2 2 1 Confirmation of FC Port Configuration Select 1 Status 2 Control Port Status to confirm the settings of FC Port Configuration When WWN is not defined When WWN is defined This function displays the FC Port status The displayed items are as follows Port Port name setting value Host Type Host type setting value Link Attach Setting value for Topology of...

Page 137: ... Extended format xxxxb 0010b yyyyb 0000b zzh 00h 2 2 Confirmation of Base Product Setting Select 2 Condition 1 Condition View to confirm the resources being set The resource states are distinguished by using different colors to be displayed graphically Maintenance required Red State transition Yellow Normal operation Green No installation White CONT0 CONT1 should be ready green During lock CONT0 C...

Page 138: ...em to offline Next check the port s to be selected newly to set them online Set the on off status of the host ports on the CONT card Port On Off Switch Feature of Port On Off with host Only mounting ports appear CONT0 HP0 CONT0 HP1 CONT0 HP2 CONT0 HP3 CONT1 HP0 CONT1 HP1 CONT1 HP2 CONT1 HP3 Remove the check of port to be deselected and click SET Offline Add the check of port to be selected and cli...

Page 139: ...t NOTE The following procedures supposes that a rail is installed on the left part of a rack when the rack is viewed from its front Install a rail on the right part of the rack in the similar procedure The left and right rails are different from each other Use the correct rail when installing it in the rack See the figure below For each rail assume the face with the inner as the rear see the figur...

Page 140: ... the rack Insert the provided screw into the hole at the bottom to secure the rail If the two small head screws are provided use them as shown in the right figure below Set screw Set screw Insert 1U partition mark 1U partition mark ...

Page 141: ... projections into the angle holes 5 With the inner held push the two set screws with a part for cable clamp into the female screws of the rail support and drive the screws equally Take note on the direction of the part for cable clamp Insert Inner Drive equally ...

Page 142: ...section on the rails and push it into the rack NOTE The unit is very heavy Be careful not to drop it while lifting Fasten four set screws at two left and two right points on the front of the unit The figure below only shows the right part of the unit Fix the left part of the unit similarly Set screws Set screws ...

Page 143: ...f the following procedures supposes that a rail is installed on the left part of a rack when the rack is viewed from its front Install a rail on the right part of the rack in the similar procedure The left and right rails are different from each other Use the correct rail when installing it on the rack See the figure below For each rail assume the face with the label as the rear see the figure bel...

Page 144: ...ith angle holes use the rail as the rail support remains attached 8 Loosen the four flush screws at the rear end of the rail After loosing the screws make sure that the moving part of the rail can slide smoothly NOTE Do not remove the flush screws 9 Remove the flush screw 1 enclosed by a circle in the figure below ...

Page 145: ...e below with the flush screw removed in step 2 loosely Make sure that the moving part of the rail can slide smoothly 11 Insert the top and bottom projections into the angle holes on the front of the rack Bracket Insert Enlarged view of encircled part ...

Page 146: ...f the rack with the screw holes of the rail and fix the rail with the attached set screws Use the set screw see the figure below 13 Pull the inner toward you and push the top and bottom projections into the angle holes Set screw Inner Insert Insert ...

Page 147: ...ws with a part for cable clamp into the female screws of the rail support and drive the screws equally Take note on the direction of the part for cable clamp Drive the four flush screws loosened in step 1 and removed in step 3 securely Drive equally ...

Page 148: ...On the right side of the rack install the other rail in the same procedure 16 Install the rack nut at the position shown in the figure below or the first hole on the projection at the top of the rail Rack nut ...

Page 149: ...the rack NOTE The unit is very heavy Be careful not to drop it while lifting 18 Fasten four set screws at two left and two right points on the front of the unit The figure below only shows the right part of the unit Fix the left part of the unit similarly Insert Set screws ...

Page 150: ...pport from the rail 19 Remove the rail support installed previously from each rail by removing four screws two on the front and the other two on the rear 20 Loosen four flush screws at the rear side of the rail After loosening the screws make sure that the moving part of the rail can slide smoothly NOTE Do not remove the flush screws Remove Remove ...

Page 151: ...ush screw 1 enclosed by a circle in the figure below 22 Install the attached bracket see the figure below with the flush screw removed in step 3 loosely Make sure that the moving part of the rail can slide smoothly Bracket ...

Page 152: ...e with the label and fix the rail to the rack with the attached set screws Use screws see the figure below 24 Pull the inner toward you and with it held insert the two set screws with a part for cable clamp into the female screws of the inner and drive the screws equally Take note on the direction of the part for cable clamp Drive equally Set screw ...

Page 153: ...136 Drive the four flush screws loosened in step 1 and removed in step 3 securely 25 On the right side of the rack install the other rail in the same procedure ...

Page 154: ... the figure below or the hole just above the set screw the first hole of the top of the rail 27 Lift the unit put the rear section on the rails and push it into the rack NOTE The unit is very heavy Be careful not to drop it while lifting Rack nut Insert ...

Page 155: ...8 28 Fasten four set screws at two left and two right points on the front of the unit to fix the unit The figure below only shows the right part of the unit Fix the left part of the unit similarly Screws ...

Page 156: ...unt kit is to be separately purchased Ask your sales representative for details 2 1 Installation of Rails The procedure explained in this section covers the rail installed to the left side of the rack when viewed from the front of it The same procedure is applied to the right rail 29 Slightly loosen the four flush screws at the rear of the rail Flat head screw ...

Page 157: ...he unit and engage the hook with the cutout NOTE Two cutouts are provided one is for new rack and the other is for old rack The outer cutout should be used for the new rack while the inner cutout is used for the old rack 31 Pull the rail toward you and insert the rivets on the rail into the round holes on the rack Cutout for new rack Cutout for old rack Hook Rivets ...

Page 158: ...hile holding the rail tighten the set screw M4 screw 33 Move to the rear of the rack First while pulling the rail toward you screw the set screw M5 screw into the lower female threaded hole Set screw Set screw ...

Page 159: ...he fixture where the cable tie has been passed through to the rack by screwing the set screw M5 screw into the upper female threaded hole 35 Firmly tighten the four flush screws Set screw Fixture Cable tie Flat head screw ...

Page 160: ...s Move to the front of the rack and push one rack nut into the round hole which corresponds to the cutout on the rail from the side Then push another rack nut into the fifth round hole from the top as well Cutout Rack nut Rack nut ...

Page 161: ... Lift the unit and place the rear section on the rails and push the unit toward the innermost of the rack NOTE The unit is very heavy Be careful not to drop it while lifting 38 Screw four set screws M5 screws in the unit at both sides to fix the unit This completes the installation of unit Set screw ...

Page 162: ...e NF9100 SK02E rack mount kit is to be separately purchased Ask your sales representative for details 3 1 Installation of Rails 39 Temporarily tighten two set screws 10 32UNF at both ends of the front frame that corresponds to the unit installation location Do not tighten the screws firmly Set screw ...

Page 163: ... each rail fitting the round hole in the rail onto the screws in step 1 and temporarily secure it 41 Move to the rear of the rack and firmly secure each rail with two set screws 10 32UNF Screw Round hole Set screw ...

Page 164: ...t on the rails and then push it in NOTE The unit is very heavy Be careful not to drop it while lifting 43 At the front of the unit firmly tighten the four set screws 2 at right and left each 10 32UNF to secure the unit This completes the installation of the unit Set screw ...

Page 165: ...s Old type Rack NOTE The Express old type racks are N8540 28 42U rack N8540 29 36U rack N8540 38 16U rack N8540 09 44U rack N8540 09AC 44U rack N8540 10E 35U rack and N8540 10AC 35U rack The Express old type rack mount kit is the NF9100 SK03E ...

Page 166: ...149 4 1 Installing the Rack Mount Kit Install the rack mount kit into the rack as shown in the figure Detail A for fixing the installed unit ...

Page 167: ...t on the rails and then push it in NOTE The unit is very heavy Be careful not to drop it while lifting 45 At the front of the unit firmly tighten the four set screws 2 at right and left each 10 32UNF to secure the unit This completes the installation of the unit Set screws ...

Page 168: ...le clamp for cable handling if necessary However always clamp the AC cord on the unit side see the figure below For other cables put several cables together and pass each set through repeat ties as per the notes below The following figure shows sample wiring of an AC cord NOTE To route FC cables note that the maximum bending radius should be equal to or larger than 30 mm ...

Reviews: