manualshive.com logo in svg

IBM SAN384B-2, Инструкция по установке, обслуживанию и эксплуатации

IBM SAN384B-2 - мощный оборудование для хранения данных, обеспечивающее высокую производительность и надежность. Установка и обслуживание легки благодаря подробному руководству по эксплуатации. Скачайте бесплатно инструкцию по установке, обслуживанию и пользованию на manualshive.com.

Поделиться
Скачать
background image

Contents

Read this first . . . . . . . . . . . . iii

Summary of changes .

.

.

.

.

.

.

.

.

.

. iii

Fourth edition

.

.

.

.

.

.

.

.

.

.

.

. iii

Third edition .

.

.

.

.

.

.

.

.

.

.

.

. iii

Second edition

.

.

.

.

.

.

.

.

.

.

.

. iii

Getting help .

.

.

.

.

.

.

.

.

.

.

.

.

. iii

Taiwan Contact Information .

.

.

.

.

.

.

. iv

How to send your comments

.

.

.

.

.

.

.

. iv

Figures . . . . . . . . . . . . . . . xi

Tables . . . . . . . . . . . . . . . xiii

Safety notices

. . . . . . . . . . . xv

Safety notices and labels .

.

.

.

.

.

.

.

.

. xv

Danger notices .

.

.

.

.

.

.

.

.

.

.

. xv

Caution notices .

.

.

.

.

.

.

.

.

.

. xviii

Safety labels .

.

.

.

.

.

.

.

.

.

.

.

. xx

Attention notices .

.

.

.

.

.

.

.

.

.

. xxi

Rack safety .

.

.

.

.

.

.

.

.

.

.

.

.

. xxii

Rack installation .

.

.

.

.

.

.

.

.

.

. xxii

Rack relocation (19" rack) .

.

.

.

.

.

.

. xxiii

Safety inspections

.

.

.

.

.

.

.

.

.

.

. xxiv

Removing AC power

.

.

.

.

.

.

.

.

. xxiv

External machine checks .

.

.

.

.

.

.

. xxiv

Internal machine checks

.

.

.

.

.

.

.

. xxiv

Product recycling and disposal

.

.

.

.

.

.

. xxv

About this document

. . . . . . . xxvii

Who should read this document

.

.

.

.

.

. xxvii

Product documents .

.

.

.

.

.

.

.

.

.

. xxvii

Brocade documents .

.

.

.

.

.

.

.

.

.

. xxvii

IBM and Brocade product matrix .

.

.

.

. xxviii

Accessibility features for SAN384B-2 .

.

.

. xxviii

Chapter 1. Introduction . . . . . . . . 1

Overview of the SAN384B-2 .

.

.

.

.

.

.

.

. 1

Hardware components .

.

.

.

.

.

.

.

.

.

. 2

SAN384B-2 blades

.

.

.

.

.

.

.

.

.

.

.

. 5

High availability .

.

.

.

.

.

.

.

.

.

.

.

. 7

Reliability .

.

.

.

.

.

.

.

.

.

.

.

.

.

. 8

Serviceability .

.

.

.

.

.

.

.

.

.

.

.

.

. 8

Software features .

.

.

.

.

.

.

.

.

.

.

.

. 9

Security .

.

.

.

.

.

.

.

.

.

.

.

.

.

. 9

Network Manageability .

.

.

.

.

.

.

.

. 10

Chapter 2. Installing a SAN384B-2 in a
cabinet. . . . . . . . . . . . . . . 11

Items included with the SAN384B-2 .

.

.

.

.

. 11

Ordering the lift tool .

.

.

.

.

.

.

.

.

.

. 12

World trade locations .

.

.

.

.

.

.

.

.

. 12

United States locations

.

.

.

.

.

.

.

.

. 12

Installation guidelines .

.

.

.

.

.

.

.

.

.

. 13

Installing a SAN384B-2 in a 2109 C36 cabinet .

.

. 14

Time required

.

.

.

.

.

.

.

.

.

.

.

. 14

Unpacking and assembling the lift tool .

.

.

. 16

Unpacking the SAN384B-2 .

.

.

.

.

.

.

. 17

Installing the port-side exhaust kit.

.

.

.

.

. 18

Torque requirements .

.

.

.

.

.

.

.

.

. 21

Installing the exhaust kit hardware

.

.

.

.

. 21

Installing the SAN384B-2 into the cabinet .

.

. 25

Port numbering .

.

.

.

.

.

.

.

.

.

.

.

. 29

Chassis slots .

.

.

.

.

.

.

.

.

.

.

.

.

. 31

Cable organization .

.

.

.

.

.

.

.

.

.

.

. 31

Chapter 3. Starting and configuring the
SAN384B-2 . . . . . . . . . . . . . 33

Providing power to the SAN384B-2 .

.

.

.

.

. 35

Connecting the SAN384B-2 and host with a serial
cable

.

.

.

.

.

.

.

.

.

.

.

.

.

.

.

. 35

Logging in to the serial console port .

.

.

.

.

. 36

Configuring the IP addresses

.

.

.

.

.

.

.

. 36

Logging off the serial console port and
disconnecting the serial cable

.

.

.

.

.

.

. 38

Establishing an Ethernet connection .

.

.

.

.

. 38

Customizing the switch name .

.

.

.

.

.

.

. 38

Customizing a chassis name .

.

.

.

.

.

.

.

. 38

Setting the Domain ID.

.

.

.

.

.

.

.

.

.

. 39

Setting the date and time .

.

.

.

.

.

.

.

.

. 39

Setting the date .

.

.

.

.

.

.

.

.

.

.

. 39

Setting the time zone .

.

.

.

.

.

.

.

.

. 40

Synchronizing local time .

.

.

.

.

.

.

.

. 40

Verifying the persistent PID feature .

.

.

.

.

. 41

Determining installed software licenses .

.

.

.

. 41

Installing transceivers and attaching cables .

.

.

. 42

Managing cables.

.

.

.

.

.

.

.

.

.

.

.

. 44

Planning for encryption (optional) .

.

.

.

.

.

. 45

Configuring for encryption (optional).

.

.

.

.

. 46

Summary of procedure

.

.

.

.

.

.

.

.

. 46

Avoid double encryption .

.

.

.

.

.

.

.

. 47

Verifying correct operation and backing up the
configuration .

.

.

.

.

.

.

.

.

.

.

.

.

. 47

Fabric OS firmware updates .

.

.

.

.

.

.

.

. 48

Downloading and installing firmware

.

.

.

. 49

Powering off the SAN384B-2

.

.

.

.

.

.

.

. 49

Chapter 4. Monitoring system
components . . . . . . . . . . . . 51

Port, application, or encryption blade status

.

.

. 55

Control processor blade (CP8) status .

.

.

.

.

. 59

Core switch blade (CR16-4) status .

.

.

.

.

.

. 61

Power supply status

.

.

.

.

.

.

.

.

.

.

. 63

Blower assembly status

.

.

.

.

.

.

.

.

.

. 63

WWN card status .

.

.

.

.

.

.

.

.

.

.

. 65

Chapter 5. Removing and installing
components . . . . . . . . . . . . 67

Removing and installing the chassis door .

.

.

. 67

© Copyright IBM Corp. 2011, 2012

vii

||

Содержание SAN384B-2

Страница 1: ...e and User Guide Service information 2499 416 GA32 0894 03 Read Before Using This product contains software that is licensed under written license agreements Your use of such software is subject to the license agreements under which they are provided ...

Страница 2: ......

Страница 3: ...IBM System Storage SAN384B 2 Installation Service and User Guide Service information 2499 416 GA32 0894 03 ...

Страница 4: ...INESS MACHINES CORPORATION PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE Some states or regions do not allow disclaimer of express or implied warranties in certain transactions therefore this statement may not apply to you Copyright IBM Corporation 201...

Страница 5: ...pdated FOS version to 7 0 0c v Added port speed to Encryption blade information Second edition The following changes were made in the second edition v The addition of 16 Gbps long wave length LWL SFP feature v The addition of encryption including the Encryption Blade FS8 18 v Updated instructions on ordering the lift tool load plate now included with the lift tool v Other minor content updates Get...

Страница 6: ... command output v Detailed description of the problem and specific questions v Description of any troubleshooting steps already performed and the results v Serial console and Telnet session logs v Syslog message logs Visit www ibm com contact for the contact information for your country or region For detailed information about the Fibre Channel standards see the Fibre Channel Industry Association ...

Страница 7: ...v Page table or illustration numbers v A detailed description of any information that should be changed Read this first v ...

Страница 8: ...vi SAN384B 2 Installation Service and User Guide ...

Страница 9: ...haust kit 18 Torque requirements 21 Installing the exhaust kit hardware 21 Installing the SAN384B 2 into the cabinet 25 Port numbering 29 Chassis slots 31 Cable organization 31 Chapter 3 Starting and configuring the SAN384B 2 33 Providing power to the SAN384B 2 35 Connecting the SAN384B 2 and host with a serial cable 35 Logging in to the serial console port 36 Configuring the IP addresses 36 Loggi...

Страница 10: ...emoving and replacing inter chassis link QSFP cables 93 Time and items required 94 Removing an inter chassis link QSFP cable 94 Installing an ICL cable 94 Possible ICL configurations 95 Removing and replacing a SAN384B 2 chassis 98 Time required 99 Items required 99 Verifying need for replacement 99 Recording critical SAN384B 2 and SAN information 99 Disconnecting from the network and fabric 102 R...

Страница 11: ...tatement 146 Industry Canada Class A Emission Compliance Statement 147 Avis de conformité à la réglementation d Industrie Canada 147 European Union EMC Directive Conformance Statement 147 Germany Electromagnetic Compatibility Directive 147 People s Republic of China Class A Electronic Emission Statement 148 Japan Voluntary Control Council for Interference VCCI Class A Statement 149 Japan Electroni...

Страница 12: ...x SAN384B 2 Installation Service and User Guide ...

Страница 13: ...ade 57 25 FX8 24 extension blade 58 26 Control processor blade CP8 ports and LEDs 60 27 Core switch blade CR16 4 61 28 Power supply 63 29 Blower assembly LEDs 64 30 WWN bezel 66 31 Chassis door 68 32 Cable management finger assemblies 69 33 Port application and encryption blade removal and installation FC16 48 port blade shown 71 34 Filler panel removal and installation 73 35 Removing the control ...

Страница 14: ...xii SAN384B 2 Installation Service and User Guide ...

Страница 15: ...embly LED descriptions 64 13 Messages that may indicate WWN card failure 65 14 Steps for upgrading through multiple versions of Fabric OS 78 15 ICL connector port LEDs 93 16 Critical information checklist example 100 17 Cable routing table for SAN384B 2 64 ports shown 110 18 General product specifications 125 19 System architecture 125 20 System sizes and weights 127 21 System FRU weights 128 22 E...

Страница 16: ...xiv SAN384B 2 Installation Service and User Guide ...

Страница 17: ...s in the sections that follow v Note These notices provide important tips guidance or advice v Attention notices on page xxi These notices indicate potential damage to programs devices or data v Caution notices on page xviii These statements indicate situations that can be potentially hazardous to you v Danger notices These statements indicate situations that can be potentially lethal or extremely...

Страница 18: ...lace dangerous voltage on the metal shell If any of the conditions are not as described STOP Ensure the improper voltage or impedance conditions are corrected before proceeding D003 DANGER An electrical outlet that is not correctly wired could place hazardous voltage on metal parts of the system or the devices that attach to the system It is the responsibility of the customer to ensure that the ou...

Страница 19: ...hen possible use one hand only to connect or disconnect signal cables v Never turn on any equipment when there is evidence of fire water or structural damage v Disconnect the attached power cords telecommunications systems networks and modems before you open the device covers unless instructed otherwise in the installation and configuration procedures v Connect and disconnect cables as described b...

Страница 20: ...t relocation or disposal 500 lbs 227 kg a69i0333 DANGER Heavy equipment personal injury or equipment damage might result if mishandled D006 Caution notices A caution notice calls attention to a situation that is potentially hazardous to people because of some existing condition A caution notice can be accompanied by different symbols as in the examples below If the symbol is It means A hazardous e...

Страница 21: ...ded electrical outlet to avoid electrical shock C018 CAUTION This product might contain one or more of the following devices CD ROM drive DVD ROM drive DVD RAM drive or laser module which are Class 1 laser products Note the following information v Do not remove the covers Removing the covers of the laser product could result in exposure to hazardous laser radiation There are no serviceable parts i...

Страница 22: ...e current or energy levels are present inside any component that has this label attached Do not open any cover or barrier that contains this label L001 DANGER Rack mounted devices are not to be used as a shelf or work space L002 DANGER Multiple power cords The product might be equipped with multiple power cords To remove all hazardous voltages disconnect all power cords L003 DANGER Hazardous volta...

Страница 23: ... a radius less than 5 cm 2 in you can damage the cable Tie wraps are not recommended for optical cables because they can be easily overtightened causing damage to the cable ESD precautions Attention Many of the field replaceable units FRUs are sensitive to electrostatic discharge ESD and can potentially be damaged by improper handling Wear a wrist grounding strap connected to chassis ground if the...

Страница 24: ...to ensure that the outlet is correctly wired and grounded to prevent an electrical shock R001 part 1 of 2 CAUTION v Do not install a unit in a rack where the internal rack ambient temperatures will exceed the manufacturer s recommended ambient temperature for all your rack mounted devices v Do not install a unit in a rack where the air flow is compromised Ensure that air flow is not blocked or red...

Страница 25: ... hazards Verify that the route that you choose can support the weight of the loaded rack cabinet Refer to the documentation that came with your rack cabinet for the weight of a loaded rack cabinet Verify that all door openings are at least 760 x 2030 mm 30 x 80 in Ensure that all devices shelves drawers doors and cables are secure Ensure that the four leveling pads are raised to their highest posi...

Страница 26: ...er cable for damage 4 Check the external signal cable for damage 5 Check the cover for sharp edges damage or alterations that expose the internal parts of the device 6 Check that any unused serial ports are covered for dust and ESD protection The cover should be kept on the serial port whenever it is not being used 7 Correct any problems that you find Internal machine checks Perform the following ...

Страница 27: ...d with the product for translated environmental statements and information regarding product recycling and disposal This document may be provided either in printed version or on a CD ROM See Removing the batteries on page 111 for battery removal instructions if needed to meet environmental regulations Safety notices xxv ...

Страница 28: ...xxvi SAN384B 2 Installation Service and User Guide ...

Страница 29: ...e documentation may be printed material on the documentation CD that is shipped with the product or available on the web through the IBM Support Portal or IBM Publications Center v IBM System Storage SAN384B 2 Installation Service and User Guide GA32 0894 this document which is also available in accessible HTML format on the documentation CD v IBM System Storage SAN b type Safety Notices v IBM Sys...

Страница 30: ... use to correlate the Brocade products and models to the IBM product names and machine types and model numbers Products withdrawn from marketing are not listed Table 1 Brocade and IBM product and model number matrix Brocade product name IBM product name IBM machine type and model number Brocade 6505 SAN24B 5 2498 Model F24 249824G Brocade 6510 SAN48B 5 2498 Model F48 Brocade DCX 8510 4 SAN384B 2 2...

Страница 31: ...ard Microsoft Windows navigation keys Vendor software The SAN384B 2 includes certain vendor software that is not covered under the IBM license agreement IBM makes no representation about the accessibility features of these products Contact the vendor for the accessibility information about its products Related accessibility information You can view the publications for the SAN384B 2 in Adobe Porta...

Страница 32: ...xxx SAN384B 2 Installation Service and User Guide ...

Страница 33: ...are designed to increase business agility by adapting to dynamic growth and change providing non stop access to information and reducing infrastructure and administrative costs Key features of the SAN384B 2 include v Up to 192 16 Gbps external ports in a single chassis enabling high density SAN configurations with reduced footprint v Support for 2 4 8 and 16 Gbps auto sensing Fibre Channel ports T...

Страница 34: ... 192 16 Gbps Fibre Channel ports v Two slots for control processor blades CP8 A single active CP8 blade can control all 192 ports in the chassis The standby CP8 blade assumes control of the SAN384B 2 if the active CP fails v Two slots for core switch blades CR16 4 CR16 4 blade interconnects all port blades Inter chassis link ICL connectors to connect to as many as nine neighboring chassis with FOS...

Страница 35: ...4B 2 Blowers power supplies and power cables are serviced from the nonport side v World Wide Name WWN cards on the nonport side with WWN status LEDs located under the bezel v Two vertical cable management finger assemblies and a chassis door provide for efficient cable management Note Airflow in the SAN384B 2 is from the non port non cable side to the left side and port side of the chassis With th...

Страница 36: ...from the chassis exhaust vent through the port side exhaust kit The exhaust from the left side exits through the vent grill below the chassis Figure 3 on page 5 shows the non port side of the SAN384B 2 384b072 Figure 2 Port side of the SAN384B 2 with the exhaust kit installed sample configuration 4 SAN384B 2 Installation Service and User Guide ...

Страница 37: ...for the SAN384B Table 2 Blades available for the SAN384B 2 Description Feature Code Name Function Control processor blade N A CP8 The CP8 blade contains the control plane for the chassis There are two CP8 blades for redundancy This control processor blade is compatible with the SAN768B 2 SAN384B 2 SAN768B and SAN384B 3 2 1 384b003 4 Figure 3 Blower non port side of the SAN384B 2 Chapter 1 Introduc...

Страница 38: ...orting 2 4 8 10 and 16 Gbps Fibre Channel port speeds The blade also supports port based in flight encryption decryption and compression decompression This port blade is compatible with the SAN384B 2 and SAN768B 2 48 port 16 Gbps port blade FC3648 FC16 48 A 48 port port blade supporting 2 4 8 10 and 16 Gbps Fibre Channel port speeds The blade also supports port based in flight encryption decryptio...

Страница 39: ...This application blade is compatible with the SAN768B 2 SAN384B 2 SAN768B and SAN384B Encryption blade FC3895 FS8 18 The FS8 18 blade enables data cryptographic encryption decryption and data compression capabilities for data at rest It has 16 Fibre Channel 8 Gbps optical SFP ports This application blade is compatible with the SAN768B 2 SAN384B 2 SAN768B and SAN384B High availability The following...

Страница 40: ... nondisruptive fast firmware upgrades v Each control processor contains one serial port and two Ethernet ports for management and for service The standby control processor monitors diagnostics to ensure the system is operational should a failover be necessary v Bus monitoring and control of blades and other field replaceable units FRUs Serviceability The SAN384B 2 provides the following features t...

Страница 41: ... FICON with CUP Activation optional feature providing in band management of the supported SAN b type switch and director products by system automation for z OS from IBM System z10 EC z10 BC z9 EC z9 BC zSeries 990 900 890 and 880 servers v FICON Accelerator optional feature which is designed to support secure high speed data movement between multiple locations Security The list below highlights so...

Страница 42: ... this feature on this and other models The publication is available through the IBM Support Portal www ibm com supportportal or the IBM Publications Center www ibm com shop publications order Search by title or publication form number on either site Network Manageability The SAN384B 2 has a single domain and is managed as a single element with the Network Advisor The SAN384B 2 responds to its own ...

Страница 43: ...fety instructions Safety notices and labels on page xv and Rack safety on page xxii before performing any installation or service procedures svc00169 55 kg 121 2 lbs CAUTION The weight of this part or unit is more than 55 kg 121 2 lb It takes specially trained persons with a lifting device to safely lift this part or unit C011 CAUTION A fully populated SAN384B 2 weighs approximately 68 kg 150 lb B...

Страница 44: ...esentative World trade locations The following ordering procedures are for world trade locations v Order the lift tool by using the parts order system like any other part v Use the following part numbers when you order Lift tool PN 09P2481 The lift tool will include the required 24 inch load plate PN 11P4369 v You do not record parts usage v Return the lift tool and the 24 inch load plate to the p...

Страница 45: ... packed and restored in the arbocrate shipping container of the lift tool Ensure that the lift tool is functioning properly before you release the tool to UPS Logistics for return You are accountable for the lift tool until UPS Logistics picks up the lift tool for return delivery to their parts storage facility Contact your branch office tools coordinator or your region specialist if you have any ...

Страница 46: ...switch configuration or collecting supportsave output data optional v Brocade USB drive for collecting supportsave output data optional v SFPs and compatible cables 6 Ensure that the air intake vents have a minimum of 2 inches of airspace 7 Ensure that the air temperature on the air intake side is less than 40 C 104 F during operation Installing a SAN384B 2 in a 2109 C36 cabinet This section descr...

Страница 47: ... been positioned near the installation site Installing the port side exhaust kit 30 minutes Torque wrench with 2 Phillips screwdriver tip Flathead screwdriver Mounting and securing the SAN384B 2 in the rack 30 minutes Torque wrench with 2 Phillips screwdriver tip Lift tool and load plate Installing power cables and powering on the SAN384B 2 20 minutes Power cables Establishing serial connection lo...

Страница 48: ...pins sliding the legs in until the pins snap into place through the holes in the legs securing them in place 5 Tilt the lift tool upright resting on all four wheels Set the wheel brake if desired by stepping down on the brake pedal Note the brake release on the left side of the brake pedal 6 Attach the two forks to the lift tool sliding the two holes in each over the ends of the two bars If the wi...

Страница 49: ...ed a long distance or if there are uneven floors to cross keep the product in its original packaging and relocate the entire shipment close to the installation location using a pallet jack to lift and move it Note The standard packaging does not incorporate a wood pallet and pallet brackets The chassis sits on top of a plastic shipping tray 2 Once the shipment is in a location close to the install...

Страница 50: ... the chassis across the foam blocking in the shipping tray and onto the center of the load plate Do not use any of the handles on the blowers or power supplies to move the chassis 10 Attach the lift tool retention straps to secure the chassis to the load plate This is particularly important if you will be moving the chassis across any uneven floor or will be raising the chassis more than 45 cm 18 ...

Страница 51: ... in 1 27 cm Phillips screw blue Loctite on threads 12 E 10 32 x 63 in 1 60 cm Phillips screw with square cone washer 12 F 10 32 clip nut for cabinets that have rails with round holes 8 G 10 32 retainer nut for cabinets that have rails with square holes 8 H Alignment washer for cabinets that have rails with square holes 12 I 6 32 x 25 in 635 cm Phillips screw 2 Chapter 2 Installing a SAN384B 2 in a...

Страница 52: ...Exhaust 10 32 Clip Nut 10 32 x 5 10 32 x 63 10 32 Retainer Nut Alignment Washer 6 32 x 25 D E F G H I 384b032 Figure 6 Port side exhaust kit assembly for 27 to 31 in 68 58 to 78 74 cm cabinets 20 SAN384B 2 Installation Service and User Guide ...

Страница 53: ...rtical cabinet rails Eight clip nuts and retainer nuts are provided with the exhaust kit and six are provided with the hardware accessory kit Install the lower two nuts at the same relative locations on all four cabinet vertical rails to provide a level mounting of the shelf The fourteen nuts will secure the eight 10 32 screws that mount the port side exhaust kit shelf position 23 in Figure 7 on p...

Страница 54: ...osition it horizontally and level with the shelf mounting tabs on the outside of the cabinet vertical rails and aligned with the clip nuts you installed earlier c Secure the shelf to the cabinet with eight 10 32 screws with washers E in Figure 6 on page 20 two screws in each corner of the shelf see Figure 8 on page 23 Tighten screws according to specifications under Torque requirements on page 21 ...

Страница 55: ...de of the duct facing towards the center of the cabinet 6 Attach the top rail assembly A in Figure 6 on page 20 to the air duct assembly a The top rail assembly can be adjusted to a length of between 27 and 31 inches 68 58 to 78 74 cm to fit on the inside of the cabinet rails To lengthen or shorten the top rail assembly loosen by approximately 1 2 turn the two Port Side Exhaust 384b034 Figure 8 Sh...

Страница 56: ... rail assembly see Figure 10 a For rails with round holes Use two 10 32 screws with washers E in Figure 6 on page 20 on each end of the top rail assembly Tighten screws according to specifications under Torque requirements on page 21 b For rails with square holes Use the two standard 10 32 screws D in Figure 6 on page 20 with blue Loctite on the threads and alignment washers H in Figure 6 on page ...

Страница 57: ...sible to the rear of the cabinet Position the lift tool so that the blower assemblies are facing towards the inside of the cabinet and the port side of the chassis facing away from the cabinet see Figure 11 2 Set the wheel brake by pressing down on the wheel brake pedal 3 Remove the lift tool retention straps from the chassis and the lift tool 4 Carefully center the chassis over the middle section...

Страница 58: ... section is not fully extended Adjust as needed Figure 12 shows a view from inside the cabinet with the middle section of the lift tool load plate extended and the chassis centered on the load plate 9 Carefully slide the chassis into the cabinet between the shelf and the upper edge of the exhaust kit duct assembly until the chassis rests securely on the shelf Figure 13 on page 27 shows a view from...

Страница 59: ...t tool away from the cabinet 12 If necessary adjust the rubber strips on the exhaust kit duct to ensure a good seal against the chassis 13 The chassis will be secured to the cabinet with six 10 32 screws with washers see Figure 14 on page 28 Four of these screws will also be used to attach the cable management finger assemblies Do not install the screws until you determine the position of the cabl...

Страница 60: ...osition the cable management finger assemblies either towards the top of the chassis or towards the bottom of the chassis depending on your requirements for routing cables The third screw for each side is used to secure the chassis to the rails directly through the chassis flange into the clip nuts These screws do not attach the cable management assemblies to the chassis or rack Figure 15 on page ...

Страница 61: ...ist of available port and application blades for the SAN384B 2 Table 6 Port and application blades available on the SAN384B 2 Blade label IBM blade name Feature code FC16 32 32 port 16Gbps Switch Blade 3632 FC8 32E 32 port 8Gbps Enhanced Port Blade 3633 FC16 48 48 port 16Gbps Switch Blade 3648 FC8 48E 48 port 8Gbps Enhanced Port Blade 3649 FC8 64 64 port 8Gbps Switch Blade 3864 FX8 24 FCIP 8 Gbps ...

Страница 62: ...lower row of ports and 24 through 47 from right to left on the upper row of ports v FC8 48E port blade Ports are numbered from 0 through 23 from right to left on the lower row of ports and 24 through 47 from right to left on the upper row of ports v FC8 64 port blade Ports are numbered from 0 through 31 from right to left on the lower row of ports and 32 through 63 from right to left on the upper ...

Страница 63: ...cal rails They are not attached directly to the SAN384B 2 chassis This pair of cable management finger assemblies can be used to keep the cables from hanging down in front of other blades and to route them away from the exhaust vent of the port side exhaust kit which is located below the SAN384B 2 chassis Use these guidelines in planning for cable management v Plan for rack space required for cabl...

Страница 64: ...ades 1 mini SFP connector 3 1 6 mm cable 2 Duplex clip black 4 SFP connector Note that the duplex clip on the mSFP end of the cable is black for easier recognition If ISL Trunking is in use group the cables by trunking group The ports are color coded to indicate which ports can be used in the same ISL Trunking group eight ports marked with solid black ovals alternate with eight ports marked with o...

Страница 65: ...et masks and gateway addresses for both CP blades v Switch name v Domain ID optional v WWN for the chassis Note The SAN384B 2 WWN is initially set by the factory to match the license ID which is based on the chassis serial number The WWN can be changed but the license ID cannot be modified The configuration information is mirrored to the standby CP blade which allows the most current configuration...

Страница 66: ... an Ethernet connection on page 38 2 Specify a switch name See Customizing the switch name on page 38 3 Specify a domain ID for the SAN384B 2 See Setting the Domain ID on page 39 4 Set the date and time See Setting the date and time on page 39 5 Connect to the fabric See Verifying the persistent PID feature on page 41 Configuration Tasks Connect Serial Cable between Switch and Host Log In to Seria...

Страница 67: ...al state For information about LED patterns see Chapter 4 Monitoring system components on page 51 You can bypass POST by using the fastBoot command You can also disable POST for successive reboots on the SAN384B 2 using the diagDisablePost command Attention To prevent a potential IP address conflict do not connect the SAN384B 2 to the network until the IP addresses are configured Note To power off...

Страница 68: ...ord the new passwords and keep this information in a secure location The example below shows the login without changing the password swDir login admin Password Please change your passwords now Use Control C to exit or press Enter key to proceed Password was not changed Will prompt again at next login until password is changed swDir admin 2 Optional Modify passwords To skip modifying the password p...

Страница 69: ...the CP0 blade IP address by entering the ipaddrset cp 0 command at the prompt swDir admin ipAddrSet cp 0 Enter the requested information at the prompts 4 Set up the CP1 IP address by entering the ipaddrset cp 1 command swDir admin ipAddrSet cp 1 Enter the requested information at the prompts The following is a sample IP configuration for the SAN384B 2 sw 0 and the two CP blades cp0 and cp1 swDir a...

Страница 70: ...cable into the Ethernet port 3 Connect the other end to an Ethernet 10 100 1000 BaseT LAN The SAN384B 2 can now be accessed by remote connection using the command line through Telnet or any of the management tools such as Web Tools or Network Advisor 4 To complete any additional SAN384B 2 configuration procedures through a Telnet session log in to the SAN384B 2 by Telnet using the admin login The ...

Страница 71: ...6 Enter the switchEnable command to re enable the SAN384B 2 Setting the date and time The date and time settings are used for logging events Switch operation does not depend on the date and time a switch with an incorrect date and time value still functions properly However because the date and time are used for logging error detection and troubleshooting they should be set correctly Setting the d...

Страница 72: ...tandard Time 1 Enter the tsTimeZone command as follows switch admin tstimezone interactive 2 You are prompted to select a general location Please identify a location so that time zone rules can be set correctly 3 Enter the appropriate number or Ctrl D to quit 4 At the prompt select a country location 5 At the prompt enter the appropriate number to specify the time zone region or Ctrl D to quit Syn...

Страница 73: ...sing the configure command as shown below switch admin configure Configure Fabric parameters yes y no n no y Domain 1 239 1 Enable a 256 Area Limit 0 No 1 Zero Based Area Assignment 2 Port Based Area Assignment 0 2 0 1 WWN Based persistent PID yes y no n no yes command output truncated You can check the PID setting using the configshow command as in the following example You can use the grep i pid...

Страница 74: ...other blades this configuration is unsupported and will generate an error The ports are color coded to indicate which can be used in the same port group for trunking trunking port groups can be up to eight ports The ports and cables used in trunking groups must meet specific requirements Refer to the Fabric OS Administrator s Guide for more information Follow these steps to add the optical transce...

Страница 75: ...the chassis and connector and port status using the switchShow qsfp command A sample of the command output is shown below The example is from a SAN384B 2 with a core blade installed in slot 3 Note that the state reported for an unconnected QSFP shown QSFP 0 and Ports 0 3 below is No_SigDet This is different from the State of No_Synch that is reported for regular SFPs that are unconnected QSFP 7 po...

Страница 76: ...nsity FC8 64 port blades Cable management recommendations v Leave at least 1 m 3 28 ft of slack for each port cable This provides room to remove and replace blades in the chassis allows for inadvertent movement of the rack and helps prevent the cables from being bent to less than the minimum bend radius v If ISL Trunking is in use group the cables by trunking group The ports are color coded to ind...

Страница 77: ...y of hardware for encryption can be accomplished with the following Two Key Vault locations on different devices Two encryption devices in any combination of encryption switches SAN32B E4 and FS8 18 encryption blades in SAN768B SAN768B 2 SAN384B or SAN384B 2 chassis v Cable planning for the encryption switch and its back up and for a primary and secondary key vault manager is critical These device...

Страница 78: ...r TKLM Environments for additional steps 1 Initialize all encryption nodes to generate Key authentication center KAC certificates and export the signed KAC certificates to a local LINUX host 2 Obtain the necessary user credentials and log in to the TKLM server appliance from the TKLM management web console Configuring for encryption optional Summary of procedure The optional FS8 18 encryption blad...

Страница 79: ... This command provides information about switch and port status 4 Verify the correct operation of the SAN384B 2 in the fabric by entering the fabricShow command from the workstation This command provides general information about the fabric 5 To back up the configuration run the following two steps a Enter the configupload vf command This command uploads the system virtual fabric data Encryption C...

Страница 80: ...earlier Fabric OS versions Detailed information on downloading and installing firmware are provided in Downloading firmware from an FTP server on page 78 and Downloading firmware from a USB device on page 80 More information can also be found in the Fabric OS Administrator s Guide To access the appropriate matrix v Go to the IBM SAN web page www ibm com systems storage san v Select the SAN768B 2 a...

Страница 81: ... Enter firmwareDownload s on your to download the firmware to one of the CP blades from your server Powering off the SAN384B 2 If you need to power off the system follow these steps to avoid loss of data 1 Shut down the system using the sysShutdown command switch admin sysshutdown This command will shutdown the operating systems on your switch You are required to power cycle the switch in order to...

Страница 82: ...50 SAN384B 2 Installation Service and User Guide ...

Страница 83: ...Wwn 10 00 00 05 33 03 2c 00 zoning ON BB switchBeacon OFF FC Router ON FC Router BB Fabric ID 10 Address Mode 0 Index Slot Port Address Media Speed State Proto 0 1 0 820000 id N8 Online FC F Port 10 00 00 05 1e f8 a0 b4 1 1 1 820100 id N8 Online FC F Port 10 00 00 05 33 26 0e 65 2 1 2 820200 id N8 Online FC F Port 10 00 00 05 33 48 5e f5 3 1 3 820300 id N8 Online FC F Port 10 00 00 05 1e f8 a0 b3 ...

Страница 84: ...ht FC 36 1 36 822400 id N8 No_Light FC 37 1 37 822500 id N8 No_Light FC 38 1 38 822600 id N8 No_Light FC 39 1 39 822700 id N8 No_Light FC 40 1 40 822800 id N8 No_Light FC 41 1 41 822900 id N8 No_Light FC 42 1 42 822a00 id N8 No_Light FC 43 1 43 822b00 id N8 No_Light FC 44 1 44 822c00 id N8 No_Light FC 45 1 45 822d00 N16 No_Module FC 46 1 46 822e00 N16 No_Module FC 47 1 47 822f00 N16 No_Module FC 2...

Страница 85: ...s 88 Factory Part Num 60 1002142 02 Factory Serial Num BQD0344F01K Manufacture Day 18 Month 11 Year 2010 Update Day 29 Month 3 Year 2011 Time Alive 47 days Time Awake 0 days CORE BLADE Slot 6 Header Version 2 Power Consume Factor 135 Power Usage Watts 87 Factory Part Num 60 1002099 01 Factory Serial Num BQD0337F00A Manufacture Day 16 Month 9 Year 2010 Update Day 29 Month 3 Year 2011 Time Alive 77 ...

Страница 86: ... 29 Month 3 Year 2011 Time Alive 229 days Time Awake 0 days FAN Unit 2 Header Version 2 Power Consume Factor 126 Factory Part Num 60 1000384 09 Factory Serial Num AGB0623F0AK Manufacture Day 7 Month 6 Year 2010 Update Day 29 Month 3 Year 2011 Time Alive 229 days Time Awake 0 days WWN Unit 1 Header Version 2 Power Consume Factor 1 Factory Part Num 60 1000888 05 Factory Serial Num ANN2524F01N Manufa...

Страница 87: ...ates the FC16 32 port blade v Figure 20 on page 56 illustrates the FC16 48 port blade v Figure 21 on page 56 illustrates the FC8 32E port blade v Figure 22 on page 56 illustrates the FC8 48E port blade v Figure 23 on page 57 illustrates the FC8 64 port blade v Figure 24 on page 57 illustrates the FS8 18 encryption blade v Figure 25 on page 58 illustrates the FX8 24 extension blade The LED patterns...

Страница 88: ...s LED 3 Fibre Channel port 2 Power LED 4 Port status LED 1 Status LED 3 Fibre Channel port 1 3 4 2 384b074 Figure 20 FC16 48 port blade 1 3 4 2 384b086 Figure 21 FC8 32E port blade 1 3 4 2 384b087 Figure 22 FC8 48E port blade 56 SAN384B 2 Installation Service and User Guide ...

Страница 89: ...Fibre Channel port 2 Power LED 4 Port status LED Note The FC8 64 port blade requires mSFPs standard SFPs do not fit as well as narrower OM 3 LC cables offered by several major manufacturers 1 Status LED 3 Fibre Channel port 2 Power LED 4 Port status LED 1 2 3 4 384b059 Figure 23 FC8 64 port blade 2 3 4 1 384b069 Figure 24 FS8 18 encryption blade Chapter 4 Monitoring system components 57 ...

Страница 90: ...ngaged or the slider is pushed up and the ejectors are fully engaged Blade status LED No light LED is off Blade is either healthy or does not have power Verify that the power LED is on Steady amber Blade is faulty Ensure blade is firmly seated and check the status with the slotShow command If the LED remains amber contact IBM Slow flashing amber on 2 seconds then off 2 seconds Blade is not seated ...

Страница 91: ...diagnostic tests or portDisable or portCfgPersistentEnable command Reset the port from the workstation using the portEnable or portCfgPersistentEnable command Fast flashing amber on 1 2 second then off 1 2 second Transceiver or port is faulty Change the transceiver or reset the switch from the workstation Alternating green amber Port is bypassed Reset the port from the workstation using the portEn...

Страница 92: ...ht LED is off CP blade is either healthy or does not have power Verify that the power LED is on Steady amber CP blade is faulty or the switch is still booting Ensure that the blade is firmly seated and the switch has completed booting If the LED remains amber contact IBM Slow flashing amber on 2 seconds then off 2 seconds CP blade is not seated correctly or is faulty Pull the blade out and reseat ...

Страница 93: ...000 Mbps No action required USB Status LED is on USB device enabled No action required LED is off USB device not present or disabled No action required Active CP Steady blue Active CP blade No action required No light LED is off Standby CP blade No action required Core switch blade CR16 4 status To determine the status of a CR16 4 core switch blade 1 Check the LED indicators on the core switch bla...

Страница 94: ...ange exceeded Check for out of bounds environmental condition and correct it QSFP connector status LED No light LED is off No QSFP module all four QSFP ports are disabled No action needed if the QSFP is not installed or verify that the QSFP is fully inserted Steady amber QSFP module is in all four ports have no signal no sync Ensure that the cable is properly connected If the LED remains amber con...

Страница 95: ...or Status Recommended Action Power No light LED is off Power supply does not have incoming power and is not providing power to the SAN384B 2 Ensure that the power supply is firmly seated the SAN384B 2 has incoming power both power cables are connected and AC power switches are on Steady green Power supply has incoming power and is providing power to the SAN384B 2 No action required Flashing green ...

Страница 96: ... also be the result of the blower assembly not being properly seated Figure 29 shows the blower assembly 1 Power LED 2 Fault LED Table 12 Blower assembly LED descriptions LED purpose Color Status Recommended action Power No Light LED is off Blower assembly does not have power Ensure that the blower assembly is firmly seated and has power Steady green Blower assembly has power No action required 1 ...

Страница 97: ...he unit If the LED continues to flash replace the unit WWN card status Note The WWN bezel see Figure 30 on page 66 covers the WWN cards The LEDs on the WWN cards are not visible unless the bezel is removed To determine the status of the WWN card enter the chassisShow command to display information about the WWN card WWN units correspond to information specific to the WWN card Error messages that m...

Страница 98: ...esent or timestamp EM 1036 sequence number WARNING system name FRU Id is not accessible Writing to the FRU history log hilSetFruHistory has failed 0x24c fabos Switch switchname Error EM HIL_FAIL 2 HIL Error hilSetFruHistory failed rc 3 for SLOT 3 WWN unit insertion was detected timestamp EM 1049 sequence number INFO system name FRU WWN insertion detected WWN unit removal was detected timestamp EM ...

Страница 99: ... blade on page 82 v Removing and installing a power supply on page 84 v Removing and installing a blower assembly on page 86 v Removing and installing a WWN bezel and WWN card on page 88 v Removing and installing transceivers on page 89 v Removing and replacing inter chassis link QSFP cables on page 93 v Removing and replacing a SAN384B 2 chassis on page 98 Removing and installing the chassis door...

Страница 100: ...e minutes A 1 Phillips screwdriver is required Removing a cable management finger assembly Complete the following steps to remove the cable management finger assembly 1 Remove the chassis door 2 Remove the cables from the cable management finger assembly and rearrange the cables around the assembly 3 Unscrew and save the two screws that attach the cable management assembly to the rack upright see ...

Страница 101: ...chassis to the cabinet vertical rails two of which are also used to secure the cable management assembly The holes on the assembly will only match two of the holes on the chassis at a time This will allow the cable management assemblies to be mounted either towards the top or towards the bottom of the chassis depending on cable density and desired cable routing 3 Arrange the cables through the fin...

Страница 102: ... v Optical and copper cables as needed Removing a port or application blade Attention If multiple blades are being replaced replace one blade at a time Attention Follow ESD precautions see ESD precautions on page xxi for removal or replacement of any blade Note The FC8 64 port blade the FS8 18 encryption blade and the FX8 24 application blade are compatible with the SAN384B SAN384B 2 SAN768B and S...

Страница 103: ...ansceivers from the blade For mSFP transceivers FC8 64 only it is recommended that you use the pull tab to remove the transceiver from the blade before removing the cable from the transceiver 8 Unscrew the two thumbscrews from the left and right ejectors on the blade using the Phillips screwdriver Unscrew the left thumbscrew until it pops out This initiates a hot swap request 9 Wait for the power ...

Страница 104: ...vers and cables in the port blade For mSFP FC8 64 only transceivers it is recommended that you install the cables into the transceivers before installing the transceivers in the blade 8 Group and route the cables through the vertical cable management fingers 9 Install the chassis door Note The FS8 18 encryption blade requires additional configuration to enable encryption See Configuring for encryp...

Страница 105: ...hten the thumbscrew s 4 Install the chassis door see Removing and installing the chassis door on page 67 Removing and installing a CP8 control processor blade This section describes how to remove and install a control processor CP8 blade Each SAN384B 2 has two CP8 blades located in slot 4 and slot 5 Note Chassis slots are numbered from 1 8 from bottom to top viewed from the port side of the chassi...

Страница 106: ...384B 2 requires the CP8 blade Attention If you are upgrading through multiple versions of the Fabric OS refer to Table 14 on page 78 to see if you will need any intermediate versions of the Fabric OS Plan carefully and provide for extra time if this is your situation Verifying the need for replacement Confirm that you need to replace the CP blade The following events might indicate that a CP blade...

Страница 107: ... active CP blade and run the following steps a Run the haFailover command to make the standby CP blade the active blade The currently active CP blade becomes the standby blade Wait until the status LED on the currently active CP blade is no longer lit b Confirm the completion of the failover by running the haShow command c Log in to the new active CP blade 7 Run the firmwareShow command to note th...

Страница 108: ...ver command Wait until the failover has completed Use the haShow command to verify the CPs are synchronized and the failover is complete Depending on the nature of the CP failure it is possible that the haFailover command will not work Proceed to the next step anyway 4 Enter the haDisable command This is required before physically removing and replacing the CP blades 5 Power off the blade you are ...

Страница 109: ...all a CP blade slot 4 or 5 1 Open the ejector handles to approximately 45 degrees Orient the CP blade so that the handles are toward you and the flat metal side is on the bottom 2 Align the flat metal side of the CP blade inside the left and right blade guides in the slot Slide the CP blade into the slot until it is firmly seated 3 Tighten the thumb screw inside each handle using the Phillips scre...

Страница 110: ...mand may look similar to the following Note the warning message at the end of the output SAN384B 2_120 admin firmwareshow Slot Name Appl Primary Secondary Versions Status 4 CP0 FOS v7 0 0a ACTIVE v7 0 0a 5 CP1 FOS v7 0 0 STANDBY v7 0 0 WARNING The local CP and remote CP have different versions of firmware please retry firmwaredownload command 4 You must bring the replacement blade to the same firm...

Страница 111: ... similar to the following and will appear with a date and time stamp Slot 4 CP0 active Firmwaredownload command has completed successfully Use firmwareshow to verify the firmware versions 5 On the standby CP blade the blade for which you just changed the firmware level run reboot The reboot of the standby CP will initiate a firmwarecommit to the secondary partition and log you out SAN384B 2_124 ad...

Страница 112: ...device 4 Remove the serial cable from the active CP blade and attach it to the standby CP blade and log in as admin 5 Run firmwareDownload s to download the firmware to the standby CP blade The s option also disables the autoreboot so you will have to manually issue a reboot after the download finishes to initiate firmwarecommit Enter all requested information use default values 6 When the downloa...

Страница 113: ...utlined in the table above Otherwise proceed to step 10 10 Log out of the standby CP blade and log in to the active CP blade 11 Proceed to Completing the CP8 blade replacement Completing the CP8 blade replacement Complete the following steps to complete the CP8 control blade replacement procedure 1 Enter haEnable to re enable HA on the active CP blade Note haEnable will cause the standby CP blade ...

Страница 114: ...ment Confirm that you need to replace the core switch blade before continuing The following events might indicate that a core switch blade is faulty v The status LED on the core switch blade is lit steady amber or the power LED is not lit v The slotShow command does not show that the core switch blade is enabled v The haShow command indicates an error v Any of the following messages display in the...

Страница 115: ...hot swap request 3 Label and then disconnect all cables from the faulty core switch blade 4 Open the ejectors by rotating them toward the center of the blade face Pull the blade out of the chassis using the ejectors Figure 36 Installing a CR16 4 core switch blade Attention Follow ESD precautions see ESD precautions on page xxi whenever handling blades Note The CR16 4 blade is compatible only with ...

Страница 116: ...sis door See Removing and installing the chassis door on page 67 9 Pack the faulty core switch blade in the packaging provided with the new core switch blade for return to IBM following local procedures Removing and installing a power supply Use this procedure to remove and replace a power supply The SAN384B 2 can continue operating during the replacement if the other power supply is operating Not...

Страница 117: ... power switch on the power supply you are replacing 3 Disconnect the power cord 4 Loosen the thumbscrew using a Phillips screwdriver if necessary 5 Grasp the handle and pull sliding the power supply from the chassis see Figure 38 on page 86 Support the power supply from beneath as you remove it 6 If you are not immediately replacing the power supply insert and attach a power supply filler panel in...

Страница 118: ...emoving and installing a blower assembly This procedure provides instructions for removing and installing a blower assembly Attention The system can continue operating during the replacement if the second blower assembly is operating To ensure continuous adequate cooling maintain both blower assemblies except for the brief period during replacement Time and items required The installation procedur...

Страница 119: ...ng the blower assembly from the chassis and supporting the blower assembly from beneath as you remove it see Figure 39 Installing a blower assembly complete the following steps to install a blower assembly 1 Orient the blower assembly in front of the open slot and slide it into the chassis pushing firmly to ensure that it is seated 2 Verify that the power LED displays a green light 3 Use the screw...

Страница 120: ...s 1 or 2 Removing the WWN bezel and WWN card Attention Follow ESD precautions see ESD precautions on page xxi whenever handling cards or blades Complete the following steps to remove the WWN bezel and WWN card 1 Open a Telnet session to the SAN384B 2 and log in to the active CP as admin The default password is password 2 Verify you are logged into the active CP Run the haShow command to determine ...

Страница 121: ...mponents Note The LEDs might take up to 2 minutes after WWN card installation to begin functioning 4 Install the WWN bezel Orient the bezel on the chassis Figure 40 Insert and tighten the two screws 5 Pack the faulty WWN card in the packaging provided with the new card for return to IBM following local procedures Removing and installing transceivers Note For a listing of transceivers compatible wi...

Страница 122: ...ers it is recommended to connect the cables first and then insert them as a unit into the port These SFP transceivers do not require the extraction tool Note This tool is part of the SAN384B 2 ship group and should be kept with the chassis Attention mSFP optical transceivers should not be inserted into ports intended for SFP transceivers They will be faulted on power up Removing an SFP optical tra...

Страница 123: ...ceiver Connect the cable to the 16 Gbps SFP first and then insert the SFP cable unit into the port using the pull tab to help push the transceiver and cable into the port 1 For SFPs and SFP transceivers with wire bails make sure that the bail wire handle is in the unlocked position Align the optical transceiver so that the key is oriented correctly to the port Insert the transceiver into the port ...

Страница 124: ...ansceivers Attention mSFP optical transceivers should not be inserted into ports intended for SFP transceivers They will be faulted on power up To replace an mSFP transceiver complete the following steps Due to high port and cable density it is recommended that the optical cable be either removed from or inserted into the mSFP while the transceiver is out of the switch or blade Removing an mSFP tr...

Страница 125: ...QSFP transceivers Table 15 describes the ICL connector port LED patterns and the recommended actions for those patterns Table 15 ICL connector port LEDs LED purpose Color Status Recommended action QSFP connector status No light LED is off No QSFP module all four QSFP ports are disabled No action is required if QSFP is not present or verify that the QSFP is fully inserted Steady amber QSFP module i...

Страница 126: ...SFP cable 1 Remove the chassis door Removing and installing the chassis door on page 67 2 If you are replacing an ICL cable note the cable routing paying attention to which cable end plug into which socket Replace only one ICL cable at a time to minimize errors 3 Grasp the rubber housing on the end of the cable and pull it straight out of the QSFP transceiver 4 If the QSFP transceiver also needs t...

Страница 127: ... you are installing If you are installing ICL cables for the first time pay particular attention to the configuration in which the cables must be installed See Possible ICL configurations for one possible configuration between two chassis 4 Replace the chassis door Removing and installing the chassis door on page 67 5 Once all the cables are attached see the Fabric OS Administrator s Guide for the...

Страница 128: ...hassis are shown in the figure the chassis can be any combination of SAN384B 2 and SAN768B 2 The cabling scheme should follow the parallel example shown in the Figure 47 Each line in the Figure 48 on page 97 actually represents four cables running between the chassis 1 2 384b083 Figure 47 QSFP cable connections for two SAN768B 2 chassis sample configuration 96 SAN384B 2 Installation Service and Us...

Страница 129: ...Figure 49 on page 98 The SAN768B 2 chassis are shown in the figure but either chassis can be connected In this example the three trunk groups are shown in different shades 384b089 Figure 48 Core edge ICL topology for SAN384B 2 and SAN768B 2 chassis Chapter 5 Removing and installing components 97 ...

Страница 130: ...tion on page 99 v Disconnecting from the network and fabric on page 102 v Removing components from the chassis on page 103 v Removing a SAN384B 2 from the cabinet on page 104 v Installing the replacement chassis on page 105 v Installing components into the new chassis on page 105 Trunked ICLs 384b090 Trunked ICLs Trunked ICLs Figure 49 full mesh ICL topology for SAN384B 2 and SAN768B 2 chassis 98 ...

Страница 131: ...eshooting and contact IBM support with any questions about whether the chassis should be replaced Any of the following events might indicate the need to replace the chassis v Visible mechanical damage to the chassis including damage to sheet metal or card guides that prevents correct installation of a blade v Bent or damaged connectors on the backplane the surface inside the chassis to which the b...

Страница 132: ... output Information about the new chassis New factory serial number New serial number if available 1 Open a Telnet session and log in to the SAN384B 2 as admin The default password is password Enable the logging function on your Telnet or serial console connection 2 Back up the current configuration Note If you are using the virtual fabric feature run configUpload vf before running the configUploa...

Страница 133: ... admin 5 Display and record the manufacturer serial numbers Enter chassisShow then copy the command output into the config miscinfo txt file Factory Serial Num and Serial Num are listed under Chassis WWN Unit 1 If the current WWN cards are the original cards the factory serial number listed is the same as the chassis serial number switch admin chassisshow Chassis Backplane Revision 1F SW BLADE Slo...

Страница 134: ...or longer depending on the size of the SAN This file provides a backup of all the information that might be required by Technical Support The information can be used after the SAN384B 2 is restored to the fabric to verify that no unintentional changes have occurred to the fabric switch admin supportshow version 7 0 0 output truncated switch admin 8 Record the cable connections between the SAN384B ...

Страница 135: ...l cables from the control processor and core switchblades 8 Disconnect any ICL or QSFP cables Removing and replacing inter chassis link QSFP cables on page 93 Removing components from the chassis Attention Follow ESD precautions see ESD precautions on page xxi when handling components 1 Remove the cable management fingers Removing and installing cable management finger assemblies on page 68 2 Remo...

Страница 136: ... for removing components 1 Assemble the lift tool if it is not assembled The assembly and disassembly instructions are included with the lift tool Additional instructions are also in Unpacking and assembling the lift tool on page 16 2 Remove the two screws holding each vertical cable management finger assembly from the cabinet vertical rails and remove the additional screw securing the chassis to ...

Страница 137: ... The following instructions require that the port side exhaust kit is already installed If the rack does not have this shelf and exhaust duct installed refer to Installing the port side exhaust kit on page 18 for complete instructions 1 Follow the steps in Unpacking the SAN384B 2 on page 17 to unpack the replacement chassis 2 Follow the steps in Installing the SAN384B 2 into the cabinet on page 25...

Страница 138: ...s should be a steady green 14 Verify that all components are functioning correctly by checking their LEDs If the LEDs do not indicate correct operation try reinstalling the corresponding component Downloading the configuration Once the chassis and its various components have been reassembled and powered back on use the configDownload command to restore the original configuration The configDownload...

Страница 139: ...384B 2_130 switchType 121 3 switchState Online switchMode Native switchRole Principal switchDomain 130 switchId fffc82 switchWwn 10 00 00 05 33 03 2c 00 zoning ON ZONE_CONFIG_NAME switchBeacon OFF FC Router ON FC Router BB Fabric ID 10 Address Mode 0 Index Slot Port Address Media Speed State Proto 0 1 0 820000 id N8 Online FC F Port 10 00 00 05 1e f8 a0 b4 1 1 1 820100 id N8 Online FC F Port 10 00...

Страница 140: ...9 particularly for differences between the SFP and mSFP installations Note The ports and cables used in trunking groups must meet specific requirements For a list of these requirements refer to the Fabric OS Administrator s Guide a Position one of the transceivers so that the key is oriented correctly to the port and insert the transceiver into the port until it is firmly seated and the latching m...

Страница 141: ...de Name Enet IP Addr FC IP Addr Name output truncated switch admin lscfg show Created switches 128 ds 1 2 bs Port 0 1 2 3 4 5 6 7 8 9 FID 1 1 1 1 1 128 128 128 128 128 output truncated switch admin 2 Determine any differences between the information in the SANafter txt file and the information in the SANbefor txt file created earlier In particular look for differences in the following v Device typ...

Страница 142: ...the number of ports in the chassis Table 17 Cable routing table for SAN384B 2 64 ports shown Slot Port Cable labels Connected device Slot Port of device Slot Port Switch end Device end 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 110 SAN384B 2 Installation Service and User Guide ...

Страница 143: ...5 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 Removing the batteries Local regulations may require removal of the battery before recycling or disposing of the product Batteries are located in the control processor blades CP8 and also in optional Encryption blades FS8 18 Follow these steps to remove the batteries from the product Chapter 5 Removing and installing components 111 ...

Страница 144: ...68 C66 C69 R158 R377 R381 R376 R378 R380 R375 R170 R373 R374 R365 R372 R171 R172 R366 R368 R173 R367 R175 R174 R176 R178 R177 C26 C27 R383 R382 R379 C83 C81 C82 C80 R623 R624 R516 C12 C15 C16 C19 C7 C10 C11 C25 C13 C14 C17 C18 C8 C9 C23 C24 R387 R388 R63 R61 R59 R57 R55 R53 R25 R51 R24 R49 R23 R22 R21 R47 R45 R43 R41 R20 R19 R39 R18 R37 R17 R35 R33 R628 R646 R645 R639 R641 R642 R635 R79 R74 R75 R8...

Страница 145: ...ate Refer to the Environmental Notices and User Guide shipped with the product for more information on battery recycling and disposal 1 b32e4016 Figure 51 Encryption blade battery location Chapter 5 Removing and installing components 113 ...

Страница 146: ...114 SAN384B 2 Installation Service and User Guide ...

Страница 147: ...talling a QSFP and inter chassis license on page 123 v FC7872 Installing a QSFP and Enterprise inter chassis license on page 124 FC3632 FC3648 Installing a 16 Gb port blade 32 or 48 ports These features can be installed while the SAN384B 2 is operational Attention Follow these precautions for all procedures in this section to avoid damaging the port blades or chassis v Wear a grounded ESD strap wh...

Страница 148: ...uide 4 Remove the filler panel or port blade Refer to Removing a port or application blade on page 70 or Removing and installing blade filler panels on page 72 Attention A filler panel should be removed only when being replaced with a port blade or new filler panel Any slot that is not occupied by a port blade should be occupied by a filler panel to ensure correct cooling of the chassis and protec...

Страница 149: ...serviceable parts inside the port blade These instructions cover installing a new FC3633 or FC3649 in the SAN384B 2 chassis Time required 20 minutes or less per port blade Items required v ESD electrostatic discharge grounding strap v Workstation computer v Port blade v Phillips screwdriver v SFP transceivers as needed v Optical cables as needed Procedures Follow the links in the steps below to co...

Страница 150: ... chassis 8 Verify the installation For information about how to check the status of hardware components using the CLI see the Fabric OS Administrator s Guide which is located on the product documentation CD FC3864 Installing an 8 Gb 64 port port blade This feature can be installed while the SAN384B 2 is operational Attention Follow these precautions for all procedures in this section to avoid dama...

Страница 151: ...e chassis and protection from dust 6 Follow the instructions for Installing a blade on page 72 7 Remove any mSFPs that are pre installed in the new FC8 64 blade and set them aside for later installation See Removing and installing an mSFP optical transceiver on page 92 paying particular attention to the notices to avoid damaging the mSFP pull tabs or mSFPs 8 Follow the instructions for Installing ...

Страница 152: ...nstalling a port blade with incorrect alignment damages both the chassis and the replacement part v Hold the port blade by the edges of the metal pan Do not use the ejectors to hold a port blade v Disassembling any part of a port blade voids the part warranty and regulatory certifications There are no user serviceable parts inside the port blade Time required Less than 20 minutes Items required v ...

Страница 153: ...he CLI see the Fabric OS Administrator s Guide which is located on the product documentation CD FC3895 Installing an Encryption Blade FS8 18 This feature can be installed while the SAN384B 2 is operational Attention Thoroughly review Planning for encryption optional on page 45 prior to installing the FS8 18 encryption blade You must also refer to the Fabric OS Encryption Administrator s Guide Supp...

Страница 154: ...ng and installing blade filler panels on page 72 Attention A filler panel should be removed only when being replaced with a blade or new filler panel Any slot that is not occupied by a blade should be occupied by a filler panel to ensure correct cooling of the chassis and protection from dust 5 Install the encryption blade Installing a blade on page 72 Remove the protective strip from the blade co...

Страница 155: ...e can be installed while the SAN384B 2 is operational Time required Less than 10 minutes not including installation of the ICL license or any needed configuration Items required v QSFPs and four ICL cables v FC 7871 ICL license is required for each chassis that you are connecting Instructions for installation are included with that license feature Procedures Attention If ICL cables are not in use ...

Страница 156: ...ot in use rubber plugs must be inserted in the QSFPs Follow the links in the steps below to complete this installation 1 Verify that the QSFP is the correct part 99Y0377 2 Verify with the customer that the ICL license is installed on each chassis to be connected Enter the licenseIdShow command for each chassis If required install the ICL license following the instructions included with the license...

Страница 157: ...SI Fibre Channel protocol FC PH Fibre Channel Physical and Signalling Interface standard Modes of operation Class 2 Class 3 Class F interswitch frames Fabric initialization Complies with FC SW 5 0 FC IP IP over Fibre Channel Complies with FC IP 2 3 of the FCA profile Port to port latency Local switching 800ns add 400ns for E_Port to E_Port Blade to blade 2 4 microseconds add 400ns for E_Port to E_...

Страница 158: ...ny port to any port 2 4 msec blade to blade at 16 Gbps cut through routing FC16 48 blade 800 ns any port to any port 2 4 msec blade to blade at 16 Gbps cut through routing FX8 24 blade FC to FC 2 1 msec any port to any port at 8 Gbps cut through routing Maximum frame size 2112 byte payload Frame buffers 8000 per ASIC with 5000 more that can be borrowed from neighboring ASIC if enabled Port types F...

Страница 159: ...TP v3 Port Fencing Registered State Change Notification RSCN Reliable Commit Service RCS Simple Name Server SNS syslog Top Talkers Virtual Fabrics Logical Switch Logical Fabric Inter chassis link ICL QSFP Chassis to chassis linkage through connectors on the core switch blade CR16 4 System size and weights The weight of the SAN384B 2 can vary considerably depending on the combination of blades inst...

Страница 160: ...rd filler panel 1 5 kg 3 2 lb Power supply 2 45 kg 5 4 lb Blower assembly 5 73 kg 12 6 lb WWN bezel and cards 0 3 kg 0 6 lb Cable management assembly 2 0 45 kg 1 0 lb Chassis door 2 09 kg 4 6 lb Facility requirements The facility where the SAN384B 2 is in use must meet the following requirements to provide for correct operation v Adequate supply circuit line fusing and wire size as specified by th...

Страница 161: ...inute Air flow 425 cu m hr 250 cu ft min None required Heat dissipation fully loaded with QSFPs 1195 Watts or 4078 BTU hr 192 port configuration Not applicable Note The 0 to 40 Celsius range applies to the ambient air temperature at the air intake vents on the nonport side of the SAN384B 2 The temperature inside the SAN384B 2 can be up to 75 Celsius during SAN384B 2 operation If the internal tempe...

Страница 162: ...ge 47 63 Hz Nominal 50 60 Hz Inrush current Limited to 60A peak for any initial current surge or spike of 10ms or less at either cold or warm start Any additional inrush current surges or spikes in the form of AC cycles or multiple AC cycles greater than 10ms and less than 150ms must not exceed 15A peak Power supply output each Low line 85 132 VAC 1000W High line 180 264 VAC 2000W System power con...

Страница 163: ... FC8 48E 8Gb 160 4 Port blade 48 8 Gbps SFP up to 4 192 FC16 32 16Gb 140 Port blade 32 16 Gbps SFP can use 8 Gbps SFP up to 4 128 FC16 48 16Gb 160 4 Port blade 48 16 Gbps SFP can use 8 Gbps SFP up to 4 192 FC8 64 8Gb 126 4 Port blade 64 8Gbps SFP up to 4 256 FS8 18 235 Encryption blade 16 8 Gbps SFP up to 4 64 FX8 24 250 Extension blade 12 8 Gbps SFP 10 1 Gbps Ethernet 2 10 Gbps Ethernet up to 4 4...

Страница 164: ...m 49 ft 35 m 115 ft 100 m 328 ft 125 m 410 ft N A QSFP 4 x 16 Gbps N A 50 m 164 ft N A N A N A LWL SFP 8 Gbps N A N A N A N A 10 km 6 2 mi SFP 10 Gbps N A N A N A N A 10 km 6 2 mi SFP 16 Gbps N A N A N A N A 10 km 6 2 mi ELW SFP 2 Gbps N A N A N A N A 30 km 18 6 mi SFP 4 Gbps N A N A N A N A 30 km 18 6 mi SFP 8 Gbps N A N A N A N A 25 km 15 53 mi Greater distances can be achieved with the addition...

Страница 165: ... blade The FX8 24 blade has 12 external Fibre Channel FC SFP ports supporting the Fibre Channel Routing Services and 10 external 1 Gigabit Ethernet GbE or GE SFP ports supporting the Fibre Channel Over IP FCIP feature There are also 2 licensable external 10 Gigabit Ethernet 10GbE or 10GE SFP ports supporting FCIP It operates with the Fabric Operating System and can communicate with another FX8 24 ...

Страница 166: ...ape pipelining over FCIP licensable v FICON with CUP Activation licensable v Virtual E_ports v FCIP QoS v Support for 200 ms RTT on a limited number of GbE ports v Adaptive Rate Limiting licensable v TCP performance graphing in Web Tools v FCIP Tunnels A maximum of 10 FCIP Tunnels for all GbE ports Four tunnels maximum per GbE port Two 10 GbE ports can support up to ten FCIP tunnels each Each FCIP...

Страница 167: ...ge Reference and the Fabric OS Administrator s Guide for more information v Review RASlog entries v Enter the sensorShow command to determine the status of the hardware components v Run diagnostic tests see Diagnostics on page 137 v Reboot the SAN384B 2 or power the entire chassis off Powering off the SAN384B 2 on page 49 and then back on Providing power to the SAN384B 2 on page 35 If the problem ...

Страница 168: ... blade is rebooted it fails over to the standby CP blade POST To verify that POST has completed without error v Verify that all LEDs return to a normal state after POST completes see Chapter 4 Monitoring system components on page 51 If one or more LEDs do not return to a normal state and this is not due to the SAN384B 2 being set to beacon refer to the relevant LED table to identify and correct th...

Страница 169: ...ntenance Each diagnostic test can be implemented by entering the related command through a Telnet or serial session For a list of diagnostic tests and commands refer to the Fabric OS Command Reference Manual and the Fabric OS Administrator s Guide All diagnostic tests are run at all supported link speeds They might temporarily lock the transmit and receive speeds to a specific speed Some diagnosti...

Страница 170: ...negotiation set up by the network Specify the CP Ethernet link speed by entering the ifModeSet command Configuration data is inaccurate or cannot be accessed The SAN384B 2 was powered off on while a WWN card was uninstalled or failed Install an operational WWN card and power the system off on again The SAN384B 2 was rebooted while a WWN card was uninstalled or failed Initial set up results in IP a...

Страница 171: ...n the temperature readings to the operating ranges Also try moving the blades within the chassis since it is possible that airflow might not be adequate to cool everything in certain configurations Blades might be faulty Enter the slotShow command to determine status For more information enter the diagDisablePost command then the slotPowerOff slot number and slotPowerOn slot number command Resolve...

Страница 172: ...140 SAN384B 2 Installation Service and User Guide ...

Страница 173: ...3 shows an FC8 64 port blade v Figure 58 on page 143 shows an FS8 18 encryption blade v Figure 59 on page 143 shows an FX8 24 extension blade 1 Port map 3 QSFP ports 0 3 right to left 2 QSFP ports 4 7 right to left Table 28 shows the mappings from the numbered ports on the face of the core blade to the port mappings as shown by the slotShow command Each external port maps to four actual ports Tabl...

Страница 174: ...47 2 Status LED 4 FC ports 0 23 1 Power LED 5 FC ports 16 23 2 Status LED 6 FC ports 0 7 3 FC ports 24 31 7 FC ports 8 15 4 Port and trunking group map 2 1 4 3 6 7 5 384b084 Figure 53 FC16 32 port blade 2 1 3 4 384b085 Figure 54 FC16 48 port blade 2 1 4 3 6 7 5 384b091 Figure 55 FC8 32E port blade 142 SAN384B 2 Installation Service and User Guide ...

Страница 175: ... Port 30 8 FC ports 0 31 right to left 1 Gigabit Ethernet ports GE0 GE1 2 Key management smart card interface 3 FC ports 0 15 2 1 3 4 384b092 Figure 56 FC8 48E port blade 8 7 3 2 1 5 6 4 384b064 Figure 57 FC8 64 port blade 384b070 3 2 1 Figure 58 FS8 18 encryption blade 3 4 5 6 7 1 2 384b067 Figure 59 FX8 24 extension blade Appendix D Port numbering 143 ...

Страница 176: ... right to left 2 Power LED 6 FC ports 6 11 numbered right to left 3 1 GbE ports 0 3 numbered right to left 7 1 GbE ports 4 9 numbered right to left 4 10 GbE ports 0 1 numbered right to left 144 SAN384B 2 Installation Service and User Guide ...

Страница 177: ...al law INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF NON INFRINGEMENT MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE Some states do not allow disclaimer of express or implied warranties in certain transactions therefore this statement may not apply to you...

Страница 178: ...ed trademarks or trademarks of Adobe Systems Incorporated in the United States and or other countries Java and all Java based trademarks and logos are trademarks of Sun Microsystems Inc in the United States other countries or both Linux is a registered trademark of Linus Torvalds in the United States other countries or both Microsoft and Windows are trademarks of Microsoft Corporation in the Unite...

Страница 179: ...anada European Union EMC Directive Conformance Statement This product is in conformity with the protection requirements of EU Council Directive 2004 108 EC on the approximation of the laws of the Member States relating to electromagnetic compatibility IBM cannot accept responsibility for any failure to satisfy the protection requirements resulting from a non recommended modification of the product...

Страница 180: ...Dieses Produkt entspricht dem Gesetz über die elektromagnetische Verträglichkeit von Geräten EMVG Dies ist die Umsetzung der EU Richtlinie 2004 108 EG in der Bundesrepublik Deutschland Zulassungsbescheinigung laut dem Deutschen Gesetz über die elektromagnetische Verträglichkeit von Geräten EMVG bzw der EMC EG Richtlinie 2004 108 EG für Geräte der Klasse A Dieses Gerät ist berechtigt in Übereinstim...

Страница 181: ...ies Association JEITA Confirmed Harmonics Guideline products greater than 20 A per phase Korea Communications Commission KCC Class A Statement Please note that this equipment has obtained EMC registration for commercial use In the event that it has been mistakenly sold or purchased please exchange it for equipment certified for home use Russia Electromagnetic Interference EMI Class A Statement Aus...

Страница 182: ...Taiwan Class A Electronic Emission Statement 150 SAN384B 2 Installation Service and User Guide ...

Страница 183: ...tput example 52 comments sending iv component status 51 components installing 67 monitoring 51 removing 67 103 configuration backing up 47 download 106 encryption blade 33 parameters 36 configuration file backup 48 uploading 48 configuring encryption 46 SAN384B 2 33 connection serial 35 connection Ethernet 38 control processor blade components 60 CP8 5 LEDs 60 status 59 60 cords power 132 core swi...

Страница 184: ...des 70 117 FC8 64 port blade 5 FC8 64 blade 57 components 57 installing 72 LEDs 58 removing 70 status 55 58 FC8 64 port blades 70 118 FCIP extension blade FX8 24 55 features high availability 7 installing 115 features and components 1 features software 9 Fibre cables attaching 42 FIPS seals installing 123 FIPS security seals 10 installation sequence 14 firmware downloading 49 installing 49 firmwar...

Страница 185: ...v safety and environmental xv types xv notices and labels safety xv notices attention xxi notices caution xviii notices danger xv NTP server 40 O ordering the lift tool and the 24 inch load plate 12 organizing cables 44 overview 1 P parameters configuration 36 part number 24 inch load plate 12 lift tool 12 parts power cords 132 password 36 changing 36 saving 48 patents 145 PID mode verifying 41 pl...

Страница 186: ...alling 89 removing 89 SFP transceivers 42 SFP s compatible 42 installing 42 slot numbers 31 Smart card 45 SNMP 10 software features 9 software licenses 41 installed 41 specifications 125 power 130 specifications product 125 standard features software Advanced Zoning 9 Fabric Watch 9 ISL Trunking 9 Performance Monitoring 9 Web Tools 9 standard software features 9 starting SAN384B 2 33 status blower...

Страница 187: ...WWN bezel 65 card status 65 WWN bezel installing 88 removing 88 WWN card failure 65 removing 88 Index 155 ...

Страница 188: ...156 SAN384B 2 Installation Service and User Guide ...

Страница 189: ......

Страница 190: ... Part Number 98Y2654 Printed in USA GA32 0894 03 1P P N 98Y2654 ...

Отзывы:

Нет отзывов

Похожие инструкции для SAN384B-2

ABSCO SHEDS CYCHK Assembly & Instruction Manual preview
CYCHK
Бренд: ABSCO SHEDS Страницы: 25
IBM TS7650 PROTECTIER DEDUPLICATION APPLIANCE Installation Roadmap Manual preview
TS7650 PROTECTIER DEDUPLICATION APPLIANCE
Бренд: IBM Страницы: 218
LaCie d2 300938 Specifications preview
d2 300938
Бренд: LaCie Страницы: 2
U-Line S-12707 Quick Start Manual preview
S-12707
Бренд: U-Line Страницы: 3
adapt 4814109 Manual preview
4814109
Бренд: adapt Страницы: 3
Vivo DESK-E144WC Instruction Manual preview
DESK-E144WC
Бренд: Vivo Страницы: 8
Blackmagic Cloud Pod Operation Manual preview
Cloud Pod
Бренд: Blackmagic Страницы: 326
Palram Skylight Shed-6x3 Assembly Instructions Manual preview
Skylight Shed-6x3
Бренд: Palram Страницы: 35
GMI DT-Z Series Assembly Instructions preview
DT-Z Series
Бренд: GMI Страницы: 2
Heartland 16826 Assembly Manual preview
16826
Бренд: Heartland Страницы: 71
Cavalry Cavalry ACSSDS32F Product Reference Card preview
Cavalry ACSSDS32F
Бренд: Cavalry Страницы: 1
Cavalry CADB Series User Manual preview
CADB Series
Бренд: Cavalry Страницы: 20
Cavalry CADA-SA8 Series User Manual preview
CADA-SA8 Series
Бренд: Cavalry Страницы: 20
Corvus systems Corvus Installation Manual preview
Corvus
Бренд: Corvus systems Страницы: 79
Promise Technology Pegasus2 R2+ Product Manual preview
Pegasus2 R2+
Бренд: Promise Technology Страницы: 78
LaCie Two Big User Manual preview
Two Big
Бренд: LaCie Страницы: 44
ABSCO SHEDS 3060HK Manual preview
3060HK
Бренд: ABSCO SHEDS Страницы: 55
QNAP TS-963X User Manual preview
TS-963X
Бренд: QNAP Страницы: 42

Бренды по названию

Популярные бренды

Загрузить еще бренды