Broadcom Brocade X6-8 Director Скачать руководство пользователя страница 75

Страница: 75 / 207

53-1004105-13 Hardware Installation Guide

Brocade X6-8 Director

Hardware Installation Guide

LED Purpose

Color

Status

Recommended Action

Slow-flashing amber (on 2 seconds,

then off 2 seconds)

Port is disabled due to diagnostic

tests or to

portDisable

portCfgPersistentEnable

commands.

Reset the port from the workstation

using the

portEnable

portCfgPersistentEnable

commands.

Fast-flashing amber (on 1/2 second,

then off 1/2 second)

A transceiver or port has an error or

is faulty.

Change the transceiver or reset the

switch from the workstation.

Alternating green and amber

The port is bypassed.

Reset the port from the workstation

using the

portEnable

portCfgPersistentEnable

command.

Interpreting Core Routing Blade LEDs

See the following figure and table to interpret the LED patterns on the CR32-8 blade. The LED patterns may temporarily

change during POST and other diagnostic tests.

53-1004105-13

Broadcom

Содержание Brocade X6-8 Director

Страница 1: ...Brocade X6 8 Director Hardware Installation Guide Hardware Installation Guide 23 April 2021 53 1004105 13 23 April 2021 Broadcom ...

Страница 2: ...Safety Precautions 18 Facility Requirements 19 Time and Items Required 20 Shipped Items 21 Quick Installation Checklists 22 Mounting the Device 25 Mounting Options 25 Mounting Precautions 25 Unpacking and Transporting the Device 26 Installing the 14U Rack Mount Kit for Four Post Racks XBR DCX 0120 and XBR DCX 0152 27 Time and Items Required 27 Parts List 27 Assembling the Rack Hardware 28 Installi...

Страница 3: ... Up the Configuration 52 Powering Down the Chassis 53 Installing Transceivers and Cables 56 Supported Transceivers and Cables 56 Port and Extension Blade Transceivers 57 Core Routing Blade Transceivers 58 Time and Items Required 59 Precautions Specific to Transceivers and Cables 60 Cleaning the Fiber Optic Connectors 60 Cable Management 60 Installing an SFP Transceiver 61 Replacing an SFP Transcei...

Страница 4: ...8 Port Blade Numbering and Trunking 95 FC32 64 Port Blade Overview 97 FC32 64 Port Blade Numbering and Trunking 98 Extension Blade Overview 99 Extension Features 100 SX6 Blade Port Numbering and Trunking 101 Blade Specific Precautions 102 Faulty Blade Indicators 102 Time and Items Required for Removal and Installation 103 Removing a Blade 103 Installing a Blade 106 Verifying Blade Operation 107 Co...

Страница 5: ...cedure 124 Removing a Blade 124 Installing a Blade 125 Verifying and Synchronizing Firmware on Blades 126 Replacing a CP Blade Cold Swap Procedure 130 Removing a Blade 130 Installing a Blade 131 Completing the Replacement 132 Verifying Blade Operation 133 WWN Cards 135 WWN Card Overview 135 WWN Card Location and Numbering 135 Precautions Specific to WWN Cards 136 WWN Card Fault Indicators 136 WWN ...

Страница 6: ...9 Fan Assembly Fault Indicators 159 Fan Assembly Task Guide 160 Time and Items Required 161 Removing a Fan Assembly 161 Installing a Fan Assembly 162 Verifying Fan Operation 162 Blade Filler Panels 163 Blade Filler Panel Removal and Replacement 163 Removing a Filler Panel 163 Installing a Filler Panel 163 Cable Management Comb 165 Cable Management Comb Overview 165 Time and Items Required for Remo...

Страница 7: ...ronizing Airflow Direction on WWN Cards 178 Downloading the Configuration 179 Reconnecting the System to the Network and Fabric 179 Verifying Correct Operation of the System 180 Verifying Correct Configuration of the Fabric 182 Technical Specifications 184 Regulatory Statements 191 BSMI Statement Taiwan 191 Canadian Requirements 191 CE Statement 191 China ROHS 192 FCC Warning U S Only 192 Germany ...

Страница 8: ...ssume any liability arising out of the application or use of this information nor the application or use of any product or circuit described herein neither does it convey any license under its patent rights nor the rights of others The product described by this document may contain open source software covered by the GNU General Public License or other open source license agreements To find out wh...

Страница 9: ...0 VAC and 2870W 200 240 VAC This model supports nonport side intake NPI airflow Fabric OS 8 0 1 Yes AC power supply XBR X6 RACNPEPSU 0104 Provides 1450W 100 120 VAC and 2870W 200 277 VAC This model supports nonport side exhaust NPE airflow Fabric OS 8 0 1 Yes XBR X6 HVNPIPSU 0104 Dual function high voltage model provides the following power output from either high voltage AC or DC power source 145...

Страница 10: ...abric OS 8 0 1 Yes Power supply assembly slot filler panel XBR X6 0130 Required to cover empty slot to maintain airflow in chassis Fabric OS 8 0 1 Yes Table 2 Rack Mount Kits Kit Part Number Short Description XBR DCX 0121 Mid mount rack mount kit for two post rack XBR DCX 0120 14U rack mount kit for four post rack 27 31 in Rack mount kits XBR DCX 0152 14U rack mount kit for four post rack 22 in No...

Страница 11: ...om mybroadcom You must initially register to gain access to the Customer Support Portal Once there select Customer Support Portal Support Portal You will now be able to navigate to the following sites Knowledge Search Clicking the top right magnifying glass brings up a search bar Case Management The legacy MyBrocade case management tool MyCases has been replaced with the Fibre Channel Networking c...

Страница 12: ...h eight blades up to 384 32G external ports are possible in a single chassis enabling high density SAN configurations with reduced footprint Support for 48 Fibre Channel ports on each FC32 48 port blade that provide 8 10 16 and 32G The 10G transceivers can be used for any port on the FC32 48 port blades Trunking technology groups up to eight ports to create high performance 256G ISL trunks between...

Страница 13: ...r hot swappable field replaceable units FRUs Three fan assemblies available with NPI or NPE airflow Up to four power supplies available with NPI or NPE airflow Redundant primary power connections ensure high availability Each power supply assembly has its own connector so the number of primary power connections is four for optimum efficiency and redundancy Two World Wide Name WWN cards located on ...

Страница 14: ... FC32 48 4 Cable management comb 5 Control processor blades CPX6 slot 1 upper slot 2 lower CAUTION Do not attempt to lift or support the chassis by the logo bezel attached over the port side air vents NOTE Depending on the fans and power supplies that are installed airflow can be from the port side to the nonport side of the chassis or from the nonport side to the port side of the chassis 53 10041...

Страница 15: ...pins and connectors designed for specific blade types Only install the control processor CP core routing CR port and extension blades into slot numbers as follows Slots 1 2 are restricted to CP blades Note that the blade installed in slot 1 will be designated as CP0 while the blade in slot 2 will be designated as CP1 in CLI command and message output Slots 3 6 and slots 9 12 are restricted to port...

Страница 16: ...rom the nonport side to the port side of chassis Although not illustrated the chassis label that contains the serial number SKU and WWN is located on the lower portion of the chassis below the fan assemblies Device Management Options You can use the management functions built into the device to monitor the fabric topology port status physical status and other information to help you analyze switch...

Страница 17: ... connection Brocade Fabric OS Administration Guide Brocade Fabric OS Command Reference Manual Brocade Web Tools Ethernet or serial connection Brocade Fabric OS Web Tools Administration Guide Standard SNMP applications Ethernet or serial connection Brocade Fabric OS MIB Reference Manual Management Server Ethernet or serial connection Brocade Fabric OS Administration Guide Brocade Fabric OS Command ...

Страница 18: ...ION Disassembling any part of the power supply and fan assembly voids the warranty and regulatory certifications There are no user serviceable parts inside the power supply and fan assembly CAUTION Make sure the airflow around the front and back of the device is not restricted CAUTION To protect the serial port from damage keep the cover on the port when not in use CAUTION Never leave tools inside...

Страница 19: ...VAC HVDC power supply should not exceed 305 VAC and 400 VDC CAUTION For removal of the metal cable restraint cover under the high voltage power supply inlet remove the 2 Torx screws Lifting Precautions DANGER Use safe lifting practices when moving the product DANGER A fully populated chassis weighs approximately 145 83 kg 321 5 lbs and requires a hydraulic or assisted lift to install it CAUTION Do...

Страница 20: ...o install the device with the air intake side facing the cool air aisle The device can be installed facing either direction if serviceability and cooling requirements are met Ensure that the airflow available at the air vents meets the minimum requirements for the device Install the device with the airflow aligned with other devices in the rack Some devices have airflow running from the port side ...

Страница 21: ... Install an Ethernet cable open a telnet session and configure the device domain ID date and time and additional system parameters Verify and back up the configuration 20 minutes Ethernet cable optional for telnet access Refer to the Brocade Fabric OS Administration Guide Install transceivers as needed 20 30 minutes SFP and QSFP28 optical transceivers as needed Attach fiber optic cables cable ties...

Страница 22: ...lanning and site preparation ensure seamless installation especially when installing multiple devices Table 6 Installation Prerequisites Task Task Details or Additional Information Completed Unpack the device Take an inventory of the hardware components included in your shipment See Shipped Items Gather necessary components and required tools Review the time and items required information at the b...

Страница 23: ...tach a management station establish a serial connection and change the default passwords optional See Establishing a Serial Connection to the Device After completing this task log on to the serial port to configure the device Set the IP address the subnet mask and the default gateway IP address Use the ipaddrset command to configure a static device IP address subnet mask and gateway IP address or ...

Страница 24: ...perational baseline for the device Refer to the Brocade Fabric OS Command Reference Manual for more information on these commands errdump fanshow historyshow psshow tempshow Back up the configuration Use the interactive configupload command to back up the configuration See Backing Up the Configuration for more information Optional Power off the devices Enter the shutdown command and wait for the d...

Страница 25: ...utions before mounting the device and ensure that all Facility Requirements are met NOTE The preceding rack mount kits are supported for these devices on the publication date of this guide For current support information contact your Broadcom representative Mounting Precautions The following precautions specifically apply to mounting the device CAUTION Do not use the port cover tabs to lift the mo...

Страница 26: ...sted lift to transport the device to the installation area Ensure that the doorways are wider than 36 in 91 cm to accommodate the device 3 Remove the chassis door if installed 4 Remove the cable management comb if attached to the device 5 Use a lift to raise the device to the correct level Use two people one to operate the lift and the other to secure the device on the lift CAUTION Do not attempt ...

Страница 27: ...llation Guide Hardware devices illustrated in these procedures are only for reference and may not depict the device you are installing into the rack Time and Items Required Allow approximately one hour to unpack and install a device in a rack The following tools are required when installing the 14U Rack Mount Kit for Four Post Rack Torque screwdriver with No 2 Phillips screwdriver tip Slotted flat...

Страница 28: ...ount shelf bracket 2 Right rack mount shelf bracket 3 10 32 x 5 8 in 1 58 cm panhead Phillips screw and washer 4 10 32 clip nut for cabinets that have rails with round holes 5 1 4 20 x 1 2 in 1 27 cm panhead Phillips screw with lock washer for cabinets that have rails with round holes 6 10 32 retainer nut for cabinets that have rails with square holes 7 1 4 20 x 1 2 in 1 27 cm panhead Phillips scr...

Страница 29: ... 5 1 4 20 x 1 2 in 1 27 cm panhead Phillips screw with thread locker for rails with square holes 4 on each end of each bracket 16 total 6 Adjustable ends of shelf brackets 7 Intake air direction 8 Exhaust air direction CAUTION Use the screws specified in the procedure Using longer screws can damage the device 3 Position the shelf brackets with the adjustable ends on the intake air aisle side of th...

Страница 30: ... spaces between the holes are 1 58 cm 1 58 cm and 1 27 cm 5 8 in 5 8 in and 1 2 in 4 Tighten the adjusting screws on the sliding portion of the rack mount shelf brackets to a torque of 37 cm kg 32 in lb 5 Attach the clip nuts for rails with round holes or retainer nuts for rails with square holes to the vertical rails on the exhaust aisle side of the rack see the previous figure These clip nuts ar...

Страница 31: ... that the door if installed is removed from the port side of the device See Chassis Door for removal and replacement instructions 2 Use a lift to raise the device to the level of the shelf brackets 3 Move the lift as close as possible to the rack with the air intake side of the device facing the front of the rack see the following figure 4 If applicable lock the wheels of the lift 5 Gently slide t...

Страница 32: ...ice Installing the 14U Chassis Mid Mount Rack Kit for Two Post Racks XBR DCX 0121 Use the following instructions to install a Brocade modular device in a telecommunications Telco rack using the 14U Chassis Mid Mount Rack Kit for Two Post Racks XBR DCX 0121 Observe the following considerations when mounting this device The kit is compatible with rack rails that are either 7 6 cm 3 in or 12 7 cm 5 i...

Страница 33: ...lic or assisted lift with a minimum raise of 140 cm 55 in and a minimum capacity of 113 kg 250 lbs Parts List The following parts are provided with the 14U Chassis Mid Mount Rack Kit for Two Post Racks XBR DCX 0121 Figure 8 Rack Kit Parts 1 Tray front mid mount chassis 2 Tray rear mid mount chassis 3 Adapter rear mid mount right 4 Adapter rear mid mount left 5 Screw 10 32 x 3 8 in panhead Phillips...

Страница 34: ...ails Orient the tray see the following figure and use nine screws Item 5 for each rail 2 Attach the front tray to both rack rails Orient the tray and use nine screws Item 5 for each rail 3 Verify that the rear edge of the front tray is seated into the front edge of the rear tray Figure 9 Attaching the Rear Tray to the Rack Rails 2 Tray rear mid mount chassis 3 Adapter rear mid mount right 4 Adapte...

Страница 35: ...the Rack DANGER Use safe lifting practices when moving the product NOTE A fully populated device requires a hydraulic lift or an assisted lift to install into a rack Perform the following steps to load the device into the mid mount trays 1 Ensure that the door is removed from the port side of the device For instructions see the door removal and replacement procedures in Chassis Door 53 1004105 13 ...

Страница 36: ...Trays 1 Tray front mid mount chassis 2 Tray rear mid mount chassis 5 Use three screws Item 5 to attach each side of the rear tray to the device see the following figure NOTE The screw holes in the device walls have pem nuts on the inside surface 6 Use four screws Item 5 to attach each side of the front tray to the device 7 Use six screws Item 5 to attach the lip on each side of the front tray to t...

Страница 37: ...53 1004105 13 Hardware Installation Guide Brocade X6 8 Director Hardware Installation Guide Figure 12 Attaching Trays to the Device 8 Reinstall the device door 53 1004105 13 37 Broadcom ...

Страница 38: ...vice The blue Active LED illuminates on the active CP blade Configure IP addresses for the device Configure an IP address and subnet mask for a chassis management connection Configure IP addresses host names subnet masks and gateway addresses for both control processor CP blades Establish an Ethernet connection to the device Connect Ethernet cable to active CP blade Ethernet port labeled Managemen...

Страница 39: ...spare Access to an FTP server or USB device for backing up uploading or downloading the device configuration or collecting supportsave output data optional A Brocade USB drive for collecting supportsave output data optional Providing Power to the Device Perform the steps to provide power that are applicable to your power supply model Observe the following precautions for all power connections Befo...

Страница 40: ...rvice loop of 15 2 cm 6 in available and are routed to avoid stress 5 Plug the power cords into power supplies The power supply LED will light green when power is applied Note that after one power supply is plugged into AC power LEDs on the remaining installed power supplies will flash green until they also have power applied The director performs a power on self test POST each time it is powered ...

Страница 41: ...ssemblies near the bottom of the chassis 3 Install all power supplies provided for your device if not already installed See Installing a Power Supply for procedures 4 When installing the device in a rack route power cables from power distribution units PDUs so they do not cover air vents in chassis 5 Before connecting the power cord to a power supply first remove the cable restraint cover if it is...

Страница 42: ...your facility and local code requirements For more information on the HVAC HVDC power cord available for these power supplies see Using HVAC HVDC Power Cords DANGER Make sure that the power source circuits are properly grounded and then use the power cord supplied with the device to connect it to the power source c If connecting to an AC power source connect to a power source with voltage of 200 2...

Страница 43: ...her FRUs may display amber Power LEDs on all FRUs display green when POST is complete and all FRUs are functional You can bypass POST by using the fastBoot command You can also disable POST for successive reboots on the device using the diagDisablePost command NOTE Do not connect the device to the network until the IP addresses are configured 12 After POST is complete verify that the power LEDs on...

Страница 44: ...e by verifying that all power LED indicators on the power supplies fans and blades display a steady green light 2 Remove the shipping cap from the console I0I0 port on the active CP blade The active CP is indicated by an illuminated blue LED on the CP blade front panel NOTE The console or serial port is intended primarily for the initial setting of the IP address and for service purposes 3 Use the...

Страница 45: ...erminal emulator application stops reporting information press Enter The following logon prompt displays CP0 Console Login NOTE CP0 in the preceding prompt is an example CP1 will display if it is the active CP 7 Log on to the console using admin as the default logon name and password as the default password As logon to the device occurs you are prompted to change the device passwords Please change...

Страница 46: ...following steps to set the IP addresses for the device 1 Log on to the device through a serial console connection to the active CP blade The active CP is indicated by an illuminated blue LED on the blade front panel If you are already logged on through a console port you can determine whether you are logged in to the active or standby CP by entering hashow at the prompt The following example shows...

Страница 47: ...s being changed Done Establishing an Ethernet Connection to the Device After using a serial connection to configure the IP addresses for the device you can connect the active CP blade to the local area network LAN NOTE Connecting the CP blades to a private network or VLAN is recommended After establishing an Ethernet connection you can complete the device configuration using a serial console conne...

Страница 48: ...and The command prompts display sequentially Enter a new value or press Enter to accept each default value c Enter y after the Fabric param prompt Fabric param yes y no n no y d Enter a unique domain ID such as the domain ID used by the previous device if still available Domain 1 239 1 3 e Complete the remaining prompts or press Ctrl D to accept the remaining settings without completing all the pr...

Страница 49: ...al console connection to the active CP blade The active CP is indicated by an illuminated blue LED on the blade front panel A telnet session using the chassis management IP address Log on to the device using admin If you have not changed the default password use password 2 Enter the tsTimeZone command using one of the following options Enter the tsTimeZone interactive command enter the appropriate...

Страница 50: ...rce Perform the following steps to synchronize the local time of the principal or primary FCS device with the time of an external NTP server 1 Log on to the device using one of the following methods A serial console connection to the active CP blade The active CP is indicated by an illuminated blue LED on the blade front panel A telnet session using the chassis management IP address 2 Log on to th...

Страница 51: ...in You can enter switchName to verify the new name after login 5 Record the new names for future references Verifying Installed Licenses All licenses come preinstalled on the director Use the following steps to list installed licenses and to record your license key and chassis ID for future reference 1 Log on to the device using one of the following methods A serial console connection to the activ...

Страница 52: ...e device slotshow m Displays blades with model numbers detected in each slot slotshow p Displays power consumption data and enabled status for installed blades switchShow Displays switch status and information tempShow Displays temperature status and information Backing Up the Configuration Back up the configuration on a regular basis to ensure that a complete configuration is available for downlo...

Страница 53: ...ous Path Filename home dir config txt dumps supportsaves fos9k folder d239 Section all chassis FID all configUpload complete All selected config parameters are uploaded 3 Back up the virtual fabric configuration using the configUpload vf command For more information on using the configUpload and configUpload vf commands refer to the Brocade Fabric OS Command Reference Manual 4 Enter the following ...

Страница 54: ...itching off rack power source Note that power supply LEDs will continue to flash green briefly after disconnecting power until power supply is completely off 3 To disconnect power cables from HVAC HVDC power supplies only perform the following steps a Remove the cable restraint cover if installed under the power cord connector by unscrewing the two torx head screws 1 Torx head screws 2 Metal cable...

Страница 55: ...53 1004105 13 Hardware Installation Guide Brocade X6 8 Director Hardware Installation Guide 1 Power cable 2 Connector latch 53 1004105 13 55 Broadcom ...

Страница 56: ...n specific predetermined fixed lengths that are qualified by Brocade For SFP transceiver connections use an appropriate cable with LC connectors to connect between the blade and device For connecting QSFP transceivers on core routing blades to ICLs use an appropriate QSFP to QSFP standard cable This cable provides a single quad connector on each end for connecting between director QSFPs For connec...

Страница 57: ...pecifications Port and Extension Blade Transceivers FC SFP transceivers installed in port blades and extension blade ports provide connections to devices on FC fabrics The following figure illustrates a FC SFP transceiver A separate fiber optic cable plugs into the transceiver Figure 15 FC SFP Transceiver 1 Pull tab 2 Transceiver GbE SFP and QSFP ports on extension blades allow connection of blade...

Страница 58: ...port Figure 17 QSFP Cable and Transceiver with Bail Open 1 Fiber optic cable 2 Bail 3 Transceiver Core Routing Blade Transceivers QSFPs installed in core routing blades are used for connecting inter switch links ICLs between Brocade X6 Directors or between Brocade X6 and DCX 8510 Directors Interconnecting these devices increases the number of useable ports for device connections The following list...

Страница 59: ...irectors forming the ICL connection Up to nine neighboring Directors can be connected with the MTP cables The 32G QSFP28 SWL transceivers on Brocade X6 Director core routing blades operate at 4x32G and 4x16G speeds so can be used for an ICL connection between a 32G QSFP on a Brocade X6 Director core routing blade and a 16G QSFP transceiver on a DCX 8510 Director core routing blade Use the appropri...

Страница 60: ...ring in place Cable Management The minimum radius that a 50 micron cable can be bent under full tensile load is 5 1 cm 2 in For a cable under no tensile load that minimum is 3 0 cm 1 2 in Cables can be organized and managed in a variety of ways for example using cable channels on the sides of the rack or patch panels to minimize cable management Following is a list of additional recommendations Pl...

Страница 61: ... state Fabric OS also logs the issue in the system error log To insert an SFP transceiver complete the following steps NOTE Always use the pull tab to insert or remove transceivers since they might be hot 1 Perform one of the following steps depending on your transceiver type If the transceiver has a pull tab use the pull tab to help push the transceiver into the port until it is firmly seated and...

Страница 62: ... insert any unsupported cable intended for another type of transceiver into a regular SFP transceiver You may damage the cable as well as the transceiver Replacing an SFP Transceiver Complete the following steps to remove and then install a new SFP transceiver NOTE The 16G and 32G SFP transceivers do not have bails instead they have pull tabs Always use the pull tab to insert or remove the SFP tra...

Страница 63: ...ure 22 Installing an SFP Transceiver with a Bail Latch into a Blade Port 1 Bail 3 To install the transceiver perform one of the following steps depending on your transceiver type If the transceiver has a pull tab use the pull tab to help push the transceiver into the port until it is firmly seated and the latching mechanism clicks If the transceiver has a bail latch mechanism ensure that the bail ...

Страница 64: ... the two blade types Although most QSFPs support standard QSFP to QSFP and in some cases breakout cable the 4x16G 2 km LWL QSFP has an integrated cable for connection directly to a female terminated connector in a patch panel or patch cable On Gen 6 platforms 16G QSFPs may sometimes negotiate the link speed to 8G when a breakout cable is connected To avoid this disable and then re enable the port ...

Страница 65: ...d_Inv state Fabric OS also logs the issue in the system error log Also note the following Each QSFP contains four individual ports Be aware that any problems with one port could affect all four ports in the quad if the QSFP must be replaced Although installation and removal procedures are the same for QSFP transceivers installed in port blades and extension blades these transceivers are not interc...

Страница 66: ... is established When the link is fully established the LED displays a steady green NOTE Cables are keyed so that they can be inserted in only one way If a cable does not slide in easily ensure that it is correctly oriented 5 Organize cables to avoid covering LEDs and air vents See Cable Management Verifying the Operation of New Transceivers You can use the following commands to verify if the trans...

Страница 67: ...enance This chapter provides information about determining the status of each component using LEDs and CLI commands Refer to the Brocade Fabric OS Web Tools Administration Guide and the Brocade Fabric OS Administration Guide for additional information Interpreting FC32 48 Port Blade LEDs See the following figure and table to interpret the LED patterns for the FC32 48 blade The LED patterns tempora...

Страница 68: ...tallation Guide Figure 25 FC32 48 Port Blade LEDs 1 Blade power LED 2 Blade status LED 3 Status LED for right FC port 4 Status LED for left FC port The following table describes the port blade LED patterns and the recommended actions for those patterns 53 1004105 13 68 Broadcom ...

Страница 69: ...and cable Polling is in progress Allow 60 seconds for polling to complete No light LED is off Connected device is configured in an offline state Verify the status of the connected device Steady green Port is online connected to an external device but has no traffic No action required Slow flashing green on 1 second then off 1 second Port is online but segmented indicating a loopback plug or cable ...

Страница 70: ...and other diagnostic tests Figure 26 FC32 64 Port Blade LEDs 1 Blade power LED 2 Blade status LED 3 Status LEDs for QSFP ports The following table describes the blade LED patterns and the recommended actions for those patterns NOTE When the QSFP is operating in breakout mode each of the four LEDs to the right of the QSFP quad port indicates the status of an individual breakout port When the QSFP i...

Страница 71: ...hen off 1 28 seconds The blade is not seated correctly or is faulty Pull the blade out and reseat it If LED continues to flash replace the blade Status Fast flashing amber on 320 ms second then off 320 ms Environmental range has been exceeded Check for out of bounds environmental conditions and correct them Port has no incoming power or there is no light or signal carrier detected Verify that the ...

Страница 72: ... the workstation using the portDisable or portCfgPersistentEnable command Fast flashing amber on 320 ms second then of 320 ms Transceiver or port is faulty Change the transceiver or reset the switch from the workstation Alternating green amber Port is beaconing No action is required Interpreting Extension Blade LEDs See the following figure and table to interpret the LED patterns on the SX6 extens...

Страница 73: ... Blade status LED 3 Right 40GbE QSFP port 0 status LED 4 Left 40GbE QSFP port 1 status LED 5 Right 1 or 10GbE port status LED 6 Left 1 or 10GbE port status LED 7 Right FC port status LED 8 Left FC port status LED The following table describes the extension blade LED patterns and the recommended actions for those patterns 53 1004105 13 73 Broadcom ...

Страница 74: ...line but has no traffic No action is required linking green Port is online with traffic lowing through the port No action is required GbE port status Blinking amber A transceiver or port has an error or is faulty Change the transceiver or reset the switch from the workstation Port has no incoming power or there is no light or signal carrier detected Verify that the power LED is on check the transc...

Страница 75: ...istentEnable commands Fast flashing amber on 1 2 second then off 1 2 second A transceiver or port has an error or is faulty Change the transceiver or reset the switch from the workstation Alternating green and amber The port is bypassed Reset the port from the workstation using the portEnable or portCfgPersistentEnable command Interpreting Core Routing Blade LEDs See the following figure and table...

Страница 76: ...n Guide Brocade X6 8 Director Hardware Installation Guide Figure 28 CR32 8 Core Routing Blade LEDs 1 Blade power LED 2 Blade status LED 3 QSFP status LED for right QSFP port 4 QSFP status LED for left QSFP port 53 1004105 13 76 Broadcom ...

Страница 77: ...ing amber on 1 2 second then off 1 2 second The environmental range has been exceeded Check for out of bounds environmental conditions and correct them No light LED is off No QSFP module is seated or all four QSFP ports are disabled No action is needed if the QSFP is not installed If the QSFP is installed verify that it is fully inserted Steady amber The QSFP module is in but all four ports have n...

Страница 78: ... beacon LED is reserved for future use The following table describes the CP blade LED patterns and the recommended actions for those patterns Table 16 CP Blade LED Descriptions LED Purpose Color Status Recommended Action Steady green CP blade is on No action required Power No light LED is off CP blade is not on Ensure that the blade is firmly seated and has power No light LED is off CP blade is ei...

Страница 79: ...le describes how link activity and 10 100 1000Mb s link speed are indicated by status and activity LED operation on the MGMT and SERVICE Ethernet Ports on the CP blade NOTE To force a persistent Ethernet link speed enter the ifModeSet command Table 17 LED Descriptions for 10 100 1000Mb s Ethernet Ports LED Inactive link 10 Mb s 100 Mb s 1000 Mb s Ethernet link status 10 100 1000Mb s port No light ...

Страница 80: ...y seated power cables are connected and cables are connected to a power source Power Steady green The card is receiving power No action required No light LED is off The card is either healthy or does not have power No action required Status Steady amber The card is faulty Replace card Interpreting Power Supply LEDs See the following information to interpret the LED patterns on the power supply The...

Страница 81: ...is connected to the power source Disconnect the power cable from the power supply remove and reinsert the power supply and then reconnect the power cable to restart If the status persists replace the power supply assembly Steady green The power supply has incoming power and is providing power to the device No action is required Flashing on one half second and then off a one half second AC power is...

Страница 82: ...s persists replace the power supply assembly Table 20 HVAC HVDC Power Supply LED Descriptions LED Purpose Color Status Recommended Action No light LED is off The power supply does not have incoming power and is not providing power to the device When incoming power is first removed LED flashes and then turns off Ensure that the power supply is firmly seated the power cable is connected and the powe...

Страница 83: ...an Assembly LEDs See the following figure and table to interpret the LED patterns on fan assemblies The LED patterns may temporarily change during POST and other diagnostic tests The Brocade X6 8 Director has three fan assemblies Figure 33 Fan Assembly LEDs 1 Power LED 2 Status LED 53 1004105 13 83 Broadcom ...

Страница 84: ... fully tightened If screws are loose pressure from fans may unseat the fan from chassis connectors Interpreting POST and Boot Results The device performs a power on self test POST by default each time the device is powered on rebooted or reset The device can be rebooted using the reboot command to reboot each CP individually or the fastBoot command The fastBoot command reboots the switches without...

Страница 85: ...ommands refer to the Brocade Fabric OS Command Reference Manual For more information on error messages refer to the Brocade Fabric OS Message Reference Manual chassisShow The chassisShow command can be especially helpful in monitoring the health of the device This command provides information on installed blade fan assembly and power supply assembly FRUs In addition customer supplied information c...

Страница 86: ...Month 10 Year 2015 Update Day 23 Month 3 Year 2016 Time Alive 84 days Time Awake 0 days ID output truncated CORE BLADE Slot 7 Header Version 2 Power Consume Factor 450W Power Usage 264W Factory Part Num 60 1003199 08 Factory Serial Num DYH0344L005 Manufacture Day 17 Month 11 Year 2015 Update Day 0 Month 0 Year 0 Time Alive 0 days Time Awake 0 days ID output truncated SW BLADE Slot 9 Header Version...

Страница 87: ...06V Manufacture Day 10 Month 8 Year 2015 Update Day 15 Month 2 Year 2016 Time Alive 68 days Time Awake 2 days ID FAN Unit 1 Fan Direction Non portside Intake Header Version 2 Power Consume Factor 300w Factory Part Num 60 1003203 03 Factory Serial Num DYL0329L04R Manufacture Day 3 Month 10 Year 15 Update Day 15 Month 2 Year 2016 Time Alive 68 days Time Awake 2 days ID output truncated WWN Unit 1 Sy...

Страница 88: ...CHASSIS INFO My_Chassis The new Version Fabric OS v8 0 1_bld52 2016 03 28 08 48 27 SULB 1002 95 SLOT 1 CHASSIS INFO My_Chassis Firmwaredownload command has completed successfully 2016 03 28 08 50 51 IPAD 1003 96 SLOT 1 CHASSIS INFO My_Chassis DNS parameters saved successfully The output can contain several thousand lines Use the errClear command to reset the output when needed This command clears ...

Страница 89: ...Show command to display the entire history log which includes insertion and removal events for field replaceable units FRUs such as blades power supplies fans and world wide name WWN cards The following is an example of historyShow output chassisX6 8 admin historyshow CORE BLADE Slot 7 Inserted at Mon Jun 13 13 58 38 2016 Factory Part Number 60 1003323 01 Factory Serial Number DYH0339L00D POWER SU...

Страница 90: ... Serial Number DYJ0332L031 CP BLADE Slot 1 Inserted at Mon Jun 13 13 59 19 2016 Factory Part Number 60 1003201 09 Factory Serial Number DYK0338L008 output truncated psShow Use the psShow command to display the current status of installed power supplies The following is an example of psShow output chassisX6 8 admin psshow Power Supply 1 is OK V10M03 DUE2M03M04P 23 0000163 01 21 DELTA ECD16020044 S1...

Страница 91: ...ial ID SFP in the specified port The following is example of sfpShow output chassisX6 8 admin sfpshow Slot 3 Port 0 Slot 3 Port 1 Slot 3 Port 2 output truncated Slot 6 Port 32 id sw Vendor BROCADE Serial No JAF315420000114 Speed 8 16 32_Gbps Slot 6 Port 33 id sw Vendor BROCADE Serial No JAF315410000NDL Speed 8 16 32_Gbps Slot 6 Port 34 id sw Vendor BROCADE Serial No JAF31542000010P Speed 8 16 32_G...

Страница 92: ...d to set up FTP parameters always recommended In the following examples the c operand allows use of the FTP SCP or SFTP parameters set by supportFtp The n operand turns off confirmation prompting chassisX6 8 admin supportsave n c Saving support information for switch ras015 module RAS Saving support information for switch ras015 module RTE Saving support information for switch ras015 module IF_TRE...

Страница 93: ...eed State Proto 0 3 0 010000 id N32 Online FC F Port 86 0d 00 11 0d 06 00 00 1 3 1 010100 id N32 Online FC F Port 86 24 00 11 0d 07 00 00 2 3 2 010200 id N32 Online FC F Port 86 0c 00 11 0d 05 00 00 3 3 3 010300 id N32 Online FC F Port 86 25 00 11 0d 08 00 00 4 3 4 010400 id N32 Online FC F Port 21 00 00 24 ff 90 55 30 5 3 5 010500 id N32 Online FC F Port 21 00 00 24 ff 90 55 31 6 3 6 010600 id N3...

Страница 94: ...re and the firmware including internal connections and circuitry transceivers and port cables However diagnostic tests are generally intended for use by support personnel NOTE Error messages do not necessarily indicate that the device requires maintenance Each diagnostic test can be implemented by entering the related command through a telnet or serial session For a list of diagnostic tests and co...

Страница 95: ...ight hot swappable port blades can be installed in a single chassis to provide up to 384 32G FC ports Optics such as the following can be installed in the blade s FC ports For a complete list of transceivers see Supported Transceivers and Cables 32G SFP transceivers supporting 8G 16G and 32G speeds 16G SFP transceivers supporting 4G 8G and 16G speeds 10G SFP transceivers supporting 10G Port blades...

Страница 96: ...ualified transceivers for blade ports The following table defines the eight port Fibre Channel port groups for configuring trunk groups or trunks On the blade ports belonging to the same port group are indicated with the same color border beneath the port on the blade label Ports belonging to the same ASIC are indicated by a border with a similar color tone Table 22 Port Groups for Configuring Tru...

Страница 97: ...ts operate in non breakout mode so you must enable breakout mode for ports containing Ethernet transceivers using the portcfgbreakout enable command Connection speeds depend on the QSFP transceiver installed For example a 4x32G QSFP transceiver would provide four 32 16G connections and a 4x16G QSFP transceiver provides four 16 8 4G connections The following list shows considerations for using thes...

Страница 98: ...reakout mode features and commands refer to the Brocade Fabric OS Administration Guide and Brocade Fabric OS Command Reference Manual FC32 64 Port Blade Numbering and Trunking The following illustration shows how ports are numbered on the blade Figure 35 FC32 64 Blade Port Numbering NOTE Numbering 0 63 on this figure accounts for the quad ports available for 16 installed QSFP transceivers The phys...

Страница 99: ...ew The Brocade SX6 Extension blade is intended as an extension platform to support Fibre Channel FC FICON and IP based storage data flows Brocade Extension enables you to use the existing IP wide area network WAN infrastructure to connect Fibre Channel and IP fabrics Brocade Extension supports applications such as remote data replication RDR centralized backup and data migration over very long dis...

Страница 100: ...ression delivers the ability to maximize throughput over lower bandwidth links in the wide area network optimizing the cost efficiencies of FCIP The SX6 blade compresses FC frames before they are encapsulated into FCIP packets Key protocol features are enabled in the FCIP implementation to optimize the performance of extension over IP networks including WAN Optimized TCP WO TCP 9K jumbo frame and ...

Страница 101: ...d rate of a single circuit is 10G whether configured on a 10GbE or 40GbE port FCIP and hybrid mode FC IP modes SX6 Blade Port Numbering and Trunking The following figure shows how ports are numbered on the blade Ports are labeled as 10GE 40GbE and FC on the blade Figure 36 SX6 Extension Blade Port Numbering 1 40GbE port 0 2 40GbE port 1 3 10 1GbE ports 2 9 bottom to top 4 10 1GbE ports 10 17 botto...

Страница 102: ...e Observe the following precautions when replacing these blades Wear an appropriately grounded ESD wrist strap when handling and installing device blades and cards Follow electrostatic discharge ESD precautions Wear a wrist grounding strap connected to chassis ground if the chassis is plugged in or a bench ground Install only port and extension blades in slots 3 6 and 9 12 Slots 7 and 8 are reserv...

Страница 103: ...s see Using Monitoring Commands and the Brocade Fabric OS Command Reference Manual For more information about error messages refer to the Brocade Fabric OS Message Reference Manual Time and Items Required for Removal and Installation The removal or installation procedure for each blade takes less than 10 minutes Removing and restoring transceivers and cables may take longer depending on how many m...

Страница 104: ... be removed using the portcfg iproute delete command c Delete all IP interfaces IPIFs defined on the blade using the portcfg ipif slot geX delete command d If logical switches are used on the switch move all blade ports back to the default logical switch Refer to the lscfg command in the Brocade Fabric OS Command Reference Manual for details NOTE If you are removing the extension blade to install ...

Страница 105: ...e one hand under it for support Do not support the blade by the injector handles after removal Figure 37 Removing and Replacing Port or Extension Blade 13 If the blade is not being replaced by another blade install a filler panel and reinstall the chassis door The filler panel is required for proper chassis cooling The door is required to meet EMI compliance 53 1004105 13 105 Broadcom ...

Страница 106: ...and chassis do not push the blade into a slot or pull the blade from a slot using the ejector handles When the blade face is about 2 54 cm 1 in from the chassis you should feel resistance as the blade connectors meet the backplane connectors c Continue pushing the blade into the slot using your thumbs or fingers until the ejectors move in toward the blade slightly indicating that the connectors ar...

Страница 107: ...tion Perform the following tasks to verify the operation of a blade 1 Check the LED indicators on the blade s front panel For information on interpreting LED patterns see one of the following sections of this guide Interpreting FC32 64 Port Blade LEDs Interpreting FC32 48 Port Blade LEDs Interpreting Extension Blade LEDs 2 Enter the following commands and note any error conditions slotshow p Displ...

Страница 108: ...d to 16 QSFP transceivers on the blade s front panel These transceivers can create ICL connections for up to nine separate directors in a full mesh topology and 12 directors in a core to edge topology Each transceiver provides four 32G FC links for a total of 128G per connection This core switch blade is compatible only with the Brocade X6 8 Core routing blades contain the following LED indicators...

Страница 109: ...ugh 15 on the right side from bottom to top For information on supported QSFP transceivers see Supported Transceivers and Cables Ports belonging to the same trunking groups are indicated with the same color border under the ports These colors are also applied to the port map labels on each blade to indicate ports belonging to the same trunking groups Each numbered QSFP port on the blade provides f...

Страница 110: ...two QSFPs within a port trunk group on a core blade installed in one device must be connected to a pair of QSFPs within a trunk group on a core blade in another device Each CR32 8 blade on the Brocade X6 8 Director has four ICL trunking groups consisting of the following QSFP ports 0 1 8 and 9 2 3 10 and 11 4 5 12 and 13 6 7 14 and 15 Ports belonging to the same trunking groups are indicated with ...

Страница 111: ...Chassis 2 X6 4 To connect multiple X6 Directors via ICLs a minimum of four ICL ports two on each core routing blade must be connected between each chassis The dual connections on each core blade must reside within the same trunk group If more than four ICL connections are required between a pair of directors additional ICL connections should be added in pairs one on each core blade ISLs and ICLs c...

Страница 112: ...een Brocade X6 Director and DCX 8510 Director models Blade Specific Precautions This document describes how to remove and replace a core routing blade Observe the following precautions when replacing these blades The CR32 8 core routing blade is compatible only with the Brocade X6 8 Director Wear an appropriately grounded ESD wrist strap when handling and installing blades and cards Follow electro...

Страница 113: ... is enabled Any of the following messages display in errShow output or errShowAll output for root capable administrators Slot unknown message relating to a core switch slot Core switch blade errors or I2C timeouts FRU FRU_FAULTY messages for a core switch blade FAULTY xx with an associated code used by support Configuration loader messages or Sys PCI config messages Generic system driver messages ...

Страница 114: ... ICLs are not connected to the blade or the traffic over blade ICLs has been halted skip these procedures and then go on to Removing a Core Routing Blade 1 Ensure that Lossless Dynamic Load Sharing is enabled on each logical switch that resides on each physical switch that has ICL connections through the core blades Log on to each logical switch using an account with admin permissions and then ent...

Страница 115: ... command displays information about the blades including part numbers xx xxxxxxx xx serial numbers and additional status 7 Disconnect all cables and remove transceivers from the blade 8 Label and then disconnect cables from the faulty core routing blade 9 Loosen the captive screws for both ejector handles on the blade using a No 1 Phillips screwdriver Loosening the screws initiates a hot swap requ...

Страница 116: ...e by the injector handles after removal Figure 41 Removing and Installing a Core Routing Blade 13 If the blade is not being replaced by another blade install a filler panel and reinstall the chassis door The filler panel is required for proper chassis cooling The door is required to meet EMI compliance Installing a Core Routing Blade Complete the following steps to install a core routing blade int...

Страница 117: ... connectors meet the backplane connectors c Continue pushing with your thumbs or fingers until the ejectors move in toward the blade slightly indicating that the connectors are engaged d Simultaneously push both ejector handles in toward the blade center with even pressure until the blade completely seats in the slot NOTE As you move the handles you will hear connectors engaging the backplane conn...

Страница 118: ...ade 1 Check the LED indicators on the blade s front panel For information on interpreting LED patterns see Interpreting Core Routing Blade LEDs 2 Enter the following commands and note any error conditions slotShow p Displays the current data on each slot in the system including blade type blade ID status and power usage tempShow Displays temperature reading of blades sensorShow Displays temperatur...

Страница 119: ...ctive interface while the other is select as the standby interface All traffic is transmitted over the active port while no traffic is transmitted over the standby interface If the primary Ethernet port fails due to something other than power loss the standby port becomes active and immediately takes over data transmission to retain link layer communication NOTE Connecting the CP blades to a priva...

Страница 120: ... in slots 1 and 2 which are half the height of other slots in the device The firmware upgrade policy for CP blades specifies testing for the current Fabric OS release and one version earlier It is possible to upgrade by more than one version but it is a very specific and detailed process Read the directions under Downloading Firmware from a USB Device and Downloading Firmware from an FTP Server ca...

Страница 121: ...ges FABSYS Platform system driver messages Platform EM messages that indicate a problem with a CP blade Function fail messages for the CP master See Using Monitoring Commands and refer to the Brocade Fabric OS Command Reference Manual for output examples and additional information on Fabric OS commands For more information about error messages refer to the Brocade Fabric OS Message Reference Manua...

Страница 122: ... server for backing up the device configuration No 1 Phillips screwdriver Replacement CP blade Preparing for Replacement Use this procedure to prepare the system for CP blade replacement 1 Back up the device configuration before you replace a CP blade by uploading various device configuration files using a Telnet connection and saving them to a host computer Before you upload a configuration file ...

Страница 123: ...y CP blade and skip to Step 8 6 If both CP blades are healthy and you want to replace the standby CP blade log on to the active CP blade and skip to Step 8 7 If both CP blades are healthy and you want to replace the active CP blade log on to the active CP blade and run the following steps a Run the haFailover command to make the standby CP blade the active blade The currently active CP blade becom...

Страница 124: ...nchronized and the failover is complete Depending on the nature of the failure it is possible that the haFailover command may not work Proceed to the next step anyway 4 Enter the haDisable command This is required before physically removing and replacing a CP blade 5 Disconnect all cables from the faulty standby CP blade 6 Loosen the captive screws for both ejector handles on the blade using a No ...

Страница 125: ...chassis door The filler panel is required for proper chassis cooling The door is required to meet EMI compliance Installing a Blade NOTE Read all of the instructions for replacing the CP blade before beginning the procedure Make sure that the same version of Fabric OS is installed on both CP blades Using different versions is not supported and may cause malfunctioning If the replacement CP blade h...

Страница 126: ... 1 Phillips screwdriver As the blade seats completely the amber blade status and the green blade power LEDs illuminate NOTE Be sure that the captive screws are tightened If they are not tightened high pressure from fan operation may unseat blade from chassis connectors 5 Observe the blade power and status LEDs and verify the following a The amber status LED on the blade illuminates until POST comp...

Страница 127: ...If you are using an FTP server to download the firmware skip to the procedure for downloading firmware from an FTP server If you are using a USB device to download the firmware skip to the procedure for downloading firmware from a USB device If the firmware on the standby CP blade is more than one level down from the level on the active CP blade you must have formatted USB devices for each of the ...

Страница 128: ...s successfully 2016 06 17 14 56 50 SULB 1004 908 SLOT 2 CHASSIS INFO Chassis_1 Firmwarecommit has completed 2016 06 17 14 56 50 SULB 1036 909 SLOT 2 CHASSIS INFO Chassis_1 The new Version Fabric OS version 2016 06 17 14 56 50 SULB 1002 910 SLOT 2 CHASSIS INFO Chassis_1 Firmwaredownload command has completed successfully 5 Log back on to the standby CP blade and run firmwareDownloadStatus on the st...

Страница 129: ...successfully Use firmwareshow to verify the firmware versions 7 Ensure that you are still logged on to the standby CP blade the blade for which you just changed the firmware level and type reboot The reboot of the standby CP will initiate a firmwarecommit to the secondary partition and log you out Chassis_1 admin reboot Broadcast message from root ttyS0 Fri Jun 17 14 49 45 2016 The system is going...

Страница 130: ...or Replacement 2 Power down the device 3 Remove the chassis door 4 Disconnect all cables from the CP blades 5 Loosen the captive screws for both ejector handles on the blade using a No 1 Phillips screwdriver Loosening the screws initiates a hot swap request and disconnects power from the blade The spring loaded captive screws will pop out from the slot 63 cm 25 in when fully disengaged Do not ejec...

Страница 131: ...e power is off cold swap procedure 1 Rotate the ejector handles away from the center of the blade completely approximately 45 degrees Do not support the blade using ejector handles Orient the blade so that the handles are toward you and the flat metal side is facing left 2 Follow these steps to insert each blade into the slot a Align the blade in the slot with the flat metal on the left side blade...

Страница 132: ...ing mode configuration files to the local system 10 Power cycle the chassis The system recovers 11 Enter chassisDisable 12 Enter configDownload all to download system configuration data including chassis and switch configuration for all logical switches to the local system All the licenses configurations and FCIP tunnels are restored 13 Enter reboot The device becomes fully functional with the new...

Страница 133: ...ctive CP and extension blades will run the same version of the firmware 4 Enter the chassisEnable command to enable all user ports in the chassis and enable a virtual fabric aware chassis 5 Replace the chassis door The door is required to meet EMI compliance 6 Pack the faulty CP blade in the packaging provided with the new CP blade and contact the switch supplier to determine the return procedure ...

Страница 134: ...ion Guide See Using Monitoring Commands and the Brocade Fabric OS Command Reference Manual for output examples and additional information on Fabric OS commands For more information about error messages refer to the Brocade Fabric OS Message Reference Manual 53 1004105 13 134 Broadcom ...

Страница 135: ...all errors detected and prompt you through a data recovery process The wwnrecover utility permits recovery of WWN card data in the event of corruption The data recovery mechanism may vary depending on the error encountered and the data being compared Problems such as a mismatch between license IDs cannot be fixed with wwnrecover and the output will direct you to call Brocade Technical Support For ...

Страница 136: ...rate with one WWN card but will be in degraded condition If you have removed a card be sure to replace as soon as possible NOTE Do not use steps in the WWN card and WWN card bezel removal procedures to disable logical switches and power down the device DANGER For safety reasons the ESD wrist strap should contain a series 1 megaohm resistor CAUTION Static electricity can damage the chassis and othe...

Страница 137: ...sages might be observed regarding WWN units in chassisshow output Error messages that may indicate problems with a WWN card are summarized in the following table Table 25 Messages That May Indicate WWN Card Failure Type of Message Sample Error Message WWN unit fails its field replaceable unit FRU header access 0x24c fabos Switch switchname error EM I2C_TIMEOUT 2 WWN 1 I2C timed out state 0x4 WWN u...

Страница 138: ...ying WWN Card Operation Replacing WWN Cards Cold Swap Use this procedure to replace WWN cards with system power off You can use this procedure to replace one or both WWN cards 1 Save settings and system data and order the replacement WWN card by following all steps under Preparing for Replacement 2 Replace the card by following all steps under Cold Swap Replacement 3 Verify WWN card operation usin...

Страница 139: ... has been inserted a WWN verification audit will be run to detect any mismatches or other problems A second WWN card is enabled and the WWN card audit will be run If an error is detected during the audit EM 1220 and EM 1222 messages are generated HIL 1650 CHASSIS ERROR Unable to detect WWN cards in chassis Access to WWN halted The WWN card has been removed from the device Replace the card as soon ...

Страница 140: ...ad vf ficonshow switchrnid FICON mainframe environments only ipaddrshow license show lid for Fabric OS 9 0 or higher or licenseidshow for Fabric OS versions earlier than 9 0 switchname The factory serial number and the sequence number in the following output from the chassisShow command should match In the ficonshow switchrnid output a sequence number indicates the logical switch number if virtual...

Страница 141: ... thumb on the end of the assembly to fully seat it into the backplane connector c Use a Phillips screwdriver to tighten the captive screw and secure the card assembly to the chassis NOTE Be sure that the captive screws are tightened If they are not tightened high pressure from fan operation may unseat cards from chassis connectors 3 Verify that the WWN card is correctly connected by noting if the ...

Страница 142: ...ou will not be able to establish SSH or other sessions that use the previous IP addresses You can change IP addresses on the new cards using the ipaddrset command 1 Unpack the replacement WWN card assembly and save the packaging for the faulty WWN card s The WWN card assemblies are labeled 1 for the left slot and 2 for the right slot 2 Perform the following steps a Log on to the device and execute...

Страница 143: ...lade run the wwnrecover command and specify WWN 2 card for recovery when prompted in wwnrecover output messages See Using the wwnrecover Utility for more information on this command 11 If wwnrecover messages prompt for a system reboot reboot both CP blades to ensure that the system is running with valid WWN card data 12 Verify the new card settings by running the following commands and comparing t...

Страница 144: ...ed label the assembly with No 1 for the left side assembly and No 2 for the right side assembly for future reference 5 Set the WWN card assembly on a static free surface such as a grounding pad Configuring the Airflow Direction on WWN Cards All fan and power supply assemblies installed in the chassis must provide the same airflow direction either nonport side intake NPI or nonport side exhaust NPE...

Страница 145: ...ot automatically reconfigure and the fan or power supply assembly with mismatched airflow will fault In this case you must replace fan or power supply assemblies to achieve matching airflow direction for all and then reboot the system Verifying WWN Card Operation Perform the following tasks to verify operation of the WWN cards 1 Check the LED indicators on the WWN card bezel located between the po...

Страница 146: ...tatus LED 5 AC power cable receptacle 6 Airflow label 7 Captive screw The Brocade X6 8 Director can have three or four power supplies installed depending on the quantity ordered The use of the high voltage line 200 to 240 VAC is highly recommended because of better power conversion efficiency See Power Supply Requirements in the Technical Specifications for minimum power supplies required for AC l...

Страница 147: ...st NPE This assembly has two fans that move the air from the port side to the nonport side of the device Consider the following important notes about installing this power supply You cannot upgrade from standard voltage AC power supplies in an existing chassis to HVAC HVDC power supplies You must order a new base chassis and the required HVAC HVDC power supplies You cannot mix HVAC HVDC and standa...

Страница 148: ...ration with N 1 or greater redundancy the director can continue operating during the replacement if procedures in this guide are followed Otherwise installed blades may power off Power cords are available from Brocade Power cords are 6m 19 68 ft long and contain three colored 14 AWG unterminated wires which are described in the following table Table 27 HVAC HVDC Power Cable Wiring Label Color Func...

Страница 149: ...d with a green E or orange I airflow symbol All fans and power supplies in a chassis must have the same label affixed to guarantee airflow direction is consistent Figure 50 Airflow Labels The orange I symbol indicates an intake FRU This unit pulls air in from the nonport side of the device and exhausts it out the port side This symbol should appear on FRUs with part numbers that contain an NPI The...

Страница 150: ...semblies from chassis connectors See Safety Precautions for caution and danger notices related to installing power supplies Power Supply Assembly Fault Indicators Use one of the following methods to determine if a power supply is faulty Check the power supply status LED The LED may take up to 10 seconds to illuminate If the LED does not illuminate the power supply has no incoming power Check if th...

Страница 151: ... could result in insufficient system power which could cause some blades to power down Ensure that there is an adequate number of active power supply assemblies when removing a single power unit during hot swapping 1 Unplug the power cable from failed power supply assembly and loosen the captive screw 2 Remove the power supply assembly 3 Insert the new power supply assembly and securely tighten th...

Страница 152: ...demand can be met 2 Perform one of the following steps If you need to power down the chassis to remove a power supply enter the sysShutdown command See Powering Down the Chassis for detailed procedures When the chassis completes shut down remove power cords from all power supply assemblies NOTE To remove a power cord from an HVAC HVDC power supply you must first remove the power cord retainer cove...

Страница 153: ...d supporting the power supply from beneath as you remove it Figure 51 Removing and Installing Power Supply Assembly 5 If you are not replacing the power supply and can leave the chassis operating insert a filler panel into the slot and tighten the captive screw to secure to chassis This completes the procedure for removing a power supply 53 1004105 13 153 Broadcom ...

Страница 154: ...ons when one power supply fails NOTE A maximum of four power supplies can be installed in the device For Fabric Watch monitoring change the switchStatus policy settings to the following using the switchStatusPolicySet command switch status policy PowerSupplies down 1 switch status policy PowerSupplies marginal 0 For more details on executing the switchStatusPolicyShow and switchStatusPolicySet com...

Страница 155: ...ion Guide See Using Monitoring Commands and the Brocade Fabric OS Command Reference Manual for output examples and additional information on Fabric OS commands For more information about error messages refer to the Brocade Fabric OS Message Reference Manual 53 1004105 13 155 Broadcom ...

Страница 156: ... directions can be installed All fan assemblies must have the same airflow direction and match the airflow direction of installed power supplies Fan assembly with nonport side air intake Fans move air from the nonport side to the port side of the chassis Fan assembly with nonport side air exhaust Fans move air from the port side to the nonport side of the chassis Fan assemblies can be removed and ...

Страница 157: ...ice must have either NPI nonport side intake or NPE nonport side exhaust airflow You must order a replacement FRU with the same part number P N as the FRU being replaced to provide the same airflow The manufacturing P N located on the top of the FRU contains either NPI or NPE If a mismatched power source or fan assembly is installed by mistake a RASlog message occurs indicating that a mismatch in ...

Страница 158: ...RU This unit pulls air in from the port side of the device and exhausts it out the nonport side This symbol should appear on FRUs with part numbers that contain an NPE Ensure that the airflow direction of power supply and fan assemblies matches If the power supply or fan airflow direction does not match the FRU will fault Faulty fans can cause an increase in temperature Airflow direction can be ve...

Страница 159: ...move it from the chassis unless an FRU is available for replacement If the slot is left empty for an extended time period this could cause chassis air leakage and overheating NOTE Make sure that the captive screws securing fan assemblies to the chassis are tightened If they are not tightened high pressure from fan operation may unseat the fan from chassis connectors Fan Assembly Fault Indicators U...

Страница 160: ...ix functioning fans for operation If hot swapping a fan assembly be sure to have the replacement fan assembly ready to install before removing a faulty fan assembly and replace it as soon as possible NOTE If a fan assembly has failed do not remove it from the chassis unless an FRU is available for replacement If the slot is left empty for an extended time period chassis air leakage and overheating...

Страница 161: ... swap replacement 2 Perform one of the following steps If you need to power down the chassis to remove a fan assembly enter the sysShutdown command When command output indicates that the chassis has completed shut down remove power cords from all power supply assemblies If you can hot swap the fan assembly go on to the next step NOTE Replace fan as soon as possible to avoid overheating and eventua...

Страница 162: ...asks to verify operation of a fan assembly 1 Check the LED indicators on the fan assemblies The fan assemblies are located on the nonport side of the device The LED patterns may temporarily change during POST and other diagnostic tests For information on interpreting LED patterns see Interpreting Fan Assembly LEDs 2 Check the fan assembly status using the following commands fanShow Displays the st...

Страница 163: ... filler panel from a blade slot 1 Remove the chassis door 2 Pull out the spring loaded latch release on the latch at each end of the cover using your thumb and forefinger and slide the latches toward the center of the cover This action moves the latches away from the ends of the slot to unlatch the cover from chassis 3 Using the latch pull tabs as handles pull the filler panel out of the chassis I...

Страница 164: ...8 Director Hardware Installation Guide Figure 56 Removing and Installing the Blade Filler Panel on an X6 8 Director 1 Latch pull tab 2 Latch release 4 Reinstall the chassis door The door must be installed to meet EMI compliance 53 1004105 13 164 Broadcom ...

Страница 165: ...t comb to organize and route cables attached to blade ports The Brocade X6 8 Director can continue to operate while removing or installing the cable management comb Time and Items Required for Removal and Installation The replacement procedure for the cable management comb takes less than five minutes A No 1 Phillips screwdriver is required 53 1004105 13 165 Broadcom ...

Страница 166: ...b 2 Unscrew and save the four 4 screws that hold the comb to the device Support the comb to prevent it from falling 3 Remove the cable management comb Figure 57 Removing or Installing the Cable Management Comb Installing the Cable Management Comb Complete the following steps to replace the cable management comb 1 Position and tighten the four 4 screws to secure the cable management comb to the cha...

Страница 167: ...ted on a matching corner of the chassis Time and Items Required Removal and reinstallation should take less than 5 minutes Required for installation are the door assembly packaged separately from the chassis and ball studs for the door Ball studs are packaged with the door assembly The door assembly is packaged separately from the chassis Removing a Chassis Door Support the door to prevent it from...

Страница 168: ...l the door 1 Unfasten the bezel from the chassis mounting bracket by removing the two 6 32 X 3 8 in panhead Phillips screws securing the bezel to the bracket using a Phillips screwdriver One screw is located above the bracket and one beneath the bracket at bezel center Do not remove the bezel mounting bracket 1 from the chassis Save the bezel and screws for future installation Figure 59 Removing t...

Страница 169: ...llation Guide 2 Align the ball stud attachment holes located vertically on each side of the rear of door with the ball studs on each chassis mounting ear Push door onto chassis to snap onto the studs Figure 60 Removal and Replacement of the Chassis Door 53 1004105 13 169 Broadcom ...

Страница 170: ...transferred to the replacement chassis based on the license identification LID of the new preinstalled WWN card through the RMA process You should be provided a license for the new chassis through email If you have not received this contact your Brocade support representative Before beginning these procedures perform the following tasks Place the replacement chassis in close proximity to the old c...

Страница 171: ...aced Any of the following events might indicate the need to replace the chassis Visible mechanical damage to the chassis including damage to sheet metal or card guides that prevents the correct installation of a blade Bent or damaged connectors on the backplane the surface inside the chassis to which the blades connect One or more components such as a power supply blower assembly port blade contro...

Страница 172: ...ired by Technical Support Recording Critical Device and SAN Information instructs you to run the following commands and record specific output chassisShow configUpload all configupload vf fabricShow ipAddrShow sw license show for Fabric OS 9 0 and higher or licenseShow for Fabric OS versions earlier than 9 0 nsAllShow nsShow supportShow switchShow qsfp Before beginning replacement you must also pr...

Страница 173: ...e requested information at the prompts NOTE If you are using the Virtual Fabric feature run configupload vf before running the configupload command to save the logical switch configuration This configUpload all command uploads the device configuration to the customer defined FTP server making it available for downloading Alternatively you can save the configuration file to a USB device For more in...

Страница 174: ...fe80 60 69bc 63 1 cp 0 fe80 60 69bc 63 2 cp 1 fe80 60 69bc 63 1 cp 1 fe80 60 69bc 63 2 cp 1 fe80 60 69bc 63 3 5 Display and record the manufacturer serial numbers Enter chassisShow and then copy the command output into the config miscinfo txt file Factory Serial Num and Serial Num are listed under Chassis WWN Unit 1 and Chassis WWN Unit 2 If the current WWN cards are the original cards the factory...

Страница 175: ...1 2019 8 Enter supportShow then copy the command output into a text file named spptshow txt NOTE The supportShow command has a very long output and time for completion It may last 20 minutes or longer depending on the size of the SAN This command displays support information from groups of preselected Fabric OS and Linux commands Groups include os exception port fabric services security network po...

Страница 176: ...pplies and the power outlets 3 Remove the chassis door 4 Label the cables connected to all blades and record the connections For each connection identify the director slot and port the device connected and the slot or port on the connected device 5 Disconnect the cables from the transceivers in the extension port and core routing blades and set them aside For transceivers with integrated cables re...

Страница 177: ...is adequately secured to prevent it from becoming unstable or falling over 1 If the chassis is in a rack remove it from the rack 2 Place the chassis on a lift or on the shipping pallet provided with the original chassis and transport it to a storage location 3 Unpack the new chassis a Cut the bands that encircle the packaging b Open the top of the shipping box and remove the accessory kit the rack...

Страница 178: ...or filler panels Installing a Blade and Installing a Filler Panel 7 Replace the cable management comb 8 Replace the chassis door The door is required to meet EMI compliance See Installing a Chassis Door 9 Plug in the power cords from the power source into all installed power supplies to power on the device See Providing Power to the Device The device performs a power on self test POST The POST tak...

Страница 179: ...or serial session but the device must have an Ethernet connection to the server name or IP address of the host for the download process to complete For more information refer to the help configDownload command or the Brocade Fabric OS Command Reference Manual Complete the following steps to download the configuration 1 Log on to the device as admin switch admin login login admin password xxxxxxxx ...

Страница 180: ... of the System Complete the following steps to verify correct operation of the device 1 Log on to the device as admin switch admin login login admin password xxxxxxxx switch admin 2 Enter the chassisShow command to verify that the airflow direction set on WWN cards matches the airflow direction for fans in fan and power supply assemblies installed in the device The airflow direction of the fans an...

Страница 181: ...ow command This switchShow command displays the device and port status information switch15 admin switchshow switchName sw15 switchType 166 0 switchState Online switchMode Native switchRole Subordinate switchDomain 1 switchId fffc01 switchWwn 10 00 00 23 f8 f2 15 82 zoning ON MPR4k switchBeacon OFF FC Router OFF FC Router BB Fabric ID 128 Address Mode 0 Fabric Name BB1 HIF Mode OFF Index Slot Port...

Страница 182: ...m this section into a file You must be logged in with Admin privileges 1 Create an after process SAN profile by entering the following commands and copying the output to a text file named SANafter txt fabricShow lscfg show if using the Virtual Fabrics feature nsAllShow nsShow switchShow switch admin nsshow Type Pid COS PortName NodeName TTL sec N 020f00 3 10 00 00 01 73 00 29 46 10 00 00 01 73 00 ...

Страница 183: ...e active fabric where you are connecting the new chassis modify the policy to include the WWN of the new chassis Refer to the Brocade Fabric OS Administration Guide for information on SCC policy Use the wwn command to determine the WWN of the chassis Use the secPolicyAdd command to modify an existing policy 4 Resolve any issues or unintentional changes to the device or fabric If there are any mech...

Страница 184: ...ching bandwidth 2Tb s for FC32 64 64 ports x 32G data rate Chassis bandwidth Brocade X6 8 Director 20Tb s per chassis 512 ports with 32G data rate plus 32 4x32G ICLs X6 UltraScale ICL cables Brocade X6 UltraScale ICL cables connect UltraScale ICL ports over OM3 or OM4 optical cables in the following manner Brocade X6 4 32G FC 100m QSFPs require MPO 1 12 OM4 ribbon cable connectors and multimode ri...

Страница 185: ... zoning broadcast zoning Dynamic Path Selection DPS Extended Fabrics Fabric Vision FDMI FICON CUP Flow Vison Frame Redirection FSPF Integrated Routing IPFC ISL Trunking Management Server N_Port Trunking NPIV NTP v3 Port Fencing Registered State Change Notification RSCN Reliable Commit Service RCS Simple Name Server SNS syslog Virtual Fabrics logical switch logical fabric target driven zoning peer ...

Страница 186: ...cessor CP LED displaying two different states depending on active or standby status Unicolor bright white LED illuminates to indicate blade location beacon WWN card status Unicolor green LED displaying the power off and power on condition Unicolor amber fault LED Fan status Unicolor green LED displaying the power off and power on condition Unicolor amber LED displaying four different states based ...

Страница 187: ...sea level 0 to 3000m 10 000 feet 0 to 12 000m 40 000 feet Shock 10G 11 ms half sine wave 20G 11 ms half sine wave Vibration Random vibration is 5 10Hz 5dB Oct 10 200 Hz 0 0005 Grms 200 500 Hz 5dB Oct Scale 0 05 Grms Random vibration is 3 10Hz 5dB Oct 10 200 Hz 0 0065 Grms 200 500 Hz 5dB Oct Scale 1 12 Grms Air flow Brocade X6 8 maximum 1711 cmh 1007 cfm Brocade X6 8 nominal 985 cmh 580 cfm N A Ope...

Страница 188: ...y Model Name Configured Ports Input Connection Minimum Power Supplies for Operation Number of Power Supplies for Redundancy 100 120 VAC low line 2 3 N 1 100 120 VAC low line 2 4 N N Brocade X6 8 144 32G ports and QSFP ICLs 200 240 VAC high line 200 277 HVAC high line 240 380 HVDC 1 2 N N 100 120 VAC low line 3 Not supported 200 240 VAC high line 200 277 HVAC high line 240 380 HVDC 2 3 N 1 Brocade ...

Страница 189: ...rts using eight FC32 64 Fibre Channel port blades 384 E F D M and EX Fibre Channel ports using eight FC32 48 Fibre Channel port blades 32G SFP 64 E F D M and EX Fibre Channel ports using eight SX6 extension blades 384 E F D M and EX Fibre Channel ports using eight FC32 48 Fibre Channel port blades 16G SFP 64 E F D M and EX Fibre Channel ports using four SX6 extension blades 384 E F D M and EX Fibr...

Страница 190: ... 1M Transceiver Specifications Specification Standards Approval Description Class 1M Pass Radiation output and standards information 3 1 mW N A Max output of laser radiation N A N A Pulse duration 840 860 nm N A Emitted wavelength IEC 60825 1 2007 IEC 60825 2 A2 2010 Pass The name and publication date of the standard Serial Port Specifications Pinout RJ 45 Pin Number Signal Description 1 Not suppo...

Страница 191: ...mérique de la classe A est conforme à la norme NMB 003 du Canada CE Statement ATTENTION This is Class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures The standards compliance label on this device contains the CE mark which indicates that this system conforms to the provisions of the following European Co...

Страница 192: ...rmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at the user s own expense Germany Statement Machine noise information regulation 3 GPSGV the highest sound pressure level value is 68 2 dB A in accordance with EN ISO 7779 Maschinenlärminformations V...

Страница 193: ...ic environment radio disturbance might arise When such trouble occurs the user might be required to take corrective actions Regulatory Compliance Regulatory Compliance EMC 2014 30 EU AS NZS CISPR 32 Australia Class A CISPR 32 CNS 13438 EN 55024 EN 55032 Class A EN 55035 EN 61000 3 2 EN 61000 3 3 FCC Part 15 Subpart B Class A ICES 003 Canada KN 32 KN 35 VCCI 32 Japan Regulatory Compliance Safety 20...

Страница 194: ...battery directive 2011 65 EU Restriction of the use of certain hazardous substances in electrical and electronic equipment EU RoHS 2012 19 EU Waste electrical and electronic equipment EU WEEE 30 2011 TT BCT Vietnam circular 94 62 EC Packaging and packaging waste EU Section 1502 of the Dodd Frank Wall Street Reform and Consumer Protection Act of 2010 U S Conflict Minerals SJ T 11363 2006 Requiremen...

Страница 195: ... EN GARDE Si le voyant à DEL d un ventilateur indique une défaillance ou une panne de courant vérifiez que le ventilateur est bien logé dans le châssis et que les vis qui fixent le ventilateur au châssis sont bien serrées Si les vis sont desserrées la pression créée par les ventilateurs peut déplacer le ventilateur suffisament pour qu il se connecte du châssis PRECAUCIÓN Si el LED del montaje del ...

Страница 196: ... that the airflow direction of the power supply unit matches that of the installed fan tray The power supplies and fan trays are clearly labeled with either a green arrow with an E or an orange arrow with an I VORSICHT Vergewissern Sie sich dass die Luftstromrichtung des Netzteils der eingebauten Lüftereinheit entspricht Die Netzteile und Lüftereinheiten sind eindeutig mit einem grünen Pfeil und d...

Страница 197: ... side air vents VORSICHT Versuchen Sie nicht das Chassis über die Logo Blende anzuheben oder zu stützen welche über den portseitigen Luftauslässen angebracht ist MISE EN GARDE Ne tentez pas de soulever ou de soutenir le châssis par la plaque du logo qui est fixée sur les bouches d aération et située sur le côté des ports PRECAUCIÓN No intente levantar ni sostener el chasis sujetando el bisel del l...

Страница 198: ...Außerdem müssen bei allen Schraubverbindungen des Erdungskabels Drehsicherungen oder Sicherungsscheiben verwendet werden MISE EN GARDE Pour garantir la conformité de l installation d un dispositif Brocade à la norme NEBS utilisez un câble de mise à la terre d au moins 2 AWG Le câble de mise à la terre doit être muni d une cosse sertie homologuée fournie avec l appareil à une extrémité l autre extr...

Страница 199: ... MISE EN GARDE Tous les équipements dotés de sources d alimentation C A sont destinés à être installés uniquement dans des zones à accès réglementé Une zone à accès réglementé est une zone dont l accès n est possible qu au personnel de service qualifié utilisant un verrou une clé ou un outil spécial ou d autres moyens de sécurité PRECAUCIÓN Todos los dispositivos con fuentes de alimentación de cor...

Страница 200: ...hâssis par les poignées du ventilateur ou de l alimentation Ces poignées n ont pas été conçues pour supporter le poids du châssis PRECAUCIÓN Para prevenir daños al chasis y a los componentes nunca intente levantar el chasis usando las asas de la fuente de alimentación o del ventilador Tales asas no han sido diseñadas para soportar el peso del chasis Danger Notices A Danger statement indicates cond...

Страница 201: ... je schwerer desto tiefer darüber untergebracht werden DANGER Montez les dispositifs que vous installez dans un bâti aussi bas que possible Placez le dispositif le plus lourd en bas et le plus léger en haut en plaçant tous les dispositifs progressivement de bas en haut du plus lourd au plus léger PELIGRO Monte los instrumentos que instale en un bastidor lo más bajos posible Ponga el instrumento má...

Страница 202: ... elektronischen gefährdeten Bauelementen mit einem 1 Megaohm Reihenwiderstand ausgestattet sein DANGER Pour des raisons de sécurité la dragonne ESD doit contenir une résistance de série 1 méga ohm PELIGRO Por razones de seguridad la correa de muñeca ESD deberá contener un resistor en serie de 1 mega ohmio DANGER If the installation requires a different power cord than the one supplied with the dev...

Страница 203: ...nce requirements defined in 21 CFR Subchapter I and with IEC 60825 and EN60825 Optical products that do not comply with these standards might emit light that is hazardous to the eyes GEFAHR Verwenden Sie nur optische Transceiver die von Broadcom und die die Anforderungen gemäß FDA Class 1 Radiation Performance Standards in 21 CFR Unterkapitel I sowie IEC 60825 und EN60825 erfüllen Optische Produkt...

Страница 204: ...lation Guide Brocade X6 8 Director Hardware Installation Guide PELIGRO Radiacion de Laser No vea directamente con Instrumentos Opticos Clase 1M de Productos de Laser 警告レーザ放射光学器具で直接ビームを見ないことクラス１ M レーザ製品 53 1004105 13 204 Broadcom ...

Страница 205: ...sumption tables for all AC and HVAC HVDC power supplies in Technical Specifications for a director with FC32 64 blades installed 53 1004105 10 10 April 2018 Added information on the FC32 64 blade to Supported Hardware Modified bullets in Product Features to include the maximum external ports possible for a device if an FC32 64 blade is installed and support for Flexport and Fibre Channel over Ethe...

Страница 206: ...C Power Supplies Typical Configuration Power Consumption for AC Power Supplies Idle Configuration Power Consumption for AC Power Supplies Maximum Configuration Power Consumption for HVAC HVDC Power Supplies typical Configuration Power Consumption for HVAC HVDC Power Supplies Idle Configuration Power Consumption for HVAC HVDC Power Supplies Maximum Configuration Power Consumption Modules Data Port ...

Страница 207: ......

Результаты поиска

Содержание Brocade X6-8 Director

Отзывы:

Похожие инструкции для Brocade X6-8 Director

Бренды по названию

Популярные бренды

Broadcom Brocade X6-8 Director, Руководство по установке оборудования

Результаты поиска

Содержание Brocade X6-8 Director

Отзывы:

Похожие инструкции для Brocade X6-8 Director

Бренды по названию

Популярные бренды