background image

58

Mellanox Technologies



6  Troubleshooting

Problem Indicator

Symptoms

Cause and Solution

LEDs

System Status LED is blinking 
for more than 5 minutes

Cause: Mellanox Onyx (MLNX-OS) software did not 
boot properly and only firmware is running.
Solution: Connect to the system via the console port, 
and check the software status. You might need to contact 
an FAE if the Mellanox Onyx (MLNX-OS) software did 
not load properly.

System Status LED is red

Cause:

Critical system fault (CPU error, bad firmware)
Over temperature

Solution:

Check environmental conditions (room temperature)

Fan Status LED is red

Cause: Possible fan issue
Solution:

Check that the fan is fully inserted and nothing 
blocks the airflow
Replace the fan FRU if needed (possible in SN2700, 
SN2740 and SN2410 only)

PSU Status LED is red

Cause: Possible PSU issue

Solution:

Check/replace the power cable
Replace the PSU if needed (possible in SN2700, 
SN2740 and SN2410 only)

Summary of Contents for Spectrum SN2100

Page 1: ...20 2020 07 09 PM https docs mellanox com x Cw1p Mellanox Technologies Mellanox Spectrum 1U Switch Systems Hardware User Manual 10 25 40 50 100GbE Open Ethernet Switch Systems Models SN2700 SN2740 SN24...

Page 2: ...NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT INDIRECT SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCUREMENT...

Page 3: ...Telescopic Rail Kit 21 3 7 1 Removing the System from the Rack 24 3 8 SN2740 SN2410 Static Rail Kit 25 3 9 SN2100 SN2010 Side by Side Mounting Rail Kit 27 3 10 SN2100 SN2010 Static Single Switch Rail...

Page 4: ...Port LEDs 47 4 8 LED Notifications 47 4 8 1 System Status LED 48 4 8 2 Fan Status LED 50 4 8 3 Power Supply Status LEDs 51 4 8 4 Unit Identification LED 53 4 8 5 Bad Port LED 53 4 8 6 Port LEDs 54 4...

Page 5: ...ions 68 8 3 1 QSFP28 Pin Description 68 8 3 2 SFP28 Pin Description 71 8 3 3 RJ45 to DB9 Harness Pinout 72 8 3 4 RJ45 to RJ45 Harness 73 8 4 Disassembly and Disposal 73 8 4 1 Disassembly Procedure 73...

Page 6: ...Cumulus Linux User Guide This document contains information regarding the configuration and management of the Cumulus Linux software See https docs cumulusnetworks com display DOCS Open Network Insta...

Page 7: ...bE 1U Open Ethernet Switch with Mellanox Onyx MLNX OS 32 QSFP28 ports 2 Power Supplies AC x86 CPU Standard depth P2C airflow Rail Kit RoHS6 MSN2700 CS2FC Mellanox Spectrum 100GbE 1U switch w Cumulus L...

Page 8: ...SFP28 ports 8 QSFP28 ports 2 power supplies AC x86 dual core Short depth P2C airflow Rail Kit RoHS6 MSN2410 CB2R Mellanox Spectrum based 25GbE 100GbE 1U Open Ethernet switch with Mellanox Onyx MLNX OS...

Page 9: ...s AC x86 CPU short depth C2P airflow Rail Kit must be purchased separately 1 4 SN2010 Ordering Part Numbers OPN Marketing Description MSN2010 CB2F Mellanox Spectrum based 25GbE 100GbE 1U Open Ethernet...

Page 10: ...a fully certified and interoperable design speeds up time to service and RoI The systems introduce hardware capabilities for multiple tunneling protocols that enable increased reachability and scalabi...

Page 11: ...00 Rear View SN2010 Rear View 2 1 Speed and Switching Capabilities The table below describes maximum throughput and interface speed per system model System Model 10 25GbE SFP28 Interfaces 40 50 56 100...

Page 12: ...ces PSUs and Fans The table below lists the various management interfaces PSUs and fans per system model System Model USB MGT Console PSU Fan SN2700 Rear Rear 2 ports Rear 2 units 4 units SN2740 Front...

Page 13: ...the installation please review the safety warnings Note that not all warnings may apply to all models Safety Warnings English Installation Instructions Read all installation instructions before conne...

Page 14: ...y other equipment If the chassis falls it can cause bodily injury and equipment damage Redundant Power Supply Connection Electrical Hazard This product includes a redundant power or a blank in its pla...

Page 15: ...sted and CSA Certified Power Supply Cord For North American power connection select a power supply cord that is UL Listed and CSA Certified 3 conductor 16 AWG terminated with a molded plug rated at 12...

Page 16: ...les Air Flow Direction Marking Power Side Inlet to Connector Side Outlet Connector front side inlet to power side outlet marked with red power supplies fans FRUs handles Air Flow Direction Marking Con...

Page 17: ...9 System Mounting Options By default the SN2700 systems are shipped with the static rail kit described SN2700 Static Rail Kit The SN2410 and SN2740 systems are shipped with the static rail kit describ...

Page 18: ...how to place the system consider the two installation options shown in the figure below and review the following points Make sure the system air flow is compatible with your installation selection It...

Page 19: ...A to the switch by gently pushing the switch chassis pins through the slider key holes until locking occurs Secure the chassis in the rails by screwing 2 flat head Phillips screws E in the designated...

Page 20: ...rack 4 cage nuts in the non extractable side in the top and bottom holes only and 4 cage nuts in the extractable side Installing the Cage Nuts While your installation partner is supporting the system...

Page 21: ...not remove them yet Loosen the screws attaching the blades to the rack and pull the blades towards you while your partner is holding the system Extract the loosened screws from Step 2 and dismount the...

Page 22: ...from rail C by pushing it outside from the rear part of the assembly To allow complete separation of rail A from rail C press the quick release latch Rails Separation Before mounting the system to the...

Page 23: ...ctable side and 6 cage nuts in the extractable side Installing the Cage Nuts Mount both of the outer rails C D into the rack as illustrated below and use 8 standard pan head screws E to fix them to th...

Page 24: ...from the Rack To remove a unit from the rack Turn off the system and disconnect it from peripherals and from the electrical outlet Unscrew the two M6 screws securing the front of the inner rails ears...

Page 25: ...ST 6 32 X 1 4 screw with around patch D Other threads are available by special order M5 10 32 12 24 G type cage nut is available by special order Rack Rail Kit Parts Prerequisites Before mounting the...

Page 26: ...thin the rack or in case more space is needed for cable bending radius it is possible to recess the connector side or the FRU side by 3 5 8 9 cm by optional placement of the system s rails The FRU sid...

Page 27: ...the blades into the rack Do not tighten the screws yet Sliding the Blades in the Rails Secure the system in the rack by tightening the 8 screws inserted in Step 3 and Step 4 with a torque of 4 5 0 5...

Page 28: ...stall two systems The 2 system metal frame will fit into racks with from 23 6 600mm to 31 5 800mm space between the vertical supports You may choose to install your system in the right or in the left...

Page 29: ...er hand to secure the blades to the chassis Screw the right blade with eight 4 40 flathead screws and the left blade with seven 4 40 flathead screws The recommended torque is 0 49 0 54 Nm Attach the B...

Page 30: ...three cage nuts in the front part of each cabinet post and two cage nuts in the rear part of each cabinet post Installing the Cage Nuts Attach the frame to the rack by using ten spacer cage nuts and...

Page 31: ...10 Static Single Switch Rail Kit Kit OPN Rack Size and Rack Depth Range MTEF KIT E Rack installation static kit for SN2100 SN2010 systems short depth 1U half width switches allows installation of a si...

Page 32: ...to the system s sides using 8 flat head 4 40 screws A in each side Attaching the Brackets to the System s Sides Install 8 cage nuts of the relevant type square or round holes according to your rack t...

Page 33: ...corresponding to each data port will light when the physical connection is established When a logical connection is made the relevant port LED will turn on To remove a cable disengage the locks and sl...

Page 34: ...34 Mellanox Technologies SN2010 SFP Cable Orientation SN2740 Cable Orientation SN2410 Cable Orientation...

Page 35: ...nterconnect_overview 3 11 1 2 Using Splitter Breakout Cables with Cumulus Linux If you are using 4x10G direct attach copper cables or active optical cables edit the etc cumulus ports conf to enable su...

Page 36: ...ts 50 52 54 56 gray are blocked when the upper ports are in split mode 3 11 1 5 SN2100 Splitting Options All QSFP28 ports are splittable Each port can be split into 4xSFP28 10 25G or 2xQSFP28 50G port...

Page 37: ...the figures below For more information refer to LED Notifications System Status LEDs 5 Minutes After Power On in SN2700 System Status LEDs 5 Minutes After Power On in SN2740 System Status LEDs 5 Minu...

Page 38: ...example HyperTerminal minicom or Tera Term on your host PC with the settings described in the table below Once you perform that you should get the CLI prompt of the system Serial Terminal Program Con...

Page 39: ...or not If you enter no no Zeroconf you must enter a static IP and the session will continue Step 3 Enable IPv6 yes The management interface will be able to use IPv6 addresses If you enter no no IPv6 y...

Page 40: ...p 6 Default gateway for example 192 168 10 1 10 10 10 255 Step 7 Primary DNS server Step 8 Domain name Step 9 Enable IPv6 yes Step 10 Enable IPv6 autoconfig SLAAC on mgmt0 interface no Step 11 Admin p...

Page 41: ...queue len 1000 switch01 config Step 6 Check the software version embedded in your system using the command show version Compare this version to the latest version that can be retrieved from Mellanox s...

Page 42: ...Linux uses the OpenSSH package to provide SSH functionality To securely access a Cumulus Linux switch remotely please follow the instructions on the SSH for Remote Access page in the Cumulus Linux Us...

Page 43: ...e with your right hand push the latch release with your thumb while pulling the handle outward As the fan unit unseats the fan unit status LEDs will turn off Remove the fan unit To insert a fan unit M...

Page 44: ...44 Mellanox Technologies...

Page 45: ...nox QSFP28 to SFP28 Dynamix QSA adapters hybrid or split cables The systems offer support of up to 3 5W transceivers in all QSFP28 ports and support of up to 1 5W in all SFP28 ports Some QSFP28 ports...

Page 46: ...the command speed under interface configuration mode Refer to the Mellanox Onyx MLNX OS User Manual for instructions on port speed re configuration 4 3 RS232 Console The port labeled Console is an RS...

Page 47: ...assword push the reset button and keep it pressed for at least 15 seconds When using a Mellanox Onyx MLNX OS based system this should allow you to enter without a password and set a new password for t...

Page 48: ...Off Unit Identifier LED Lights up on command through the CLI Off or blue when identifying a port a There are two PSU LEDs in SN2100 SN2010 b This LED does not exist in SN2740 4 8 1 System Status LED B...

Page 49: ...There are no LEDs in the rear panel of SN2100 System Status LED in SN2010 The LED in the read oval is located on the front panel of SN2010 There are no LEDs in the rear panel of SN2010 System Status...

Page 50: ...after starting the system unplug the system and call your Mellanox representative for assistance 4 8 2 Fan Status LED Fan Status LED in SN2700 Front and Rear Sides Both of these LEDs in the red ovals...

Page 51: ...unit is missing or not operating properly The fan unit should be replaced Off System boot N A 4 8 3 Power Supply Status LEDs Power Status LED The table above Fan Status Rear LED Assignments One LED pe...

Page 52: ...00 SN2740 and SN2410 LED Behavior Description Action Required Solid Green All plugged one or two power supplies are running normally N A Solid Red PSU is faulty or disconnected Make sure the AC cable...

Page 53: ...ly continues to operate high temp high power high current slow fan Call your Mellanox representative for assistance Off No AC power to all power supplies Call your Mellanox representative for assistan...

Page 54: ...ated by four LEDs as shown in the picture above While the bottom LEDs signify the port status in regular condition the upper LEDs operate only when the port is split When one port is split to two a co...

Page 55: ...Information The system s inventory parameters such as Serial Number Part Number GUID and MAC address can be extracted from the inventory pull out tab on the lower right side of the front panel In som...

Page 56: ...56 Mellanox Technologies SN2100 Pull out Tab SN2010 Pull out Tab...

Page 57: ...website If you do not have the latest revision upgrade your software using the CLI or the GUI Copy the updated software to a known location on a remote server within the user s LAN For further informa...

Page 58: ...he Mellanox Onyx MLNX OS software did not load properly System Status LED is red Cause Critical system fault CPU error bad firmware Over temperature Solution Check environmental conditions room temper...

Page 59: ...ot this image or any other key for boot menu Booting default image in 3 seconds Boot Menu 0 SX_X86_64 SX_3 4 0008 2014 11 10 20 07 51 x86_64 1 SX_X86_64 SX_3 4 0007 2014 10 23 17 27 34 x86_64 Use the...

Page 60: ...peed 10 25 40 50 56 100GbE per port Connector cage 32 QSFP28 Environmental Temperature Operational 0 to 40 C Non Operational 40 to 70 C Humidity Operational 10 85 non condensing Non Operational 10 90...

Page 61: ...Spectrum Memory 8GB DDR3 RAM 32G SSD for systems based on Switch rev B1 and earlier 8GB DDR3 RAM 16G SSD for systems based on Switch rev B2 and higher Throughput 6 4Tb s 7 2 SN2740 Series Feature Val...

Page 62: ...g 2W per port 266W 100GbE Models Typical power with passive cables ATIS 140 4W Max power with optical cables assuming 3 5W per port 335W Main Devices CPU Intel x86 2 40GHz Quad Core PCIe 4x Gen2 0 Swi...

Page 63: ...48VDC Input voltage 40 72 VDC Global Power Consumption 40GbE Models Typical power with passive cables ATIS 165W same as the 100GbE models Max power with optical cables assuming 2W per each QSFP28 port...

Page 64: ...e 3050m Noise level 73 7 dB A Regulatory Safety EMC CB cTUVus CE CU S_Mark CE FCC VCCI ICES RCM BSMI KCC CCC RoHS RoHS complaint Power Input Voltage 100 127VAC 50 60Hz 4 5A 200 240 50 60Hz 2 9A Global...

Page 65: ...orts of 40 100GbE Environmental Temperature Operational 0 to 40 C Non Operational 40 to 70 C Humidity Operational 10 85 non condensing Non Operational 10 90 non condensing Altitude 3050m Noise level 7...

Page 66: ...66 Mellanox Technologies Feature Value Switch Mellanox Spectrum Memory SDRAM 8GB DDR3L 1600 MT s SO DIMM Storage 16GB Dual Channel MLC M 2 SATA SSD Throughput 1 7Tb s...

Page 67: ...be mounted into short depth racks SN2410 SN2740 MTEF KIT SP Rack installation kit for 1U wide systems to be mounted into standard depth racks SN2410 SN2740 Included in the SN2410 and SN2740 packages...

Page 68: ...nor lead to any action by hardware such as switch shutdown Critical 120 C When the ASIC device crosses this temperature the switch firmware will automatically shut down the device Emergency 130 C In...

Page 69: ...ule Reset 10 Vcc Rx 3 3 V Power supply receiver 11 SCL 2 wire serial interface clock 12 SDA 2 wire serial interface data 13 GND Ground 14 Rx3p Connected to Port 3 lane Tx Non Inverted Data 15 Rx3n Con...

Page 70: ...ModPrsL Module cable Present 28 IntL Interrupt 29 Vcc Tx 3 3 V Power supply transmitter 30 Vcc 1 3 3 V Power Supply 31 LPMode Low Power Mode 32 GND Ground 33 Tx3p Connected to Port 3 lane Rx Non Inve...

Page 71: ...e Description Note 1 VeeT Module Transmitter Ground 2 TX_Fault Module Transmitter Fault a 3 TX_Disable Transmitter Disable Turns off transmitter laser output b 4 SDA 2 wire Serial Interface Data Line...

Page 72: ...utput which should be pulled up with a 4 7k 10k Ohms resistor on the host board if intended for use Pull up voltage should be between 2 0V to Vcc 0 3V A high output indicates a transmitter fault cause...

Page 73: ...the switch serial port with the terminal server console server 8 4 Disassembly and Disposal 8 4 1 Disassembly Procedure To disassemble the system from the rack Unplug and remove all connectors Unplug...

Page 74: ...ould be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way Follow the instructions fou...

Page 75: ...8 2 5 Migrated to online format minor reorganization October 2018 2 4 Updated High Power LR4 Transceivers Support in the Interfaces chapter August 2018 2 3 Added Static Single Switch Rail Kit for SN21...

Page 76: ...ng Information Side by Side Mounting for SN2100 SN2010 Rail Kit May 2016 1 3 Added SX1012 to the following sections Introduction to Mellanox SN2000 Spectrum Ethernet Switch Systems Installation Interf...

Reviews: