background image

©Copyright Lenovo 2015

1

Chapter

1

Lenovo Flex System EN4023 10Gb Scalable Switch

The Lenovo Flex System EN4023 10Gb Scalable Switch is a high-density, 64-port, 10-Gbps 
Ethernet switch that is used in the Lenovo Flex System chassis. The switch provides 42 internal 
ports to compute nodes by way of the midplane, and 14 external SFP+ ports that are capable of 
running 10-Gbps Ethernet and 4-Gbps, 8-Gbps, and 16-Gbps Fibre Channel. Also included are two 
external Quad SFP (QSFP) ports that can support 40-Gbps Ethernet or 4x10-Gbps Ethernet in 
breakout mode.

This 

User’s Guide

 contains information and instructions for installing the switch and getting the 

switch up-and-running as quickly as possible. See the 

Lenovo Flex System Installation and Service 

Guide

 that comes with your Lenovo Flex System chassis to install the switch in the chassis; then, 

return to this 

User’s Guide

 for the information and instructions needed to complete the installation.

For information about the types of compatible devices available for Lenovo products, contact your 
Lenovo marketing representative or authorized reseller. For a list of supported optional devices, 
see 

http://www.ibm.com/servers/eserver/serverproven/compat/us/

For the most up-to-date product documentation for all of your Lenovo Flex System products, go to 
the Lenovo Flex System Information Center at: 

http://pic.dhe.ibm.com/infocenter/flexsys/information/index.jsp

NOTES:

The Lenovo Flex System EN4023 10Gb Scalable Switch is also referred to as “the switch” 
throughout this document.

Changes are made periodically to the Lenovo

®

 website. Procedures for locating firmware and 

documentation might vary slightly from what is described in this document.

The illustrations in this document might differ slightly from your hardware.

The screens that are described or referenced in this document might differ slightly from the 
screens that are displayed by your system. Screen content varies according to the type of 
Lenovo Flex System chassis, and the firmware versions and options that are installed.

Related documentation

This 

User’s Guide 

contains setup and installation instructions for the Lenovo Flex System EN4023 

10Gb Scalable Switch and general information about the switch, including how to configure, 
update, and troubleshoot the switch, as well as how to get help. For the most up-to-date product 
documentation for all of your Lenovo Flex System products, go to the Lenovo Flex System 
Information Center at the following location: 

http://pic.dhe.ibm.com/infocenter/flexsys/information/index.jsp

Summary of Contents for Flex System EN4023

Page 1: ...Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide ...

Page 2: ......

Page 3: ...Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide ...

Page 4: ...ion and Environmental Notices and User Guide documents on the Lenovo Notices for Network Devices CD and the Warranty Information document that comes with the product Sixth Edition April 2015 Copyright Lenovo 2015 US Government Users Restricted Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp ...

Page 5: ...tions and specifications 6 Switch components 7 Product name and serial number 8 Chapter 2 Installing the Switch Installation guidelines 9 System reliability guidelines 9 Handling static sensitive devices 10 Installing the switch 10 Installing and removing an SFP or QSFP transceiver 13 Installing a FC SFP 14 Handling an SFP or QSFP transceiver 15 Inserting an SFP or QSFP transceiver 16 Removing or ...

Page 6: ...the configuration 33 Resetting the switch to factory defaults 34 Removing or replacing the switch 35 Chapter 3 Updating the Firmware Determining the switch firmware level 37 Determining firmware from the CMM 37 Determining firmware from the switch using the CLI 37 Upgrading the switch firmware 38 Chapter 4 Solving Problems Running POST 41 POST errors 41 Parts listing 42 Appendix A Getting Help and...

Page 7: ... Copyright Lenovo 2015 vii Safety ...

Page 8: ...viii Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide ...

Page 9: ...ix Safety statements Safety statements ...

Page 10: ...x Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide Safety statements ...

Page 11: ...xi Safety statements Class 1 Laser Product Laser Klasse 1 Laser Klass 1 Luokan 1 Laserlaite Appareil A Laser de Classe 1 ...

Page 12: ...xii Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide UL Regulatory Information UL Regulatory Information This device is for use only with Listed Lenovo Flex System Enterprise Chassis ...

Page 13: ...rvers eserver serverproven compat us For the most up to date product documentation for all of your Lenovo Flex System products go to the Lenovo Flex System Information Center at http pic dhe ibm com infocenter flexsys information index jsp NOTES The Lenovo Flex System EN4023 10Gb Scalable Switch is also referred to as the switch throughout this document Changes are made periodically to the Lenovo ...

Page 14: ...ontain detailed information about installing configuring updating and troubleshooting specific Lenovo Flex System network devices which include network switches pass thru switches and adapters Environmental Notices and User Guide This document is provided on the Lenovo Notices for Network Devices CD and it contains translated environmental notices Safety Information This document is provided on th...

Page 15: ...luding up to 14 External Flex Ports that can operate at 8 Gbps and 16 Gbps Fibre Channel Up to 42 internal ports connected up to 28 compute nodes at the midplane auto negotiating to 10 Gbps Ethernet available through Ports On Demand activation or 16 Gbps and 8 Gbps Fibre Channel using 8 Gbps or 16 Gbps transceivers Up to 14 External Ports capable of supporting 1 Gbps Ethernet or 10 Gbps Ethernet t...

Page 16: ... a wide range of value added applications for example virtualization features that are distributed throughout a fabric and multitenancy features Requires Network OS version 4 0 0_bbd or later Supports Lenovo Features on Demand Supports Ports on Demand POD SNMP v1 v2 and v3 support SSH v2 support NTP client support NTP V3 SCP and SFTP support for firmware upgrades SNMP MIB monitoring functionality ...

Page 17: ...e the external SFP ports as Ethernet ports or as Fibre Channel FC ports Qualified 10 GbE SFP transceivers 8 Gbps FC transceivers or 16 Gbps FC transceivers must be installed in ports to allow Ethernet or FC configuration When configuring a mixture of Ethernet and FC ports in a port group you can configure mixtures of speeds and protocols as follows 2 Gbps 4 Gbps and 8 Gbps FC and 1 10 Gbps Etherne...

Page 18: ...ental conditions and specifications that are supported by the system TABLE 2 Switch specifications Characteristic Description Height 30 7 mm 1 21 inches Width 299 3 mm 11 78 inches Depth including ejectors 310 6 mm 12 23 inches Weight 3 59 Kg 7 91 pounds TABLE 3 Memory and processor specifications Memory type Value P3041 Quad core CPU Onboard 4 e500mc cores up to 1 5 GHz DDR3 SDRAM Bus 8 GB runnin...

Page 19: ...enovo Flex System EN4023 10Gb Scalable Switch ports as 1 10 GbE or 2 4 8 or 16 Gbps FC ports FlexPort is supported by Network OS 5 0 0 and later FIGURE 1 Components of the Lenovo Flex System EN4023 10Gb Scalable Switch 1 Release levers x2 5 RJ 45 Ethernet port Mgmt 2 Port LEDs Fault and activity for each port 6 System LEDs 3 QSFP ports 7 Ethernet Mgmt port LEDs 4 Mini USB console port 8 14 externa...

Page 20: ...odule CMM For more information see Chapter 2 Installing the Switch Product name and serial number Record information about the switch in Table 4 The product name and serial number are on the identification label on the bottom cover of the switch The Media Access Control MAC address is on a label located on the top handle of the switch You will need this information when you register the switch wit...

Page 21: ...de or chassis indicates that the component can be hot swapped which means that if the chassis and operating system support hot swap capability you can remove or install the component while the chassis is running Orange can also indicate touch points on hot swap components See the instructions for removing or installing a specific hot swap component for any additional procedures that you might have...

Page 22: ... on any other grounded rack component in the rack in which you are installing the device for at least two seconds This drains static electricity from the package and from your body Remove the device from its package and install it directly into the chassis without setting down the device If it is necessary to set down the device put it back into its static protective package Do not place the devic...

Page 23: ...ps 8 Gbps or 16 Gbps FC ports depending on installed SFP transceivers Refer to FlexPort on page 5 for more information FlexPort is supported by Network OS 5 0 0 and later Configuration requirements for the switch and chassis might vary For the most up to date product documentation for all of your Lenovo Flex System products go to the Lenovo Flex System Information Center at http pic dhe ibm com in...

Page 24: ... operating correctly The POST takes approximately 5 minutes to complete During POST the switch LEDs will go through a lamp test When the switch has completed POST all LEDs except the OK LED will power off and follow normal operation Refer to Locating the information panel LEDs and external ports on page 20 for more information NOTE To maintain proper airflow make sure the ventilation holes on the ...

Page 25: ... required by the switch For additional information about cabling the switch see Installing and removing an SFP or QSFP transceiver on page 13 and the documentation that comes with the cables and the optional network devices to which the cables have been connected For the locations of the connectors on the chassis see the documentation that comes with the chassis Installing and removing an SFP or Q...

Page 26: ...rrectly to the port Insert the transceiver into the port until it is firmly seated and the latching mechanism clicks then close the bail The 16 Gbps SFP transceivers do not have bails Use the pull tab on the 16 Gbps SFP transceivers to help push the transceiver into the port Do not push too hard on the tab itself because it can bend Transceivers are keyed so that they can only be inserted with the...

Page 27: ...ntegral guide key that is designed to prevent you from inserting the transceiver incorrectly Use minimal pressure when you insert the transceiver into the port Forcing the transceiver into the port can cause damage to the transceiver or the switch port You can insert or remove the transceiver while the chassis is powered on You must first insert the transceiver into the port before connecting the ...

Page 28: ... is extended or become pinched when the device is retracted Route the cable away from places where it can be snagged by other devices in the rack Do not overtighten the cable straps or bend the cables to a radius of less than 38 mm 1 5 in Do not put excess weight on the cable at the connection point Make sure the cable is well supported Class 1 Laser Product Laser Klasse 1 Laser Klass 1 Luokan 1 L...

Page 29: ... until it clicks into place a For SFP transceivers use ports 43 through 56 See Figure 7 b For QSFP transceivers use ports 57 and 58 See Figure 8 ATTENTION To avoid damage to the cable or transceiver make sure you install the transceiver before you connect the fiber optic cable FIGURE 7 SFP transceiver installation FIGURE 8 QSFP transceiver installation 6 Connect the fiber optic cable to the SFP or...

Page 30: ...ng the lever in a downward motion 5 Place the SFP or QSFP transceiver in a static protective package 6 Insert another SFP or QSFP transceiver into the port See Inserting an SFP or QSFP transceiver on page 16 Cabling the switch This section provides instructions for connecting and disconnecting the cables to the physical ports on the Lenovo Flex System EN4023 10Gb Scalable Switch Connecting and dis...

Page 31: ...RJ 45 Ethernet cable The RJ 45 Ethernet cable can be connected to the RJ 45 port located on the front panel To connect the RJ 45 connector to the switch push the connector into the port connector until it clicks into place as shown in Figure 10 FIGURE 10 RJ 45 Ethernet connection To disconnect the RJ 45 Ethernet cable grasp the connector and gently pull the cable from the switch ...

Page 32: ...ystem EN4023 10Gb Scalable Switch ports as 1 10 GbE or 2 4 8 or 16 Gbps FC ports FlexPort is supported by Network OS 5 0 0 and later FIGURE 11 Lenovo Flex System EN4023 10Gb Scalable Switch information panel LEDs and port groups 1 Tx Rx LED One LED per port 6 System Status LED Locator 2 Fault LED One LED per port 7 System Status LED Fault 3 Ethernet LED Tx Rx activity 8 Trunk Group C shown as port...

Page 33: ...s of Ethernet activity The Ethernet RJ 45 management port has separate link and activity LEDs In addition to the LEDs the information panel is divided into three different groups Group A Group B and Group C These groups support the ability to group trunk ports A trunk port is a set of individual ports that are grouped collectively to simulate a single port with much faster data transmission The ab...

Page 34: ...CMM to ensure that the switch is operating correctly For more information see the documentation for the chassis For more information refer to the following sections SFP and QSFP port LEDs on page 22 Ethernet port status LEDs on page 23 System status LEDs on page 24 SFP and QSFP port LEDs Each SFP and QSFP port has two LEDs The Tx Rx LED is green when lit the Fault LED is amber when lit When lit LE...

Page 35: ... When a link is established the Link LED appears as a steady green light When there is activity the Link LED appears as a flashing green light The Tx Rx LED appears as a steady green light when lit which indicates a port speed of 100 1000 Mbps If the Tx Rx LED is not lit port speed is 10 Mbps NOTE Do not attach any devices to the RJ 45 connector other than a compatible cable 1 Tx Rx LED 2 Fault LE...

Page 36: ...Figure 15 During power on self test POST the switch performs internal tests and LED tests During POST the LEDs are lit intermittently After POST is successfully completed the LEDs will behave as described in Table 7 and Table 8 1 Tx Rx LED 2 Link LED TABLE 6 RJ 45 Ethernet port status LEDs Status LED Description Ethernet Link LED green No light There is no link Steady green There is a link Flashin...

Page 37: ...ption The left most LED is the Power LED When lit it appears solid green The middle LED is the Location LED When lit it appears solid blue The right most LED is the Fault LED When lit it appears solid amber TABLE 8 System status LEDs functionality Condition Power LED Green Location LED Blue Fault LED Amber Comments Pre POST Off Off Off Power off POST start First 1 3 seconds on then blinking during...

Page 38: ...iguring the switch Configuring the switch requires that you first assign an IP address to the switch which must be done from the Chassis Management Module CMM using the CLI or GUI After the IP address is assigned you then connect to the switch over SSH to define configuration settings To log in to the CMM see the Lenovo Flex System Chassis Management Module User s Guide Configuring an IP address o...

Page 39: ... Step 2 from the switch serial console you can see the newly configured IP address on the switch 7 From the CMM enter ifconfig to confirm that the new IP address has been applied See Figure 17 FIGURE 17 Verifying the IP address using the CMM CLI 8 Use SSH to open a session to the switch using the newly configured IP address Log in to the switch using the following default user name and password se...

Page 40: ... 2 Log in to the CMM using the following default user name and password settings User ID USERID Password PASSW0RD wherein the sixth character is a zero 3 From the CMM GUI navigate to Chassis Management Component IP Configuration 4 Select the I O Module bay in which the switch is installed The example in Figure 18 is using IO Module 3 The IP Address Configuration IO Module for the selected bay dial...

Page 41: ...following default user name and password settings User ID USERID Password PASSW0RD wherein the sixth character is a zero 3 From the CMM GUI navigate to Chassis Management Component IP Configuration 4 Select the I O Module bay in which the switch is installed The example in Figure 19 is using IO Module 3 The IP Address Configuration IO Module for the selected bay dialog box displays 5 Select the IP...

Page 42: ...n use the SSH program from an external management station or the CMM to access and control the switch The management station and the switch must be on the same IP subnet If you have to obtain the IP address for the switch or establish a network connection contact your system or network administrator To connect to the switch over the SSH interface complete the following steps 1 Open an SSH connecti...

Page 43: ... is not available or not functional Only one of the two Ethernet management ports can be enabled at any given time enabling the RJ 45 Ethernet port will disable the internal management port Any changes made to enable the RJ 45 Ethernet interface are temporary and require a root password NOTE The switch will default to using the internal management port with a switch reboot Refer to the Technical S...

Page 44: ...and user and these accounts are associated with the corresponding admin and user roles in the switch local user database Only the admin and user users can access the CLI and except for the account password no other attributes can be changed for the default users admin and user By default all account information is stored in the switch local user database User authentication and tracking of logins ...

Page 45: ...cking up the configuration Prior to backing up a switch configuration you can check the switch configuration by initiating the show running config and show startup config commands Complete these steps to back up the switch configuration to an FTP server 1 Open an SSH session to the switch 2 Upload the configuration file to an FTP SCP or SFTP server The example in Figure 20 is using an FTP server F...

Page 46: ... a configuration refer to the Network OS Administrator s Guide For detailed information about the commands used in backing up a configuration refer to the Network OS Command Reference Resetting the switch to factory defaults ATTENTION Restoring the switch to factory defaults is disruptive Before doing so save the switch configuration Use the Lenovo Chassis Management Module CMM to reset the switch...

Page 47: ...or the locations of the connectors on the chassis see the documentation that comes with the chassis 3 Pull the release latches out from the switch as shown in Figure 2 on page 12 The switch moves out of the bay approximately 0 6 cm 0 25 inch 4 Slide the switch out of the bay and set it aside 5 Replace the removed switch with either another switch or a filler panel You must complete this step withi...

Page 48: ...36 Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide Managing the switch 2 ...

Page 49: ...ware information using multiple methods through the Lenovo Chassis Management Module CMM or from the switch using the CLI Determining firmware from the CMM 1 Log in to the CMM as described in the Lenovo Flex System Chassis Management Module User s Guide If necessary obtain the IP address of the CMM from your system administrator The login window opens 2 From the Monitors menu click Firmware VPD Th...

Page 50: ...S EN4023 Updates nos4 0 0_bbd nos4 0 0_bbd_rel_123 dist rele ase plist Protocol ftp scp sftp ftp User admin Password Reboot system after download y n n Do Auto Commit after Reboot y n yes Performing system sanity check Do you want to continue y n y Checking conditions for downloading to 4 0 0 You are running firmware download with auto reboot disabled After firmware is downloaded please reboot the...

Page 51: ...4 100 Done install Package All packages have been downloaded successfully The command has completed successfully EN4023 EN4023 NOTE If you are downloading firmware to the switch and you log in to the FTP server as an anonymous user anonymous is the user name the Network OS requires that you enter text to represent a password ...

Page 52: ...40 Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide Upgrading the switch firmware 3 ...

Page 53: ...xternal ports on page 20 POST errors Two types of errors can result noncritical and critical A noncritical error applies to one port and the switch is operational You can continue to operate the switch however you must replace it as soon as possible When critical errors occur the switch does not operate To view POST results complete the following steps 1 Log in to the CMM as described in the Lenov...

Page 54: ...orted components go to the Lenovo Server Proven website at http www 03 ibm com systems info x86servers serverproven compat us flex html TABLE 12 Error listing Diagnostic indicator in hex Failing functional area Failure criticality 00 7F Base internal functions Critical 80 9F Internal interface failures Noncritical A0 AF External interface errors Noncritical B0 FE Reserved Noncritical FF Switch goo...

Page 55: ... Copyright Lenovo 2015 43 Appendix A Getting Help and Technical Assistance ...

Page 56: ...44 Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide Before you call A Before you call ...

Page 57: ...Getting Help and Technical Assistance 45 Using the documentation A Using the documentation Getting help and information from the World Wide Web ...

Page 58: ...46 Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide Software service and support A Software service and support Hardware service and support ...

Page 59: ...Getting Help and Technical Assistance 47 IBM Taiwan product service A IBM Taiwan product service ...

Page 60: ...48 Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide IBM Taiwan product service A ...

Page 61: ... Copyright Lenovo 2015 49 Appendix B Notices ...

Page 62: ...50 Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide Trademarks B Trademarks ...

Page 63: ...Notices 51 Important notes B Important notes ...

Page 64: ...enovo Flex System EN4023 10Gb Scalable Switch User s Guide Important notes B Electronic emission notices Federal Communications Commission FCC statement Industry Canada Class A emission compliance statement ...

Page 65: ...Notices 53 Important notes B Australia and New Zealand Class A statement ...

Page 66: ...54 Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide Important notes B European Union EMC Directive conformance statement Germany Class A statement ...

Page 67: ...Notices 55 Important notes B Japan VCCI Class A statement ...

Page 68: ... Switch User s Guide Important notes B Korea Communications Commission KCC statement Russia Electromagnetic Interference EMI Class A statement People s Republic of China Class A electronic emission statement Taiwan Class A compliance statement ...

Page 69: ...tion backing up 33 initial 32 resetting 34 configuring the switch using CLI 26 using GUI 28 using SSH 30 console port 4 CPU 6 critical errors 41 D dimensions 6 documentation additional 1 2 DPOD 5 Dynamic ports on demand 5 E environmental specifications 6 error codes 41 errors critical and noncritical 41 Ethernet internal ports 4 ethernet cabling 19 Ethernet mgmt port 7 ethernet port external 31 in...

Page 70: ... 45 23 24 RJ 45 port 21 SFP 23 switch status 21 system 4 system status 24 25 Lenovo documentation 1 licenses POD1 4 POD2 4 M memory 6 memory specifications 6 Mgmt port 7 mini USB console port 18 N network adapter requirements 10 Network OS 4 noncritical errors 41 notes important 51 P physical characteristics 6 port LEDs 7 port maps 26 POST 12 41 errors 41 power on self test 12 processor 6 processo...

Page 71: ...vironmental 6 memory 6 processor 6 switch 6 SSH access 30 SSH access 30 static sensitive devices handling 10 switch components 7 switch components 7 switch management 8 switch module physical dimensions 6 weight 6 switch specifications 6 system LEDs 7 system status LEDs 24 25 T transceivers QSFP 13 17 SFP 13 SFP ports 17 U upgrading firmware 37 USB cabling 18 USB cable connecting 18 W weight switc...

Page 72: ...60 Lenovo Flex System EN4023 10Gb Scalable Switch User s Guide ...

Page 73: ...Part Number 00KD347 Printed in USA ...

Page 74: ... IP P N 00KD347 47C9167 ...

Reviews: