Dell EMC PowerEdge MX Series Hardware Architecture Manual Download Page 75

Page: 75 / 75

Appendix B: Additional Information

Dell EMC PowerEdge MX

Networking Architecture Guide

Documentation and Support

The following Dell EMC documentation provides additional and relevant information.
Access to these documents depends on your login credentials. If you do not have access
to a document, contact your Dell EMC representative.

•

Dell EMC TechCenter Networking Guides

•

Dell EMC PowerEdge MX SmartFabric Deployment Guide

•

Dell EMC PowerEdge MX SmartFabric Deployment Video

•

Dell EMC OS10EE Enterprise Edition Users Guide

•

PowerEdge MX IO Guide

•

Dell EMC Networking Transceivers and Cables

•

Manuals and documentation for Dell EMC PowerEdge MX7000

For technical support visit

http://www.dell.com/support o

r call (USA) 1-800-945-3355.

We encourage readers to provide feedback on the quality and usefulness of this
publication by sending an email to

[email protected].

Dell EMC
documentation

Technical
Support

Feedback for
this document

Summary of Contents for PowerEdge MX Series

Page 1: ...tworking Architecture Guide January 2019 Architecture Guide Abstract This architecture guide provides an overview of the architecture features and functionality of the PowerEdge MX networking infrastructure Dell EMC Solutions ...

Page 2: ...tion requires an applicable software license Copyright 2019 Dell Inc or its subsidiaries All Rights Reserved Dell Technologies Dell EMC Dell EMC and other trademarks are trademarks of Dell Inc or its subsidiaries Intel the Intel logo the Intel Inside logo and Xeon are trademarks of Intel Corporation in the U S and or other countries Other trademarks may be trademarks of their respective owners Pub...

Page 3: ...ble density connectors 28 Interfaces and port groups 29 Embedded Top of Rack switching 33 Scalable Fabric OS10EE CLI Commands 35 Chapter 4 PowerEdge MX Ethernet Switch Operating Modes 36 Operating modes description 37 PowerEdge MX7000 SmartFabric topologies 39 SmartFabric uplink topologies 41 Deploying a SmartFabric 46 Appendix A Additional Guidelines and Equipment Details 49 Scalable Fabric restr...

Page 4: ...w 4 Dell EMC PowerEdge MX Networking Architecture Guide Chapter 1 Dell EMC PowerEdge MX Platform Overview This chapter presents the following topics PowerEdge MX models and components 5 PowerEdge MX7000 rear 9 PowerEdge MX7000 chassis fabric slots 16 ...

Page 5: ...ns Its responsive design and delivers the innovation and longevity customers of all sizes need for their IT and digital business transformations This section contains information about the hardware and options available in the PowerEdge MX7000 The section is divided into two parts The front of the MX7000 chassis containing compute and storage sleds The back of the MX7000 chassis containing network...

Page 6: ...ht Figure 2 Dell EMC PowerEdge MX7000 front The Dell EMC PowerEdge MX740c is a two socket full height single width compute sled that offers impressive performance and scalability It is ideal for dense virtualization environments and can serve as a foundation for collaborative workloads The MX7000 chassis supports up to eight MX740c sleds Key features of the MX740c include Single width slot design ...

Page 7: ...ptionally large memory capacity and a highly expandable storage subsystem It is the ultimate scale up server that excels at running a wide range of database applications substantial virtualization and software defined storage environments The MX7000 chassis supports up to four MX840c compute sleds Key features of the MX840c include Dual width slot design Four CPU sockets 48 DIMM slots of DDR4 memo...

Page 8: ...S drives The PowerEdge MX5016s storage sled delivers scale out shared storage within the PowerEdge MX architecture The MX5016s provides customizable 12 GB s direct attached SAS storage with up to 16 SAS HDDs SSDs Both the MX740c and the MX840c compute sleds can share drives with the MX5016s using the PowerEdge MX5000s SAS module Internal server drives may be combined with up to seven MX5016s sleds...

Page 9: ... slots to provide redundancy Figure 6 shows the rear of the PowerEdge MX7000 chassis From top to bottom the chassis is configured with One Dell EMC Networking MX9116n Fabric Switching Engine FSE installed in fabric slot A1 One Dell EMC Networking MX7116n Fabric Expander Module FEM installed in fabric slot A2 Two Dell EMC Networking MX5108n Ethernet switches installed in fabric slots B1 and B2 Two ...

Page 10: ...ME M console Two external 1G BaseT Ethernet ports are provided to enable management connectivity and to connect more MX7000 chassis into a single logical chassis The MX7000 chassis supports two MX9002m modules for redundancy Figure 7 shows a single MX9002m module and its components Figure 7 Dell EMC PowerEdge MX9002m module The following MX9002m module components are labeled Figure 7 1 Handle rele...

Page 11: ...ts can be used for Ethernet uplink connectivity see Section 3 1 for more information The unified ports can be used for Ethernet uplink connectivity and supporting eight 32Gb Fibre Channel ports for SAN connectivity supporting both NPIV Proxy Gateway NPG and direct attach FC capabilities The QSFP28 DD ports provide fabric expansion connections for up to nine more MX7000 chassis using the MX7116n Fa...

Page 12: ...for more information Figure 9 Dell EMC Networking MX7116n FEM The following MX7116n FEM components are labeled in Figure 9 1 Express service tag 2 Supported optic LED 3 Power and indicator LEDs 4 Module insertion removal latch 5 Two QSFP28 DD fabric expander ports Note The MX7116n FEM cannot act as a stand alone switch and must be connected to the MX9116n FSE to function The Dell EMC Networking MX...

Page 13: ...ge USB port 3 Micro B USB console port 4 Power and indicator LEDs 5 Module insertion removal latch 6 One QSFP port 7 Two QSFP28 ports 8 Four 10GBASE T ports There are two Ethernet Pass Through Modules PTM providing non switched Ethernet connections to Top of Rack switches Each PTM provides 16 internal 10GbE and or 25GbE ports Figure 11 shows the 25GbE Ethernet PTM The 25GbE PTM provides 16 externa...

Page 14: ... Networking MXG610s is a high performance 32 Gb Fibre Channel switch based on Brocade Gen 6 technology The MXG610s features 8 16 32 GbE capable interfaces It is ideal for connectivity to all flash SAN storage solutions and is designed for maximum flexibility and value with pay as you grow scalability using a Port on Demand or PoD license model The MXG610s is compatible with Brocade and Cisco fabri...

Page 15: ...dge MX7000 chassis The MX5000s uses T10 SAS zoning to provide multiple SAS zones domains for the compute sleds Storage management is conducted through the OEM M console The MX5000s provides Fabric C SAS connectivity to each compute and one or more MX5016s storage sleds Compute sleds connect to the MX5000s using either SAS Host Bus Adapters HBA or a PowerEdge Raid Controller PERC in the mini mezzan...

Page 16: ...lots A1 A2 B1 and B2 This orthogonal connection method results in a mid plane free design and enables the adoption of new I O technologies without the burden of having to upgrade the mid plane The MX740c supports two mezzanine cards which are installed in slots A1 and B1 and the MX840c supports four mezzanine cards which are installed in slots A1 A2 B1 and B2 Each mezzanine card provides redundant...

Page 17: ...n Figure 16 supporting redundant MXG610s FC switches or MX5000s SAS modules This fabric uses a mid plane connecting the C1 and C2 modules to each compute or storage sled The MX740c supports one mini mezzanine card which is installed in slot C1 and the MX840c supports two mini mezzanine cards which are installed in slots C1 and C2 Figure 16 Dell EMC PowerEdge MX740c mini mezzanine card Mini mezzani...

Page 18: ...Networking Architecture Guide Chapter 2 OpenManage Enterprise Modular Console This chapter presents the following topics Introduction 19 PowerEdge MX7000 initial deployment 19 PowerEdge MX7000 Multi Chassis Management groups 19 PowerEdge MX7000 OME M component management 22 ...

Page 19: ...on and troubleshooting including wireless server vKVM PowerEdge MX7000 initial deployment Initial PowerMX7000 chassis configuration consists of initial deployment assigning network settings for OME M and completing the Chassis Deployment Wizard There are three methods for initial configuration Using the LCD touchscreen on the front left of the MX7000 chassis Setting the initial OME M console IP ad...

Page 20: ...e done with an MCM group View the rollup health status of the OME M chassis group Automatically propagate lead chassis settings to member chassis Perform any chassis operating on the entire group Create a Scalable Fabric Architecture with the MX9116n FSE and MX7116n FEM Note See Chapter 3 for more information about Scalable Fabric Architectures Creating an MCM group consists of physically cabling ...

Page 21: ...ain cabling Table 1 lists each MX9002m module and the associated connections that are shown in Figure 17 Table 1 MX9002m module cable requirements CxMMx Port Gb1 Port Gb2 C1MM1 To management network C2MM1 Port Gb1 C2MM1 C1MM1 Port Gb2 C3MM2 Port Gb1 C3MM1 C2MM1 Port Gb2 CnMM1 Port Gb1 CnMM1 C3MM1 Port Gb2 C1MM2 Port Gb2 C1MM2 C2MM2 Port Gb2 CnMM1 Port Gb2 ...

Page 22: ...igure 18 shows a two member MX7000 MCM group Group1 with two participating chassis members Figure 18 OME M console A healthy MCM group Note In the event the lead chassis fails an administrator can access a member chassis through its assigned IP address to determine which chassis has taken over the lead role In the event the chassis is not in the lead role a caution banner is displayed PowerEdge MX...

Page 23: ...erations for SmartFabric Services mode Some administrative tasks include View IOM specific alerts Power cycle the IOM Configure or change device management information Configure supported breakout port modes Configure port administrative states Configure MTU Toggle Auto Negotiation Update IOM firmware Figure 19 OME M console I O Modules inventory Figure 20 shows using the OME M console to change t...

Page 24: ...4 Dell EMC PowerEdge MX Networking Architecture Guide Figure 20 OME M console MX9116n FSE breakout mode options Note To change the breakout on a port the HardwareDefault option must be selected and applied before choosing the appropriate breakout type ...

Page 25: ...chitecture Guide Chapter 3 PowerEdge MX Scalable Fabric Architecture This chapter presents the following topics Scalable Fabric architecture overview 26 QSFP28 double density connectors 28 Interfaces and port groups 29 Embedded Top of Rack switching 33 Scalable Fabric OS10EE CLI Commands 35 ...

Page 26: ...ach MX7116n FEM connects to the MX9116n FSE corresponding to its fabric and slot This hardware enabled architecture applies regardless of whether the switch is running in Full Switch or SmartFabric mode Note See Chapter 4 for more information about Full Switch and SmartFabric modes Figure 21 shows up to 10 MX7000 chassis in a single Scalable Fabric architecture The first two chassis hold a combina...

Page 27: ... 22 Two Scalable Fabrics spanning two PowerEdge MX7000 chassis The following restrictions and guidelines are in place when building a Scalable Fabric Mixing IOM types in the same Scalable Fabric for example MX9116n FSE in fabric slot A1 and MX5108n in fabric slot A2 is not supported See Appendix A for information on unsupported configurations All participating MX9116n FSEs and MX7116n FEMs must be...

Page 28: ... QSFP28 DD connector is slightly longer than the QSFP28 connector This is to enable for the second row of pads that carry the additional four 25 GbE lanes This allows the form factor of a single QSFP28 DD port to present as two QSFP28 logical ports Note A 100GbE QSFP28 optic can be inserted into a QSFP28 DD port resulting in 100GbE of available bandwidth The other 100GbE will not be available Figu...

Page 29: ...ED INTERNAL true 1 1 9 FIXED INTERNAL true 1 1 10 FIXED INTERNAL true 1 1 11 FIXED INTERNAL true 1 1 12 FIXED INTERNAL true 1 1 13 FIXED INTERNAL true 1 1 14 FIXED INTERNAL true 1 1 15 FIXED INTERNAL true 1 1 16 FIXED INTERNAL true 1 1 17 QSFP28 DD QSFP28 DD 200GBASE 2SR4 AOC TW04829489D0007 true 1 1 18 QSFP28 DD QSFP28 DD 200GBASE 2SR4 AOC TW04829489D0007 true 1 1 19 Not Present 1 1 20 Not Presen...

Page 30: ...ort groups along the top and the bottom shows the physical ports in each port group For instance QSFP28 DD port group 1 has members Ethernet 1 1 17 and Ethernet 1 1 18 and unified port 15 has a single member Ethernet 1 1 43 Figure 24 MX9116n FSE port groups On the MX9116n FSE QSFP28 DD port groups are 1 through 12 and contain ports ethernet 1 1 17 through 1 1 40 and are used to Connect to a MX7116...

Page 31: ... in 2x 100 GbE breakout mode Note Before changing the port breakout configuration from one setting to another the port must first be set back to the default setting On the MX9116n FSE single density QSFP28 port groups are 13 and 14 and contain ports Ethernet 1 1 41 and 1 1 42 and are used to connect to upstream networking devices By default both port groups are set to 1x100GbE Port groups 13 and 1...

Page 32: ...rations 4x 8Gb Breakout a unified port group into four 8Gb FC interfaces 2x 16Gb Breakout a unified port group into two 16Gb FC interfaces 4x 16Gb Breakout a unified port group into four 16Gb FC interfaces 1x 32Gb Breakout a unified port group into one 32Gb FC interface 2x 32Gb Breakout a unified port group into two 32Gb FC interfaces 4x 32Gb Breakout a unified port group into four 32Gb FC interfa...

Page 33: ... does this automatically However in full switch mode the unit provision node unit id provision_name command must be used Note For more information about virtual ports see the OS10EE Enterprise Edition Users Guide Embedded Top of Rack switching Most environments with blade servers also have rack servers Figure 26 shows a typical design having rack servers connecting to their respective Top of Rack ...

Page 34: ...is results in increased operations cost from the increased number of managed switches Embedded ToR functionality is built into the MX9116n FSE Configure any QSFP28 DD port to break out into 8x10GbE or 8x25GbE and connect the appropriate cables and optics This enables all servers and storage connect directly to the MX9116n FSE and communication between all devices that are kept within the switch Th...

Page 35: ...a future release Scalable Fabric OS10EE CLI Commands Additional OS10EE CLI commands are available on MX9116n to assist with MX7116n FEM management show discovered expanders displays the MX7116n FEMs attached to the MX9116n FSEs show unit provision displays the unit ID and service tag of the MX7116n FEM attached to an MX9116n FSE unit provision Provisions the unit ID of a Fabric Expander Module tha...

Page 36: ... 36 Dell EMC PowerEdge MX Networking Architecture Guide Chapter 4 PowerEdge MX Ethernet Switch Operating Modes This chapter presents the following topics PowerEdge MX7000 SmartFabric topologies 39 SmartFabric uplink topologies 41 Deploying a SmartFabric 46 ...

Page 37: ... events Only the configuration changes made using the following OS10EE commands are persistent across power cycle events All other CLI configuration commands are disabled clock hostname interface ip nameserver logging management route ntp snmp server username spanning tree vlan All switch interfaces are assigned to VLAN 1 by default and are in the same Layer 2 bridge domain Layer 2 bridging is dis...

Page 38: ... unit When PowerEdge MX networking components are placed in SmartFabric mode the switches operate as layer 2 I O aggregation devices The OME M console supports most switch configuration settings SmartFabric mode supports all OS10EE show commands and the following subset of CLI configuration commands clock Configure clock parameters end Exit to the EXEC mode exit Exit from the current mode help Dis...

Page 39: ...8 shows the supported topology for the Scalable Fabric Architecture The blue links represent two QSFP28 DD ports in a VLTi configuration Placing the MX9116n FSEs in separate chassis provides redundancy in the event of a hardware failure This configuration supports placement in chassis1 fabric slot A1 and chassis 2 slot A2 Alternatively chassis1 slot B1 and chassis 2 slot B2 is supported The red li...

Page 40: ...shows two MX5108n switches in single chassis configuration The blue links represent two ports in a VLTi configuration The first port is a QSFP port and the second port is a QSFP28 port In SmartFabric mode the QSFP28 port is configured to operate at 40GbE allowing for a valid port channel Note See Appendix A for more information Two M5108n Ethernet switches in the same chassis ...

Page 41: ... 31 shows the wiring topology in an Ethernet only environment The MX9116n FSE pair and the leaf pair are each configured for VLT Uplinks are shown in green with both links from each MX9116n FSE in a VLT port channel In addition to the uplinks shown if extra uplink bandwidth is needed the QSFP28 DD port groups can be used as uplinks by changing the breakout type and cabling as described in Section ...

Page 42: ...hows the two universal ports on each MX9116n FSE being used for FC connectivity The unified ports groups 15 and 16 support both NPIV Proxy Gateway NPG and direct attach F_PORT mode not shown In this example two Dell Networking S4148U ON switches are shown but any FC capable switch can be used Note FCoE uplinks must be physically separate from Ethernet uplinks MX9116n FSE Fibre Channel connectivity...

Page 43: ...MX9116n FSE Fibre Channel connectivity Figure 33 and Figure 34 show two methods for using the MX5108n in a LAN The two diagrams highlight using either 10GBASE T ports or QSFP28 ports with breakout for 10GbE or 25GbE uplinks Apart from the ports and cables that are used the configuration is the same MX5108n Ethernet only ...

Page 44: ...Chapter 4 PowerEdge MX Ethernet Switch Operating Modes 44 Dell EMC PowerEdge MX Networking Architecture Guide Figure 33 MX5108n Ethernet using 10GBASE T ports ...

Page 45: ...e 35 shows how the MX5108n can add FCoE functionality to an existing LAN only topology The MX5108n is configured to operate in FSB mode The MX5108n snoops FIP packets on FCoE enabled VLANs and discovers the following information End nodes ENodes Fibre channel forwarder FCF Connections between ENodes and FCFs Sessions between ENodes and FCFs MX5108n FCoE FIP Snooping Bridge ...

Page 46: ...e uplinks from the fabric to the existing network and assign VLANs to those uplinks 4 Deploy the appropriate server templates to the compute sleds Note For more information about deploying a SmartFabric see the Dell EMC PowerEdge MX SmartFabric Deployment Guide Besides being able to create and assign VLANs SmartFabric automates QoS settings based on chosen configuration options Figure 36 shows tha...

Page 47: ...traffic 3 General Purpose Gold Used for high priority data traffic 4 General Purpose Platinum Used for extremely high priority data traffic 5 Cluster Interconnect Used for cluster heartbeat VLANs 5 Hypervisor Management Used for hypervisor management connections such as the ESXi management VLAN 5 Storage iSCSI Used for iSCSI VLANs 5 Storage FCoE Used for FCoE VLANs 5 Storage Data Replication Used ...

Page 48: ...ation about QoS see the OS10EE Enterprise Edition Users Guide Because SmartFabric mode provides network automation capabilities that Full Switch mode does not the number of recommended VLANs differs between the modes Table 5 provides the recommended maximum number of VLANs per fabric uplink and server port Table 5 SmartFabric VLAN scaling guidelines OS10EE Version Parameter Value 10 4 0E R3S Recom...

Page 49: ...etails This appendix presents the following topics Scalable Fabric restrictions and guidelines 50 Supported cables and optical connectors 57 Rate limited 32 Gb Fibre Channel 64 Spanning Tree Protocol recommendations 65 NIC teaming restrictions 66 PowerEdge MX IOM slot support matrix 67 PTM port mapping 69 Examples of unsupported Scalable Fabric topologies 71 ...

Page 50: ... of chassis is not supported When operating with multiple chassis switches in A1 A2 or B1 B2 in one chassis must be interconnected only with other A1 A2 or B1 B2 switches respectively Create symmetrical uplinks For example if one MX9116n FSE has two uplinks the other MX9116n FSE must have two uplinks of the same speed Enable LACP on upstream switches LACP is required on the connected port channel ...

Page 51: ...B will be connected to the red tiles Any subsequent chassis will be connected in a similar fashion using the other tiles on the switch See Table 7 for port connection information Figure 38 Z9100 ON Tile Distribution Figure 39 displays the uplink connections from two MX9116n FSEs in two chassis The two chassis provide the uplinks for a group of up to 10 chassis Chassis 3 10 each have four MX7116n F...

Page 52: ...e 39 Uplink connections for fabric A Table 7 outlines the recommended port order for connecting chassis with MX9116n FSEs with a pair of Dell EMC Z9100 ON spine switches to optimize buffer utilization Chassis one and two are in the first group of 10 chassis the second set of 10 chassis starts with chassis 11 and 12 ...

Page 53: ...ssis 1 FSE A2 41 1 1 1 42 1 1 1 43 1 1 3 44 1 1 3 Chassis 1 FSE B2 41 1 1 5 42 1 1 5 43 1 1 7 44 1 1 7 Chassis 2 FSE A1 41 1 1 9 42 1 1 9 43 1 1 11 44 1 1 11 Chassis 2 FSE B1 41 1 1 13 42 1 1 13 43 1 1 15 44 1 1 15 Chassis 11 FSE A2 41 1 1 17 42 1 1 17 43 1 1 19 44 1 1 19 Chassis 11 FSE B2 41 1 1 21 42 1 1 21 43 1 1 23 44 1 1 23 Chassis 12 FSE A1 41 1 1 25 42 1 1 25 43 1 1 27 44 1 1 27 Chassis 12 ...

Page 54: ... a 40GbE port and port 10 a 100GbE port The SmartFabric wizard then automatically configures a 1x40GbE breakout on port 10 so that the VLTi has two connections that are running at the same speed The VLTi connections using ports 9 and 10 are shown in Figure 40 Figure 40 Two MX5108n in a single chassis When using the SmartFabric wizard for 2xMX5108n Ethernet Switches in same chassis there is a print...

Page 55: ...e chassis are shown in Figure 42 This option helps to ensure that the VLTi connections expected in the SmartFabrics are correctly cabled Figure 42 MX5108n VLTi topology Following are the prerequisites to create a wired or daisy chained chassis group Each chassis must be physically connected as part of the Multi Chassis Management MCM daisy chain as shown in Figure 43 A password is not needed as th...

Page 56: ...and local access The daisy chain configuration helps in surviving A single network cable failure A single management module failure Power loss of any chassis in the stack The wired chassis displays under Available Chassis in the Group Deployment Wizard Note More information about the configuration of MCM groups can be found in the Dell EMC OpenManage Enterprise Modular Edition Version 1 00 01 for ...

Page 57: ...cal connectors The PowerEdge MX7000 supports various optics and cables The sections in this appendix provide a brief summary of the specified industry standards and the use case regarding the chassis Table 8 shows the various cable types that are supported Note Additional information on supported cables and optics can be found in the PowerEdge MX IO Guide PowerEdge MX700 supported optics and cable...

Page 58: ...le 9 shows the different optical connectors as well as a brief description of the standard Table 9 Optical connectors Connector Description Small Form factor Pluggable SFP SFP 1Gb SFP 10Gb SFP28 25Gb SFP 1 Channel 2 Fibers or wires 1 1 5W Duplex LC optical connector MMF or SMF Quad Small Form factor Pluggable QSFP QSFP 40Gb QSFP28 100Gb QSFP 4 Channels 8 Fibers or wires 3 5W 5W MPO12 8 fiber paral...

Page 59: ...een in Table 9 SFP is a 10GbE transceiver and SFP28 is a 25GbE transceiver both of which can use either fiber or copper media to achieve 10GbE or 25GbE communication in each direction While the MX5108n has four 10GBASE T copper interfaces the focus is on optical connectors The SFP media type is typically seen in the PowerEdge MX7000 with the use of the 25GbE Pass Through Module PTM and using break...

Page 60: ...use of breakout cables QSFP is a 40Gb standard that uses either fiber or copper media to achieve communication in each direction This standard has four individual 10Gb lanes which can be used together to achieve 40GbE throughput or separately as four individual 10GbE connections using breakout connections One variant of the Dell QSFP transceiver is shown in Figure 47 Figure 47 QSFP Transceiver The...

Page 61: ...ow an example of QSFP Coppers The Direct Attach Copper DAC is a copper cable with a QSFP transceiver on either end The Multi fiber Push On MPO cable is a fiber cable that has MPO connectors on either end these connectors attach to QSFP transceivers The third variant is an Active Optical Cable AOC that is similar to the DAC with a fixed fiber optic cable in between the attached QSFP transceivers Fi...

Page 62: ...rts the use of QSFP to SFP breakout cables This offers the ability to use a QSFP port and connect to four SFP ports on the terminating end Figures 51 and 52 show the DAC and MPO cables which are two variations of breakout cables The MPO cable in this example attaches to one QSFP transceiver and four SFP transceivers Figure 51 QSFP to SFP Breakout cables Direct Attach Copper DAC Breakout ...

Page 63: ...Gb that uses either fiber or copper media to achieve communication in each direction The QSFP28 transceiver has four individual 25Gb lanes which can be used together to achieve 100GbE throughput or separately as four individual 25GbE connections using 4 SFP28 modules One variant of the Dell QSFP28 transceiver is shown in Figure 53 Figure 53 QSFP28 transceiver There are three variations of cables f...

Page 64: ...ulated QSFP28 end and two de populated QSFP28 ends each with 2x25GbE lanes This product is only available as DAC cables 4x25Gb with a QSFP28 connection and using 4 SFP28 connections using either a DAC AOC or MPO breakout cable with associated transceivers 4x10Gb with a QSFP28 connection and using 4 SFP connections using either a DAC AOC or MPO breakout cable with associated transceivers Rate limit...

Page 65: ... the maximum 28 Gbps throughput per port use the 2x 32 Gb breakout mode This mode configures the connections between the NPU and the FC ASIC as shown in Figure 51 Figure 58 2x 32 Gb FC breakout mode In 2x 32 Gb FC breakout mode the MX9116n FSE binds two 50 Gbps links together to provide a total of 100 Gbps bandwidth per lane to the FC ASIC This results in the two FC ports operating at 28 Gbps The ...

Page 66: ...ing RPVST to change to the existing STP protocol before connecting a OS10EE switch In the following example RSTP is enabled globally on an MX9116n FSE with a similar MST configuration MX9116n FSE config spanning tree mode rstp MX9116n FSE config end MX9116n FSE show spanning tree brief Spanning tree enabled protocol rstp with force version rstp Executing IEEE compatible Spanning Tree Protocol Root...

Page 67: ...ed if the Failover option on IDRAC is enabled Also if Microsoft Windows is the host operating system the LACP timer MUST be set to Slow To change the timing see the following Windows 2012R2 Update adds support for the slow timer in LACP in Windows Server 2012 R2 Instructions 2012R2 Windows 2016 LACP Timer is configured incorrectly when you create a NIC Team for LBFO Instructions 2016 PowerEdge MX ...

Page 68: ...6n MX7116n 25G PTM 25G PTM 10GBASE T PTM 10GBASE T PTM MX9116n MX9116n MX9116n MX5108n MX5108n MX5108n MX7116n MX7116n MX7116n 25G PTM 25G PTM 25G PTM 10GBASE T PTM 10GBASE T PTM 10GBASE T PTM MX9116n MX9116n MX5108n MX5108n MX9116n MX9116n 25G PTM 25G PTM MX9116n MX9116n 10GBASE T PTM 10GBASE T PTM MX9116n MX7116n MX5108n MX5108n MX7116n MX9116n MX5108n MX5108n MX9116n MX7116n 25G PTM 25G PTM MX7...

Page 69: ... MX9116n MX9116n 25G PTM 25G PTM MX7116n MX7116n 25G PTM 25G PTM MX9116n MX7116n 25G PTM 25G PTM MX7116n MX9116n 25G PTM 25G PTM 10GBASE T PTM 10GBASE T PTM 10GBASE T PTM 10GBASE T PTM MX9116n MX9116n 10GBASE T PTM 10GBASE T PTM MX7116n MX7116n 10GBASE T PTM 10GBASE T PTM MX9116n MX7116n 10GBASE T PTM 10GBASE T PTM MX7116n MX9116n 10GBASE T PTM 10GBASE T PTM 25G PTM 25G PTM PTM port mapping The fo...

Page 70: ...ines and Equipment Details 70 Dell EMC PowerEdge MX Networking Architecture Guide Figure 59 Ethernet PTM Dual Port NIC Mapping Figure 60 Ethernet PTM Quad Port NIC Mapping Note Ports 9 through 16 are reserved for future expansion ...

Page 71: ...ogies The Scalable Fabric Architecture currently requires that a MX7116n FEM in slot A1 be connected to an MX9116n FSE in slot A1 an MX7116n in slot A2 connected to an MX9116n FSE in slot A2 the same rule applies to devices in B1 and B2 It is not supported to have an MX7116n FEM in slot A2 connected to an MX9116n FSE in slot A1 for example The following examples are not supported configurations ...

Page 72: ...Appendix A Additional Guidelines and Equipment Details 72 Dell EMC PowerEdge MX Networking Architecture Guide Figure 62 Unsupported A1 A2 B1 B2 Figure 63 Unsupported A1 B2 B1 A2 ...

Page 73: ...etworking Architecture Guide Figure 64 Unsupported A1 B1 A2 B2 The following configurations are supported in full switch mode however they are not supported configurations for SmartFabric mode Figure 65 Unsupported VLT configuration Figure 66 Unsupported inter chassis configuration ...

Page 74: ...Appendix B Additional Information 74 Dell EMC PowerEdge MX Networking Architecture Guide Appendix B Additional Information This appendix presents the following topics Documentation and Support 75 ...

Page 75: ...es Dell EMC PowerEdge MX SmartFabric Deployment Guide Dell EMC PowerEdge MX SmartFabric Deployment Video Dell EMC OS10EE Enterprise Edition Users Guide PowerEdge MX IO Guide Dell EMC Networking Transceivers and Cables Manuals and documentation for Dell EMC PowerEdge MX7000 For technical support visit http www dell com support or call USA 1 800 945 3355 We encourage readers to provide feedback on t...

Search results

Summary of Contents for PowerEdge MX Series

Reviews:

Related manuals for PowerEdge MX Series

Brands by name

Popular brands

Dell EMC PowerEdge MX Series, Hardware Architecture Manual

Search results

Summary of Contents for PowerEdge MX Series

Reviews:

Related manuals for PowerEdge MX Series

Brands by name

Popular brands