Cisco SE-CL-L3 Installation Manual Download

Page: 4 / 106

Required Equipment For Service Procedures

Shutting Down and Removing Power From the Server

Shutting Down Using the Power Button

Shutting Down Using The Cisco IMC GUI

Shutting Down Using The Cisco IMC CLI

Removing the Server Top Cover

Serial Number Location

Hot Swap vs Hot Plug

Removing and Replacing Components

Serviceable Component Locations

Replacing SAS/SATA Hard Drives or Solid State Drives

SAS/SATA Drive Population Guidelines

4K Sector Format SAS/SATA Drives Considerations

Replacing a SAS/SATA Drive

Replacing a Front-Loading NVMe SSD

Front-Loading NVMe SSD Population Guidelines

Front-Loading NVME SSD Requirements and Restrictions

Enabling Hot-Plug Support in the System BIOS

Replacing a Front-Loading NVMe SSD

Installing a PCIe Cable For Front-Loading NVMe SSDs

Replacing Fan Modules

Replacing CPUs and Heatsinks

CPU Configuration Rules

Tools Required For CPU Replacement

Replacing a CPU and Heatsink

Moving an M5 Generation CPU

Replacing Memory DIMMs

DIMM Population Rules and Memory Performance Guidelines

Replacing DIMMs

Replacing a Mini-Storage Module

Replacing a Mini-Storage Module Carrier

Replacing an M.2 SSD in a Mini-Storage Carrier For M.2

Replacing an Internal USB Drive

Replacing a USB Drive

Cisco Application Services Engine Hardware Installation Guide

Contents

Summary of Contents for SE-CL-L3

Page 1: ...ces Engine Hardware Installation Guide First Published 2019 10 15 Americas Headquarters Cisco Systems Inc 170 West Tasman Drive San Jose CA 95134 1706 USA http www cisco com Tel 408 526 4000 800 553 NETS 6387 Fax 408 527 0883 ...

Page 3: ...nagement Arm Optional 14 Reversing the Cable Management Arm Optional 15 Initial Server Setup 16 Connecting to the Server Locally For Setup 17 Connecting to the Server Remotely For Setup 18 Updating the BIOS and Cisco IMC Firmware 19 Accessing the System BIOS 19 Smart Access Serial 20 Maintaining the Server 21 C H A P T E R 3 Status LEDs and Buttons 21 Front Panel LEDs 21 Rear Panel LEDs 24 Interna...

Page 4: ...Loading NVMe SSD Population Guidelines 34 Front Loading NVME SSD Requirements and Restrictions 35 Enabling Hot Plug Support in the System BIOS 35 Replacing a Front Loading NVMe SSD 36 Installing a PCIe Cable For Front Loading NVMe SSDs 37 Replacing Fan Modules 38 Replacing CPUs and Heatsinks 39 CPU Configuration Rules 39 Tools Required For CPU Replacement 39 Replacing a CPU and Heatsink 40 Moving ...

Page 5: ...2 RAID Controller 71 Replacing the Supercap RAID Backup 73 Replacing a SATA Interposer Card 75 Replacing a Chassis Intrusion Switch 76 Installing a Trusted Platform Module TPM 77 TPM Considerations 77 Service Headers and Jumpers 78 Using the Clear CMOS Header J38 Pins 9 10 79 Using the BIOS Recovery Header J38 Pins 11 12 80 Procedure 1 Reboot With recovery cap File 80 Procedure 2 Use BIOS Recovery...

Page 6: ... SAS Modular RAID Controller 92 Mixing Drive Types in RAID Groups 93 RAID Controller Migration 93 Storage Controller and Backplane Connectors 94 Embedded SATA RAID Controller 96 Embbeded SATA RAID Requirements 97 Embedded SATA RAID Controller Considerations 97 Embedded SATA RAID Two SATA Controllers 98 Enabling SATA Mode For the Embedded Controllers 98 Accessing the Software RAID Configuration Uti...

Page 7: ...es Drive bays 1 and 2 support NVMe SSDs The Cisco Application Services Engine software is pre installed on the server It is detected after the server is connected installed and powered on Cisco Application Services Engine app allows you to fully enable the capabilities of the Cisco Application Services Engine Cisco Application Services Engine app can be downloaded from the Cisco DC App Center See ...

Page 8: ...t asset tag 10 Unit identification button LED 4 KVM connector used with KVM cable that provides one DB 15 VGA one DB 9 serial and two USB connectors 11 System status LED 5 Power supply status LED 6 SE CL L3 LFF Drives Front Panel Features The following figure shows the front panel features of the large form factor drive version of the server For definitions of LED states see Front Panel LEDs on pa...

Page 9: ...9 Power button power status LED 3 KVM connector used with KVM cable that provides one DB 15 VGA one DB 9 serial and two USB connectors 10 Unit identification button LED 4 Pull out asset tag 11 System health LED 5 Fan status LED 6 SE CL L3 Rear Panel Features The rear panel features are the same for all versions of the server For definitions of LED states see Rear Panel LEDs on page 24 Cisco Applic...

Page 10: ...rt 1 Gbps and 10 Gbps depending on the link partner capability 3 PCIe riser 1 slot 1 x16 lane 10 VGA video port DB 15 connector 4 Threaded holes for dual hole grounding lug 11 1 Gb Ethernet dedicated management port 5 Serial port RJ 45 connector 6 Serviceable Component Locations This topic shows the locations of the field replaceable components and service related items The view in the following f...

Page 11: ...en hot swappable 2 PCIe riser 2 slot 2 half height x16 lane Includes PCIe cable connectors for front loading NVMe SSDs x8 lane 12 Supercap unit mounting bracket RAID backup 3 PCIe riser 1 slot 1 full height x16 lane Includes socket for Micro SD card 13 DIMM sockets on motherboard 12 per CPU 4 Modular LOM mLOM card bay on chassis floor x16 PCIe lane not visible in this view 14 CPUs and heatsinks up...

Page 12: ...port on motherboard 8 RTC battery vertical socket 9 Summary of Server Features The following table lists a summary of server features Description Feature One rack unit 1RU chassis Chassis Up to two CPUs from the Intel Xeon Processor Scalable Family This includes CPUs from the following series Intel Xeon Silver 4XXX Processors Central Processor 24 DDR4 DIMM sockets on the motherboard 12 each CPU Me...

Page 13: ...onnectivity Modular LOM One power supply AC power supplies 1050 W AC each Power The advanced configuration and power interface ACPI 4 0 standard is supported ACPI Seven hot swappable fan modules for front to rear cooling Cooling Two horizontal PCIe expansion slots on a PCIe riser assembly See PCIe Slot Specifications on page 60 for specifications of the slots PCIe I O The PCIe bus slots in this se...

Page 14: ...1 array Storage internal The server has a dedicated internal mRAID riser that supports one of the following storage controller options A PCIe style Cisco modular RAID controller card SAS SATA A PCIe style interposer card for the server s embedded SATA RAID controller For a detailed list of storage controller options see Supported Storage Controllers and Cables on page 91 Storage management The ser...

Page 15: ...ection contains the following topics Installation Warnings and Guidelines Before you install operate or service a server review the Regulatory Compliance and Safety Information for important safety information Note IMPORTANT SAFETY INSTRUCTIONS This warning symbol means danger You are in a situation that could cause bodily injury Before you work on any equipment be aware of the hazards involved wi...

Page 16: ...ack the servers using rail kits Physically placing the units on top of one another or stacking without the use of the rail kits blocks the air vents on top of the servers which could result in overheating higher fan speeds and higher power consumption We recommend that you mount your servers on rail kits when you are installing them into the rack because these rails provide the minimal spacing req...

Page 17: ... D 1992 The rack post holes can be square 0 38 inch 9 6 mm round 0 28 inch 7 1 mm 12 24 UNC or 10 32 UNC when you use the Cisco supplied slide rails The minimum vertical rack space per server must be one rack unit RU equal to 1 75 in 44 45 mm Supported Cisco Slide Rail Kits The server supports the following rail kit Cisco part UCSC RAILB M4 ball bearing slide rail kit Rack Installation Tools Requi...

Page 18: ...de of the server so that the three keyed slots in the rail align with the three pegs on the side of the server b Set the keyed slots over the pegs and then slide the rail toward the front to lock it in place on the pegs The front slot has a metal clip that locks over the front peg c Install the second inner rail to the opposite side of the server Figure 5 Attaching the Inner Rail to the Side of th...

Page 19: ... the inside of the rack post e Attach the second slide rail assembly to the opposite side of the rack Ensure that the two slide rail assemblies are at the same height and are level front to back f Pull the inner slide rails on each assembly out toward the rack front until they hit the internal stops and lock in place Step 4 Insert the server into the slide rails This server can weigh up to 60 poun...

Page 20: ...crew threads into the static part of the rail on the rack post and prevents the server from being pulled out Repeat for the opposite slam latch Installing the Cable Management Arm Optional The cable management arm CMA is reversible left to right To reverse the CMA see Reversing the Cable Management Arm Optional on page 15 before installation Note Step 1 With the server pushed fully into the rack s...

Page 21: ...end of the width adjustment slider onto the end of the stationary slide rail that is attached to the rack post Slide the tab over the end of the rail until it clicks and locks Step 5 Open the hinged flap at the top of each plastic cable guide and route your cables through the cable guides as desired Reversing the Cable Management Arm Optional Step 1 Rotate the entire CMA assembly 180 degrees left ...

Page 22: ...ult settings The NIC mode is Shared LOM EXT Shared LOM EXT mode enables the 1 Gb 10 Gb Ethernet ports and the ports on any installed Cisco virtual interface card VIC to access the Cisco Integrated Management Interface Cisco IMC The NIC redundancy is Active Active All Ethernet ports are utilized simultaneously DHCP is enabled IPv4 is enabled Connection Methods There are two methods for connecting t...

Page 23: ...tach each power cord to a grounded power outlet Wait for approximately two minutes to let the server boot to standby power during the first bootup You can verify system power status by looking at the system Power Status LED on the front panel The system is in standby power mode when the LED is amber Step 2 Connect a USB keyboard and VGA monitor to the server using one of the following methods Conn...

Page 24: ... two minutes to let the server boot to standby power during the first bootup You can verify system power status by looking at the system Power Status LED on the front panel The system is in standby power mode when the LED is amber Step 2 Plug your management Ethernet cable into the dedicated management port on the rear panel Step 3 Allow your preconfigured DHCP server to assign an IP address to th...

Page 25: ...rmware are matching or the server does not boot Cisco provides the Cisco Host Upgrade Utility to assist with simultaneously upgrading the BIOS Cisco IMC and other firmware to compatible levels Caution Accessing the System BIOS Step 1 Enter the BIOS Setup Utility by pressing the F2 key when prompted during bootup The version and build of the current BIOS are displayed on the Main page of the utilit...

Page 26: ...ection must be enabled in the server BIOS Terminal type must be set to VT100 or VTUFT8 Serial over LAN SOL must be disabled SOL is disabled by default To switch from host serial to Cisco IMC CLI press Esc 9 You must enter your Cisco IMC credentials to authenticate the connection To switch from Cisco IMC CLI to host serial press Esc 8 You cannot switch to Cisco IMC CLI if the serial over LAN SOL fe...

Page 27: ...ng Components on page 30 Service Headers and Jumpers on page 78 Status LEDs and Buttons This section contains information for interpreting front rear and internal LED states Front Panel LEDs Figure 10 Front Panel LEDs Table 1 Front Panel LEDs Definition of States States LED Name Cisco Application Services Engine Hardware Installation Guide 21 ...

Page 28: ...ing insertion or the driver is unloading following an eject command Amber The drive has failed Amber blinking A drive Locate command has been issued in the software NVMe SSD drive fault NVMe solid state drive SSD drive tray LEDs have different behavior than SAS SATA drive trays Note 1 NVMe Off No drive activity Green blinking There is drive activity NVMe SSD activity 2 NVMe Off There is no AC powe...

Page 29: ... power supplies are in a degraded operational state Amber blinking One or more power supplies are in a critical fault state Power supply status 6 Green All fan modules are operating properly Amber blinking One or more fan modules breached the non recoverable threshold Fan status 7 Off The Ethernet LOM port link is idle Green One or more Ethernet LOM ports are link active but there is no activity G...

Page 30: ...net link status on both LAN1 and LAN2 2 Off Link speed is 10 Mbps Amber Link speed is 100 Mbps Green Link speed is 1 Gbps 1 Gb Ethernet dedicated management link speed 3 Off No link is present Green Link is active Green blinking Traffic is present on the active link 1 Gb Ethernet dedicated management link status 4 Off The unit identification function is not in use Blue blinking The unit identifica...

Page 31: ... input 12 V main power off 12 V standby power off Green blinking 12 V main power off 12 V standby power on Green solid 12 V main power on 12 V standby power on Amber blinking Warning threshold detected but 12 V main power on Amber solid Critical error detected 12 V main power off for example over current over voltage or over temperature failure Power supply status one LED each power supply unit 6 ...

Page 32: ...U fault LEDs one behind each CPU socket on the motherboard These LEDs operate only when the server is in standby power mode Amber CPU has a fault Off CPU is OK 2 Preparing For Component Installation This section includes information and tasks that help prepare the server for component installation Required Equipment For Service Procedures The following tools and equipment are used to perform the p...

Page 33: ...utton or the software management interfaces Shutting Down Using the Power Button Step 1 Check the color of the Power button LED Amber The server is already in standby mode and you can safely remove power Green The server is in main power mode and must be shut down before you can safely remove power Step 2 Invoke either a graceful shutdown or a hard shutdown To avoid data loss or damage to your ope...

Page 34: ...mpletely remove power from the server disconnect all power cords from the power supplies in the server Removing the Server Top Cover Step 1 Remove the top cover a If the cover latch is locked use a screwdriver to turn the lock 90 degrees counterclockwise to unlock it b Lift on the end of the latch that has the green finger grip The cover is pushed back to the open position as you lift the latch c ...

Page 35: ... on page 28 Hot Swap vs Hot Plug Some components can be removed and replaced without shutting down and removing power from the server This type of replacement has two varieties hot swap and hot plug Hot swap replacement You do not have to shut down the component in the software or operating system This applies to the following components Cisco Application Services Engine Hardware Installation Guid...

Page 36: ...ts handle them only by carrier edges and use an electrostatic discharge ESD wrist strap or other grounding device to avoid damage Caution You can press the unit identification button on the front panel or rear panel to turn on a flashing blue unit identification LED on both the front and rear panels of the server This button allows you to locate the specific server that you are servicing when you ...

Page 37: ...swappable 2 PCIe riser 2 slot 2 half height x16 lane Includes PCIe cable connectors for front loading NVMe SSDs x8 lane 12 Supercap unit mounting bracket RAID backup 3 PCIe riser 1 slot 1 full height x16 lane Includes socket for Micro SD card 13 DIMM sockets on motherboard 12 per CPU 4 Modular LOM mLOM card bay on chassis floor x16 PCIe lane not visible in this view 14 CPUs and heatsinks up to two...

Page 38: ... You do not have to shut down the server or drive to replace SAS SATA hard drives or SSDs because they are hot swappable To replace an NVMe PCIe SSD drive which must be shut down before removal see Replacing a Front Loading NVMe SSD on page 36 Note SAS SATA Drive Population Guidelines The server is orderable in the following different version SE CL L3 Small form factor SFF drives with 10 drive bac...

Page 39: ...Options tab Step 3 Set Boot Mode to UEFI Mode Step 4 Under Boot Option Priorities set your OS installation media such as a virtual DVD as your Boot Option 1 Step 5 Press F10 to save changes and exit the BIOS setup utility Allow the server to reboot Step 6 After the OS installs verify the installation a Enter the BIOS setup utility by pressing the F2 key when prompted during bootup b Go to the Boot...

Page 40: ... 5 inch or 3 5 inch form factor NVMe solid state drives SSDs in front panel drive bays Front Loading NVMe SSD Population Guidelines The front drive bay support for 2 5 inch NVMe SSDs SE CL L3 Small form factor SFF drives with 10 drive backplane Drive bays 1 and 2 support 2 5 inch NVMe SSDs Cisco Application Services Engine Hardware Installation Guide 34 Maintaining the Server Replacing a Front Loa...

Page 41: ...ng systems Hot insertion and hot removal are supported in all supported operating systems except VMWare ESXi Enabling Hot Plug Support in the System BIOS Hot plug OS informed hot insertion and hot removal is disabled in the system BIOS by default If the system was ordered with NVMe PCIe SSDs the setting was enabled at the factory No action is required If you are adding NVMe PCIe SSDs after factory...

Page 42: ...e ejector lever and then pull the drive tray out of the slot d Remove the four drive tray screws that secure the SSD to the tray and then lift the SSD out of the tray If this is the first time that front loading NVMe SSDs are being installed in the server you must install PCIe cable CBL NVME C220FF before installing the drive See Installing a PCIe Cable For Front Loading NVMe SSDs on page 37 Note ...

Page 43: ...front panel drive backplane to the PCIe riser 2 board on the PCIe riser assembly If the server was ordered with 2 5 or 3 5 inch form factor NVMe SSDs this cable was preinstalled at the factory No action is required If you are adding 2 5 or 3 5 inch form factor NVMe SSDs for the first time you must order and install the cable as described in the following procedure Cisco Application Services Engine...

Page 44: ...en the fan is correctly seated and is operating OK The LED lights amber when the fan has a fault or is not correctly seated Tip You do not have to shut down or remove power from the server to replace fan modules because they are hot swappable However to maintain proper cooling do not operate the server for more than one minute with any fan module removed Caution Step 1 Remove an existing fan modul...

Page 45: ...ce Guidelines on page 51 The server operates with two identical CPUs installed The maximum combined memory allowed in the 12 DIMM slots controlled by any one CPU is 768 GB To populate the 12 DIMM slots with more than 768 GB of combined memory you must use a high memory CPU that has a PID that ends with an M for example UCS CPU 6134M Tools Required For CPU Replacement You need the following tools a...

Page 46: ... to detach cables from the rear panel to provide clearance If you cannot safely view and access the component remove the server from the rack Caution c Remove the top cover from the server as described in Removing the Server Top Cover on page 28 d Use the T 30 Torx driver that is supplied with the replacement CPU to loosen the four captive nuts that secure the assembly to the motherboard standoffs...

Page 47: ...eatsink from the CPU assembly the CPU assembly includes the CPU and the CPU carrier a Place the heatsink with CPU assembly so that it is oriented upside down as shown below Note the thermal interface material TIM breaker location TIM BREAKER is stamped on the CPU carrier next to a small slot Cisco Application Services Engine Hardware Installation Guide 41 Maintaining the Server Replacing a CPU and...

Page 48: ...e TIM breaker slot Use caution to avoid damaging the heatsink surface Caution d Gently rotate the screwdriver to lift up on the CPU until the TIM on the heatsink separates from the CPU Do not allow the screwdriver tip to touch or damage the green CPU substrate Note e Pinch the CPU carrier inner latch at the corner opposite the TIM breaker and push up to disengage the clip from its slot in the heat...

Page 49: ... extreme care to avoid damaging pins Caution Figure 22 CPU Assembly Tool CPU Assembly and Heatsink Alignment Features Angled corner on heatsink pin 1 alignment feature 4 CPU assembly tool 1 Triangle cut into carrier pin 1 alignment feature 5 CPU assembly CPU in plastic carrier 2 Angled corner on CPU assembly tool pin 1 alignment feature 6 Heatsink 3 Step 4 Apply new TIM to the heatsink The heatsin...

Page 50: ...ling There are two different heatsinks UCSC HS C220M5 for standard performance CPUs 150 W and less UCSC HS2 C220M5 for high performance CPUs above 150 W Note the wattage described on the heatsink label Caution Step 5 With the CPU assembly on the CPU assembly tool set the heatsink onto the CPU assembly Note the pin 1 alignment features for correct orientation Push down gently until you hear the cor...

Page 51: ...ptive nuts that secure the heatsink to the motherboard standoffs Alternate tightening the heatsink nuts evenly so that the heatsink remains level while it is lowered Tighten the heatsink nuts in the order shown on the heatsink label 1 2 3 4 The captive nuts must be fully tightened so that the leaf springs on the CPU socket lie flat Caution e Replace the top cover to the server f Replace the server...

Page 52: ...ve to separate the heatsink from the CPU Perform the following steps a Use a T 30 Torx driver to loosen the four captive nuts that secure the assembly to the board standoffs Alternate loosening the heatsink nuts evenly so that the heatsink remains level as it is raised Loosen the heatsink nuts in the order shown on the heatsink label 4 3 2 1 Note b Lift straight up on the CPU heatsink assembly to ...

Page 53: ...s from the new system to the system that you are returning a Remove the socket covers from the replacement system Grasp the two recessed finger grip areas marked REMOVE and lift straight up Keep a firm grasp on the finger grip areas at both ends of the cover Do not make contact with the CPU socket pins Note Cisco Application Services Engine Hardware Installation Guide 47 Maintaining the Server Mov...

Page 54: ...e cover except the two points described Pressing elsewhere might damage the socket pins Caution c Press down on the two circular markings next to the word INSTALL that are closest to the two threaded posts see the following figure Press until you feel and hear a click You must press until you feel and hear a click to ensure that the dust covers do not come loose during shipping Note Cisco Applicat...

Page 55: ...rd align the assembly over the CPU socket as shown below Note the alignment features The pin 1 angled corner on the heatsink must align with the pin 1 angled corner on the CPU socket The CPU socket posts must align with the guide holes in the assembly Cisco Application Services Engine Hardware Installation Guide 49 Maintaining the Server Moving an M5 Generation CPU ...

Page 56: ...nto the CPU socket c Use a T 30 Torx driver to tighten the four captive nuts that secure the heatsink to the board standoffs Alternate tightening the heatsink nuts evenly so that the heatsink remains level while it is lowered Tighten the heatsink nuts in the order shown on the heatsink label 1 2 3 4 The captive nuts must be fully tightened so that the leaf springs on the CPU socket lie flat Note C...

Page 57: ...wing figure shows the numbering of the DIMM slots on the motherboard Figure 29 DIMM Slot Numbering DIMM Population Rules Observe the following guidelines when installing or replacing DIMMs for maximum performance Each CPU supports six memory channels CPU 1 supports channels A B C D E F CPU 2 supports channels G H J K L M Each channel has two DIMM sockets for example channel A slots A1 A2 In a sing...

Page 58: ... two populated channels provides data When memory mirroring is enabled you must install DIMMs in even numbers of channels The NVIDIA Tesla P Series GPU can support more than 1 TB of memory in the server All other NVIDIA GPUs M Series can support only 1 TB or less of memory in the server Observe the DIMM mixing rules shown in the following table Table 4 DIMM Mixing Rules DIMMs in the Same Bank DIMM...

Page 59: ...ovide clearance If you cannot safely view and access the component remove the server from the rack Caution c Remove the top cover from the server as described in Removing the Server Top Cover on page 28 d Remove the air baffle that covers the front ends of the DIMM slots to provide clearance e Locate the DIMM that you are removing and then open the ejector levers at each end of its DIMM slot Step ...

Page 60: ...t remove the server from the rack Caution Step 3 Remove the top cover from the server as described in Removing the Server Top Cover on page 28 Step 4 Remove a carrier from its socket a Locate the mini storage module carrier in its socket just in front of power supply 1 b At each end of the carrier push outward on the clip that secures the carrier c Lift both ends of the carrier to disengage it fro...

Page 61: ...u can use one or two M 2 SSDs in the carrier M 2 socket 1 is on the top side of the carrier M 2 socket 2 is on the underside of the carrier the same side as the carrier s motherboard connector Dual SATA M 2 SSDs can be configured in a RAID 1 array with the BIOS Setup Utility s built in embedded SATA RAID utility See Embedded SATA RAID Controller on page 96 If M 2 NVMe SSDs are installed in the M 2...

Page 62: ...ternal USB drive while the server is powered on because of the potential for data loss Caution Step 1 Remove an existing internal USB drive a Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server on page 27 b Slide the server out the front of the rack far enough so that you can remove the top cover You might have to detach cables from the rear ...

Page 63: ...up Utility by pressing the F2 key when prompted during bootup Step 2 Navigate to the Advanced tab Step 3 On the Advanced tab select USB Configuration Step 4 On the USB Configuration page select USB Ports Configuration Step 5 Scroll to USB Port Internal press Enter and then choose either Enabled or Disabled from the dialog box Step 6 Press F10 to save and exit the utility Cisco Application Services...

Page 64: ... You might have to detach cables from the rear panel to provide clearance If you cannot safely view and access the component remove the server from the rack Caution c Remove the top cover from the server as described in Removing the Server Top Cover on page 28 d Locate the RTC battery The vertical socket is directly in front of PCIe riser 2 e Remove the battery from the socket on the motherboard G...

Page 65: ... includes procedures for replacing AC power supply units Replacing AC Power Supplies on page 59 Replacing AC Power Supplies If you have ordered a server with power supply redundancy two power supplies you do not have to power off the server to replace a power supply because they are redundant as 1 1 Note Do not mix power supply types or wattages in the server Both power supplies must be identical ...

Page 66: ...locks c Connect the power cord to the new power supply d Only if you shut down the server press the Power button to boot the server to main power mode Figure 33 Replacing AC Power Supplies Power supply handle 2 Power supply release lever 1 Replacing a PCIe Card Cisco supports all PCIe cards qualified and sold by Cisco PCIe cards not qualified or sold by Cisco are the responsibility of the customer...

Page 67: ...ackplane to support front panel NVMe SSDs Gen 3 x8 PCIe cable connector for front panel NVMe SSDs Riser 2 Slot 2 is not available in single CPU configurations Note Replacing a PCIe Card If you are installing a Cisco Virtual Interface Card there are prerequisite considerations See Cisco Virtual Interface Card VIC Considerations on page 64 Note RAID controller cards install into a separate mRAID ris...

Page 68: ...en the hinged plastic retainer that secures the rear panel tab of the card h Pull evenly on both ends of the PCIe card to remove it from the socket on the PCIe riser If the riser has no card remove the blanking panel from the rear opening of the riser Step 2 Install a new PCIe card a With the hinged tab retainer open align the new PCIe card with the empty socket on the PCIe riser PCIe riser 1 slot...

Page 69: ...cable that supports front panel NVMe SSDs 5 External riser handle 2 PCIe slot 2 rear panel opening 3 d Position the PCIe riser over its two sockets on the motherboard and over the two chassis alignment channels Cisco Application Services Engine Hardware Installation Guide 63 Maintaining the Server Replacing a PCIe Card ...

Page 70: ... for this server If you use the Cisco Card NIC mode you must also make a VIC Slot setting that matches where your VIC is installed The options are Riser1 Riser2 and Flex LOM Note Table 7 VIC Support and Considerations in This Server Minimum Cisco IMC Firmware Primary Slot For Cisco Card NIC Mode Primary Slot For Cisco UCS Manager Integration Slots That Support VICs How Many Supported in Server VIC...

Page 71: ...erver Top Cover on page 28 d Remove the mRAID riser to provide access to the mLOM socket below the riser To remove the mRAID riser use both hands to grasp the external blue handle on the rear and the blue finger grip on the front Lift straight up You do not have to disconnect cables from any RAID card or interposer card that is installed in the riser Carefully move the riser aside only far enough ...

Page 72: ...cated motherboard socket and provides a horizontal socket for the installed card This riser can be ordered as the following options UCSC XRAIDR 220M5 Replacement unit for this mRAID riser UCSC MRAID1GB KIT Kit for first time addition of this riser includes RAID controller supercap and supercap cable See also Replacing a SAS Storage Controller Card RAID or HBA on page 69 See also Replacing the Supe...

Page 73: ...er upside down on an antistatic surface d Remove any card from the riser Open the blue card ejector lever that is on the edge of the card and then pull the card straight out from its socket on the riser Step 3 Install a new mRAID riser a Install your card into the new riser Close the card ejector lever on the card to lock it into the riser b Connect cables to the installed card c Align the riser w...

Page 74: ...D Controller on page 96 for details Note Storage Controller Card Firmware Compatibility Firmware on the storage controller RAID or HBA must be verified for compatibility with the current Cisco IMC and BIOS versions that are installed on the server If not compatible upgrade or downgrade the storage controller firmware using the Cisco Host Upgrade Utility HUU for your firmware release to bring it to...

Page 75: ...ard from the riser a Disconnect cables from the existing card b Open the blue card ejector lever on the back side of the card to eject it from the socket on the riser c Pull the card from the riser and set it aside Step 4 Install a new storage controller card to the riser a With the riser upside down set the card on the riser b Push on both corners of the card to seat its connector in the riser so...

Page 76: ...rives plus an integrated 6 Gbps SATA RAID controller that can control the SATA M 2 drives in a RAID 1 array Cisco Boot Optimized M 2 RAID Controller Considerations Review the following considerations The minimum version of Cisco IMC that support this controller is 4 0 4 and later This controller supports RAID 1 single volume and JBOD mode A SATA M 2 drive in slot 1 the top is the first SATA device...

Page 77: ... properties and erase the physical drive contents Access the utility by pressing F2 when prompted during server boot Then navigate to Advanced Cisco Boot Optimized M 2 RAID Controller Replacing a Cisco Boot Optimized M 2 RAID Controller This topic describes how to remove and replace a Cisco Boot Optimized M 2 RAID Controller The controller board has one M 2 socket on its top Slot 1 and one M 2 soc...

Page 78: ...ote a Use a 1 Phillips head screwdriver to remove the single screw that secures the M 2 drive to the carrier b Lift the M 2 drive from its socket on the carrier c Position the replacement M 2 drive over the socket on the controller board d Angle the M 2 drive downward and insert the connector end into the socket on the carrier The M 2 drive s label must face up e Press the M 2 drive flat against t...

Page 79: ...r on the server by pressing the Power button Replacing the Supercap RAID Backup This server supports installation of one supercap unit The unit mounts to a bracket that is in the middle of the row of cooling fan modules The supercap provides approximately three years of backup for the disk write back cache DRAM in the case of a sudden power loss by offloading the cache to the NAND flash Step 1 Pre...

Page 80: ...cap free of the bracket and set it aside Step 3 Install a new supercap a Set the new supercap into the mounting bracket b Close the hinged plastic clip over the supercap Push down until the securing tab clicks c Connect the supercap cable from the RAID controller card to the connector on the new supercap cable Step 4 Replace the top cover to the server Step 5 Replace the server in the rack replace...

Page 81: ... of the riser b Lift the riser straight up to disengage it from the motherboard socket c Set the riser upside down on an antistatic surface Step 3 Remove any existing card from the riser a Disconnect cables from the existing card b Open the blue card ejector lever on the back side of the card to eject it from the socket on the riser c Pull the card from the riser and set it aside Step 4 Install a ...

Page 82: ... that you can remove the top cover You might have to detach cables from the rear panel to provide clearance If you cannot safely view and access the component remove the server from the rack Caution c Remove the top cover from the server as described in Removing the Server Top Cover on page 28 Step 2 Remove an existing intrusion switch a Disconnect the intrusion switch cable from the socket on the...

Page 83: ... then fully power on the server by pressing the Power button Figure 44 Replacing a Chassis Intrusion Switch Intrusion switch location 1 Installing a Trusted Platform Module TPM The trusted platform module TPM is a small circuit board that plugs into a motherboard socket and is then permanently secured with a one way screw The socket location is on the motherboard below PCIe riser 2 TPM Considerati...

Page 84: ... IMC Image Header J39 Pins 1 2 on page 82 Using the Reset Cisco IMC Password to Default Header J39 Pins 3 4 on page 83 Using the Reset Cisco IMC to Defaults Header J39 Pins 5 6 on page 84 Figure 45 Location of Service Header Blocks J38 and J39 Location of header block J39 6 Location of header block J38 1 J39 pin 1 arrow printed on motherboard 7 J38 pin 1 arrow printed on motherboard 2 Boot Cisco I...

Page 85: ... Removing the Server Top Cover on page 28 Step 4 Locate header block J38 and pins 9 10 as shown in Service Headers and Jumpers on page 78 Step 5 Install a two pin jumper across pins 9 and 10 Step 6 Reinstall the top cover and reconnect AC power cords to the server The server powers up to standby power mode indicated when the Power LED on the front panel is amber Step 7 Return the server to main po...

Page 86: ...pdate package and extract it to a temporary location Step 2 Copy the contents of the extracted recovery folder to the root directory of a USB drive The recovery folder contains the bios cap file that is required in this procedure The bios cap file must be in the root directory of the USB drive Do not rename this file The USB drive must be formatted with either the FAT16 or FAT32 file system Note S...

Page 87: ...rver Step 10 Return the server to main power mode by pressing the Power button on the front panel The server boots with the updated BIOS boot block When the BIOS detects a valid bios cap file on the USB drive it displays this message Found a valid recovery file Transferring to Cisco IMC System would flash the BIOS image now System would restart with recovered image after a few seconds Step 11 Wait...

Page 88: ...ds and any other cables and then power on the server by pressing the Power button Using the Boot Alternate Cisco IMC Image Header J39 Pins 1 2 You can use this Cisco IMC debug header to force the system to boot from an alternate Cisco IMC image Step 1 Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server on page 27 Disconnect power cords from a...

Page 89: ...ver on page 28 Step 4 Locate header block J39 pins 3 4 as shown in Service Headers and Jumpers on page 78 Step 5 Install a two pin jumper across J39 pins 3 and 4 Step 6 Reinstall the top cover and reconnect AC power cords to the server The server powers up to standby power mode indicated when the Power LED on the front panel is amber Step 7 Return the server to main power mode by pressing the Powe...

Page 90: ...ated when the Power LED on the front panel is amber Step 7 Return the server to main power mode by pressing the Power button on the front panel The server is in main power mode when the Power LED is green When you next log in to Cisco IMC you see a message similar to the following CIMC reset to factory defaults debug functionality is enabled On input power cycle CIMC will be reset to factory defau...

Page 91: ...cations The following table lists the physical specifications for the server versions Table 8 Physical Specifications Specification Description 1 7 in 43 2 mm Height 16 9 in 429 0 mm Width Server only 29 5 in 740 3 mm Server with slide rail 31 0 in 787 4 mm Depth length Maximum 37 5 lb 17 0 Kg Minimum 29 0 lb 13 2 Kg Weight Environmental Specifications The following table lists the environmental r...

Page 92: ...ver is stored or transported 8 to 90 Humidity RH operating 5 to 93 Humidity RH non operating when the server is stored or transported 0 to 10 000 feet Altitude operating 0 to 40 000 feet Altitude non operating when the server is stored or transported 5 5 Sound power level Measure A weighted per ISO7779 LwAd Bels Operation at 73 F 23 C 40 Sound pressure level Measure A weighted per ISO7779 LpAm dBA...

Page 93: ...atinum Efficiency 80Plus Platinum certified Efficiency rating RSP2 Form factor IEC320 C14 Input connector Power Cord Specifications Each power supply in the server has a power cord Standard power cords or jumper power cords are available for connection to the server The shorter jumper power cords for use in racks are available as an optional alternative to the standard power cords Only the approve...

Page 94: ...50 V 10 A Israel 2 5 8 2 CAB 250V 10A CN AC power cord 250 V 10 A PR China 2 3 7 5 CAB ACTW AC power cord 250 V 10 A Taiwan 0 68 2 2 CAB C13 CBN AC cabinet jumper power cord 250 10 A C13 to C14 2 0 6 6 CAB C13 C14 2M AC cabinet jumper power cord 250 V 10 A C13 to C14 2 5 8 2 CAB 9K10A AU AC power cord 250 V 10 A 3112 plug Australia 2 5 8 2 CAB N5K6A NA AC power cord 200 240 V 6 A North America Cis...

Page 95: ... BS1363 plug United Kingdom 2 5 8 2 CAB 9K12A NA AC power cord 125 V 13 A NEMA 5 15 plug North America 2 0 6 6 CAB AC L620 C13 AC power cord NEMA L6 20 to C13 connectors 2 5 8 2 CAB 9K10A IT AC power cord 250 V 10 A CEI 23 16 VII plug Italy NA NA R2XX DMYMPWRCORD No power cord PID option for ordering server with no power cord Cisco Application Services Engine Hardware Installation Guide 89 Server ...

Page 96: ...Cisco Application Services Engine Hardware Installation Guide 90 Server Specifications Server Specifications ...

Page 97: ...rollers and Cables This server supports a single PCIe style SAS RAID or HBA controller that plugs into a dedicated internal riser Alternatively the server has a software based SATA RAID controller embedded in the system Do not mix controller types in the server Do not use the embedded SATA controller and a hardware based RAID controller card at the same time This combination is not supported and c...

Page 98: ... drives that mount to this controller Cisco Boot Optimized M 2 RAID Controller UCS M2 HWRAID Storage Controller Card Firmware Compatibility Firmware on the storage controller RAID or HBA must be verified for compatibility with the current Cisco IMC and BIOS versions that are installed on the server RAID Backup Supercap This server supports installation of one supercap unit The unit mounts to a bra...

Page 99: ...AID group However see the recommendations that follow for the best performance Table 12 Mixing Drive Types Allowed Mix of Drive Types in RAID Group Yes SAS HDD SATA HDD Yes SAS SSD SATA SSD No HDD SSD Drive Type Mixing Best Practices For the best performance follow these guidelines Use either all SAS or all SATA drives in a RAID group Use the same capacity for each drive in the RAID group Never mi...

Page 100: ...upported internal controllers in the SFF 10 drive of the SE CL L3 This section also contains diagrams that show the cable to drive mapping Embedded RAID This SW RAID option can control up to 8 SATA drives in the SFF 10 drive version and up to 4 SATA drives in the LFF 4 drive version This embedded RAID option requires that you have a SATA interposer card installed in internal mRAID riser 3 Use the ...

Page 101: ...ard installed in internal mRAID riser 3 Use the SAS SATA cables that came with the server 1 Connect SAS SATA cable A1 from the A1 card connector to the A1 backplane connector 2 Connect SAS SATA cable A2 from the A2 card connector to the A2 backplane connector 3 For SFF 10 drive servers only Connect SAS SATA cable B2 from the B2 card connector to the B2 backplane connector See the following figures...

Page 102: ...he secondary controller can control two internal M 2 SATA drives The VMware ESX ESXi operating system is not supported with the embedded SATA MegaRAID controller in SW RAID mode You can use VMWare in AHCI mode Note The Microsoft Windows Server 2016 Hyper V hypervisor is supported for use with the embedded MegaRAID controller in SW RAID mode but all other hyperviors are not supported All Hypervisor...

Page 103: ...ller hub is SATA RAID 0 1 and 10 support for up to eight front loading SATA drives and up to two internal M 2 SATA drives The hub is divided into two SATA controllers that have different functions See Embedded SATA RAID Two SATA Controllers on page 98 When you order the server with this embedded controller the controller is enabled in the BIOS Instructions for enabling the controller are included ...

Page 104: ...and PCIe Slots Configuration b For the primary pSATA controller select pSATA and then choose one of the options from the dialog LSI SW RAID Enable the embedded pSATA RAID controller This menu option does not appear when the server is set to boot in Legacy mode UEFI mode is required To change the boot mode use the BIOS setting for Boot Options Boot Mode Note Disabled Disable the embedded pSATA RAID...

Page 105: ...y SATA For the sSATA controller select LSI Software RAID Configuration Utility sSATA For More RAID Utility Information The Broadcom utilities have help documentation for more information about using the utilities For basic information about RAID and for using the utilities for the RAID controller cards that are supported in Cisco servers see the Cisco Servers RAID Guide For hardware SAS MegaRAID c...

Page 106: ...Cisco Application Services Engine Hardware Installation Guide 100 Storage Controller Considerations For More RAID Utility Information ...

Search results

Summary of Contents for SE-CL-L3

Reviews:

Related manuals for SE-CL-L3

Brands by name

Popular brands

Cisco SE-CL-L3, Installation Manual

Search results

Summary of Contents for SE-CL-L3

Reviews:

Related manuals for SE-CL-L3

Brands by name

Popular brands