Cisco UCS C240 M4 Installation And Service Manual Download Page 142 | Manualshive

Page: 142 / 190

background image

C-10

Cisco UCS C240 M4 Server Installation and Service Guide

OL-32474-01

Appendix C RAID Controller Considerations

Embedded SATA RAID Controller

Embedded SATA RAID Controller

Note

VMware ESX/ESXi or any other virtualized environments are not supported for use with the embedded
MegaRAID controller. Hypervisors such as Hyper-V, Xen, or KVM are also not supported for use with
the embedded MegaRAID controller.

This server includes an embedded MegaRAID controller hub that can control up to eight SATA-only
front-facing drives (SFF 8-drive server only). It can also control up to two internal boot SSDs (SFF
24-drive and LFF 12-drive servers only).

This section contains the following topics:

•

Embedded SATA RAID Controller Requirements For Front-Facing Drive Control, page C-10

•

Embedded SATA RAID: Two SATA Controllers, page C-11

•

Embedded SATA RAID Controller Considerations, page C-12

•

Installing a SATA Interposer Board For Front-Facing Drive Control, page C-12

•

Installing a Software RAID 5 Key Module for Embedded RAID 5 Support, page C-12

•

Enabling the Embedded RAID Controller in the BIOS, page C-13

•

Disabling the Embedded RAID Controller in the BIOS, page C-14

•

Launching the LSI Embedded MegaRAID Configuration Utilities, page C-14

•

Installing LSI MegaSR Drivers For Windows and Linux, page C-15

Embedded SATA RAID Controller Requirements For Front-Facing Drive Control

The embedded SATA RAID controller hub requires the following items:

•

For front-facing drive control—The SFF, 8-drive version of the server.

The embedded RAID option is available for front-facing drive control only with the SFF 8-drive,
direct-connect backplane.

•

A SATA interposer board and Y-cable (bundled as

UCSC-IP-PCH-C240M4=

).

This interposer board plugs into the motherboard and provides cable connectors.

•

(Optional) A SATA RAID 5 key module.

This optional module can be installed to a motherboard header to add SATA RAID 5 support for
front-facing drives.

•

The embedded SATA RAID controller must be enabled in the server BIOS.

•

(Optional) LSI MegaSR drivers for Windows or Linux.

Note

The embedded SATA RAID controller can also manage internal SSD boot drives in a RAID 1 array. For
that case, the requirement is either the LFF 12-drive or the SFF 24-drive version of the server. Only the
LFF 12-drive and the SFF 24-drive versions of the server support internal boot SSDs. No cabling is
required for managing the internal SSD boot drives.

«
...
140
141
142
143
144
...
»

Summary of Contents for UCS C240 M4

Page 1: ...co has more than 200 offices worldwide Addresses phone numbers and fax numbers are listed on the Cisco website at www cisco com go offices Cisco UCS C240 M4 Server Installation and Service Guide June 21 2016 Text Part Number OL 32474 01 ...

Page 2: ...pyright 1981 Regents of the University of California NOTWITHSTANDING ANY OTHER WARRANTY HEREIN ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED AS IS WITH ALL FAULTS CISCO AND THE ABOVE NAMED SUPPLIERS DISCLAIM ALL WARRANTIES EXPRESSED OR IMPLIED INCLUDING WITHOUT LIMITATION THOSE OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEA...

Page 3: ...Preparing for Server Installation 2 3 Installation Guidelines 2 3 Rack Requirements 2 4 Equipment Requirements 2 4 Supported Slide Rail Kits 2 4 Slide Rail Adjustment Range and Cable Management Arm Dimensions 2 4 Installing the Server In a Rack 2 5 Installing the Slide Rails 2 5 Installing the Cable Management Arm Optional 2 8 Reversing the Cable Management Arm Optional 2 9 Initial Server Setup 2 ...

Page 4: ...ment 3 12 Installing or Replacing Server Components 3 13 Replaceable Component Locations 3 14 Replacing SAS SATA Hard Drives or Solid State Drives 3 15 SAS SATA Drive Population Guidelines 3 15 Replacing SAS SATA Drives 3 18 Replacing NVMe PCIe Solid State Drives 3 19 NVMe PCIe SSD Population Guidelines 3 19 NVME PCIe SSD Requirements and Restrictions 3 19 Replacing an NVMe PCIe SSD 3 19 Installin...

Page 5: ... Resolving Limited Resources 3 55 Installing an NVIDIA GPU Card 3 57 Replacing Internal SATA Boot Drives 3 57 Replacing an Internal SATA Boot Drive 3 57 Installing a Trusted Platform Module TPM 3 59 TPM 2 0 Considerations 3 59 Installing the TPM Hardware 3 60 Enabling TPM Support in the BIOS 3 62 Enabling the Intel TXT Feature in the BIOS 3 63 Replacing Power Supplies 3 64 Replacing an AC Power Su...

Page 6: ...UCS C240 M4 Server RAID Controllers C 4 Cisco UCS SAS 9300 8e HBA Considerations C 4 Mixing Rules C 4 Cisco UCS 9300 8e Bad Drive and Predictive Failure Behavior C 4 Setting the Preferred Boot Device for Cisco UCS 9300 8e C 5 Mixing Drive Types in RAID Groups C 6 RAID Backup Units C 6 RAID Controller Cabling C 7 Cable Routing C 7 Cisco UCS C240 M4 Server RAID Controller Cabling Instructions C 8 SF...

Page 7: ...D 1 GPU Card Configuration Rules D 2 Requirement For All Supported GPUs Memory Mapped I O Greater than 4 GB D 3 Replacing a GPU Card Less Than 300 W D 4 Installing an NVIDIA K80 GPU Card and 300 W GPU Conversion Kit D 6 Installing a Tesla M60 GPU Card and 300 W GPU Conversion Kit D 13 Installation Overview D 13 Installing the NVIDIA M60 Hardware D 13 NVIDIA GRID License Server Overview D 21 Regist...

Page 8: ...Contents viii Cisco UCS C240 M4 Server Installation and Service Guide OL 32474 01 ...

Page 9: ...s This document uses the following conventions for notes cautions and safety warnings Notes and cautions contain important information that you should know Note Means reader take note Notes contain helpful suggestions or references to material that are not covered in the publication Caution Means reader be careful Cautions contain information about something you might do that could result in equip...

Page 10: ...oa huomioi sähköpiirien käsittelemiseen liittyvät riskit ja tutustu onnettomuuksien yleisiin ehkäisytapoihin Turvallisuusvaroitusten käännökset löytyvät laitteen mukana toimitettujen käännettyjen turvallisuusvaroitusten joukosta varoitusten lopussa näkyvien lausuntonumeroiden avulla SÄILYTÄ NÄMÄ OHJEET Attention IMPORTANTES INFORMATIONS DE SÉCURITÉ Ce symbole d avertissement indique un danger Vous...

Page 11: ... que poderá ser causadora de lesões corporais Antes de iniciar a utilização de qualquer equipamento tenha conhecimento dos perigos envolvidos no manuseio de circuitos elétricos e familiarize se com as práticas habituais de prevenção de acidentes Utilize o número da instrução fornecido ao final de cada aviso para localizar sua tradução nos avisos de segurança traduzidos que acompanham este disposit...

Page 12: ...xii Cisco UCS C240 M4 Server Installation and Service Guide OL 32474 01 ...

Page 13: ...ão fornecido ao final de cada aviso para localizar sua tradução nos avisos de segurança traduzidos que acompanham o dispositivo GUARDE ESTAS INSTRUÇÕES Advarsel VIGTIGE SIKKERHEDSANVISNINGER Dette advarselssymbol betyder fare Du befinder dig i en situation med risiko for legemesbeskadigelse Før du begynder arbejde på udstyr skal du være opmærksom på de involverede risici der er ved elektriske kred...

Page 14: ...xiv Cisco UCS C240 M4 Server Installation and Service Guide OL 32474 01 ...

Page 15: ...o ucs docfeedback external cisco com We appreciate your feedback Obtaining Documentation and Submitting a Service Request For information on obtaining documentation using the Cisco Bug Search Tool BST submitting a service request and gathering additional information see What s New in Cisco Product Documentation at http www cisco com c en us td docs general whatsnew whatsnew html Subscribe to What ...

Page 16: ...xvi Cisco UCS C240 M4 Server Installation and Service Guide OL 32474 01 ...

Page 17: ... 5 inch SAS SATA hard drives or solid state drives SSDs This version also supports up to 2 NVMe PCIe SSDs See Figure 1 1 Cisco UCS C240 M4 SFF drives with 16 drive backplane and integrated expander This version holds up to 16 2 5 inch SAS SATA hard drives or solid state drives This version also supports up to 2 NVMe PCIe SSDs See Figure 1 2 Cisco UCS C240 M4 SFF drives with 8 drive direct connect ...

Page 18: ...A drives 7 Fan status LED 2 Drive bays 1 and 2 support NVMe PCIe SSDs and SAS SATA drives 8 Temperature status LED 3 Operations panel buttons and LEDs 9 Power supply status LED 4 Power button LED 10 Network link activity LED 5 Unit Identification button LED 11 Pull out asset tag 6 System status LED 12 KVM connector used with KVM cable that provides two USB 2 0 one VGA and one serial connector 3529...

Page 19: ...ays 1 16 support SAS SATA drives 7 Fan status LED 2 Drive bays 1 and 2 support NVMe PCIe SSDs and SAS SATA drives 8 Temperature status LED 3 Operations panel buttons and LEDs 9 Power supply status LED 4 Power button LED 10 Network link activity LED 5 Unit Identification button LED 11 KVM connector used with KVM cable that provides two USB 2 0 one VGA and one serial connector 6 System status LED 12...

Page 20: ...anel Features 1 Drive bays 1 8 support SAS SATA drives 7 Fan status LED 2 Drive bays 1 and 2 support NVMe PCIe SSDs and SAS SATA drives 8 Temperature status LED 3 Operations panel buttons and LEDs 9 Power supply status LED 4 Power button LED 10 Network link activity LED 5 Unit Identification button LED 11 KVM connector used with KVM cable that provides two USB 2 0 one VGA and one serial connector ...

Page 21: ... 12 Drive Front Panel Features 1 Drive bays 1 16 up to 16 2 5 inch drives 7 Temperature status LED 2 Operations panel buttons and LEDs 8 Power supply status LED 3 Power button LED 9 Network link activity LED 4 Unit Identification button LED 10 Pull out asset tag 5 System status LED 11 KVM connector used with KVM cable that provides two USB 2 0 one VGA and one serial connector 6 Fan status LED 3529...

Page 22: ...iser options and slot specifications 7 Serial port RJ 45 connector 2 PCIe riser 2 slots 4 5 6 8 Dual 1 Gb Ethernet ports LAN1 LAN2 3 Power supplies DC power supplies shown See Power Specifications page A 2 for specifications and options 9 VGA video port DB 15 connector 4 Modular LAN on motherboard mLOM card slot 10 Rear Unit Identification button LED 5 USB 3 0 ports two 11 Grounding lug holes for ...

Page 23: ...ng a PCIe Card page 3 49 for riser options and slot specifications 3 DIMM sockets on motherboard up to 24 DIMMs 12 SATA boot drives two sockets available only on PCIe riser 1 option 1C 4 CPUs and heatsinks two 13 mLOM card socket on motherboard under PCIe riser 1 5 Cisco SD card slots on motherboard two 14 Socket for embedded RAID interposer board 6 PCIe interposer board socket 15 Cisco modular RA...

Page 24: ...onnector that is used with the KVM cable which provides two USB 2 0 one VGA and one serial DB 9 connector Modular I O A dedicated socket can be used to add an mLOM card for additional rear panel connectivity up to four 1 Gb or 10 Gb Ethernet ports WoL 1 Gb BASE T Ethernet LAN ports support the wake on LAN WoL standard Power Two power supplies AC power supplies optionally 650 W AC 1200 W AC or 1400...

Page 25: ...n holds up to 12 3 5 inch SAS SATA hard drives Note You cannot change the backplane type after factory To change a front panel backplane configuration a chassis replacement is required Internal USB One internal USB 3 0 port on the motherboard that you can use with a USB thumb drive for additional storage SD cards Two internal bays on the motherboard for up to two SD cards The two flash drives can ...

Page 26: ...1 10 Cisco UCS C240 M4 Server Installation and Service Guide OL 32474 01 Chapter 1 Overview ...

Page 27: ... the BIOS and Cisco IMC Firmware page 2 15 Note Before you install operate or service a server review the Regulatory Compliance and Safety Information for Cisco UCS C Series Servers for important safety information Warning IMPORTANT SAFETY INSTRUCTIONS This warning symbol means danger You are in a situation that could cause bodily injury Before you work on any equipment be aware of the hazards inv...

Page 28: ...f any damage occurred during transportation or any items are missing contact your customer service representative immediately Step 1 Remove the server from its cardboard container and save all packaging material Step 2 Compare the shipment to the equipment list provided by your customer service representative Verify that you have all items Step 3 Check for damage and report any discrepancies or da...

Page 29: ...for short circuit overcurrent protection Ensure that the protective device is rated not greater than 250 V 15 A Statement 1005 Warning Installation of the equipment must comply with local and national electrical codes Statement 1074 Caution To ensure proper airflow it is necessary to rack the servers using rail kits Physically placing the units on top of one another or stacking without the use of ...

Page 30: ...ard 19 in 48 3 cm wide four post EIA rack with mounting posts that conform to English universal hole spacing per section 1 of ANSI EIA 310 D 1992 The rack post holes can be square 0 38 inch 9 6 mm round 0 28 inch 7 1 mm 12 24 UNC or 10 32 UNC when you use the supplied slide rails The minimum vertical rack space per server must be two RUs equal to 3 5 in 88 9 mm Equipment Requirements The slide rai...

Page 31: ... be mounted at the bottom of the rack if it is the only unit in the rack When mounting this unit in a partially filled rack load the rack from the bottom to the top with the heaviest component at the bottom of the rack If the rack is provided with stabilizing devices install the stabilizers before mounting or servicing the unit in the rack Statement 1006 Step 1 Attach the inner rails to the sides ...

Page 32: ...the rack post holes from the outside front see Figure 2 2 Note The rack post must be between the mounting pegs and the open securing plate b Push the mounting pegs into the rack post holes from the outside front c Press the securing plate release button marked PUSH The spring loaded securing plate closes to lock the pegs in place d Adjust the slide rail length and then push the rear mounting pegs ...

Page 33: ... at the internal stops c Slide the release clip toward the rear on both inner rails Figure 2 3 and then continue pushing the server into the rack until its front slam latches engage with the rack posts Figure 2 3 Inner Rail Release Clip Step 5 Optional Secure the server in the rack more permanently by using the two screws that are provided with the slide rails Perform this step if you plan to move...

Page 34: ...2 4 Slide the tab over the end of the rail until it clicks and locks Step 3 Pull out the width adjustment slider that is at the opposite end of the CMA assembly until it matches the width of your rack see Figure 2 4 Step 4 Slide the CMA tab that is at the end of the width adjustment slider onto the end of the stationary slide rail that is attached to the rack post see Figure 2 4 Slide the tab over...

Page 35: ...es must remain pointing upward Step 2 Flip the tabs at the end of each CMA arm so that they point toward the rear of the server Step 3 Pivot the tab that is at the end of the width adjustment slider Depress and hold the metal button on the outside of the tab and pivot the tab 180 degrees so that it points toward the rear of the server Figure 2 5 Reversing the CMA 1 CMA tab on end of width adjustme...

Page 36: ...procedure requires a KVM cable Cisco PID N20 BKVM See Local Connection Procedure page 2 10 Remote setup Use this procedure if you want to perform setup through your dedicated management LAN See Remote Connection Procedure page 2 11 Note To configure the system remotely you must have a DHCP server on the same network as the system Your DHCP server must be preconfigured with the range of MAC address...

Page 37: ... power status by looking at the system Power Status LED on the front panel see External Features Overview page 1 1 The system is in standby power mode when the LED is amber Step 2 Plug your management Ethernet cable into the dedicated management port on the rear panel see External Features Overview page 1 1 Step 3 Allow your preconfigured DHCP server to assign an IP address to the server node Step...

Page 38: ...ancy and IP setting See also the required VIC Slot setting below VIC Slot If you use the Cisco Card NIC mode you must select this setting to match where your VIC is installed The choices are Riser1 Riser2 or Flex LOM the mLOM slot If you select Riser1 slot 2 is the primary slot but you can use slot 1 If you select Riser2 slot 5 is the primary slot but you can use slot 4 If you select Flex LOM you ...

Page 39: ...ased on the switch port to which the server is connected If you disable auto negotiation you must set the port speed and duplex mode manually Step 10 Optional Reset port profiles and the port name Step 11 Press F5 to refresh the settings that you made You might have to wait about 45 seconds until the new settings appear and the message Network settings configured is displayed before you reboot the...

Page 40: ...ccess Cisco IMC You must select a NIC redundancy and IP setting See also the required VIC Slot setting below VIC Slot If you use the Cisco Card NIC mode you select this setting to match where your VIC is installed The choices are Riser1 Riser2 or Flex LOM the mLOM slot If you select Riser1 slot 2 is the primary slot but you can also use slot 1 If you select Riser2 slot 5 is the primary slot but yo...

Page 41: ... Cisco Cisco provides release notes with each firmware image There are several methods for updating the firmware Recommended method for system components firmware update Use the Cisco Host Upgrade Utility to simultaneously upgrade Cisco IMC BIOS LOM LSI storage controller and Cisco UCS VIC firmware to compatible levels See the Cisco Host Upgrade Utility Quick Reference Guide for your firmware leve...

Page 42: ...up Note The version and build of the current BIOS are displayed on the Main page of the utility Step 2 Use the arrow keys to select the BIOS menu page Step 3 Highlight the field to be modified by using the arrow keys Step 4 Press Enter to select the field that you want to change and then modify the value in the field Step 5 Press the right arrow key until the Exit menu screen is displayed Step 6 F...

Page 43: ...system event logs by using the built in Cisco Integrated Management Controller Cisco IMC GUI or CLI interfaces See the user documentation for your firmware release at the following URL http www cisco com en US products ps10739 products_installation_and_configuration_guides_list html Server Configuration Utility Cisco has also developed the Cisco Server Configuration Utility for C Series servers wh...

Page 44: ...s 16 drive version are shown Figure 3 1 Front Panel LEDs 1 Hard drive fault LED on each drive tray Note NVMe PCIe SSDs drive tray LEDs have slightly different behavior See Table 3 1 for the LED states 6 Fan status LED 2 Hard drive activity LED on each drive tray 7 Temperature status LED 3 Power button power status LED 8 Power supply status LED 4 Unit Identification button LED 9 Network link activi...

Page 45: ...drive is reading or writing data 1 PCIe NVMe PCIe SSD status SFF 8 drives version only Off The drive is not in use and can be safely removed Green The drive is in use and functioning properly Green blinking the driver is initializing following insertion or the driver is unloading following an eject command Amber The drive has failed Amber blinking A drive Locate command has been issued in the soft...

Page 46: ...s are operating properly Amber steady One or more fan modules breached the critical threshold Amber blinking One or more fan modules breached the non recoverable threshold 7 Temperature status Green The server is operating at normal temperature Amber steady One or more temperature sensors breached the critical threshold Amber blinking One or more temperature sensors breached the non recoverable th...

Page 47: ...fault This is a summary for advanced power supply LED information see Table 3 3 Off The power supply is operating normally Amber blinking An event warning threshold has been reached but the power supply continues to operate Amber solid A critical fault threshold has been reached causing the power supply to shut down for example a fan failure or an over temperature condition 2 Power supply status T...

Page 48: ...resent on the active link 4 1 Gb Ethernet dedicated management link speed Off Link speed is 10 Mbps Amber Link speed is 100 Mbps Green Link speed is 1 Gbps 5 1 Gb Ethernet dedicated management link status Off No Link is present Green Link is active Green blinking Traffic is present on the active link 6 1 Gb Ethernet link speed Off Link speed is 10 Mbps Amber Link speed is 100 Mbps Green Link speed...

Page 49: ...nking Off 12Vmain off standby power mode Off Off No AC power input all PSUs present Off On No AC power input redundant supply active Blinking Solid on 12V over voltage protection OVP Blinking Solid on 12V under voltage protection UVP Blinking Solid on 12V over current protection OCP Blinking Solid on 12V short circuit protection SCP Solid on Solid on PSU fan fault Lock before OTP Blinking Solid on...

Page 50: ...Figure 3 1 or Figure 3 2 with AC power removed An LED lights amber to indicate a faulty component See Figure 3 3 for the locations of these internal LEDs Figure 3 3 Internal Diagnostic LED Locations 1 Fan module fault LEDs one on each fan module 4 SD card fault LEDs 2 DIMM fault LEDs one directly in front of each DIMM socket on the motherboard 5 RTC battery fault LED under PCIe riser 1 3 CPU fault...

Page 51: ...g fans and it is safe to power off the server from this mode You can invoke a graceful shutdown or a hard shutdown by using either of the following methods Use the Cisco IMC management interface Use the Power button on the server front panel To use the Power button follow these steps Step 1 Check the color of the Power Status LED see the Front Panel LEDs section on page 3 2 Green The server is in ...

Page 52: ... top cover straight up from the server and set it aside Step 2 Replace the top cover Note The latch must be in the fully open position when you set the cover back in place which allows the opening in the latch to sit over a peg that is on the fan tray a With the latch in the fully open position place the cover on top of the server about one half inch 1 27 cm behind the lip of the front cover panel...

Page 53: ...erver Installation and Service Guide OL 32474 01 Chapter 3 Maintaining the Server Preparing for Server Component Installation Figure 3 4 Removing the Top Cover 1 Front cover panel 3 Locking cover latch 2 Top cover 352953 1 2 3 ...

Page 54: ...wap or Hot Plug Replacement Some components can be removed and replaced without powering off and removing AC power from the server Hot swap replacement You do not have to precondition or shut down the component in the software before you remove it for the following components SAS SATA hard drives or SSDs Cooling fan modules Power supplies when 1 1 redundant Hot plug replacement You must take the c...

Page 55: ...LEDs remotely by using the Cisco IMC interface See the Status LEDs and Buttons section on page 3 2 for locations of these LEDs This section describes how to install and replace server components and it includes the following topics Replaceable Component Locations page 3 14 Replacing SAS SATA Hard Drives or Solid State Drives page 3 15 Replacing NVMe PCIe Solid State Drives page 3 19 Replacing Fan ...

Page 56: ...e slots 4 5 6 2 Fan modules six hot swappable 11 PCIe riser 1 PCIe slots 1 2 3 Slot 3 not present in all versions See Replacing a PCIe Card page 3 49 for riser options and slot specifications 3 DIMM sockets on motherboard up to 24 DIMMs 12 SATA boot drives two sockets available only on PCIe riser 1 option 1C 4 CPUs and heatsinks two 13 mLOM card socket on motherboard under PCIe riser 1 5 Cisco SD ...

Page 57: ...r solid state drives SAS SATA drives are hot swappable Cisco UCS C240 M4 SFF drives with 8 drive direct connect backplane and no expander This version holds up to 8 2 5 inch SAS SATA hard drives or solid state drives SAS SATA drives are hot swappable Cisco UCS C240 M4 Large form factor LFF drives with 12 drive backplane and integrated expander This version holds up to 12 3 5 inch SAS SATA hard dri...

Page 58: ...rive that contains a mix of hard drives and SSDs That is when you create a logical volume it must contain all hard drives or all SSDs 4K Sector Format Drives Considerations You must boot 4K sector format drives in UEFI mode not legacy mode See Setting Up Booting in UEFI Mode in the BIOS Setup Utility page 3 17 or Setting Up Booting in UEFI Mode in the Cisco IMC GUI page 3 17 Do not configure 4K se...

Page 59: ...n prompted during bootup b Go to the Boot Options tab c Under Boot Option Priorities verify that the OS you installed is listed as your Boot Option 1 Setting Up Booting in UEFI Mode in the Cisco IMC GUI Step 1 Use a web browser and the IP address of the server to log into the Cisco IMC GUI management interface Step 2 Navigate to Server BIOS Step 3 Under Actions click Configure BIOS Step 4 In the C...

Page 60: ... 10 b Grasp and open the ejector lever and then pull the drive tray out of the slot c If you are replacing an existing drive remove the four drive tray screws that secure the drive to the tray and then lift the drive out of the tray Step 2 Install a new drive a Place a new drive in the empty drive tray and replace the four drive tray screws b With the ejector lever on the drive tray open insert th...

Page 61: ...er board is not available in a single CPU system Observe these restrictions for NVMe PCIe SSDs You cannot boot from an NVMe PCIe SSD You cannot control an NVMe PCIe SSD with a SAS RAID controller because they communicate with the server via the PCIe bus Caution NVMe PCIe SSDs are hot pluggable which means that you must shut down the drive before removal but you do not have to fully power off the s...

Page 62: ...he four drive tray screws b With the ejector lever on the drive tray open insert the drive tray into the empty drive bay c Push the tray into the slot until it touches the backplane and then close the ejector lever to lock the drive in place Step 3 Observe the drive tray LED and wait until it returns to solid green before accessing the drive Off The drive is not in use Green blinking the driver is...

Page 63: ...cket on the motherboard see Figure 3 12 b Pinch the securing clip on the board while you insert the board to the socket as shown in Figure 3 11 c Carefully push down to seat the board then release the securing clip Step 5 Connect the two cables that come with the interposer board a Connect the double connector end of the cable to the interposer board see Figure 3 11 b Route the cables to the front...

Page 64: ...40 M4 Server Installation and Service Guide OL 32474 01 Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3 12 PCIe Interposer Board Cabling 1 PCIe interposer board socket on motherboard ...

Page 65: ... you can remove the top cover You might have to detach cables from the rear panel to provide clearance Caution If you cannot safely view and access the component remove the server from the rack Step 2 Remove the top cover as described in Removing and Replacing the Server Top Cover page 3 10 Step 3 Identify a faulty fan module by looking for a fan fault LED that is lit amber see Figure 3 14 Step 4 ...

Page 66: ...hapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3 14 Fan Modules Latch and Fault LED 1 Finger latch on each fan module 2 Fan module fault LED on each fan module 352959 FAN 05 FAN 04 FAN 03 FAN 02 FAN 01 CPU 1 CPU 2 SD1 SD2 Riser 2 Riser 1 1 2 ...

Page 67: ...does not support third party DIMMs Using non Cisco DIMMs in the server might result in system problems or damage to the motherboard Note To ensure the best server performance it is important that you are familiar with memory performance guidelines and population rules before you install or replace the memory Memory Performance Guidelines and Population Rules This section describes the type of memo...

Page 68: ...h CPU identically Fill blue 1 slots in the channels first A1 E1 B1 F1 C1 G1 D1 H1 Fill black 2 slots in the channels second A2 E2 B2 F2 C2 G2 D2 H2 Fill white 3 slots in the channels third A3 E3 B3 F3 C3 G3 D3 H3 Any DIMM installed in a DIMM socket for which the CPU is absent is not recognized In a single CPU configuration populate the channels for CPU1 only A B C D Memory mirroring reduces the am...

Page 69: ...annels on a CPU must be populated identically with regard to size and organization DIMM socket populations within a channel for example A1 A2 A3 do not have to be identical but the same DIMM slot location across all four channels must be populated the same For example DIMMs in sockets A1 B1 C1 and D1 must be identical DIMMs in sockets A2 B2 C2 and D2 must be identical However the A1 B1 C1 D1 DIMMs...

Page 70: ...aution If you cannot safely view and access the component remove the server from the rack Step 3 Remove the top cover as described in Removing and Replacing the Server Top Cover page 3 10 Step 4 Remove the air baffle that sits over the DIMM sockets and set it aside Step 5 Identify the faulty DIMM by observing the DIMM socket fault LEDs on the motherboard see Figure 3 3 Step 6 Remove the DIMMs that...

Page 71: ...n in Table 3 6 you can replace the CPU hardware by using the procedure in this section If your server s firmware and or Cisco UCS Manager software is earlier than the required levels use the instructions in the Cisco UCS C Series Servers Upgrade Guide for Intel Xeon v4 CPUs to upgrade your software After you upgrade the software return to the procedure in this section as directed to replace the CP...

Page 72: ...d Powering Off the Server page 3 9 Step 2 Slide the server out the front of the rack far enough so that you can remove the top cover You might have to detach cables from the rear panel to provide clearance Caution If you cannot safely view and access the component remove the server from the rack Step 3 Remove the top cover as described in Removing and Replacing the Server Top Cover page 3 10 Step ...

Page 73: ...CPU by the finger grips on its plastic frame and align the tab on the frame that is labeled ALIGN with the hinged seat as shown in Figure 3 17 b Insert the tab on the CPU frame into the seat until it stops and is held firmly The line below the word ALIGN should be level with the edge of the seat as shown in Figure 3 17 c Swing the hinged seat with the CPU down until the CPU frame clicks in place a...

Page 74: ...let it soak for a least 15 seconds b Wipe all of the old thermal grease off the old heat sink and CPU using the soft cloth that is included with the heatsink cleaning kit Be careful to not scratch the heat sink surface Note New heatsinks come with a pre applied pad of thermal grease If you are reusing a heatsink you must apply thermal grease from a syringe UCS CPU GREASE3 c Align the four heatsink...

Page 75: ...required for CPU handling or installation Always grasp the plastic frame on the CPU when handling Scenario 1 You are reusing the existing heatsinks Heat sink cleaning kit UCSX HSCK Thermal grease kit for C240 M4 UCS CPU GREASE3 Scenario 2 You are replacing the existing heatsinks Heat sink UCSC HS C240M4 Heat sink cleaning kit UCSX HSCK A CPU heatsink cleaning kit is good for up to four CPU and hea...

Page 76: ...ess the component remove the server from the rack Step 3 Remove the top cover as described in Removing and Replacing the Server Top Cover page 3 10 Step 4 Remove the plastic air baffle that sits over the CPUs to gain access to the interposer cables Step 5 Remove PCIe riser 1 from the server to provide clearance See Replacing a PCIe Riser page 3 47 Step 6 Remove any existing PCH SATA interposer boa...

Page 77: ...OL 32474 01 Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3 18 SATA Interposer Board Socket Location 1 SATA interposer board socket on motherboard 352960 FAN 05 FAN 04 FAN 03 FAN 02 FAN 01 CPU 1 CPU 2 SD1 SD2 Riser 2 Riser 1 1 ...

Page 78: ...ity HUU for your firmware release to bring it to a compatible level See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring server components to compatible levels HUU Guides Replacement Procedure Step 1 Power off the server as described in Shutting Down and Powering Off the Server page 3 9 Step 2 Slide the server out the front of the rack far eno...

Page 79: ...racket b Align the two slots on the back of the bracket with the two pegs on the chassis wall The two slots on the bracket must slide down over the pegs at the same time that you push the card into the motherboard socket c Gently press down on both top corners of the metal bracket to seat the card into the socket on the motherboard d Connect the supercap power module cable to its connector on the ...

Page 80: ...om the modular RAID controller card see Figure 3 20 a The plastic bracket on the card has a securing plastic clip at each end of the TMM Gently spread each clip away from the TMM b Pull straight up on the TMM to lift it off the two plastic guide pegs and the socket on the card Step 6 Install a TMM to the modular RAID controller card see Figure 3 20 a Align the TMM over the bracket on the card Alig...

Page 81: ...ocket c Gently press down on both top corners of the metal bracket to seat the card into the socket on the motherboard Figure 3 20 TMM on Modular RAID Controller Card 1 TMM on modular RAID card 5 Side view guide peg 2 Securing bracket clips 6 Side view socket on modular RAID card 3 Guide pegs on bracket protruding through guide holes on TMM 7 Side view connector on underside of TMM 4 SCPM cable co...

Page 82: ...cribed in Shutting Down and Powering Off the Server page 3 9 Step 2 Slide the server out the front of the rack far enough so that you can remove the top cover You might have to detach cables from the rear panel to provide clearance Caution If you cannot safely view and access the component remove the server from the rack Step 3 Remove the top cover as described in Removing and Replacing the Server...

Page 83: ...Server Installing or Replacing Server Components Figure 3 21 SCPM RAID Backup Unit Mounting Point and Cable Path 1 SCPM mounting point on removable air baffle air baffle not shown 2 SCPM cable routing path the red line 352962 FAN 05 FAN 04 FAN 03 FAN 02 FAN 01 CPU 1 CPU 2 SD1 SD2 Riser 2 Riser 1 1 2 ...

Page 84: ...ar enough so that you can remove the top cover You might have to detach cables from the rear panel to provide clearance Caution If you cannot safely view and access the component remove the server from the rack Step 3 Remove the top cover as described in Removing and Replacing the Server Top Cover page 3 10 Step 4 Remove any existing software RAID key module a Locate the module on the motherboard ...

Page 85: ...y module a Align the module with the pins in the motherboard header b Gently press down on the module until it is seated and the retention clip locks over the module see Figure 3 23 Figure 3 23 Software RAID 5 Key Module Retention Clip 1 Printed circuit board on module 3 Motherboard header 2 Retention clip on motherboard header 4 Retention clip in installed position 303691 3 4 2 1 1 2 ...

Page 86: ...ng Off the Server page 3 9 Step 2 Slide the server out the front of the rack far enough so that you can remove the top cover You might have to detach cables from the rear panel to provide clearance Caution If you cannot safely view and access the component remove the server from the rack Step 3 Remove the top cover as described in Removing and Replacing the Server Top Cover page 3 10 Step 4 Remove...

Page 87: ...nel to provide clearance Caution If you cannot safely view and access the component remove the server from the rack Step 3 Remove the top cover as described in Removing and Replacing the Server Top Cover page 3 10 Step 4 Remove an SD card see Figure 3 25 a Push on the top of the SD card and then release it to allow it to spring out from the slot b Remove the SD card from the slot Step 5 Install an...

Page 88: ... USB port can be enabled or disabled in the server BIOS See Figure 3 5 for the location of the internal USB 3 0 slot on the motherboard Step 1 Enter the BIOS Setup Utility by pressing the F2 key when prompted during bootup Step 2 Navigate to the Advanced tab Step 3 On the Advanced tab select USB Configuration Step 4 On the USB Configuration page choose USB Ports Configuration Step 5 Scroll to USB ...

Page 89: ...e riser and lift straight up on both ends to disengage its circuit board from the socket on the motherboard Set the riser on an antistatic mat b If the riser has a card installed remove the card from the riser See Replacing a PCIe Card page 3 49 Step 5 Install a new PCIe riser a If you removed a card from the old PCIe riser install the card to the new riser see Replacing a PCIe Card page 3 49 b Po...

Page 90: ... Server Installing or Replacing Server Components Figure 3 26 PCIe Riser Alignment Features 1 Alignment peg locations on motherboard two for each riser 2 Alignment channel locations on chassis two for each riser 352970 FAN 05 FAN 06 FAN 04 FAN 03 FAN 02 FAN 01 CPU 1 CPU 2 SD1 SD2 Riser 2 Riser 1 1 2 ...

Page 91: ... Replacing a PCIe Card page 3 51 Special Considerations for Cisco UCS Virtual Interface Cards page 3 53 Special Considerations for Cisco UCS Fusion ioMemory3 Storage Accelerator Cards page 3 54 Installing Multiple PCIe Cards and Resolving Limited Resources page 3 55 PCIe Slots The server contains two toolless PCIe risers for horizontal installation of PCIe cards see Figure 3 27 Riser 1 can be orde...

Page 92: ...PU power connector in this version Use riser version 1A or 1C for GPU cards Slot Number Electrical Lane Width Connector Length Card Length Card Height NCSI Support 1 Gen 3 x8 x16 connector 3 4 length Full height No 2 Gen 3 x8 x24 connector Full length Full height Yes 3 Gen 3 x8 x16 connector Full length Full height No Table 3 9 Riser 1C UCSC PCI 1C 240M4 PCIe Expansion Slots Slot Number Electrical...

Page 93: ... server from the rack Step 3 Remove the top cover as described in Removing and Replacing the Server Top Cover page 3 10 Step 4 Remove a PCIe card or a blanking panel from the PCIe riser a Lift straight up on both ends of the riser to disengage its circuit board from the socket on the motherboard Set the riser on an antistatic mat b On the bottom of the riser loosen the single thumbscrew that holds...

Page 94: ... the top cover Step 7 Replace the server in the rack replace cables and then power on the server by pressing the Power button Step 8 If you replaced a RAID controller card continue with Restoring RAID Configuration After Replacing a RAID Controller page C 23 Figure 3 28 PCIe Riser Securing Features Three Slot Riser Shown 1 Securing plate hinge tabs 3 GPU card power connector 2 Securing plate thumb...

Page 95: ...sco UCS Manager Integration Primary Slot for Cisco Card NIC Mode Minimum Cisco IMC Firmware Minimum VIC Firmware Cisco UCS VIC1225 UCSC PCIE CSC 02 4 PCIe PCIE 2 PCIE 1 PCIE 5 PCIE 4 See footnote1 1 For riser PID UCSC PCI 1B 240M4 slot 2 is the only slot that supports a VIC in riser version 1B In this riser version slot 2 is an 8x lane so if you are using Cisco UCS VIC1385 give it priority on slot...

Page 96: ...C F FIO 1000PS 61 1 PCIe riser 1 versions UCSC PCI 1A 240M4 and UCSC PCI 1C 240M4 have only two slots and therefore when using those versions only five cards are supported in the server All 2 0 2 Half height Cisco UCS 1300 GB Fusion ioMemory3 PX Performance Line UCSC F FIO 1300PS 6 All 2 0 2 Half height2 2 A rear panel tab adapter is required to fit the half height cards in full height slots Cisco...

Page 97: ... the BIOS Setup utility ERROR CODE SEVERITY INSTANCE DESCRIPTION 146 Major N A PCI out of resources error Major severity requires user intervention but does not prevent system boot To resolve this issue disable the Option ROMs that are not needed for system booting The BIOS Setup Utility provides the setup options to enable or disable the Option ROMs at the PCIe slot level for the PCIe expansion s...

Page 98: ...lowing symptoms have been observed The system might get stuck in an infinite reset loop The BIOS might appear to hang while initializing PCIe devices The PCIe option ROMs might take excessive time to complete which appears to lock up the system PCIe boot devices might not be accessible from the BIOS PCIe option ROMs might report initialization errors These errors are seen before the BIOS passes co...

Page 99: ...r page 3 9 Step 2 Slide the server out the front of the rack far enough so that you can remove the top cover You might have to detach cables from the rear panel to provide clearance Caution If you cannot safely view and access the component remove the server from the rack Step 3 Remove the top cover as described in Removing and Replacing the Server Top Cover page 3 10 Step 4 Remove PCIe riser 1C f...

Page 100: ...e motherboard and over its alignment features in the chassis see Figure 3 26 d Carefully push down on both ends of the PCIe riser to fully engage its circuit board connector with the socket on the motherboard Step 8 Replace the top cover Step 9 Replace the server in the rack replace cables and then power on the server by pressing the Power button Step 10 Set the boot order for these SATA boot driv...

Page 101: ...ng TPM in the server you can install TPM 2 0 You must first upgrade to Intel v4 code regardless of whether the installed CPU is Intel v3 or v4 TPM 2 0 requires Intel v4 code or later Caution If your Intel v3 or Intel v4 system is currently supported and protected by TPM version 2 0 a potential security exposure might occur if you downgrade the system software and BIOS to a version earlier than tho...

Page 102: ...l to provide clearance Caution If you cannot safely view and access the component remove the server from the rack Step 4 Remove the top cover as described in Removing and Replacing the Server Top Cover page 3 10 Step 5 Remove PCIe riser 2 to provide clearance See Replacing a PCIe Riser page 3 47 for instructions Step 6 Install a TPM a Locate the TPM socket on the motherboard as shown in Figure 3 2...

Page 103: ...01 Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3 29 TPM Socket Location on Motherboard 1 TPM socket location on the motherboard under PCIe riser 2 352965 FAN 05 FAN 06 FAN 04 FAN 03 FAN 02 FAN 01 CPU 1 CPU 2 SD1 SD2 Riser 2 Riser 1 1 ...

Page 104: ...OS Setup Utility window choose the Advanced tab d Choose Trusted Computing to open the TPM Security Device Configuration window e Change TPM SUPPORT to Enabled f Press F10 to save your settings and reboot the server Step 2 Verify that TPM support is now enabled a Watch during bootup for the F2 prompt and then press F2 to enter BIOS setup b Log into the BIOS Setup utility with your BIOS Administrat...

Page 105: ... 2 When prompted press F2 to enter the BIOS Setup utility Step 3 Verify that the prerequisite BIOS values are enabled a Choose the Advanced tab b Choose Intel TXT LT SX Configuration to open the Intel TXT LT SX Hardware Support window c Verify that the following items are listed as Enabled VT d Support default is Enabled VT Support default is Enabled TPM Support TPM State If VT d Support and VT Su...

Page 106: ...ID PID Step 1 Remove the power supply that you are replacing or a blank panel from an empty bay a Perform one of the following actions If your server has only one power supply shut down and power off the server as described in Shutting Down and Powering Off the Server page 3 9 If your server has two power supplies you do not have to shut down the server b Remove the power cord from the power suppl...

Page 107: ...ion to be provided as part of the building installation Install only in accordance with national and local wiring regulations Statement 1045 Warning When installing or replacing the unit the ground connection must always be made first and disconnected last Statement 1046 Warning Installation of the equipment must comply with local and national electrical codes Statement 1074 Warning Hazardous volt...

Page 108: ...ource from your facility s circuit breaker to avoid electric shock hazard Step 2 Wire the supplied 3 wire connector cable to your facility s DC power source Note The supplied connector cable contains 8 AWG gauge wires The recommended facility wire gauge is 8 AWG The minimum facility wire gauge is 10 AWG Step 3 Plug the supplied connector cable into the power input socket on the power supply The co...

Page 109: ...of insulation off the DC wires that you will use Note The recommended wire gauge is 8 AWG The minimum wire gauge is 10 AWG Step 4 Orient the connector as shown in Figure 3 32 with the orange plastic button toward the top Step 5 Use a small screwdriver to depress the spring loaded wire retainer lever on the lower spring cage wire connector Insert your green ground wire into the aperture and then re...

Page 110: ...round of the rack is available Screw holes for use with your grounding lugs and grounding wires are supplied on the chassis rear panel Note The grounding points on the chassis are sized for M5 screws The grounding points are spaced at 0 625 inches 15 86 mm You must provide your own screws grounding lug and grounding wire The grounding lug required is a Panduit LCD10 14AF L or equivalent The ground...

Page 111: ...scribed in Removing and Replacing the Server Top Cover page 3 10 Step 4 Remove PCIe riser 1 to provide clearance See Replacing a PCIe Riser page 3 47 for instructions Step 5 Remove any existing mLOM card or a blanking panel see Figure 3 33 a Loosen the single thumbscrew that secures the mLOM card to the chassis floor b Slide the mLOM card horizontally to disengage its connector from the motherboar...

Page 112: ... 32474 01 Chapter 3 Maintaining the Server Installing or Replacing Server Components Figure 3 33 mLOM Card Location 1 mLOM card socket location on motherboard under PCIe riser 1 352967 FAN 05 FAN 06 FAN 04 FAN 03 FAN 02 FAN 01 CPU 1 CPU 2 SD1 SD2 Riser 2 Riser 1 1 ...

Page 113: ... Clear CMOS DIP Switch page 3 75 DIP Switch Location on the Motherboard See Figure 3 34 The position of the block of DIP switches SW8 is shown in red In the magnified view all switches are shown in the default position BIOS recovery switch 1 Clear password switch 2 Not used switch 3 Clear CMOS switch 4 Figure 3 34 Service DIP Switches 1 DIP switch block SW8 3 Clear password switch 2 2 Clear CMOS s...

Page 114: ...ecover the BIOS use procedure 2 Procedure 1 Reboot with recovery cap File Step 1 Download the BIOS update package and extract it to a temporary location Step 2 Copy the contents of the extracted recovery folder to the root directory of a USB thumb drive The recovery folder contains the recovery cap file that is required in this procedure Note The recovery cap file must be in the root directory of ...

Page 115: ...recovery DIP switch from position 1 to the closed position see Figure 3 34 Step 8 Reconnect AC power cords to the server The server powers up to standby power mode Step 9 Insert the USB thumb drive that you prepared in Step 2 into a USB port on the server Step 10 Return the server to main power mode by pressing the Power button on the front panel The server boots with the updated BIOS boot block W...

Page 116: ... 6 Reinstall the top cover and reconnect AC power cords to the server The server powers up to standby power mode indicated when the Power LED on the front panel is amber Step 7 Return the server to main power mode by pressing the Power button on the front panel The server is in main power mode when the Power LED is green Note You must allow the entire server not just the service processor to reboo...

Page 117: ...e top cover as described in Removing and Replacing the Server Top Cover page 3 10 Step 5 Slide the clear CMOS DIP switch from position 4 to the closed position see Figure 3 34 Step 6 Reinstall the top cover and reconnect AC power cords to the server The server powers up to standby power mode indicated when the Power LED on the front panel is amber Step 7 Return the server to main power mode by pre...

Page 118: ...3 76 Cisco UCS C240 M4 Server Installation and Service Guide OL 32474 01 Chapter 3 Maintaining the Server Service DIP Switches ...

Page 119: ...ental Specifications page A 6 Physical Specifications Table A 1 lists the physical specifications for the server Table A 1 Physical Specifications Description Specification Height 3 4 in 8 70 cm Width including slam latches 19 0 in 48 26 cm Depth length Depth including slam latches and power supply handles 29 0 in 73 70 cm 31 5 in 80 00 cm Maximum Weight fully loaded SFF 8 drive 52 9 lb 24 0 Kg SF...

Page 120: ...http ucspowercalc cisco com 650 W AC Power Supply Table A 2 lists the specifications for each 650 W AC power supply Cisco part number UCSC PSU2V2 650W Table A 2 Power Supply Specifications Description Specification AC input voltage Nominal range 100 120 VAC 200 240 VAC Range 90 132 VAC 180 264 VAC AC input frequency Nominal range 50 to 60Hz Range 47 63 Hz Maximum AC input current 7 6 A at 100 VAC ...

Page 121: ...0 120 VAC 200 240 VAC Range 90 132 VAC 180 264 VAC AC input frequency Nominal range 50 to 60Hz Range 47 63 Hz Maximum AC input current 11 A at 100 VAC 7 A at 200 VAC Maximum input volt amperes 1456 VA Maximum output power per PSU 800 W at 100 120 VAC 1200 W at 200 240 VAC Maximum inrush current 35 A sub cycle duration Maximum hold up time 12 ms at 1200 W Power supply output voltage 12 VDC Power su...

Page 122: ... input voltage Nominal range 200 240 VAC Range 180 264 VAC AC input frequency Nominal range 50 to 60Hz Range 47 63 Hz Maximum AC input current 8 5 A at 200 VAC Maximum input volt amperes 1700 VA Maximum output power per PSU 1400 W at 200 240 VAC Maximum inrush current 35 A sub cycle duration Maximum hold up time 12 ms at 1200 W Power supply output voltage 12 VDC Power supply standby voltage 12 VDC...

Page 123: ... W Maximum output power per PSU 930 W Maximum inrush current 35 A sub cycle duration Maximum hold up time 5 ms at 930 W Power supply output voltage 12 VDC Power supply standby voltage 12 VDC Efficiency rating 92 at 50 load Form factor RSP1 C Series 2U and 4U servers Input connector Fixed 3 wire block Table A 6 930 W DC Power Supply Specifications Description Specification DC input voltage range No...

Page 124: ...rate the maximum temperature by 1 C per every 305 meters of altitude above sea level Temperature nonoperating when the server is in storage or is transported 40 to 149 F 40 to 65 C Humidity RH operating 10 to 90 Humidity non operating 5 to 93 Altitude operating 0 to 10 000 feet Altitude nonoperating when the server is in storage or is transported 0 to 40 000 feet Sound power level Measure A weight...

Page 125: ...ds provided with the server are supported Table B 1 lists the power cords for the server power supplies Table B 1 Supported Power Cords for the Server Description Length Power Cord Reference Illustration Feet Meters CAB 250V 10A AR Power Cord 250 VAC 10 A IRAM 2073 Plug Argentina 8 2 2 5 Figure B 1 CAB 9K10A AU 250 VAC 10 A 3112 Plug Australia 8 2 2 5 Figure B 2 CAB 250V 10A CN Power Cord 250 VAC ...

Page 126: ...K6A NA Power Cord 250 VAC 13 A NEMA 6 15 Plug North America 8 2 2 5 Figure B 11 CAB 9K12A NA Power cord 125 VAC 13 A NEMA 5 15 Plug North America 8 2 2 5 Figure B 12 CAB C13 CBN Cabinet Jumper Power Cord 250 VAC 10 A C13 C14 Connectors 2 2 0 68 Figure B 13 CAB C13 C14 2M Cabinet Jumper Power Cord 250 VAC 10 A C13 C14 Connectors 6 6 2 0 Figure B 14 CAB C13 C14 AC Cabinet Jumper Power Cord 250 VAC 1...

Page 127: ... Figure B 1 through Figure B 15 Figure B 1 CAB 250V 10A AR Figure B 2 CAB 9K10A AU Figure B 3 CAB 250V 10A CN 186571 2500 mm Cordset rating 10 A 250 500 V MAX Length 8 2 ft Plug EL 219 IRAM 2073 Connector EL 701 IEC60320 C13 Plug EL 206 A S 3112 2000 Cordset rating 10 A 250 V 500V Length 2500mm 186581 Connector EL 701C IEC 60320 C15 Cordset rating 10A 250V 2500 mm Plug EL 218 CCEE GB2009 186573 Co...

Page 128: ...ure B 4 CAB 9K10A EU Figure B 5 CAB 250V 10A ID Figure B 6 CAB 250V 10A IS Connector VSCC15 Cordset rating 10A 16 A 250 V Length 8 ft 2 in 2 5 m Plug M2511 186576 OVE Cordset rating 16A 250V 2500mm Plug EL 208 187490 Connector EL 701 Cordset rating 10A 250V 500V MAX 2500 mm Plug EL 212 SI 32 186574 Connector EL 701B IEC60320 C13 EL 212 16A 250V ...

Page 129: ... Figure B 8 CAB 9K10A SW Figure B 9 CAB 9K10A UK Plug I 3G CEI 23 16 Connector C15M EN60320 C15 Cordset rating 10 A 250 V Length 8 ft 2 in 2 5 m 186575 Plug MP232 R Cordset rating 10 A 250 V Length 8 ft 2 in 2 5 m 186578 Connector IEC 60320 C15 Plug Cordset rating 10 A 250 V 500 V MAX Length 2500mm 186580 Connector EL 701C EN 60320 C15 EL 210 BS 1363A 13 AMP fuse ...

Page 130: ...10 CAB AC 250V 13A Figure B 11 CAB N5K6A NA Figure B 12 CAB 9K12A NA Cordset rating 13A 250V 6 6 feet 79 2m Plug EL312MoldedTwistlock NEMA L6 20 186568 Connector EL 701 IEC60320 C13 Cordset rating 10 A 250 V Length 8 2 ft 186570 Plug NEMA 6 15P Connector IEC60320 C13 Connector IEC60320 C15 Cordset rating 13A 125V 8 2 feet 2 5m Plug NEMA 5 15P 192260 ...

Page 131: ...s Figure B 13 CAB C13 CBN Jumper Power Cord 0 68 m Figure B 14 CAB C13 C14 2M Jumper Power Cord 2 m Figure B 15 CAB C13 C14 AC Jumper Power Cord 3 m Cordset rating 10A 250V 686mm Plug SS10A 186569 Connector HS10S Cordset rating 10A 250V 2 0 m Plug SS10A 336014 Connector HS10S Cordset rating 10A 250V 3 0 m Plug SS10A 336013 Connector HS10S ...

Page 132: ...B 8 Cisco UCS C240 M4 Server Installation and Service Guide OL 32474 01 Appendix B Power Cord Specifications Supported Power Cords and Plugs Figure B 16 CAB 48DC 40A 8AWG DC Power Cord 3 5 m ...

Page 133: ...BA Considerations page C 4 Mixing Drive Types in RAID Groups page C 6 RAID Backup Units page C 6 RAID Controller Cabling page C 7 Embedded SATA RAID Controller page C 10 Restoring RAID Configuration After Replacing a RAID Controller page C 23 For More Information page C 24 Also see these procedures for replacing RAID related hardware Replacing a Cisco Modular RAID Controller Card page 3 36 Replaci...

Page 134: ...nterposer board bundled as UCSC IP PCH C240M4 Cisco UCS 12G SAS Modular RAID Controller This controller can be ordered with modular flash based write cache FBWC options 1 GB 2 GB or 4 GB PCIe SFF 8 drives no expander 8 internal drives SFF 16 drives expander 16 internal drives SFF 24 drives expander 24 internal drives LFF 12 drives expander 12 internal drives Yes2 2 SCPM SuperCap power module RAID ...

Page 135: ... Modular RAID Controller For this server and other Cisco Generation M4 servers the default write cache policy for the Cisco Modular RAID controller is Write Through irrespective of the presence of a charged Supercap power module or good BBU This utilizes the optimal performance characteristics of the controller If you have Cisco IMC 2 0 5 or later firmware installed to the M4 server the write poli...

Page 136: ... BIOS 2 0 8 or later Cisco UCS Manager 2 2 6 or later for integrated servers only Cisco UCS 9300 8e Bad Drive and Predictive Failure Behavior The bad drive and predictive failure behavior for the Cisco UCS SAS 9300 e HBA cards is different than that for LSI MegaRAID cards The list below compares behavior for these HBA cards and LSI MegaRAID cards Bad invalid 0MB drive handling MegaRAID The bad dri...

Page 137: ...ect the preferred boot device in the LSI BIOS CU SAS Topology screen When you select the preferred boot device in the BIOS CU SAS Topology screen it is displayed at the top of the list in the server BIOS Setup Utility Boot Option dialog making it easy to identify Step 1 In the LSI SAS BIOS CU navigate to the SAS Topology screen Step 2 Press Alt B to select or deselect a device as the preferred boo...

Page 138: ... drives in a RAID group Use the same capacity for each drive in the RAID group Never mix HDDs and SSDs in the same RAID group RAID Backup Units This server supports installation of one SuperCap power module SCPM The units mount to clips on the removable air baffle see Figure 3 21 The SCPM provides approximately three years of backup for the disk write back cache DRAM in the case of a sudden power ...

Page 139: ...g path from the Cisco modular RAID controller to the SCPM on the removable air baffle The SCPM cable should pass through the opening on the rear of the air baffle to avoid interfering with the top cover The green line shows the recommended cable routing path from an HBA in slot 1 to the drive backplane or expander Figure C 1 RAID Controller Connectors and Cable Paths 352972 FAN 05 FAN 06 FAN 04 FA...

Page 140: ...e Y cable mini SAS HD to mini SAS 36 pin x2 Make the following connections 1 Connect the PORT A cable connector to the PORT A connector on the interposer board 2 Connect the PORT B cable connector to the PORT B connector on the interposer board 3 Connect the single mini SAS HD cable connector to the single connector on the backplane Cisco UCS 12G Modular RAID Controller This option can control up ...

Page 141: ...the single mini SAS HD connector on the expander LFF 12 Drive Backplane with Expander The LFF 12 drive option has a SAS expander integrated with the backplane Note No cabling is required for the embedded SATA RAID controller to control the internal SSD boot drives Cisco UCS 12G Modular RAID Controller This option can control up to 12 drives The required UCS 240CBLMR12 cable kit has one Y cable wit...

Page 142: ...isabling the Embedded RAID Controller in the BIOS page C 14 Launching the LSI Embedded MegaRAID Configuration Utilities page C 14 Installing LSI MegaSR Drivers For Windows and Linux page C 15 Embedded SATA RAID Controller Requirements For Front Facing Drive Control The embedded SATA RAID controller hub requires the following items For front facing drive control The SFF 8 drive version of the serve...

Page 143: ...AID group of up to four drives comprised of only front drives 1 4 see Figure C 2 The first SATA controller can also control a RAID 1 group of the two internal SATA boot drives The secondary sSATA controller can control a RAID group of up to four drives comprised of only front drives 5 8 see Figure C 2 Figure C 2 Embedded RAID Controller Drive Groups See Enabling the Embedded RAID Controller in the...

Page 144: ...AID embedded controller for front facing drive control Caution Data migration from software RAID embedded RAID to HW RAID a controller card is not supported and could result in data loss Migrations from software RAID to HW RAID are supported only before there is data on the drives or the case in which there are no drives in the server The required drivers for this controller are already installed ...

Page 145: ...ersion see Support Matrix For Cisco UCS C240 M4 Server RAID Controllers page C 4 Note Before you change from LSI SW RAID mode to AHCI mode delete all the RAID volumes configured in the connected physical drives d If you selected LSI SW RAID mode and you want to set the option ROM mode continue with the next step If not skip to Step 3 Note There is no option ROM mode in AHCI SATA mode Step 2 Option...

Page 146: ...to the server BIOS as follows 1 Press F2 when you see the prompt during system boot to open the BIOS Setup Utility 2 Select the Advanced tab 3 Open the UEFI utility for the primary SATA or the secondary controller sSATA by selecting one of the following LSI SW RAID Configuration Utility SATA LSI SW RAID Configuration Utility sSATA Note The secondary SATA sSATA UEFI utility is activated only in a S...

Page 147: ...the LSI MegaSR Drivers page C 15 Microsoft Windows Driver Installation page C 16 Linux Driver Installation page C 18 Downloading the LSI MegaSR Drivers The MegaSR drivers are included in the C Series driver ISO for your server and OS Download the drivers from Cisco com Step 1 Find the drivers ISO file download for your server online and download it to a temporary location on your workstation a See...

Page 148: ...on of the embedded MegaRAID drivers OS Storage Intel C600 c Expand the Zip file which contains the folder with the MegaSR driver files d Copy the expanded folder to a USB thumb drive Step 4 Start the Windows driver installation using one of the following methods To install from local media connect an external USB DVD drive to the server and then insert the first Windows installation disk into the ...

Page 149: ...owse to the location of the drivers folder on the USB thumb drive and then click OK Windows loads the drivers from the folder and when finished the driver is listed under the prompt Select the driver to be installed e Click Next to install the drivers Updating the Windows Driver Step 1 Click Start point to Settings and then click Control Panel Step 2 Double click System click the Hardware tab and ...

Page 150: ...ivers do not support updates to those OS kernels Preparing Physical Installation Disks For Linux This section describes how to prepare physical Linux installation disks from the driver image files using either the Windows operating system or the Linux operating system Note The driver image is too large for a floppy disk so use a USB thumb drive instead Note Alternatively you can mount the dud img ...

Page 151: ... LED goes out remove the disk Step 14 Label the diskette with the image name Preparing Installation Disks with a Linux Operating System Under Red Hat Linux and SUSE Linux you can use a driver disk utility to create disk images from image files Note The driver image is too large for a floppy disk so use a USB thumb drive instead Step 1 Download the Cisco UCS C Series drivers ISO as described in Dow...

Page 152: ...egaSR Drivers page C 15 Then continue with the next step Step 3 Extract the dud img file a Burn the ISO image to a disc b Browse the contents of the drivers folders to the location of the embedded MegaRAID drivers OS Storage Intel C600 c Copy the dud driver version img file to a temporary location on your workstation Step 4 Start the Linux driver installation using one of the following methods To ...

Page 153: ...virtual floppy The installer locates and loads the driver for your device The following message appears Loading megasr driver Step 14 Follow the Red Hat Linux installation procedure to complete the installation Step 15 Reboot the system Installing the SUSE Linux Enterprise Server Driver For the specific supported OS versions see the Hardware and Software Interoperability Matrix for your server rel...

Page 154: ...uring bootup The Boot Menu window opens Step 8 On the Boot Manager window select the physical disk or virtual DVD and press Enter The SLES installation begins when the image is booted Step 9 When the first SLES screen appears choose Installation Step 10 Enter one of the following in the Boot Options field For SLES 11 and SLES 11 SP1 32 and 64 bit enter brokenmodules ahci For SLES 11 SP2 32 and 64 ...

Page 155: ...following on screen prompt Foreign configuration s found on adapter Press any key to continue or C load the configuration utility or F to import foreign configuration s and continue Step 5 Press any key other than C to continue when you see the following on screen prompt All of the disks from your previous configuration are gone If this is an unexpected message then please power of your system and...

Page 156: ... about using the utilities For basic information about RAID and for using the utilities for the RAID controller cards that are supported in Cisco servers see the Cisco UCS Servers RAID Guide Full Avago Technologies LSI documentation is also available For hardware SAS MegaRAID Avago Technologies LSI 12 Gb s MegaRAID SAS Software User s Guide Rev F For embedded software MegaRAID LSI Embedded MegaRAI...

Page 157: ...g an NVIDIA K80 GPU Card and 300 W GPU Conversion Kit page D 6 Installing a Tesla M60 GPU Card and 300 W GPU Conversion Kit page D 13 Installing Drivers to Support the NVIDIA GPU Cards page D 31 Overview of Server Firmware Requirements Table D 1 lists the minimum server firmware versions for the supported GPU cards Table D 1 Server Firmware Minimum Versions GPU Cisco IMC BIOS Minimum Version NVIDI...

Page 158: ...te air flow When using GPU cards with this version of the server the operating temperature range is 32 to 95 F 0 to 35 C Mixing rules You can mix GRID K1 and K2 GPU cards in the same server Do not mix GRID GPU cards with Tesla GPU cards in the same server Do not mix different models of Tesla GPU cards in the same server NVIDIA GPUs can support only less than 1 TB of memory in the server Therefore ...

Page 159: ...IOS policy in your service profile Step 1 Refer to the Cisco UCS Manager configuration guide GUI or CLI for your release for instructions on configuring service profiles Cisco UCS Manager Configuration Guides Step 2 Refer to the chapter on Configuring Server Related Policies Configuring BIOS Settings Step 3 In the section of your profile for PCI Configuration BIOS Settings set Memory Mapped IO Abo...

Page 160: ... up on both ends of the riser to disengage its circuit board from the socket on the motherboard Set the riser on an antistatic mat b On the bottom of the riser loosen the single thumbscrew that holds the securing plate See Figure 3 28 c Swing open the securing plate and remove it from the riser to provide access d Swing open the card tab retainer that secures the back panel tab of the card see Fig...

Page 161: ... the card tab retainer see Figure 3 28 f Position the PCIe riser over its socket on the motherboard and over its alignment features in the chassis see Figure 3 26 g Carefully push down on both ends of the PCIe riser to fully engage its circuit board connector with the socket on the motherboard Step 6 Replace the top cover Step 7 Replace the server in the rack replace cables and then power on the s...

Page 162: ... described in Shutting Down and Powering Off the Server page 3 9 Step 2 Slide the server out the front of the rack far enough so that you can remove the top cover You might have to detach cables from the rear panel to provide clearance Caution If you cannot safely view and access the component remove the server from the rack Step 3 Remove the top cover as described in Removing and Replacing the Se...

Page 163: ...ently on the fan module until the latch clicks and locks in place d Repeat until you have moved all fan modules into the new fan cage Figure D 1 Fan Cage and Fan Modules Step 9 Remove the existing heatsink from each CPU a Use a Number 2 Phillips head screwdriver to loosen the four captive screws that secure the heatsink Note Alternate loosening each screw evenly to avoid damaging the heatsink or C...

Page 164: ...new heatsink b Align the four heatsink captive screws with the motherboard standoffs and then use a Number 2 Phillips head screwdriver to tighten the captive screws evenly Note Alternate tightening each screw evenly to avoid damaging the heatsink or CPU Step 12 Set the base of the replacement air baffle into the server see Figure D 2 Figure D 2 Air Baffle Base 1 Fan cage 4 GPU front support bracke...

Page 165: ...rom the socket on the motherboard b Set the riser on an antistatic surface c On the bottom of the riser loosen the single thumbscrew that holds the securing plate see Figure 3 28 d Swing open the securing plate and remove it from the riser to provide access e Swing open the card tab retainer see Figure 3 28 Step 15 Install your first K80 GPU card into PCIe riser 1A slot 2 See Figure 3 27 for the r...

Page 166: ... retainer see Figure 3 28 d Return the securing plate to the riser Insert the two hinge tabs into the two slots on the riser and then swing the securing plate closed e Tighten the single thumbscrew that holds the securing plate Step 16 Install the PCIe riser with GPU card back into the server a Position the PCIe riser over its socket on the motherboard and over its alignment features in the chassi...

Page 167: ...he filler panel shunts airflow to the PCIe riser in which a GPU is installed A system with two GPUs does not use the filler Step 18 If your system has only a single K80 GPU install the filler panel to the air baffle base in slot 2 as shown in Figure D 5 Slide the filler panel edges into the slots as shown 1 Front end of GPU 3 Lip on support bracket latch 2 Front support bracket attached to GPU 4 L...

Page 168: ...the clips and gently press down until the clip closes over the module b Route the module s cable through the opening in the air baffle see Figure D 5 so that it does not interfere with the server top cover Step 21 Replace the top cover to the server Step 22 Replace the server in the rack replace cables and then power on the server by pressing the Power button Step 23 Continue with Installing Drive...

Page 169: ...ensing Portal and download them Installing GRID Licenses From the NVIDIA Licensing Portal to the License Server page D 25 6 Manage your GRID licenses Managing GRID Licenses page D 27 7 Decide whether to use the GPU in compute mode or graphics mode Switching Between Compute Mode and Graphics Mode page D 29 Installing the NVIDIA M60 Hardware The NVIDIA Tesla M60 GPU requires a hardware conversion ki...

Page 170: ...air baffle that covers the CPUs and DIMMs Step 6 Remove the existing server fan cage see Figure D 6 a Open the plastic locking lever at each end of the existing fan cage to the upright 90 degree position b Lift the existing fan cage with fan modules from the server Set the fan cage with fan modules aside Step 7 Install the new empty server fan cage from the conversion kit a Open the plastic lockin...

Page 171: ... CPU Step 11 Install the low profile replacement heatsinks that come with the conversion kit a Remove the protective tape from the pre applied pad of thermal grease that is on the underside of the new heatsink b Align the four heatsink captive screws with the motherboard standoffs and then use a Number 2 Phillips head screwdriver to tighten the captive screws evenly Note Alternate tightening each ...

Page 172: ...tallation and Service Guide OL 32474 01 Appendix D GPU Card Installation Figure D 7 Air Baffle Base 1 Fan cage 4 GPU front support bracket latches 2 Air baffle base 5 PCIe risers 3 Holder for RAID battery on air baffle 305092 1 3 4 5 2 ...

Page 173: ...from the socket on the motherboard b Set the riser on an antistatic surface c On the bottom of the riser loosen the single thumbscrew that holds the securing plate see Figure 3 28 d Swing open the securing plate and remove it from the riser to provide access e Swing open the card tab retainer see Figure 3 28 Step 15 Install your first M60 GPU card into PCIe riser 1A slot 2 See Figure 3 27 for the ...

Page 174: ... retainer see Figure 3 28 d Return the securing plate to the riser Insert the two hinge tabs into the two slots on the riser and then swing the securing plate closed e Tighten the single thumbscrew that holds the securing plate Step 16 Install the PCIe riser with GPU card back into the server a Position the PCIe riser over its socket on the motherboard and over its alignment features in the chassi...

Page 175: ...he filler panel shunts airflow to the PCIe riser in which a GPU is installed A system with two GPUs does not use the filler Step 18 If your system has only a single M60 GPU install the filler panel to the air baffle base in slot 2 as shown in Figure D 5 Slide the filler panel edges into the slots as shown 1 Front end of GPU 3 Lip on support bracket latch 2 Front support bracket attached to GPU 4 L...

Page 176: ... the clips and gently press down until the clip closes over the module b Route the module s cable through the opening in the air baffle see Figure D 5 so that it does not interfere with the server top cover Step 21 Replace the top cover to the server Step 22 Replace the server in the rack replace cables and then power on the server by pressing the Power button Step 23 Continue with Installing Driv...

Page 177: ...ou install into the GRID License Server via its management interface see Figure D 11 Figure D 11 GRID Licensing Architecture There are three editions of GRID licenses which enable three different classes of GRID features The GRID software automatically selects the license edition based on the features that you are using see Table D 3 VM GRID vGPU VM GRID vGPU VM GRID GPU VM GRID GPU GRID Server GR...

Page 178: ... Registration Information The NVIDIA Software Licensing Center Product Information Software dialog opens Step 3 If you have additional PAKs click Register Additional Keys For each additional key complete the form on the License Key Registration dialog and then click Submit My Registration Information Step 4 Agree to the terms and conditions and set a password when prompted Downloading the GRID Sof...

Page 179: ... and install the latest Java 32 bit runtime environment from https www oracle com downloads index html Note Install the 32 bit Java Runtime Environment regardless of whether your platform is Windows 32 bit or 64 bit Step 2 Create a server interface a On the NVIDIA Software Licensing Center dialog click Grid Licensing Create License Server b On the Create Server dialog fill in your desired server d...

Page 180: ...cat service c Start the Tomcat service sudo systemctl start tomcat service d Verify that the Tomcat service is operational Open a web browser on the License Server host and connect to the URL http localhost 8080 If the installation was successful you see the Tomcat webapp Step 3 Install the License Server a Unpack the License Server tar file using the following command tar xfz NVIDIA linux 2015 09...

Page 181: ...License Server Configuration panel opens Next to Server host ID a pull down menu lists the possible Ethernet MAC addresses Step 3 Select your License Server s MAC address from the Server host ID pull down Note It is important to use the same Ethernet ID consistently to identify the server when generating licenses on NVIDIA s Licensing Portal NVIDIA recommends that you select one entry for a primar...

Page 182: ...rver panel select Licensed Feature Usage Step 3 Click on a feature in the Feature column to see detailed information about the current usage of that feature Viewing Current License Usage Use the following procedure to view information about which licenses are currently in use and borrowed from the server Step 1 Access the GRID License Server Management Interface in a browser See Accessing the GRID...

Page 183: ...ns and shows the current license edition being used The GRID software automatically selects the license edition based on the features that you are using The default is Tesla unlicensed Step 3 If you want to acquire a license for GRID Virtual Workstation under License Edition select GRID Virtual Workstation Step 4 In the License Server field enter the address of your local GRID License Server The a...

Page 184: ...p 4 Edit the FeatureType line with the integer for the license type See the example file below GRID vGPU 1 GRID Virtual Workstation 2 Step 5 Restart the nvidia gridd service sudo service nvidia gridd restart The service automatically acquires the license edition that you specified in the FeatureType line You can confirm this in var log messages Note After you configure licensing settings in gridd ...

Page 185: ...Notes Classcode 3D Controller This classcode tells the OS that the GPU is not intended for use as the primary display device Memory base address register BAR 8 GB A large BAR is exposed for direct access to the frame buffer from the CPU and PCIe devices I O base BAR Disabled The GPU does not consume any legacy I O resources when used as a non display device Error correcting code ECC protection Ena...

Page 186: ...h compute and graphic modes The gpumodeswitch utility supports the following commands listgpumodes This command writes information to a log file named listgpumodes txt in the current working directory gpumode graphics Switches to graphics mode Switches mode of all supported GPUs in the server unless you specify otherwise when prompted gpumode compute Switches to compute mode Switches mode of all s...

Page 187: ...ystem UCS Server Firmware Step 6 Click the release number Step 7 Click Download Now to download the ucs server platform huu version_number iso file Step 8 Verify the information on the next page and then click Proceed With Download Step 9 Continue through the subsequent screens to accept the license agreement and browse to a location where you want to save the file Step 10 Use the Host Upgrade Uti...

Page 188: ...t using the utilities For basic information about RAID and for using the utilities for the RAID controller cards that are supported in Cisco servers see the Cisco UCS Servers RAID Guide Full Avago Technologies LSI documentation is also available For hardware SAS MegaRAID Avago Technologies LSI 12 Gb s MegaRAID SAS Software User s Guide Rev F For embedded software MegaRAID LSI Embedded MegaRAID Sof...

Page 189: ... the integration guides found here Cisco UCS C Series Server Integration with UCS Manager Guides Refer to the guide that is for the version of Cisco UCS Manager that you are using Also refer to the release notes for Cisco UCS Manager software and C Series software for any special considerations regarding integration in your release Cisco UCS Manager Release Notes Cisco C Series Software Release No...

Page 190: ...E 2 Cisco UCS C240 M4 Server Installation and Service Guide OL 32474 01 Appendix E Installation for Cisco UCS Manager Integration ...

Reviews:

No comments

Related manuals for UCS C240 M4

Brand: AIC Pages: 52

RS/6000 7043 43P Series

Brand: IBM Pages: 322

System x3400 M3 Types 7378

Brand: IBM Pages: 45

Brand: Qlogic Pages: 20

301160U - 1TB Ethernet Disk RAID Network Attached...

Brand: LaCie Pages: 5

Brand: IBM Pages: 106

Brand: Sollae Systems Pages: 27

callpilot 1002rp

Brand: Avaya Pages: 150

Brand: High End Systems Pages: 224

SC10E16A1 Series

Brand: San Telequip Pages: 85

Brand: Axis Pages: 69

Brand: Red Hat Pages: 120

Brand: Promise Technology Pages: 2

Multi-Port Fast Ethernet Print Server FPS-3121

Brand: Planet Pages: 12

Brand: AMX Pages: 35

Brand: Nestbox Pages: 4

FXT 5000 Series

Brand: Avere Pages: 48

Brand: Oracle Pages: 188

Brands by name

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Popular brands

Load more brands