Cisco o UCS X440p Installation And Service Manual Download Page 13 | Manualshive

Page: 13 / 62

background image

Slot Numbering

Risers and GPU slots have set numbering to identify the correct locations in the PCIe node.

• For hardware, slot numbering consists of

Riser Number Riser Type/Slot

. So, for example,

1A/1

indicates riser number 1, riser type A, slot 1.

• For Cisco management software, such as Cisco Intersight Managed Mode (IMM), the slot numbering

consists of

Riser [number/type]-Slot [number]

. So, for example,

RISER1A-SLOT1

indicates riser

number 1, riser type A, slot 1.

GPU slot numbering differs depending on the type of riser.

Figure 1: Riser and Slot Numbering, Riser Type A (UCSX-RISA-440P)

Slot 2A/2 for FHFL GPU

Riser2A is controlled by
CPU2 on the Cisco UCS
compute node paired with
the PCIe node

2

Slot 1A/1 for FHFL GPU

Riser1A is controlled by
CPU1 on the Cisco UCS
compute node paired with
the PCIe node

1

Riser 2 location

4

Riser 1 location

3

Cisco UCS X440p PCIe Node Installation and Service Guide

5

Overview

Slot Numbering

«
...
11
12
13
14
15
...
»

Summary of Contents for o UCS X440p

Page 1: ...Node Installation and Service Guide First Published 2022 10 10 Americas Headquarters Cisco Systems Inc 170 West Tasman Drive San Jose CA 95134 1706 USA http www cisco com Tel 408 526 4000 800 553 NETS 6387 Fax 408 527 0883 ...

Page 2: ... 2022 Cisco Systems Inc All rights reserved ...

Page 3: ... Cisco UCS X440p PCIe Node 11 Removing the PCIe Node 12 Installing the PCIe Node 13 PCIe Node Configuration 14 Servicing the Cisco UCS X440p PCIe Node 15 C H A P T E R 3 Serviceable Component Locations 15 Removing and Installing the PCIe Node Cover 17 Removing a PCIe Node Cover 18 Installing a PCIe Node Cover 18 Replacing the PCIe Node Companion Module 19 Replacing Riser Cages 19 Required Equipmen...

Page 4: ...the Rear Mezzanine Card 39 Removing a Rear Mezzanine Card 39 Installing a Rear Mezzanine Card 40 Recycling the PCB Assemblies 41 Recycling the Motherboard PCBA 42 Recycling the Riser A PCBA 46 Recycling the Riser B PCBA 47 PCIe Node Specifications 49 A P P E N D I X A Physical Specifications 49 Environmental Specifications 49 Power Specifications 50 Obtaining Hardware 51 A P P E N D I X B Obtainin...

Page 5: ...ION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE ALL STATEMENTS INFORMATION AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND EXPRESS OR IMPLIED USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE...

Page 6: ...y the University of California Berkeley UCB as part of UCB s public domain version of the UNIX operating system All rights reserved Copyright 1981 Regents of the University of California NOTWITHSTANDING ANY OTHERWARRANTYHEREIN ALL DOCUMENTFILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED AS IS WITH ALL FAULTS CISCO AND THE ABOVE NAMEDSUPPLIERSDISCLAIMALLWARRANTIES EXPRESSEDORIMPLIED INCLUDING WIT...

Page 7: ...rmation from Cisco sign up at Cisco Profile Manager To get the business impact you re looking for with the technologies that matter visit Cisco Services To submit a service request visit Cisco Support To discover and browse secure validated enterprise class apps products solutions and services visit Cisco Marketplace To obtain general networking training and certification titles visit Cisco Press ...

Page 8: ...Cisco UCS X440p PCIe Node Installation and Service Guide viii Preface Communications Services and Additional Information ...

Page 9: ...vity for either Two x16 FHFL dual slot PCIe cards one per riser cage Four x8 HHHL single slot PCIe card two per riser cage Each PCIe node must be configured with the same type of GPU Per vendor limitation only the same GPUs are supported on a PCIe node either two A16 two A40 or two A100 GPUs in a PCIe node Riser Type A or four T4 GPUs in a PCIe node Riser Type B Note Host connection between the PC...

Page 10: ...to the Cisco UCS X210c M6 Compute Node Installation and Service Note UCS PCIe mezzanine MEZZ card for Fabric connectivity which is a rear mezzanine card required on each paired UCS Compute Node For more information go to the Cisco UCS X210c M6 Compute Node Installation and Service Note Cisco UCS X440p PCIe nodes themselves to pair with the compute nodes Risers which are sized for either full heigh...

Page 11: ...r handles 2 2 PCIe node LED cluster See LEDs on page 3 1 PCIe node Ejector Button 3 LEDs The PCIe node front panel has the following status LEDs Cisco UCS X440p PCIe Node Installation and Service Guide 3 Overview LEDs ...

Page 12: ... Severe fault such as an insufficient power condition Blinking Amber 1 Hz Riser Cage Options GPUs are contained in risers that mount onto the PCIe node sheet metal Power and signaling are supported by cables that connect each riser cage to the PCIe node rear mezzanine PCBA Riser Type A Supports FHFL GPU cards through a single x16 FHFL dual slot PCIe connector Riser Type B Supports HHHL GPU cards t...

Page 13: ...r type Slot number So for example RISER1A SLOT1 indicates riser number 1 riser type A slot 1 GPU slot numbering differs depending on the type of riser Figure 1 Riser and Slot Numbering Riser Type A UCSX RISA 440P Slot 2A 2 for FHFL GPU Riser2A is controlled by CPU2 on the Cisco UCS compute node paired with the PCIe node 2 Slot 1A 1 for FHFL GPU Riser1A is controlled by CPU1 on the Cisco UCS comput...

Page 14: ...t 2B 3 for HHHL GPU underneath Slot 2B 4 Riser2B is controlled by CPU2 on the Cisco UCS compute node paired with the PCIe node 6 Slot 2B 4 for HHHL GPU Riser2B is controlled by CPU2 on the Cisco UCS compute node paired with the PCIe node 5 Supported GPUs The Cisco UCS X440p PCIe node supports the following models and form factors of GPU Full height full length FHFL GPUs NVIDIA A16 PCIe 250W 4X16GB...

Page 15: ...DIA Tesla A100 Passive 300W 80GB UCSX GPU A100 80 Half height half length HHHL GPUs NVIDIA T4 PCIe 16GB 75W UCSX GPU T4 16 Cisco UCS X440p PCIe Node Installation and Service Guide 7 Overview Supported GPUs ...

Page 16: ...Cisco UCS X440p PCIe Node Installation and Service Guide 8 Overview Supported GPUs ...

Page 17: ... supported in the Cisco UCS X9508 chassis only Do not attempt to install the PCIe node in any other UCS server chassis The companion compute node host power should be off before attempting any removal or insertion procedures Hot removal or insertion of the PCIe node while the host is on is not supported Each PCIe node must be paired with an X Series compute node and therefore has specific configur...

Page 18: ...tion Compute Node in Initial Slot Figure 4 Supported Configuration PCIes Node in Initial Slot Cisco UCS X440p PCIe Node Installation and Service Guide 10 Installing the Cisco UCS X440p PCIe Node Installation Guides and Limitations ...

Page 19: ...c compute node The Cisco X Fabric solution does not limit or restrict slot usage when PCIe nodes are not required Compute nodes can be installed in any slot without restriction where PCIe nodes are not used Note Replacing the Cisco UCS X440p PCIe Node The Cisco UCS X440p PCIe Node is tool less field replaceable hardware You can install or remove the node through node s integrated ejectors Cisco UC...

Page 20: ...S X440p PCIe node itself is hot swappable but the paired compute node must be powered down first before hot swapping the PCIe node Caution Step 1 If you have not already done so use Cisco management software for example Cisco IMM to power down the compute node paired with the PCIe node Step 2 After the paired compute node is completely powered off push the PCIe node s ejector button between the tw...

Page 21: ...re you begin The PCIe node is a tools free module that you install and secure to the chassis through ejectors Step 1 Orient and align the PCIe node so that the ejectors are on the right vertical side of the slot Step 2 Using one hand to support the PCIe node hold the node level and slide it into the chassis slot Cisco UCS X440p PCIe Node Installation and Service Guide 13 Installing the Cisco UCS X...

Page 22: ...ersight Managed Mode IMM power on the PCIe node s paired compute node Step 5 After the paired compute node is completely powered on use Cisco s management software such as Cisco Intersight Managed Mode IMM to rediscover the PCIe node PCIe Node Configuration The Cisco UCS X440p PCIe Node can be configured and managed using the Cisco Intersight management platform in Intersight Managed Mode Cisco In...

Page 23: ...on page 19 Replacing Riser Cages on page 19 Replacing a GPU Card on page 26 Replacing the Rear Mezzanine Card on page 39 Recycling the PCB Assemblies on page 41 Serviceable Component Locations The following image shows the locations of serviceable components on the PCIe node The PCIe node has a heatsink next to the rear mezzanine MEZZ slot This heatsink is not serviceable Note Cisco UCS X440p PCIe...

Page 24: ... card 5 MCIO cable for riser 2 8 Power cable for riser 1 7 GPU power cable for GPU slot 1 This cable is supported on FHFL GPUs only 10 Power cable for riser 2 9 LED cable for Front Panel 12 GPU power cable for GPU slot 2 This cable is supported on FHFL GPUs only 11 Cisco UCS X440p PCIe Node Installation and Service Guide 16 Servicing the Cisco UCS X440p PCIe Node Serviceable Component Locations ...

Page 25: ... Power cable for riser 2 9 Removing and Installing the PCIe Node Cover The top cover for the Cisco UCS X440p PCIe node can be removed to allow access to internal components some of which are field replaceable The green button on the top cover releases the PCIe node s cover To replace the PCIe node s top cover use the following tasks Removing a PCIe Node Cover on page 18 Installing a PCIe Node Cove...

Page 26: ...or the PCIe node Step 1 Insert the cover at an angle so that the cutouts on the rear of the catch the guide pins on the inside walls of the node Step 2 Lower the PCIe node s cover until it sits on the node Step 3 Keeping the PCIe node s cover flat slide it forward until the release button clicks Make sure that the front edge of the top cover slides under the metal edge of the node If you feel resi...

Page 27: ... and the type of riser is determined by the GPU that it contains For more information see Riser Cage Options on page 4 Riser cages cannot be mixed on the same PCIe node If you are replacing a riser cage the PCIe node must have a pair of the same type either two Type A riser cages or two Type B riser cages To replace riser cages use the following tasks Required Equipment on page 20 Cabling Consider...

Page 28: ...d GPU cables that carry power and data One cable the power cable connects from the PCIe riser cage to the base PCBA connector This cable is shown in red in the following image One cable the MCIO cable connects from the PCIe riser cage to the rear mezzanine PCBA This cable is shown in blue in the following image Figure 5 PCB Cable Connectors FHFL GPU Cisco UCS X440p PCIe Node Installation and Servi...

Page 29: ...receding section While performing some tasks for an FHFL GPU for example replacing a FHFL GPU you must disconnect this cable It is a best practice to disconnect the GPU AUX power cable from the riser socket not the GPU unless otherwise documented Removing Riser Type A Each PCIe node can contain a maximum of two PCIe riser cages of the same type Use this procedure to remove a Type A riser Step 1 Re...

Page 30: ...sconnect the power cable from the node s rear motherboard connector e When both cables are disconnected lift the riser cage off of the PCIe node What to do next Choose the appropriate option Removing a FHFL GPU Installing a FHFL GPU on page 29 Cisco UCS X440p PCIe Node Installation and Service Guide 22 Servicing the Cisco UCS X440p PCIe Node Removing Riser Type A ...

Page 31: ...ve guide pins on the PCIe module Make sure that the cables are not pinched by the riser cage Note b Lower the riser cage onto the PCIe module making sure to align the thumbscrews with the correct screw holes c Connect the MCIO cable to the rear mezzanine MEZZ connector d Connect the power cable to the node s rear motherboard connector e Using a 2 Phillips screwdriver tighten the three captive thum...

Page 32: ... Cover on page 18 Step 3 Detach the riser cage from the PCIe node a Using a 2 Phillips screwdriver loosen the three captive thumbscrews b Disconnect the MCIO cable from the rear mezzanine MEZZ connector c Lift and slide the riser cage slightly to expose the rear mezzanine connector of the power cable d Disconnect the power cable from the node s rear motherboard connector e When both cables are dis...

Page 33: ...st to the front of the node Step 2 Attach the riser cage to the PCIe node a While lowering the riser cage onto the node align the two guide holes on the cage with their respective guide pins on the PCIe module Make sure that the cables are not pinched by the riser cage Note b Lower the riser cage onto the PCIe module making sure to align the thumbscrews with the correct screw holes c Connect the M...

Page 34: ... Replacement Guidelines and Limitations Be aware of the following guidelines and limitation for replacing FHFL and HHHL GPUs For installing GPUs into a riser type there is a defined population order as shown in the following table It is a best practice to use this population order which shows which slot s should be populated before the other s For information about how slots are numbered in each r...

Page 35: ...you close the riser cage door Cisco offers Cisco PCIe blanks UCSX RIS BLK 440P that fill unused connectors in the PCIe node If your PCIe node is not fully configured with GPUs you must install the appropriate number of blanks For PCIe nodes that are less than fully configured with GPUs do not operate the PCIe node without a GPU filler blank Cisco UCS X440p PCIe Node Installation and Service Guide ...

Page 36: ...ecuring screw on the wall of the riser b Using a 2 Phillips screwdriver loosen the hinge retention screw which allows the door to swing open c Gently pull the door outward so that it swings open in an arc Make sure to hold the door level when you open it Do not push the door down or lift the door up while opening it Pushing down or pulling up can apply force to the door s hinge Caution Step 3 Disc...

Page 37: ...r a Orient the GPU so that the notches on the GPU bracket line up with the pins on the riser cage You might need to open the riser door completely to have enough space to insert the FHFL GPU Note b Lower the FHFL GPU so that the front edge will slide into the lowest retaining bracket on the riser cage floor c Align the GPU connector with its socket on the riser d Gently slide the GPU along the flo...

Page 38: ...Cisco UCS X440p PCIe Node Installation and Service Guide 30 Servicing the Cisco UCS X440p PCIe Node Installing a FHFL GPU ...

Page 39: ... removing or installing the FHFL GPU See GPU Replacement Guidelines and Limitations on page 26 Caution Step 4 When the GPU is seated close the riser door a Gently push the door inward so that it swings closed in an arc Make sure to hold the door level when you close it Do not push the door down or lift the door up while closing it Pushing down or pulling up can apply force to the door s hinge Caut...

Page 40: ...B riser is removed from the node open the riser door a Using a 2 Phillips screwdriver loosen the hinge retention screw b Using a 2 Phillips screwdriver loosen the vertical securing screw on the wall of the riser c Gently pull the door outward do that it swings open in an arc Make sure to hold the door level when you open it Do not push the door down or lift the door up while opening it Pushing dow...

Page 41: ...oor open turn the riser over and check the retaining pin e Press the retaining pin to release it then continue opening the door Cisco UCS X440p PCIe Node Installation and Service Guide 33 Servicing the Cisco UCS X440p PCIe Node Removing a HHHL GPU ...

Page 42: ...t from the PCIe connector then lift it out of the riser cage Make sure to hold the GPU level while removing it Pulling up or pushing down can apply force to the GPU connector or the PCIe socket Caution Cisco UCS X440p PCIe Node Installation and Service Guide 34 Servicing the Cisco UCS X440p PCIe Node Removing a HHHL GPU ...

Page 43: ...t Choose the correct option Installing a HHHL GPU on page 36 Installing Riser Type B on page 25 Cisco UCS X440p PCIe Node Installation and Service Guide 35 Servicing the Cisco UCS X440p PCIe Node Removing a HHHL GPU ...

Page 44: ...mitations on page 26 Step 1 Holding the HHHL GPU level align it horizontally with the PCIe connector making sure that the notch in GPU s PCIe bracket aligns with the correct pin on the riser cage In the following illustration the GPU is aligning with the bottom connector so the bottom pin is used Step 2 Seat the GPU card into the PCIe socket securely You should feel the GPU snap into place when th...

Page 45: ...evel when you open it Do not push the door down or lift the door up while closing it Pushing down or pulling up can apply force to the door s hinge Caution b Verify that the retaining block is keeping the HHHL GPU s in place Cisco UCS X440p PCIe Node Installation and Service Guide 37 Servicing the Cisco UCS X440p PCIe Node Installing a HHHL GPU ...

Page 46: ... retaining pin is securely seated in the hole d Using a 2 Phillips screwdriver tighten the hinge retention screw 3 in the following illustration e Using a 2 Phillips screwdriver tighten the vertical securing screw on the wall of the riser 4 What to do next See Installing Riser Type B on page 25 Cisco UCS X440p PCIe Node Installation and Service Guide 38 Servicing the Cisco UCS X440p PCIe Node Inst...

Page 47: ... Rear Mezzanine Card on page 40 Removing a Rear Mezzanine Card Use the following task to remove the rear mezzanine card from the PCIe node Step 1 Shut down and remove power from the PCIe node Step 2 Remove the PCIe node from the chassis Step 3 Remove the top cover from the PCIe node See Removing a PCIe Node Cover on page 18 Step 4 Disconnect the front panel LED cable from the rear mezzanine connec...

Page 48: ... b Lift the card off of the PCIe node You might need to gently rock the card while lifting it to disengage it from the socket Installing a Rear Mezzanine Card Use this task to install a rear mezzanine card onto the PCIe node Cisco UCS X440p PCIe Node Installation and Service Guide 40 Servicing the Cisco UCS X440p PCIe Node Installing a Rear Mezzanine Card ...

Page 49: ...captive thumbscrews to secure the card Step 6 Reconnect the front panel LED cable at the rear mezzanine connector Step 7 Replace the top cover of the PCIe node Step 8 Reinsert the PCIe node into the chassis and return the node to service Recycling the PCB Assemblies The Cisco UCS X440p PCIe Node has multiple different PCB assemblies PCBAs which consist of the PCB motherboard plus any components mo...

Page 50: ...nd e waste regulations Note To remove the printed circuit board assembly PCBA which is the PCB motherboard plus components mounted on it the following requirements must be met The PCIe node must be disconnected from facility power The chassis must be removed from the equipment rack You will find it helpful to gather the following equipment for this procedure Screwdrivers T10 Torx T8 Torx and a 1 P...

Page 51: ...Using a pliers pinch the heads of each of the heatsink pushpins together then push them through the holes on the PCBA to release the heatsink from the rear mezzanine card Step 5 Using a T10 Torx driver remove the seven pan head screws that secure the PCBA to the PCIe node s frame Cisco UCS X440p PCIe Node Installation and Service Guide 43 Servicing the Cisco UCS X440p PCIe Node Recycling the Mothe...

Page 52: ...the PCIe node side walls Step 7 Remove the bottom screws a Turn the PCIe node over so that the bottom sheetmetal is facing up b Using an H2 0 hex head screwdriver remove the low profile socket head screw c Using a T10 Torx driver remove the pan head screw Cisco UCS X440p PCIe Node Installation and Service Guide 44 Servicing the Cisco UCS X440p PCIe Node Recycling the Motherboard PCBA ...

Page 53: ...ep 8 Detach the frame and the PCB from the PCIe node Step 9 Remove the heatsink a Using a 1 Phillips screwdriver remove the three pan head screws b Detach the heatsink from the PCB Cisco UCS X440p PCIe Node Installation and Service Guide 45 Servicing the Cisco UCS X440p PCIe Node Recycling the Motherboard PCBA ...

Page 54: ...CB for Riser Type A Before you begin For Recyclers Only This procedure is not a standard field service option This procedure is for recyclers who will be reclaiming the electronics and sheet metal for proper disposal to comply with local eco design and e waste regulations Note To remove Riser A s PCBA the following requirements must be met The PCIe node must be disconnected from facility power The...

Page 55: ...is not a standard field service option This procedure is for recyclers who will be reclaiming the electronics and sheet metal for proper disposal to comply with local eco design and e waste regulations Note To recyle Riser B s PCBA the following requirements must be met The PCIe node must be disconnected from facility power The chassis must be removed from the equipment rack You will find it helpf...

Page 56: ...e interior side wall the side opposite the door Step 5 Detach the PCB from the sheetmetal and dispose of the PCB any components and sheetmetal in compliance with relevant e waste and recycling laws Cisco UCS X440p PCIe Node Installation and Service Guide 48 Servicing the Cisco UCS X440p PCIe Node Recycling the Riser B PCBA ...

Page 57: ... mm Depth Minimally configured node weight 12 84 lbs 5 83 kg Fully loaded PCIe Node with T4 GPU 14 9 lb minimum config with 1x T4 GPU 12 9 lb Fully loaded PCIe Node with A16 GPU 17 1 lb minimum config with 1X A16 GPU 14 6 lb Fully loaded PCIe Node with A40 GPU 16 6 lb minimum config with 1X A40 GPU 14 4 lb Fully loaded PCIe Node with A100 GPU 17 9 lb minimum config with 1X A100 GPU 15 lb Weight En...

Page 58: ... Operating Altitude 40 000 ft 12 000m Non Operating Altitude Power Specifications The Cisco UCSX 440P PCIe Node has a power cap of 1300 Watts for all combinations of components Also the ambient temperature must be less than 35 degrees C 95 degrees F Caution For configuration specific power specifications use the Cisco power calculator Go to Cisco UCS Power Calculator Cisco UCS X440p PCIe Node Inst...

Page 59: ... Fabric deployment Power cables are required and ship with the riser cages Note Cisco PID Description Hardware Component UCSX 9508 UCS X Series Server Chassis for example the Cisco UCS X9508 Server Chassis Chassis UCSX 210C M6 UCS X Series Compute Nodes for example the Cisco UCS X210c M6 Compute Node Compute Nodes UCSX 440P UCS X Series Gen4 PCIe node for example the Cisco UCS X440p Front Mezzanin...

Page 60: ...SLA A100 Passive 300W 80GB UCSX F 9416 UCS 9416 X Fabric module for 9508 chassis Must be deployed as a pair so two are required per Cisco X Series Server chassis Cisco UCS X Fabric Modules XFMs UCSX V4 PCIME UCS PCI Mezz card for X Fabric Connectivity Required for Cisco UCS X Series compute nodes for example the Cisco UCS X210c M6 Compute Node Rear Mezzanine Card Cisco UCS X440p PCIe Node Installa...

Page 61: ...6 PCBA recycling riser B 47 PCIe node cover installing 18 PCIe node cover removing 18 PCIe node installing 13 PCIe node removing 12 R rear mezzanine card installing 40 rear mezzanine card removing 39 recycling motherboard 42 recycling riser A PCBA 46 recycling riser B PCBA 47 removing PCIe node cover 18 removing full height full length GPU 28 removing half height half length GPU 32 removing rear m...

Page 62: ...Cisco UCS X440p PCIe Node Installation and Service Guide IN 2 INDEX ...

Reviews:

No comments

Related manuals for o UCS X440p

Brand: TC Electronic Pages: 2

Brand: XDS Pages: 99

IES615-2D Series

Brand: 3onedata Pages: 3

Brand: 3One data Pages: 5

Brand: 3onedata Pages: 33

Brand: Paradyne Pages: 20

Compshere 3000 Series

Brand: Paradyne Pages: 2

Brand: Pantech Pages: 17

Brand: EnGenius Pages: 3

LBON320AC Series

Brand: Lindsay Broadband Pages: 4

Brand: WAGO Pages: 48

Brand: Caen Pages: 14

Brand: ZyXEL Communications Pages: 2

Brand: TP-Link Pages: 2

Brand: Nortel Pages: 163

Brand: Baracoda Pages: 16

Brand: Altera Pages: 33

Brand: PairGain Pages: 80

Brands by name

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Popular brands

Load more brands