manualshive.com logo in svg

Sun Microsystems Datacenter Switch 3456, Installation Manual

Share
Download
Sun Microsystems Datacenter Switch 3456 Installation Manual Download Page 24

10

Sun Datacenter Switch 3456 Installation Guide • December 2008

TABLE 2-3

provides suggested configurations, based upon a fraction of the complete

configuration.

Because the line cards are equally distributed across the available slots, cabling rules
and lengths still apply. See

“Cabling the Switch” on page 98

and the

Sun Datacenter

Switch 3456 Site Planning Guide

.

TABLE 2-3

Suggested Configurations

Configuratio
n

Quantity
of Line
Cards

Line Card Slots

Power Supply Slots

Base

1

11

2, 4, 6, 9, 11, 13

1/8

3

11, 12, 10

2, 4, 6, 9, 11, 13, 0, 15

1/4

6

11, 12, 10, 13, 9, 14

2, 4, 6, 9, 11, 13, 0, 15

3/8

9

11, 12, 10, 13, 9, 14, 8, 15, 7

2, 4, 6, 9, 11, 13, 0, 15, 7, 8

1/2

12

11, 12, 10, 13, 9, 14, 8, 15, 7, 16, 6, 17

2, 4, 6, 9, 11, 13, 0, 15, 7, 8, 3, 12

5/8

15

11, 12, 10, 13, 9, 14, 8, 15, 7, 16, 6, 17, 5, 18, 4

2, 4, 6, 9, 11, 13, 0, 15, 7, 8, 3, 12

3/4

18

11, 12, 10, 13, 9, 14, 8, 15, 7, 16, 6, 17, 5, 18, 4, 19,
3, 20

2, 4, 6, 9, 11, 13, 0, 15, 7, 8, 3, 12, 1, 14

7/8

21

11, 12, 10, 13, 9, 14, 8, 15, 7, 16, 6, 17, 5, 18, 4, 19,
3, 20, 2, 21, 1

2, 4, 6, 9, 11, 13, 0, 15, 7, 8, 3, 12, 1, 14,
5, 10

Summary of Contents for Datacenter Switch 3456

Page 1: ...Submit comments about this document at http www sun com hwdocs feedback Sun Datacenter Switch 3456 Installation Guide Part No 820 4730 11 December 2008 Revision A Sun Microsystems Inc www sun com ...

Page 2: ...s droits réservés Sun Microsystems Inc détient les droits de propriété intellectuels relatifs à la technologie incorporée dans le produit qui est décrit dans ce document En particulier et ce sans limitation ces droits de propriété intellectuelle peuvent inclure un ou plus des brevets américains listés à l adresse http www sun com patent set un ou les brevets supplémentaires ou les applications de ...

Page 3: ... Chassis 2 Chassis Activity Dimensions 3 Heat Considerations 3 Air Temperature 3 Surface Temperature 4 Other Objects Temperatures 4 Hot and Cold Aisles 4 Electrical Considerations 4 Main Power 4 Bus Power 5 Pin Power 5 2 Partial Configuration 7 Complete and Base Configurations 7 Configuration Considerations 8 ...

Page 4: ...rk Checklist 12 Cabling Checklists 12 Power Cabling Checklist 12 Network Cabling Checklist 12 Spacing Checklist 12 Loading Checklist 13 Environmental Checklist 13 Personnel Checklist 13 Tools Checklists 13 Installation Tools Checklist 14 Administration Tools Checklist 14 Maintenance Tools Checklist 14 Path to Final Location 15 Security Systems 15 Signage 15 Carpets 15 Grades 16 Elevators 16 Doors ...

Page 5: ...on and Maintenance Tools 21 Standard Tools 21 4 Installation Sequence 23 Installation Sequence 23 5 Unpacking the Chassis 25 Unpacking the Chassis 25 To Remove Shipping Crate Components 26 To Remove the Plastic Envelope 29 To Fit the Ramp 30 To Unsecure the Chassis 31 To Roll Out the Chassis 32 6 Installing the Chassis 35 Installing the Chassis 35 To Move to the Final Location 35 To Level the Chas...

Page 6: ...ips 47 Inspecting Pins 48 Tools 48 To Inspect the Pins on the Rear Side of the Midplane 48 To Inspect the Pins on the Front Side of the Midplane 51 Repairing and Replacing Pins 54 Tools 54 To Remove Pins 54 To Remove a Pin With Needle Nose Pliers 56 To Insert Pins 57 8 Installing Fabric Cards 59 Fabric Card Considerations 59 Inspecting Fabric Cards 60 To Inspect the Fabric Card iTRAC Connectors 60...

Page 7: ...Card FRUID Information 70 9 Installing Line Cards 73 Line Card Considerations 73 Inspecting Line Cards 74 To Inspect the Line Card iTRAC Connectors 74 To Inspect the iPASS Connectors 75 To Inspect the Retainers 76 Installing Line Cards Into the Chassis 77 To Install the Line Cards 77 Line Card Administrative Commands 78 To Enable Line Cards 78 To Disable Line Cards 79 To Enable Line Card IPMB Buse...

Page 8: ...upply Status 87 Working With CMCs 87 Powering On the CMCs 88 To Cable CMCs to the Management Console 88 To Access the CMC From the Serial Management Port 88 To Access the CMC From the Network Management Port 89 To Verify CMC Status 90 Powering On the Sun Datacenter Switch 3456 91 To Power On the Sun Datacenter Switch 3456 91 11 Cabling the Switch 93 Installing Cable Guides 93 To Install Cable Plat...

Page 9: ...Contents ix Cable Cautions 99 To Attach Cables to the Sun Datacenter Switch 3456 99 To Remove Cables From the Sun Datacenter Switch 3456 102 To Check Link Status 103 Index 105 ...

Page 10: ...x Sun Datacenter Switch 3456 Installation Guide December 2008 ...

Page 11: ...uring computing machines Topics include cautions preparations unpacking and installation tasks Using UNIX Commands This document might not contain information about basic UNIX commands and procedures such as shutting down the system booting the system and configuring devices Refer to the following for this information Software documentation that you received with your system Solaris Operating Syst...

Page 12: ...rowser might differ from these settings Meaning Examples AaBbCc123 The names of commands files and directories on screen computer output Edit your login file Use ls a to list all files You have mail AaBbCc123 What you type when contrasted with on screen computer output su Password AaBbCc123 Book titles new words or terms words to be emphasized Replace command line variables with real names or valu...

Page 13: ...F Online Unpacking Sun Datacenter Switch 3456 Unpacking Guide 820 4736 10 PDF Printed Shipping crate Online Site Planning Sun Datacenter Switch 3456 Site Planning Guide 820 4728 10 PDF Online Installation Sun Datacenter Switch 3456 Installation Guide 820 4730 10 PDF Printed Shipping kit Online Administration Sun Datacenter Switch 3456 Administration Guide 820 4731 10 PDF Online Service Sun Datacen...

Page 14: ...xiv Sun Datacenter Switch 3456 Installation Guide December 2008 ...

Page 15: ...n Guide is shipped inside the switch shipping crate You can also access the guide at this URL http docs sun com app docs prod switch 3456 Chassis Weight As shipped the Sun Datacenter Switch 3456 switch chassis and crate weighs approximately 1800 pounds 820 kg This section describes the effects and behavior of that much mass Moving the Chassis When moving the chassis from the truck to the unpacking...

Page 16: ... The Sun Datacenter Switch 3456 chassis cannot be safely moved by one person alone Never allow any person near the direct path of the Sun Datacenter Switch 3456 Personnel moving the Sun Datacenter Switch 3456 should consciously keep their feet away from the bottom edge of the Sun Datacenter Switch 3456 because this is a pinch point and can cause injury Personnel moving the Sun Datacenter Switch 34...

Page 17: ...is 36 F 20 C hotter than the air going in While this output temperature is not hot enough to burn this temperature is sufficient to dehydrate and render useless any cooling device in the vicinity TABLE 1 1 Approximate Minimum Chassis Activity Dimensions Item Length Width Height Comment Sun Datacenter Switch 3456 chassis 6 ft 1 8 m 4 ft 1 2 m 5 ft 1 5 m Dimensions of chassis Unpacking space 35 ft 1...

Page 18: ...ed Sun Datacenter Switch 3456 is approximately 40 KW The Sun Datacenter Switch 3456s s air mass flow is calculated to approximately 3400 cfm 1 6 m3 s which means that the air exhausted from the switch is 36 F 20 C degrees hotter than the air going in As such the hot aisle for the Sun Datacenter Switch 3456 should be configured to accommodate this heat output and in no way compromise the cooling of...

Page 19: ...al injury and severe damage to the Sun Datacenter Switch 3456 Pin Power Caution When servicing the Sun Datacenter Switch 3456 pin power and signals are active While not a shock or burn threat there is the possibility of damage to the pin midplane fabric card and line card should a short or grounding take place Use all precautions associated with working with active signal conductors when servicing...

Page 20: ...6 Sun Datacenter Switch 3456 Installation Guide December 2008 ...

Page 21: ...nd Base Configurations For maximum functionality the Sun Datacenter Switch 3456 is designed to be operated in a fully configured state 24 line cards 18 fabric cards 16 power supplies 2 CMCs If necessary fewer components can be installed For example the base configuration of the switch is 1 line card 18 fabric cards 6 power supplies 2 CMCs For the base configuration or a partial configuration fille...

Page 22: ...ross the available slots The vacant slots must have filler panels installed For example if only 12 line cards are to be installed they would occupy slots 6 through 17 Filler panels are installed in the vacant slots 0 through 5 and 18 through 23 Power Supplies Power supplies are configured in a need 1 redundancy A fully configured Sun Datacenter Switch 3456 with 24 line cards and 18 fabric cards ne...

Page 23: ...ll power supplies into slots 2 4 6 9 11 and 13 in that order If you were to configure the switch with ten line cards you would install the line cards into slots 11 12 10 13 9 14 8 15 7 and 16 in that order You would also install power supplies into slots 2 4 6 9 11 13 0 15 7 and 8 in that order TABLE 2 1 Maximum Quantity of Line Cards for Quantity of Power Supplies Quantity of Power Supplies Maxim...

Page 24: ...gested Configurations Configuratio n Quantity of Line Cards Line Card Slots Power Supply Slots Base 1 11 2 4 6 9 11 13 1 8 3 11 12 10 2 4 6 9 11 13 0 15 1 4 6 11 12 10 13 9 14 2 4 6 9 11 13 0 15 3 8 9 11 12 10 13 9 14 8 15 7 2 4 6 9 11 13 0 15 7 8 1 2 12 11 12 10 13 9 14 8 15 7 16 6 17 2 4 6 9 11 13 0 15 7 8 3 12 5 8 15 11 12 10 13 9 14 8 15 7 16 6 17 5 18 4 2 4 6 9 11 13 0 15 7 8 3 12 3 4 18 11 1...

Page 25: ...tion and Maintenance Tools on page 21 Final Location Checklists This section includes a checklist that the installers can use to ensure that they are ready for installation This checklist covers power air conditioning network cabling spacing loading and other topics Power Checklist ____ Are correct power cables used ____ Is power routed through circuit breakers to code ____ Is power conditioned be...

Page 26: ...ation ____ Have appropriate connectors been fitted Network Cabling Checklist ____ Have the cables been routed between IB switches and the Sun Datacenter Switch 3456 ____ Have the cables been labeled for their respective ports ____ Have the cables been properly bundled ____ Have the cables been given enough slack for installation Spacing Checklist ____ Has enough work area been cleared for receivin...

Page 27: ...hermal demands of the switch ____ Have additional cooling systems been installed and tested operational ____ Have the air flow characteristics of the final location been analyzed ____ Has the air flow management been configured for the Sun Datacenter Switch 3456 s additional heat load Personnel Checklist ____ Have the appropriate personnel for installation administration and maintenance been deter...

Page 28: ... kit ____ Flashlights ____ Gloves ____ Digital multimeter ____ Beam level ____ Scissors ____ Pocket knife or box cutter Administration Tools Checklist ____ InfiniBand network subnet manager software stack ____ Host server for software stack ____ Server for CMC interface ____ Serial terminal for CMC interface Maintenance Tools Checklist ____ Socket extension ____ Socket ____ Ratchet ____ Molex pin ...

Page 29: ...nally security might be able to provide an alternative route that has less impact to building security Signage If the path to the final location has high foot traffic consider posting signs and providing email informing personnel of the move This action alerts uninvolved personnel to avoid the path which eases the movement of the Sun Datacenter Switch 3456 and reduces the possibility of complicati...

Page 30: ...hat the elevator can safely accommodate the weight of the Sun Datacenter Switch 3456 chassis and the personnel moving it The elevator doors must be wide enough to allow the Sun Datacenter Switch 3456 to pass ideally with personnel alongside The doors might need to be held open either physically or by pressing the door open button within the elevator Verify that the threshold at the elevator doors ...

Page 31: ...ment A quick sweeping of the path to the final location before moving the Sun Datacenter Switch 3456 can remove most objects that might later prove troublesome Turns Ensure that any turns in the path to the final location allow unhindered movement of the chassis Avoid narrow hallways and tight turns because they create opportunities for injury Check the path before moving the Sun Datacenter Switch...

Page 32: ...two for each person unpacking Scissors Gloves for each person unpacking Bin for parts collection Cleanliness The unpacking area must be clean and uncluttered Personnel will be working closely and activity The personnel must be free to move about without distraction or the possibility of tripping or slipping The task of unpacking produces packing material waste and wood shavings This debris should ...

Page 33: ...itch 3456 4 Two people can do this task however more people can speed up the tasks Additionally tasks can happen at the four corners of the chassis in parallel Moving Sun Datacenter Switch 3456 to final location 3 At least two people one to push the other to steer With three people one pushes the other two push and steer With four all push and steer Additionally a non pushing person can handle sit...

Page 34: ...The synchronized procedures of installing the line cards requires two people for lifting the cards into place Insertion is better handled by two people though one person can accomplish the task Running diagnostics 1 Only one person is needed Cabling line cards 4 One person can achieve this task though it can be greatly accelerated if two teams work on opposite ends of the chassis working towards e...

Page 35: ...rtance of correctly installing the switch Installation and Maintenance Tools This section lists the tools to be used for the installation Standard Tools TABLE 3 2 describes the tools required for the installation and maintenance of the Sun Datacenter Switch 3456 TABLE 3 2 Standard Tools for Installation Tool Purpose Socket extension Extends reach of socket to the line and fabric cards especially w...

Page 36: ...pair or replace broken bent or damaged midplane pins Flashlights For inspecting pins connectors and chassis fittings Gloves To protect hands during unpacking and moving DMM To check continuity and leakage during installation Beam level To level the Sun Datacenter Switch 3456 chassis TABLE 3 2 Standard Tools for Installation Continued Continued Tool Purpose ...

Page 37: ...acenter Switch 3456 Installation Sequence Step Task Cross Reference 1 Remove the Sun Datacenter Switch 3456 from its crate Unpacking the Chassis on page 25 2 Remove the fabric cards line cards and cabling hardware from their boxes 3 Transport the Sun Datacenter Switch 3456 to the final location To Move to the Final Location on page 35 4 Level the chassis To Level the Chassis on page 36 5 Secure th...

Page 38: ...anels on page 41 15 Install cable trees and cable plates Installing Cable Guides on page 93 16 Install additional power supplies To Install Power Supplies on page 83 17 Attach power cables Preparing Power Supplies on page 85 18 Configure the CMC Working With CMCs on page 87 19 Power up the power supplies Powering On the Sun Datacenter Switch 3456 on page 91 20 Power on the fabric cards and line ca...

Page 39: ...he chassis unpacks from the shipping crate perpendicular to the long edge of the shipping crate A rectangular area approximately 10 by 20 feet 3 by 6 meters is needed for unpacking the chassis FIGURE 5 1 shows where and how the shipping crate should be oriented to the area for unpacking FIGURE 5 1 Shipping Crate in Unpacking Area ...

Page 40: ...ls two ramps a cap a sub cap and a pallet 1 Using the scissors or knife cut the straps that secure the cap and shells to the pallet 2 Lift the cap from the shells See FIGURE 5 2 FIGURE 5 2 Lifting the Cap From the Shells Note The sub cap is flush with the shells and is removed with the shells not the cap 3 Release the shells from eachother See FIGURE 5 3 ...

Page 41: ...Chapter 5 Unpacking the Chassis 27 FIGURE 5 3 Releasing the Shells From Eachother 4 Seperate the shells and the sub cap from the pallet See FIGURE 5 4 ...

Page 42: ...nstallation Guide December 2008 FIGURE 5 4 Separating the Shells and Sub Cap From the Pallet 5 Remove the two bolts securing the each ramp to the pallet then set the ramps and bolts aside See FIGURE 5 5 FIGURE 5 5 Removing the Ramps ...

Page 43: ...y cut the plastic envelope around the perimeter of the chassis at the base See FIGURE 5 6 FIGURE 5 6 Cutting the Plastic Envelope Note Pull out on the envelope as you cut so that you do not damage the chassis surface To Fit the Ramp Attach the ramps to the side of the pallet See FIGURE 5 7 Note Ensure that the guides on the ramps are towards the center ...

Page 44: ...FIGURE 5 7 Fitting the Ramp to the Pallet To Unsecure the Chassis 1 Use the adjustable wrenches to remove the bolts securing the corner brackets to the pallet See FIGURE 5 8 FIGURE 5 8 Removing the Bracket Securing Bolts 2 Prepare the corner brackets for transport ...

Page 45: ...ce up to 5 feet 1 5 m from the end of the ramp is clear 2 Prepare the personnel One person pusher will push the chassis off the pallet from the end opposite the ramps One person guider at the left of the chassis left side of ramps will guide the chassis off the pallet and brake its roll down the ramps One person guider at the right of the chassis right side of ramps will guide the chassis off the ...

Page 46: ...ide in a concerted fashion Once the antitilt bar has cleared the pallet edge the chassis will begin rolling down the ramps under its own weight 4 The pusher stops pushing and moves to the end of the ramps to assist the guiders 5 The guiders control the descent of the chassis down the ramps and onto the floor Note Though not recommended rollout is possible with just two people At Step b the guider ...

Page 47: ...apter 5 Unpacking the Chassis 33 b Lay the ramps and their bolts onto the pallet c Return the shells to the pallet and secure them together d Set the sub cap into the shells e Set the cap onto the shells ...

Page 48: ...34 Sun Datacenter Switch 3456 Installation Guide December 2008 ...

Page 49: ...Chapter 5 Unpacking the Chassis 35 ...

Page 50: ...ing the Sun Datacenter Switch 3456 chassis and that the chassis has been unpacked from the shipping crate 1 Walk the path to the final location Prop open any doors that must be passed Take preparatory steps if security must be overridden Post signs for directions and information for others not involved with the movement Sweep the path and check the floor surfaces for objects that might hinder move...

Page 51: ...with others or collision might occur announce your presence 5 When you arrive at the final location position the chassis for leveling and securing To Level the Chassis Once the chassis is at the final location you must level the chassis The chassis does not need to be perfectly level However the load borne by the casters should now be distributed between the casters and the leveling feet Note The ...

Page 52: ...alling the Chassis 37 FIGURE 6 1 Lowering the Feet 3 Repeat Step 2 for each leveling foot 4 Lower each foot two additional turns 5 Place a beam level at the center of the chassis running right to left See FIGURE 6 2 ...

Page 53: ...ar foot If the bubble favored the right and the rear raise the right rear foot or lower the left front foot If the bubble favored the left and the front raise the left front foot or lower the right rear foot If the bubble favored the left and the rear raise the left rear foot or lower the right front foot 10 Adjust the appropriate leveling foot 11 Repeat Step 5 to Step 10 until the chassis is leve...

Page 54: ...1 Using an adjustable wrench loosen the screws securing the corner brackets to the chassis 2 Using the brackets as a template mark the floor for fastener locations 3 Remove the corner brackets 4 Prepare the floor as appropriate for building codes 5 Reattach the corner brackets to the chassis 6 Secure the brackets to the floor using washers or shims where appropriate To Remove the Power Supply Fill...

Page 55: ...d filler panels installed You must remove the filler panel where a line card will install 1 Grasp the locking levers at each end of the filler panel See FIGURE 6 3 FIGURE 6 3 Turning Filler Panel Lock Levers 2 Turn the levers counter clockwise to the unlocked position See FIGURE 6 3 3 Pull the filler panel away from the chassis by the handles See FIGURE 6 4 ...

Page 56: ...atacenter Switch 3456 is to be configured with less than 24 line cards the vacant slots must have filler panels installed to maintain proper airflow and thermal management 1 Grasp the handles at each end of the filler panel and lift the panel to the vacant slot 2 Slide the filler panel half way into the chassis 3 Turn the levers counter clockwise to the unlocked position See FIGURE 6 5 ...

Page 57: ...rning Filler Panel Lock Levers Counter Clockwise 4 Slide the filler panel into the chassis until it stops 5 Turn the levers clockwise to the locked position See FIGURE 6 6 FIGURE 6 6 Turning Filler Panel Lock Levers Clockwise 6 Repeat from Step 1 for any remaining vacant slots ...

Page 58: ...ctrical Leakage Use a DMM for this verification test 1 Grasp the release lever of power supply 0 and pull to release the power supply See FIGURE 6 7 FIGURE 6 7 Releasing the Power Supply 2 Continue to pull the power supply halfway out but do not remove it 3 Repeat from Step 1 for all power supplies 4 Set the DMM for ohms If the DMM is not autoranging set it for the highest resistance 5 Touch the b...

Page 59: ...ew on the midplane stiffener See FIGURE 6 8 8 Repeat Step 6 9 Move the black probe to a bus bar screw that is floating in the bus bar See FIGURE 6 8 10 Repeat Step 6 11 Move the black probe to a line card power connector on the left side See FIGURE 6 8 12 Repeat Step 6 13 If you read less than 1 megohm on any of these tests investigate why 14 Continue to To Verify Electrical Continuity on page 45 ...

Page 60: ...ne of the line card power connectors on the left side The resistance should be no greater than 50 ohm 4 Move the black probe to a screw on the midplane stiffener See FIGURE 6 9 5 Repeat Step 3 6 Move the black probe to a bus bar screw that is floating in the bus bar See FIGURE 6 9 7 Repeat Step 3 8 Move the black probe to a line card power connector on the left side See FIGURE 6 9 9 Repeat Step 3 ...

Page 61: ... 2008 11 Slide power supply 0 back in its slot until the release lever begins to move See FIGURE 6 10 FIGURE 6 10 Securing the Power Supply 12 Swing the power supply release lever to the left to secure the power supply 13 Repeat Step 11 for all power supplies ...

Page 62: ... and Replacing Pins on page 54 Midplane Filler Strips The Sun Datacenter Switch 3456 ships with plastic filler strips affixed to the midplane These strips protect the pins of the midplane connectors during the installation process The filler strips are secured in place by short pieces of rubber tubing which are inserted over the midplane alignment pins See FIGURE 7 1 FIGURE 7 1 Midplane Filler Str...

Page 63: ...s Pin gauge block Bright flashlight Magnifying glass or loupe Notepad and pen To Inspect the Pins on the Rear Side of the Midplane The primary tool used to check the midplane pins is the pin gauge block This tool effortlessly slides over the straight pins of an iTRAC connector that is in good condition If there is any resistance a pin is bent and requires further examination 1 Remove the rubber tu...

Page 64: ...ector number is FC R0 F17 The connector number is decoded as follows FC Fabric card Ra Row a where a is 0 through 23 Fb Frame b where b is 0 through 17 The origin of this coordinate system is the lower left corner FC R0 F0 In FIGURE 7 2 the connector identified is FC R13 F15 5 Continue down to the next connector and repeat from Step 3 6 After you have checked the bottom connector visually inspect ...

Page 65: ...arker than the surrounding pins Note Do not look at the individual pins rather look at all of the connector s pins as a whole A bent pin will be apparent 9 Identify the pin that needs repair or replacement and note this 10 Look for any contaminants that might be present These contaminants might appear as light dots near the pins 11 Move your head to the next suspect connector and inspect its pins ...

Page 66: ...er the straight pins of an iTRAC connector that is in good condition If there is any resistance a pin is bent and requires further examination 1 Remove the rubber tubes that secure the filler strip for line card slot 0 Set the tubes aside 2 Remove the filler strip for slot 0 Set the filler strip aside 3 Using the pin gauge block gently insert it into the iTRAC connector on the left side 4 If you f...

Page 67: ...t connector number is LC C0 L23 The connector number is decoded as follows LC Line card Cc Column c where c is 0 through 17 Ld Level d where d is 0 through 23 The origin of this coordinate system is the lower right corner LC C0 L0 In FIGURE 7 4 the connector identified is LC C14 L10 5 Continue right to the next connector and repeat from Step 3 6 After you have checked the far right connector visua...

Page 68: ...at the individual pins rather look at all of the connector s pins as a whole A bent pin will be apparent 9 Identify the pin that needs repair or replacement and note this 10 Look for any contaminants that might be present These contaminants might appear as light dots near the pins 11 Move your head to the next suspect connector and inspect its pins repeating Step 7 through Step 10 12 Continue in t...

Page 69: ...d Tools To repair or replace a pin you need the following tools Molex pin replacement tool Replacement pins extracted from a spare iTRAC connector Head mounted magnifier Flashlight Another person to assist you can make the task much easier To Remove Pins Before you can attempt to straighten a bent pin you must remove the pins surrounding the bent pin See FIGURE 7 6 1 Locate the bent pin See FIGURE...

Page 70: ... pin b Activate the lock to grasp the pin c Press the trigger to pull the pin out d Push the ejector back in to release the pin and reset the tool 3 Set the pin aside 4 Use the Molex tool repeating Step 2 to remove the pin if any below the bent pin 5 Set the pin aside 6 Repeat Step 2 to remove the pins to the left and right sides of the bent pin if any 7 Set these pins aside The bent pin is now ex...

Page 71: ...olex tool see To Remove a Pin With Needle Nose Pliers on page 56 To Remove a Pin With Needle Nose Pliers Perform this procedure only when the Molex tool is incapable of removing the pin You need micro tipped needle nose pliers 1 With one hand grasp the pin with the very tip of the needle nose pliers 2 Squeeze the pliers sufficiently to grip the pin for extraction 3 With the other hand steady the p...

Page 72: ...on a Press the trigger on the Molex tool to release the ejector b Slide a pin into the opening A portion of the pin protrudes c Activate the lock to grasp the pin 2 Position the Molex tool over the hole in the connector where you want to insert the pin 3 Holding the Molex tool perpendicular to the plane of the connector insert the pin into the connector 4 Slowly press the ejector in until it stops...

Page 73: ...58 Sun Datacenter Switch 3456 Installation Guide December 2008 ...

Page 74: ... install a filler panel or replacement fabric card immediately after removing one Though the fabric cards are not heavy they should be installed by two people This method ensures that proper alignment can be achieved before the fabric card retainers are locked Improper alignment can bend midplane connector pins Fabric cards use high density iTRAC connectors that interface with the midplane pins If...

Page 75: ...y as the midplane connector pins However you must verify that no connectors are damaged and no holes are blocked You need the following tools Bright flashlight Magnifying glass or loupe Dental type metal pick 1 Unwrap the fabric card from its antistatic packaging 2 Place the fabric card on a work surface with the iTRAC connectors facing you 3 Using the flashlight positioned to the side and above y...

Page 76: ...he fabric card Contact your SunServiceSM representative 5 Look for any enlarged or cracked holes An enlarged or cracked hole appears darker than the surrounding holes If you see any enlarged or cracked holes use a spare midplane connector pin to verify the resistance to insertion If the insertion gives a little resistance and the pin does not wobble in the hole the connector is still acceptable If...

Page 77: ...assis and simplify the physical connection of the fabric card connectors to the midplane connectors Allow extraction of the fabric card from the chassis and simplify the physical disconnection of the fabric card connectors from the midplane connectors The retainer s design is shown in FIGURE 8 2 Ensure that the pieces of the retainer look finished move smoothly do not bind or do not feel loose or ...

Page 78: ...ne connector the two installers must carefully align the stiffener with the midplane crossbar 1 Place the stiffener on a work surface with the retainers facing the two installers 2 Using a 17 mm socket and ratchet turn each retainer drive screw fully counter clockwise until resistance is felt 3 Rotate both the retainer drive screws clockwise 1 4 turn 4 Lift the midplane stiffener from the work sur...

Page 79: ...assistant press the midplane stiffener into position 9 Rotate both retainer levers to the locked position 10 Slowly rotate each retainer drive screw clockwise until resistance is felt then stop 11 Simultaneously rotate the retainer drive screws clockwise stopping at each half turn to maintain synchronization During this time the levers might have moved from the locked position Move the levers back...

Page 80: ... See To Install the Midplane Stiffener on page 63 2 Extend the antitilt bar from the bottom of the switch chassis See FIGURE 8 4 FIGURE 8 4 Extending the Antitilt Bars 3 Place a fabric card on a work surface with the retainers facing the two installers 4 Using a 17 mm socket and ratchet turn each retainer drive screw fully counter clockwise until resistance is felt 5 Rotate both the retainer drive...

Page 81: ...crews clockwise stopping at each half turn to maintain synchronization During this time the levers might have moved from the locked position Move the levers back to the locked position and continue 14 Continue synchronized rotation until great resistance is felt then stop 15 Verify that the fabric card is properly seated in the slot 16 Give each retainer drive screw a final turn to torque 17 Repea...

Page 82: ...clockwise stopping at each half turn to maintain synchronization 4 Continue synchronized rotation until greater resistance is felt then stop 5 Rotate both retainer levers to the unlocked position 6 Grasp the handles at both ends of the midplane stiffener and slowly pull it from the chassis See FIGURE 8 5 FIGURE 8 5 Removing the Midplane Stiffener 7 Set the midplane stiffener aside ...

Page 83: ...a fabric card is enabled the Standby LED on that fabric card flashes To Disable Fabric Cards To disable standby power and IPMB buses for a fabric card type this command where slot is the slot number of the fabric card from TABLE 8 1 When a fabric card is disabled the Standby LED on that fabric card goes out TABLE 8 1 Fabric Card Slot Mapping Fabric card FC 0 FC 1 FC 2 FC 3 FC 4 FC 5 FC 6 FC 7 FC 8...

Page 84: ...command where slot is the slot number of the fabric card from TABLE 8 1 bus is either a or b To Enable Fabric Card Standby Power To enable standby power on a fabric card type this command where slot is the slot number of the fabric card from TABLE 8 1 To Disable Fabric Card Standby Power To disable standby power on a fabric card type this command where slot is the slot number of the fabric card fr...

Page 85: ...ED turns off but the Standby LED remains flashing To Read Fabric Card FRUID Information To read the FRUID information of a fabric card type this command where ipmb address is the IPMB address of the fabric card from TABLE 8 1 The following sample is a portion of the output for fabric card 3 activate fc slot deactivate fc slot clia fruinfo ipmb address 0 clia fruinfo b8 0 Pigeon Point Shelf Manager...

Page 86: ..._FC txt Product Info Area Version 1 Language Code 25 Manufacturer Name Sun Microsystems Inc Product Name DCS 3456 Fabric Card Product Part Model 375 3562 02 Product Version Rev 3 4 Product Serial Number 37535620821BT00030 Asset Tag FRU Programmer File ID Fruid_FC txt ...

Page 87: ...72 Sun Datacenter Switch 3456 Installation Guide December 2008 ...

Page 88: ...ne Line cards are heavy and must be installed by two people This method ensures that proper alignment can be achieved before the line card retainers are locked Improper alignment can bend midplane connector pins Line cards use high density iTRAC connectors that interface with the midplane pins If these connectors are damaged the pins of the midplane connector can also be damaged upon line card ins...

Page 89: ...y as the midplane connector pins However you must verify that no connectors are damaged and no holes are blocked You need the following tools Bright flashlight Magnifying glass or loupe Dental type metal pick 1 Unwrap the line card from its antistatic packaging 2 Place the line card on a work surface with the iTRAC connectors facing you 3 Using the flashlight positioned to the side and above you l...

Page 90: ...rged or cracked holes An enlarged or cracked hole appears darker than the surrounding holes If you see any enlarged or cracked holes use a spare midplane connector pin to verify the resistance to insertion If the insertion gives a little resistance and the pin does not wobble in the hole the connector is still acceptable If there is no resistance to insertion and the pin can wobble in the hole rej...

Page 91: ...assis and simplify the physical connection of the line card connectors to the midplane connectors Allow extraction of the line card from the chassis and simplify the physical disconnection of the line card connectors from the midplane connectors The retainer s design is shown in FIGURE 9 2 Ensure that the pieces of the retainer look finished move smoothly do not bind or do not feel loose or sloppy...

Page 92: ...rizontally with the link status LEDs across the bottom 6 Insert the line card into the chassis at slot 11 Ensure that the line card is perpendicular to the surface of the midplane Note Once the line card is about halfway into the slot the installers no longer have to bear the weight of the line card 7 Continue to slide the line card in maintaining a perpendicular orientation When you feel resistan...

Page 93: ...when they are first installed Some commands require you to reference TABLE 9 1 To Enable Line Cards To enable standby power and the IPMB buses for a line card type this command where slot is the slot number of the line card from TABLE 9 1 When a line card is enabled the Standby LED on that line card flashes TABLE 9 1 Line Card Slot Mapping Line card Slot number IPMB Address Line card Slot Number I...

Page 94: ...a line card type this command where slot is the slot number of the line card from TABLE 9 1 bus is either a or b To Disable Line Card IPMB Buses To disable an IPMB bus on a line card type this command where slot is the slot number of the line card from TABLE 9 1 bus is either a or b To Enable Line Card Standby Power To enable standby power on a line card type this command where slot is the slot nu...

Page 95: ...his command where slot is the slot number of the line card from TABLE 9 1 When a line card is activated the Active LED is illuminated and the line card goes to full power To Power Down Line Cards to a Standby State To power down a line card to a standby state type this command where slot is the slot number of the line card from TABLE 9 1 When a line card is deactivated the Active LED turns off but...

Page 96: ... Info Common Header Format Version 1 Board Info Area Version 1 Language Code 25 Mfg Date Time May 28 15 08 00 2008 6525548 minutes since 1996 Board Manufacturer Sun Microsystems Inc Board Product Name DCS 3456 Line Card Board Serial Number 37535610821BT00030 Board Part Number 375 3561 02 FRU Programmer File ID Fruid_LC txt Product Info Area Version 1 Language Code 25 Manufacturer Name Sun Microsys...

Page 97: ...82 Sun Datacenter Switch 3456 Installation Guide December 2008 ...

Page 98: ...Datacenter Switch 3456 ships with 6 power supplies installed Depending upon your configuration more power supplies might be needed It is good practice to install as many power supplies as reasonably possible as it promotes future expansion and extended service life To Install Power Supplies 1 Unwrap the power supply from its antistatic packaging 2 Swing open the release lever 3 Orient the power su...

Page 99: ...de December 2008 FIGURE 10 1 Installing the Power Supply 5 Swing the release lever to the left to secure the power supply into the chassis See FIGURE 10 2 FIGURE 10 2 Securing the Power Supply 6 Repeat from Step 1 for any additional power supplies ...

Page 100: ...ch that the power cables are routed out of the way either to the sides of the chassis or under the floor 1 Ensure that the circuit breakers for the power supplies are switched off 2 Plug a power cable into each power supply See FIGURE 10 3 FIGURE 10 3 Plugging In the Power Cables 3 Route each power cable to its respective facility power receptacle 4 Plug each power cable into the receptacle 5 Ener...

Page 101: ...power cable Note At this time power is being supplied to the CMCs The CMCs are effectively on Power Supply Administrative Commands This section provides basic commands to administrate power supplies when they are first installed Some commands require you to reference TABLE 10 1 To Power On Power Supplies When the power is applied to the power supplies a standby voltage is present The CMC can instr...

Page 102: ...he Connected LED remains lit To Verify Power Supply Status To check the status of a power supply type this command where slot is the number of the power supply from TABLE 10 1 For example to check the status of power supply 0 Working With CMCs The chassis management controllers CMCs are redundant You only need to connect to one CMC for administration More information about the commands you use to ...

Page 103: ...tor is a standard RS 232 port with communication parameters 115200 8 N 1 Use a serial terminal a TIP connection or a terminal server as a means of communicating with the CMC See FIGURE 10 4 FIGURE 10 4 CMC External Features To Access the CMC From the Serial Management Port 1 If you have not already done so connect a serial terminal terminal server or workstation with a TIP connection to the serial...

Page 104: ... Guide for instructions on how to set the root password To Access the CMC From the Network Management Port To access the CMC using the network for the first time you must first configure the network management port through the serial management port See To Access the CMC From the Serial Management Port on page 88 You can set network parameters according to the specific details of your network conf...

Page 105: ...CMC s network address For example 5 Login as root using the root password The prompt is displayed Note As shipped the root password is not set and therefore not required Press the Enter key when prompted for the password Refer to the Sun Datacenter Switch 3456 Administration Guide for instructions on how to set the root password To Verify CMC Status You can use the shmstatus command from the clia ...

Page 106: ...tablish a connection to the CMCs See Working With CMCs on page 87 3 Verify all installed components are recognized as installed type If an installed component is not recognized investigate why See the Sun Datacenter Switch 3456 Administration Guide and Sun Datacenter Switch 3456 Service Manual for further assistance 4 Power on each power supply type where slot is 0 to 15 clia shmstatus clia shmsta...

Page 107: ... fan s speed is too low or the fan has stopped investigate why See the Sun Datacenter Switch 3456 Service Manual for further assistance 9 Bring each line card to full power type where slot is 0 to 23 10 Again verify all installed components are recognized as installed type If an installed component is not recognized investigate why See the Sun Datacenter Switch 3456 Administration Guide and Sun Da...

Page 108: ...ement hardware for the Sun Datacenter Switch 3456 To Install Cable Plates Note If you are delivering network cabling from overhead there is no need to install the cable plates The plates offer no advantage in this situation 1 Starting on the right side of the Sun Datacenter Switch 3456 chassis install the cable plates a Using an Allen wrench attach the lowest plate with four M5x1 5 screws The supp...

Page 109: ...ear smooth b Tighten the screws securely c Repeat from Step a for the next higher cable plate and continue until all six cable plates are installed 2 Repeat Step 1 for the left side of the switch To Remove Cable Plates 1 Starting on the right side of the Sun Datacenter Switch 3456 chassis remove the cable plates a Using an Allen wrench remove the four M5 x 1 5 screws that secure the upper cable pl...

Page 110: ...n must hold the weight of the tree for an extended time 1 Identify the cable trees The cable trees are symmetrical and their orientation for installation can be difficult to determine When properly installed the fluted branches of the tree point forward with the fluting on the underside of the branches The top surface of all branches is smooth See FIGURE 11 2 FIGURE 11 2 Cable Tree Placement 2 Set...

Page 111: ...tep 4 for the 11 screws on the front of the right cable tree 6 Press the cable tree into the switch chassis and firmly tighten all 22 screws from top to bottom 7 Repeat from Step 3 for the other cable tree at the front left corner of the chassis To Remove Cable Trees Note Two people are required to remove the cable trees One person must hold the weight of the tree for an extended time 1 Start on t...

Page 112: ...above the branches of the cable tree for the slot where you want to install the tray Slide the far end of the tray into the guides 4 Continue to press the tray into the guides until the tray stops then lower the front of the tray onto the flanges See FIGURE 11 3 FIGURE 11 3 Installing Cable Trays Note Install cable trays only as they are needed If all cable trays are installed before the switch is...

Page 113: ...A right or 0A left Cabling then works its way to the center connectors 12A right or 11A left After row A is finished you populate row B in a similar manner After line card 0 is finished use the same method for line card 1 and so on up to line card 23 One person can cable the Sun Datacenter Switch 3456 but two two person teams can speed up the task more than four fold Because the cabling is symmetr...

Page 114: ...cable for its length Pulling on an IB cable can break the cables internally Caution Do not twist an IB cable more than 1 revolution for its entire length Twisting an IB cable can break the cable internally Caution Do not route IB cables where they might be stepped upon or experience rolling loads Such a crushing effect can break the cable internally To Attach Cables to the Sun Datacenter Switch 34...

Page 115: ...e b Ensure that the retraction strap is forward c Orient the cable connector to the line card iPASS connector squarely and horizontally Ensure that the upper shell just touches the underside of the top of the connector on the line card See FIGURE 11 5 FIGURE 11 5 Checking the IB Cable Connector d Slowly move the connector in As you slide the connector in the top of the shell should scrape against ...

Page 116: ...ine card 4 Curve the cable to the right through the branches of the cable tree See FIGURE 11 6 FIGURE 11 6 Threading the Cable Through the Cable Tree Caution Do not force a bend radius of less than 5 inches 127 mm Any bend tighter than this damages the inner fibers of the cable rendering it useless 5 Place the cable over the cable plate and move the cable against the chassis See FIGURE 11 6 6 Repe...

Page 117: ...here 15 Repeat Step 3 for cables connecting to iPASS connectors 21A 2A and so on up to and including 12A and 11A Place the cables next to the cables that are already there 16 Repeat Step 3 for cables connecting to iPASS connectors 23B 0B 22B 1B and so on up to and including 12B and 11B Place the cables on top of the cables that are already there 17 When you have finished for line card 0 repeat fro...

Page 118: ...ntly lower the cable so that is it hanging from the side branch Caution Do not allow the cable to drop or strike the floor Jerking bending pulling on or dropping the cable will damage the cable See Cable Cautions on page 99 6 Repeat from Step 1 for the cable at iPASS connector 12A This cable is the lower cable 7 Repeat from Step 1 moving to the right for cables at iPASS connectors 13B 13A 14B and ...

Page 119: ...tch 3456 Administration Guide and Sun Datacenter Switch 3456 Reference Manual for more information on how to administer your switch checklinks checklinks LC 0 Active checking links OK LC 1 Active checking links OK LC 2 Active checking links OK LC 3 Active checking links OK LC 4 Active checking links OK LC 5 Active checking links OK ...

Page 120: ...ions 99 checklist 12 network 12 power 12 switch 98 cabling the switch 99 carpets 15 chassis activity dimensions 3 inspecting 43 leveling 36 loading 2 moving 1 35 rolling out 32 securing 39 unpacking 25 unsecuring 31 weight 1 check switch health 92 checkfans command 92 checklinks command 103 checklist 11 cabling 12 network 12 power 12 environmental 13 loading 13 network 12 personnel 13 power 11 spa...

Page 121: ... card IPMB bus 69 standby power 69 line card IPMB bus 79 standby power 80 disableboard command 68 79 disableipmb command 69 79 disablepsu command 87 disablestby command 69 80 display fru information fabric card 70 line card 81 doors 16 E electrical considerations 4 elevators 16 enable fabric card IPMB bus 69 standby power 69 line card IPMB bus 79 standby power 79 enableboard command 68 78 enableip...

Page 122: ...dress fabric card 70 line card 81 iTRAC connectors inspecting fabric card 60 line card 74 L leveling the chassis 36 line card activating 80 administrative commands 78 considerations 73 deactivating 80 disabling IPMB bus 79 standby power 80 displaying fru information 81 enabling IPMB bus 79 standby power 79 filler panels installing 41 removing 40 inspecting iPASS connectors 75 iTRAC connectors 74 r...

Page 123: ...ng 83 mapping 87 powering off 87 on 86 91 verifying status 87 powering fabric card off 68 on 68 line card off 79 on 78 power supplies off 87 on 86 91 psustatus command 87 R receiving area 18 cleanliness 18 equipment 18 removing cable guides plates 94 trays 98 trees 96 cables 102 line card filler panels 40 midplane stiffener 66 pins 54 56 plastic envelope 29 power supply filler panels 39 shipping c...

Page 124: ...ex 109 U unpacking chassis 25 unsecuring the chassis 31 V verifying CMC status 90 components available 91 92 electrical continuity 45 leakage 43 fans 92 link status 103 power supplies 87 W weight chassis 1 ...

Page 125: ...110 Sun Datacenter Switch 3456 Installation Guide December 2008 ...

Reviews:

No comments

Brands by name

Popular brands

Load more brands