background image

   

Contents 

 

 

 

 

 

 

 

 

 
 

6.1.1

 

Cooling .................................................................................................................... 31

 

6.2

 

Required Tools ..................................................................................................................... 31

 

6.3

 

Site Planning ......................................................................................................................... 32

 

6.3.1

 

Rack and Clearance Requirements ........................................................................ 32

 

6.3.2

 

Site Environment Specification ............................................................................... 32

 

6.3.3

 

Power Requirements .............................................................................................. 32

 

6.3.4

 

Site Preparation Checklist ...................................................................................... 33

 

6.4

 

Measuring the Distance between Mounting Rails ................................................................ 33

 

6.5

 

Assembling and Mounting the Rail ....................................................................................... 33

 

6.5.1

 

Rail Kit ..................................................................................................................... 33

 

6.5.2

 

Option 1 .................................................................................................................. 35

 

6.5.3

 

Option 2 .................................................................................................................. 42

 

6.6

 

4036/2036 Switch Power Up ................................................................................................ 47

 

6.7

 

Field Replaceable Units ........................................................................................................ 48

 

6.7.1

 

Fan Unit .................................................................................................................. 48

 

6.7.2

 

Power Supplies ....................................................................................................... 48

 

7

 

Cabling ........................................................................................................................................... 50

 

7.1

 

Cabling Guide Bracket Installation ....................................................................................... 50

 

7.2

 

InfiniBand Cabling - QDR ..................................................................................................... 52

 

7.3

 

Multipurpose Management (Mng) Console Cable ................................................................ 53

 

8

 

Operation ....................................................................................................................................... 55

 

8.1

 

Powering on the 4036/2036 Switch ...................................................................................... 55

 

8.2

 

4036/2036 Switch LED Indicators ........................................................................................ 56

 

8.3

 

Where to Go Next ................................................................................................................. 57

 

9

 

Troubleshooting ............................................................................................................................ 58

 

9.1

 

Overview ............................................................................................................................... 58

 

9.2

 

Solving Startup Problems ..................................................................................................... 58

 

9.3

 

Preparation before Contacting Customer Service ................................................................ 58

 

Appendix A:

 

Option 3 

– Chassis Installation in an iDataPlex Rack ....................................... 59

 

A.1

 

Unpacking the 4036/2036 Switch ......................................................................................... 59

 

A.1.1

 

Multipurpose Console Cable Kit ............................................................................. 60

 

A.1.2

 

Packing the Switch ................................................................................................. 60

 

A.2

 

Mounting the iDataplex Kit .................................................................................................... 60

 

Appendix B:

 

Cabling Information .............................................................................................. 64

 

B.1

 

IB Port Cable Specifications ................................................................................................. 64

 

B.2

 

1 GbE Ports (Management) .................................................................................................. 65

 

Appendix C:

 

QSFP Cable ........................................................................................................... 66

 

 

Summary of Contents for Grid Director 2036

Page 1: ...www mellanox com Grid Director 4036 2036 Installation Manual DOC 00467 A09...

Page 2: ...nge without notice and should not be construed as any commitment by Mellanox Except as permitted by the applicable license no part of this document may be reproduced stored in a retrieval system or tr...

Page 3: ...nfigurations 19 4 2 InfiniBand Clusters Using the 4036 2036 Switch 19 4 3 Ordering Information 22 5 Technical Specifications and Certifications 24 5 1 4036 2036 Switch Technical Specifications 24 5 2...

Page 4: ...abling Guide Bracket Installation 50 7 2 InfiniBand Cabling QDR 52 7 3 Multipurpose Management Mng Console Cable 53 8 Operation 55 8 1 Powering on the 4036 2036 Switch 55 8 2 4036 2036 Switch LED Indi...

Page 5: ...into the rack 37 Figure 19 Power cord over the long bracket 38 Figure 20 Securing power cords 38 Figure 21 Connecting the power cables 38 Figure 22 Secure the long brackets to the rack rail 39 Figure...

Page 6: ...ctor Dimensions 66 Figure 56 QSFP Connector 67 List of Tables Table 1 4036 2036 Front Panel Components 16 Table 2 Rear Panel Components 18 Table 3 4036 2036 Switch Ordering Information 22 Table 4 4036...

Page 7: ...stomer representative For further information and assistance go to http www mellanox com content pages php pg support_index Audience The manual is intended primarily for system administrators who are...

Page 8: ...le Notes File name pathname opt ufm conf gv cfg Console session code flashClear CR Complete sample line or block Comprises both input and output The code can also be shaded Linux shell prompt The char...

Page 9: ...ports QDR provides a date rate of 40 20 or 10 Gb s auto negotiable while the 2036 offers Dual Data Rate 4X ports DDR provides a data rate of 20 or 10 Gb sec auto negotiable The 4036 2036 switch incor...

Page 10: ...o back or back to front hot swappable fan unit QSFP InfiniBand ports supporting copper or optical cables and adapters Built in cable detection and optimization to achieve the longest available cable d...

Page 11: ...itch documentation and software Before unpacking make sure that the box is sealed and undamaged Before beginning the installation of the 4036 2036 switch verify that the package contains the items det...

Page 12: ...moved For example if it is staged at one location before being delivered at the production site A module needs to be returned for repair replacement or upgrade 2 Remove the box containing the Rail Kit...

Page 13: ...wing figure Figure 4 Removing the 4036 2036 Switch from the Cardboard Package 6 Remove the protective antistatic bag from the 4036 2036 switch 2 3 Rail Kit KIT 00008 The rail kit entails 2 Short Brack...

Page 14: ...for repair should this be necessary pack the equipment as described below To pack the 4036 2036 chassis 1 Unmount the 4036 2036 switch from the rack 2 Dissassemble the rail brackets and pack the part...

Page 15: ...the switch for repair without the rail kit it is still important to secure the switch by filling this niche with a filler This will protect the switch and prevent it from moving during transportation...

Page 16: ...ding to configuration Provides the 4036 2036 DC supply One or two AC DC 100 240Vac to 12Vdc 350W hot swappable redundant power supplies are installed in the 4036 2036 switch The power supply has an IE...

Page 17: ...Fan indication Turns off as a result of fan failure Power Supply Power indication Turns off as a result the failure of the power supply unit 3 2 Rear Panel Description This section details the rear p...

Page 18: ...100 1000 Ethernet port RJ 45 Connector 1 Gigabit Ethernet auto negotiating RJ 45 Connector for management 1Gbps 100Mbps 10Mbps LED Provides out of band management interface over a local network LEDs...

Page 19: ...tch providing bidirectional 40 Gbps 20 Gbps per port grid connectivity potentially serving as an edge switch in large fabrics where the 4036 2036 is serving as core switch or as a standalone managed u...

Page 20: ...ingle 4036 2036 switch Figure 8 InfiniBand Cluster Using 4036 Switch Single hop Configuration Figure 9 InfiniBand Cluster Using 2036 Switch Single hop Configuration The following figures show a triple...

Page 21: ...Grid Director 4036 2036 Installation Manual 21...

Page 22: ...VLT 30113 Grid Director 2036 2PS 2036 1U 36 port DDR Switch front to back cooling dual PS VLT 30013 Grid Director 2036 2PS 2036 1U 36 port DDR Switch back to front cooling dual PS VLT 30114 Grid Dire...

Page 23: ...dard packing list 510K00022 F CG 24 Cabling guide bracket kit Not part of the standard packing list Table 5 4036 2036 Switch Packing List According to Configuration Chassis P N Power supply unit Power...

Page 24: ...s DDR or 720 Gbps SDR Port to port Latency under 100 nanoseconds max Linear Forwarding Table 48K entries Multicast Table Size 1K entries Data Virtual Lanes 8 Management Virtual Lanes 1 MTU 4096 Bytes...

Page 25: ...to configuration Power supply with built in power inlet Electrical ratings V A hz 100 240Vac 5 0A 50 60 Hz 2 6A 120V 1 54A 230V 47 63Hz auto sensing Power Inlet Type C14 Power Rating Power consumption...

Page 26: ...R 22 02 CE EN55022 1998 A1 2000 A2 2003 EN55024 1998 A1 2001 A2 2003 EN 61000 3 2 00 A2 05 Harmonic current emissions EN 61000 4 2 1995 A1 98 A2 2001 EN 61000 4 3 02 A1 2002 EN 61000 4 4 1995 A1 01 A2...

Page 27: ...formity Mellanox products comply with the Radio Telecommunications Terminal Equipment Directive 99 5 EEC the EMC Directive 89 336 EEC and of the Low Voltage Directive 73 23 EEC 5 5 2 Hazardous Substan...

Page 28: ...Technical Specifications and Certifications 28 5 6 Label s The 4036 2036 label example below shows all safety and EMC text and logos Figure 11 4036 Label Example Figure 12 2036 Label Example...

Page 29: ...nce Front of the rack 4 10 cm Rear side of the rack 4 10 cm Space below the chassis No limits Space on top of the chassis No limits 5 9 Weights and Dimensions Table 9 Unpacked Weights Dimensions Engli...

Page 30: ...460EX 460GT contain a 440H6 core not a 460 core it is called 460 to distinguish it as a 90 nm core The CTP in MTOPS for the PPC440 core 17 18 F where F is the CPU clock rate in MHz The following table...

Page 31: ...nd connector side faces the front of the rack and is installed in line with the rack s front rails This option is detailed in Option 2 on page 42 Option 3 For the iDataplex rack The rear of the switch...

Page 32: ...s It is recommended to leave 4 10 cm for chassis clearance both in the front and the rear of the chassis These requirements are also listed in Chassis Clearance Requirements on page 29 6 3 2 Site Envi...

Page 33: ...e rack s U levels at which you would like to mount the switch This is important so that you can install the clip nuts in the adequate holes and ensure that the chassis is leveled 4 Using a flat screwd...

Page 34: ...P N Illustration 2 x short bracket 290000169 2 x Mounting Bar MEC 0055 6 Front side of the chassis Rear side of the chassis 14 x Pan Head Philips Screw 8 32 x 1 4 with tooth lock washer and nylon patc...

Page 35: ...front of the switch faces the front of the rack The front of the switch is recessed 5 inches from the vertical rail of the rack to allow connecting the power cords from the front side of the rack Fig...

Page 36: ...te Make sure that the distance is between 0 5 to 1 smaller than the distance you measured between the two vertical rack rails Figure 15 Positioning and aligning the mounting bar and long bracket Total...

Page 37: ...e clip nuts and placing the power cord 6 Place the power cords with the female connector facing the front of the rack or the switch with approximately 10 hanging out of the front Route the other side...

Page 38: ...re each power cord with a cable tie wrap so that you can still adjust the length of the cord if required Figure 20 Securing power cords 10 Connect the power cords to the switch power supplies PSU Figu...

Page 39: ...hten them Figure 22 Secure the long brackets to the rack rail 13 Mount a short bracket from the inner side of the mounting bar and fasten it using two 8 32x1 4 pan head Philips screws At this stage do...

Page 40: ...rail is perfectly aligned by using the same U as used in the front of the rack Figure 24 Adjusting the short bracket 15 Tighten the rack screws Rack screws are not supplied 16 Tighten the short brack...

Page 41: ...Grid Director 4036 2036 Installation Manual 41 Result Rack front view Figure 27 Switch mounted in a rack Rack front view...

Page 42: ...the rear of the switch InfiniBand connector side faces the front of the rack This rear to front chassis installation is in line with the vertical front rails of the rack Figure 28 4036 2036 Option 2...

Page 43: ...sing two 8 32x1 4 pan head Philips screws Use the long bracket middle row orifices and the holes of top row on the rail Important Left and right long brackets are different Make sure that you are usin...

Page 44: ...5 to 1 for adjustment 4 Secure the rail on the side of the switch using two 8 32x1 4 pan head Philips screws use the holes on the top row Make sure you install one screw in the middle of the switch an...

Page 45: ...at least two qualified people should perform the following steps Lift and position the switch with the connectors facing towards you and insert it into the rack Figure 34 Insert the switch into the ra...

Page 46: ...s of the correct U level and secure them using two rack screws not provided by Mellanox and two rail screws Figure 36 Installing the long bracket 9 Tighten the rack screws Rack screws are not supplied...

Page 47: ...n source can be fitted in preparation for connection Two power cords are supplied by Mellanox one per power supply unit To power up the 4036 2036 switch 1 Ensure that all site power requirements have...

Page 48: ...40 Replacing the Fan To replace the hot swappable Fan module 1 Release the captive fasteners at each side of the fan and gently remove it from its slot 2 Position the rear of the new fan in the slot...

Page 49: ...pply To replace a hot swappable power supply module 1 Release the captive fasteners at each side of the power supply and gently remove the power supply from its bay 2 Position the rear of the new powe...

Page 50: ...h should be free from obstructions such as power strips The Cabling Guide brackets CG 24 are optional however it is recommended to use the Cabling Guide Brackets The rack mounted Cabling Guide Bracket...

Page 51: ...Grid Director 4036 2036 Installation Manual 51 3 Tighten the screws Figure 43 Installing a Cabling Guide Bracket Figure 44 Installing a Cabling Guide Bracket sliding rail...

Page 52: ...e recommend dressing the cables from each row of QSFP connectors into two groups running them left and right and fastening them down gently after connectivity was verified They will be routed down alo...

Page 53: ...good physical connection 4 Route the cable to the nearest convenient rack location and gently fasten in place with Velcro tie or tie wraps CAUTION Avoid using tie wrap guns or similar tools do not fa...

Page 54: ...thernet management ports of a 4036 2036 switch can be connected simultaneously However the Ethernet ports of the front and the rear panels cannot be connected simultaneously To connect multi purpose c...

Page 55: ...maximum fault tolerance in the event of power problems NOTE For more details regarding the unit s indicators refer to 4036 2036 Switch LED on page 56 Once the 4036 2036 chassis is secure within the ra...

Page 56: ...t panel fan drawer ON All fans operational Nominal temperature OFF None of the fans are working BLINK At least one fan problem or high temperature SM Green Front panel fan drawer ON SM is active OFF S...

Page 57: ...Rear panel on each QSFP port ON Logical link is configured by SM OFF Logical link is not configured by SM BLINK traffic on the link Eth link Green Rear panel RJ45 connector ON Eth link is up OFF Eth...

Page 58: ...tor is OFF is the InfiniBand cable or connector faulty When the physical link indicator is ON the logical link indicator is OFF and the SM indicator is ON the InfiniBand cable or the connector is faul...

Page 59: ...4036 2036 chassis is supplied in a box similar to the one shown in the following figure To unpack the 4036 2036 chassis perform the following steps 1 Open the box and check that they contain the item...

Page 60: ...a rail kit accommodating iDataplex racks with a front to back distance between mounting rails of 15 75 400 mm The switch cooling direction is from rear to front The following table lists the items re...

Page 61: ...To mount the 4036 2036 in an iDataplex rack 1 Put the chassis on a flat surface 2 On each side of the switch attach the mount brackets to the rear of the chassis connector side using two 8 32x1 4 pan...

Page 62: ...to the rear of the rack 1 Place two clip nuts on each side of the desired U level of the rack rails 2 Secure the mount plates at the rear side of the rack rail into the clip nuts using two screws Note...

Page 63: ...he front side of the rack secure the front of the chassis aligning the mount brackets holes with the rack holes of the correct U level Note The Philips screws are not provided by Mellanox Figure 52 Se...

Page 64: ...ng Specifications Type Maximum Cable Length AWG Length ft Length m Gore Cable P N 4XQDR 26 16 4 7 QSN7600 5 26 13 1 4 QSN7600 4 28 9 84 3 QSN3800 3 30 6 57 2 QSN3300 2 30 4 93 1 5 QSN3300 1 5 30 3 28...

Page 65: ...00 1000 Fast Ethernet ports to external switches and routers Use modular RJ 45 cross connect cables to connect to end systems The following figures show straight through cables and cross connect cable...

Page 66: ...r Provide manageability discovery and identification capability such as vendor identification module part number serial number cable type using low speed two wire I2C interface Active cables Integrate...

Page 67: ...036 2036 Installation Manual 67 The following figure shows the QSFP module with Copper or Optical cables You can install any combination of the three cable types in any of the 36 QSFP cages Figure 56...

Reviews: