Oracle Fabric Interconnect F1-15 User Manual Download Page 1

Page: 1 / 176

Oracle Fabric Interconnect Hardware

User's Guide

Part No: E50997-04

July 2016

Summary of Contents for Fabric Interconnect F1-15

Page 1: ...Oracle Fabric Interconnect Hardware User s Guide Part No E50997 04 July 2016...

Page 2: ......

Page 3: ...dangerous applications including applications that may create a risk of personal injury If you use this software or hardware in dangerous applications then you shall be responsible to take all approp...

Page 4: ...ons risque notamment dans des applications pouvant causer des dommages corporels Si vous utilisez ce logiciel ou mat riel dans le cadre d applications dangereuses il est de votre responsabilit de pren...

Page 5: ...ling the Fabric Interconnect F1 15 in a 4 Post Rack 20 Fabric Interconnect F1 15 Locking Modules 21 Required Equipment 21 Pre Installation Considerations 22 Install the Fabric Interconnect F1 15 23 At...

Page 6: ...5 Connecting the Fabric Interconnect to Other Equipment 77 Connecting to Client Servers 77 Connecting to Switches Routers and Other Equipment 80 Management Module Connections 86 AC Power 89 Performing...

Page 7: ...nstalling the Management Module 147 Remove a Fabric Interconnect F1 15 Management Module 147 Install a Fabric Interconnect F1 15 Management Module 148 Removing and Installing the Fabric Interconnect F...

Page 8: ...Contents Index 173 8 Oracle Fabric Interconnect Hardware User s Guide July 2016...

Page 9: ...ice providers and users who have advanced experience troubleshooting and replacing hardware Required knowledge Advanced experience with Fabric Interconnect devices Product Documentation Library Docume...

Page 10: ...10 Oracle Fabric Interconnect Hardware User s Guide July 2016...

Page 11: ...ost Channel Adapter on page 75 Connecting the Fabric Interconnect to Other Equipment on page 77 Note Identify and resolve any potential installation or cabling issues before beginning the installation...

Page 12: ...onnect which provides server connectivity to network and storage resources The Fabric Interconnect F1 4 supports up to 4 of the same 1 GE 10 GE and Fibre Channel modules as Oracle Fabric Interconnect...

Page 13: ...aximum Cooling The front and back of the chassis must be free of any obstruction to the airflow front to back Caution Air vents must not be blocked and must have free access to the room ambient air fo...

Page 14: ...r choice whether or not install the cable management brackets Service Clearance 18 inches 45 7cm front and rear FIGURE 1 Verifying Rack Space Fabric Interconnect F1 4 Site Criteria Verify that your in...

Page 15: ...obstruction to the airflow front to back Caution Air vents must not be blocked and must have free access to the room ambient air for cooling Installation of the equipment in a rack should be such tha...

Page 16: ...but there are some slight differences depending on which model you ordered Before unpacking the Fabric Interconnect perform a visual inspection of the shipping container If a shipping container shows...

Page 17: ...24 InfiniBand server connections at DDR speeds or 20 InfiniBand server connections at QDR speeds Caution The Fabric Interconnect chassis weighs 100 130 pounds 45 59 kilograms depending on its configur...

Page 18: ...ment assembly CMA is included in a separate box In addition a module retention bracket also not shown is attached to the F1 15 chassis to keep modules and blanks secure while shipping The CMA can be i...

Page 19: ...tall this system alone could result in equipment damage or personal injury To unpack the system you will need the following tools 2 Phillips cross head screwdriver Box cutter Note Because the number a...

Page 20: ...55 pounds 25 kilograms Installing the Fabric Interconnect F1 15 in a 4 Post Rack This section documents how to install the Fabric Interconnect F1 15 in a 4 post equipment rack The procedure in this se...

Page 21: ...I O Module handle which has a slotted head By using a screwdriver you can turn the I O module handle in a 90 degree arc to lock or unlock the I O module For more information see Using the I O Module L...

Page 22: ...ws for a standard rack Pre Installation Considerations Be aware of the following considerations before beginning the installation procedure You will find it helpful to determine the depth of the rack...

Page 23: ...ly optional Note The rack mount rails are intended as an installation tool to assist in inserting the chassis into the equipment rack It is not mandatory to leave the rails installed after the Fabric...

Page 24: ...o Later in the procedure you will then use M6 screws to secure the chassis to the rack 5 Mark each of the rack posts at the locations that will correspond to the bottom of the Fabric Interconnect when...

Page 25: ...t After removing the module retention bracket keep it for future use 8 If you have not already done so you must determine the depth of the rack to determine where to attache the side panels to the cha...

Page 26: ...n page 26 might already be installed This procedure documents installing these parts for completeness in case they are not already installed when you remove the Fabric Interconnect from the shipping c...

Page 27: ...t and a middle slot For deeper racks you can use the end slots to lengthen the rack mount rails as needed FIGURE 8 Assembling the Rack Mount Rails 14 Repeat Step 12 and Step 13 to assemble the second...

Page 28: ...hers For 12 24 racks insert the screw into the lock washer before installing the screw into the rack Use four 4 long screws from the rail kit box to attach each mounting rail to the rack Use the appro...

Page 29: ...are attached to the rack posts tighten all screws that connect the pieces of the rail as well as the screws that attach each assembled rail to the rack Caution All screws that assemble the rails and a...

Page 30: ...ipment Rack on page 30 shows inserting the chassis into the rack FIGURE 10 Inserting the Fabric Interconnect F1 15 into the Equipment Rack Note Figure 10 Inserting the Fabric Interconnect F1 15 into t...

Page 31: ...r a 27 Sun Oracle rack Attach the Right Angle Bracket on page 31 Attach the Right Angle Bracket in a 27 Sun Oracle Rack on page 35 Attach the Right Angle Bracket 1 Align the angle bracket with the scr...

Page 32: ...to attach the chassis to the rack Each point of attachment to the rack requires two screws Figure 12 Attaching the Chassis to the Rack Posts on page 33 shows attaching the chassis to the rack Use eigh...

Page 33: ...sis to the Rack Posts Caution When the chassis is completely installed check all screws to make sure they are tight If any screws are loose make sure to tighten them All screws must be tightened befor...

Page 34: ...mandatory to remove the rail kit but if you do an extra 1U of vertical rack space becomes available 5 As an option you can install cable management assembly CMA If you want to install the CMA see Ins...

Page 35: ...10 32 flat head screws through the slots in the side panel and into the angle bracket s screw holes Each angle bracket requires 3 screws Figure 14 Attaching Angle Brackets for 27 Rack to the Side Pan...

Page 36: ...Oracle Sun 27 rack is untapped so you will need to use cage clips to attach equipment You will need to install the M6 cage nuts into the blanks in the rack then use the M6 screws to secure the equipm...

Page 37: ...metal piece that covers the top of the slots in the comb so that cables cannot be accidentally lifted out of the slots in the comb screws of different types M6 10 32 or 12 24 that match with many com...

Page 38: ...that you will not use every type of screw just the type appropriate for your equipment rack Install the CMA To install the CMA follow this procedure 1 Using tape or a marker make two horizontal marks...

Page 39: ...on the flange side of the extender opposite the attachment bracket 4 Use two M4 screws to sandwich the attachment bracket and plate to the extender in the position farthest from the flange as shown in...

Page 40: ...the other cable management extender 7 Place the long rail to the mounting location see Step 1 on the post of the rack Make sure that these rails are flush with the side of the Fabric Interconnect chas...

Page 41: ...ck or cage nut Note If you are installing into a rack tapped for 12 24 screws you must use the accompanying 12 lock washers For 12 24 racks insert the screw into the lock washer before installing the...

Page 42: ...b to the standoffs 13 When the CMA s comb is installed connect cables and drape them into the slots in the comb as shown in Figure 20 Connecting Cables and Draping Them Through the Comb on page 43 Not...

Page 43: ...raping Them Through the Comb 14 When all cables are connected align the captive screws in the top of the CMA with the screw holes in the CMA s comb as shown in Figure 21 Installing the Top of the CMA...

Page 44: ...g the Top of the CMA 15 Using a Phillips head screwdriver tighten the screws to secure the plate to the comb as shown in Figure 22 Completing Assembly of the CMA on page 45 44 Oracle Fabric Interconne...

Page 45: ...Interconnect F1 4 in a 4 Post Rack This section documents how to install the Fabric Interconnect F1 4 in a four post equipment rack The procedure in this section documents installing a Fabric Interco...

Page 46: ...which has a slotted head By using a screwdriver you can turn the I O module handle in a 90 degree arc to lock or unlock the I O module For more information see Using the I O Module Lock on page 70 By...

Page 47: ...ecures it in place After each power cord is anchored check the amount of protrusion the distance that the anchored power cord stands out from the face of the Fabric Interconnect The power cord can pro...

Page 48: ...ins 3 smaller bags for different types of common equipment racks Eight 8 10 32 x 75 Phillips pan head screws Eight 8 12 24 x 75 Phillips pan head screws Eight 8 12 lock washers Sixteen 16 M6 x 20 mm P...

Page 49: ...it on each front mounting bracket There are some considerations about how power cords must be tied See Power Cord Management on page 46 Make sure to install the Fabric Interconnect without the I O mod...

Page 50: ...lled The marks must be on the exterior faces of the rack posts 4 Verify that all four marks two on the exterior of the front rack posts and two on the exterior of the rear rack posts are level 5 Get e...

Page 51: ...ect is shipped with three complete sets of rack mounting screws 10 32 12 24 and M6 which support a wide variety of common equipment racks 10 Find the right angle brackets 7089458 and use the correct r...

Page 52: ...opposite end of the equipment rack shown in Figure 25 Attaching Right Angle Brackets to the Equipment Rack on page 52 12 While supporting the Fabric Interconnect hold it level and slide it into the ra...

Page 53: ...es to the Angle Brackets on page 53 FIGURE 26 Attaching the Rack Depth Measures to the Angle Brackets 2 Keeping the Fabric Interconnect level insert the appropriate rack mounting screws 10 32 12 24 or...

Page 54: ...7 Securing the Front Mounting Brackets to the Equipment Rack Caution Make sure that all screws are tight before proceeding 3 Align the slots in the rack depth rails with the screw holes in the right a...

Page 55: ...Interconnect F1 15 you will substitute the Oracle Fabric Interconnect F1 4 5 Install the I O modules as documented in Installing an I O Module on page 69 6 Cable the Fabric Interconnect F1 4 as docum...

Page 56: ...rack While the screws are loose you can slide the chassis along the slots in the mounting brackets until the chassis is flush with the rack or whatever depth is your preference 4 Insert the M6 pan hea...

Page 57: ...on When the chassis is completely installed check all screws to make sure they are tight If any screws are loose make sure you tighten them All screws must be tightened for the chassis to be completel...

Page 58: ...fferent models and connectivity types a Fabric Interconnect F1 15 with different speeds of InfiniBand connectivity DDR or QDR a Fabric Interconnect F1 4 with different speeds of InfiniBand connectivit...

Page 59: ...y the different layout of its 20 physical ports The front of a QDR Fabric Interconnect F1 15 has the same standard equipment for example power supplies fans and so on are the same between a QDR Fabric...

Page 60: ...Components on page 61 shows the Fabric Interconnect F1 4 s rear panel with a QDR Fabric Board installed The QDR Fabric Board is easily identifiable by the different layout of its 20 physical ports Th...

Page 61: ...vide indicators of the system s status as well as a power LED and power button for hard power on and off Figure 34 Fabric Interconnect F1 15 Control Panel on page 61 shows the Fabric Interconnect cont...

Page 62: ...Fabric Interconnect F1 4 Control Panel Fabric Interconnect I O Modules Fabric Interconnects have different models of I O Modules that provide connectivity to network and storage resources For network...

Page 63: ...pable and supports robust network software features If you are upgrading from a 10 GE module or 10 Port GE module to the 4 Port 10 GE module follow the procedure documented in Upgrading to a 4 Port 10...

Page 64: ...37 Fabric Interconnect F1 4 I O Modules and Indicators on page 64 shows I O modules in a Fabric Interconnect F1 4 I O Modules are installed horizontally in the rear of the Fabric Interconnect FIGURE...

Page 65: ...een Blinking green I O card is running diagnostics Off Blinking green I O card is booting Off Solid green I O card is up running Off Solid amber Fault detected Solid blue Solid green I O card is down...

Page 66: ...ich is affected by whether the module is inserted or being ejected the Power Status LED indicates the condition of power to the module Each Gigabit Ethernet port has two LEDs that indicate the state o...

Page 67: ...he port is not enabled and link is not present traffic activity cannot occur and as a result the traffic activity LED will be dark Figure 40 LED Codes 4 Port 10 Gigabit Ethernet Module on page 67 show...

Page 68: ...DDR Fabric Interconnects only Do not install this module in a Fabric Interconnect running an SDR InfiniBand fabric Figure 41 LED Codes Fibre Channel Module on page 68 shows the Fibre Channel I O modul...

Page 69: ...ect FIGURE 42 LED Codes Fabric Interconnect Front Panel Aux 1 Aux 2 ID Status Description N A N A Blinking green Blinking green Front panel card is running diagnostics N A N A Off Blinking green Front...

Page 70: ...unter clockwise until the handle is in the open position Open Unlocked For the Fabric Interconnect F1 15 the open position is vertical 90 degree angle For the Fabric Interconnect F1 4 the open positio...

Page 71: ...Fabric Interconnect F1 4 I O Modules contain a locking mechanism a quarter turn Pawl that is built in to the module s handle The lock is used to secure the module in place while it is inserted in the...

Page 72: ...ver to lock or unlock an I O Module make sure to apply only enough force to the locking mechanism and rotate the handle only enough to unlock or lock the module 1 When handling I O modules make sure t...

Page 73: ...hat the I O module is in the unlocked position Modules can be inserted into the Fabric Interconnect F1 4 only if they are in the unlocked position 5 Gently insert the I O module 1 as shown in Figure 4...

Page 74: ...Module s connector meeting its midplane socket Continue to apply gentle pressure until the connector is seated in the socket 6 When the module is completely inserted it should lie flush with the face...

Page 75: ...specific installation information Note When using Gore InfiniBand cables push the connector lock towards the cable s end as far as possible before inserting the cable into the connector To install an...

Page 76: ...oved the open slot is where the HCA s card will be installed See Figure 47 Removing the HCA Slot s Protective Faceplate on page 76 Note Some servers have a latch that secures the HCA card to the chass...

Page 77: ...onsult your server s documentation for information about the proper method for securing the HCA card 7 When the HCA is installed replace the cover and reattach cables per the server manufacturer s ins...

Page 78: ...ta rate QDR link to the server and operates at 40 Gbps but is capable of auto negotiating down to 20 Gbps for Double Data Rate DDR or 10 Gbps Single Data Rate SDR depending on the speed of your networ...

Page 79: ...for Fabric Interconnect F1 15 Client Server Connections Figure 50 InfiniBand Ports for Fabric Interconnect F1 4 Client Server Connections on page 80 shows an InfiniBand port connection on the Fabric...

Page 80: ...uters and storage devices to the Fabric Interconnect using Ethernet and or Fibre Channel cables as required for the Fabric Interconnect F1 15 or Fabric Interconnect F1 4 Figure 51 Fabric Interconnect...

Page 81: ...t F1 15 Fibre Channel and Gigabit Ethernet Modules and Connectors on page 81 shows an example of the 10 Port GE module but the 10 GE module which has one 10 GE port is also supported Figure 52 Fabric...

Page 82: ...Connecting the Fabric Interconnect to Other Equipment FIGURE 52 Fabric Interconnect F1 4 Fibre Channel Module and Connectors 82 Oracle Fabric Interconnect Hardware User s Guide July 2016...

Page 83: ...tandalone SFP optical transceivers which is the more involved procedure To connect the 4 Port 10 GE Module using SFP optical transceivers follow this procedure 1 Insert the 4 Port 10 GE Module into th...

Page 84: ...rting the Optical Transceiver into the 4 Port 10 GE Module 4 Insert one end of the optical cable into the SFP transceiver See Figure 54 Inserting the Optical Cable into the Optical Transceiver on page...

Page 85: ...ule s port to make sure that the port detects the cable The Link LED should be glowing steady green 7 Check the Link LED on the peer device The Link LED on the peer device should show that a physical...

Page 86: ...nt These are the adapter s pin assignments Management Port DB9 Serial Port Pin Signal Name Pin Signal Name 1 RTS 8 CTS 2 DTR 6 DSR 3 TXD 2 RXD 4 GND 5 GND 5 DCD 1 DCD 6 RXD 3 TXD 7 DSR 4 DTR 8 CTS 7 R...

Page 87: ...des 2 Verify that the serial port on your system is set up as follows 115200 baud 8 bits no parity VT100 encoding 1 stop bit Note The Serial 2 port is used for debug purposes only Connect to a Fabric...

Page 88: ...t Management module Connect directly to the Serial 1 port on the Management module This step requires an adaptor that supports straight through CAT 5 cable or the equivalent See Connecting the Managem...

Page 89: ...re located on the front of the chassis and the power plugs are on the rear of the chassis as shown in Figure 57 Fabric Interconnect F1 15 Power Supplies for Connecting to AC Facility Power on page 90...

Page 90: ...r for the Fabric Interconnect F1 4 The Fabric Interconnect F1 4 s power supplies and power plugs are located on the front of the chassis See below Caution Verify that your AC power source as well as a...

Page 91: ...the cable tie is in use 2 Insert the cable tie through the top slot of the anchor first then the bottom slot Figure 23 Power Cord Anchor on page 47 shows the location of the anchors Make sure that th...

Page 92: ...nd complies with the considerations in Power Cord Management on page 46 clip the tie wrap so that it has no more than 1 2 54 cm of excess length 6 Repeat Step 3 through Step 5 for the other power supp...

Page 93: ...connect F1 4 has I O modules and is cabled to facility power network storage and server resources you can power it on and perform initial configuration through the Oracle Configuration Wizard See Perf...

Page 94: ...94 Oracle Fabric Interconnect Hardware User s Guide July 2016...

Page 95: ...allation and Boot Guide Oracle Virtual Networking for Oracle Solaris Hosts Installation and Boot Guide Oracle Virtual Networking for Windows Hosts Installation and Boot Guide Initial Configuration Thi...

Page 96: ...ce for proactive system monitoring By default the wizard sets this to true so that diagnostic information is sent to Oracle Technical Assistance In the Oracle First Boot script the diagnostic informat...

Page 97: ...assword admin Once you have successfully logged in the Configuration Wizard will automatically launch 3 Enter the values indicated by the bold text that are appropriate for your system environment Wou...

Page 98: ...ou want to keep the default of public When you have completed the configuration the Oracle Configuration Wizard closes and returns you to the admin system_name prompt Change the Root Password When you...

Page 99: ...odule or 10 Port GE module to the 4 Port 10 GE module follow the procedure documented in Upgrade to a 4 Port 10 GE Module on page 142 Management module See Removing and Installing the Management Modul...

Page 100: ...15 when the SCP reconnects to the Fabric Interconnect s midplane When removing the Front Panel from a Fabric Interconnect F1 15 the Fabric Interconnect remains online but tasks affecting the configur...

Page 101: ...e between the Fabric Interconnect F1 15 and Fabric Interconnect F1 4 Front Panel PSUs Fans Management Module The ID LED The ID indicator LED ID LED on the Fabric Interconnect front panel provides a vi...

Page 102: ...mmand For example admin nerf ovn show chassis detail dn chassis mod descr nerf id 1 type chassisIb15Slot model num XC1DH41ZZZ 1 part num 705 00005 01 part num major 01 part num minor 05 assembly id 71...

Page 103: ...m to lightly snug Do not overtighten screws or they can break Caution When replacing the Fan Modules wear an ESD wrist strap When the hardware is out of its shipping package or not in the Fabric Inter...

Page 104: ...t F1 15 Fan s Securing Screws 2 Grasp the handle and slide the fan module out of the chassis See Figure 62 Removing a Fabric Interconnect F1 15 Fan Module on page 104 FIGURE 62 Removing a Fabric Inter...

Page 105: ...e two spring loaded securing screws located at the top corners of the each fan module 1 See Figure 63 Removing a Fabric Interconnect F1 4 Fan Module on page 105 FIGURE 63 Removing a Fabric Interconnec...

Page 106: ...in the Fabric Interconnect F1 4 chassis The fan module is correctly seated when the fan module sits flush with the face of the Fabric Interconnect F1 4 3 When the fan module is correctly seated use t...

Page 107: ...lling starts when the Fabric Interconnect senses a PSU disconnect from the system s power channel When a PSU is disconnected you must wait for at least 30 seconds before re inserting it This 30 second...

Page 108: ...The supply is fully reinserted in the chassis when the locking lever rotates upward to its original locked position Make sure to properly tighten the locking screw Remove Fabric Interconnect F1 4 Powe...

Page 109: ...ic Interconnect F1 4 PSU the Fabric Interconnect polls for hardware status every 30 seconds Polling starts when the Fabric Interconnect senses a PSU disconnect from the system s power channel When a P...

Page 110: ...b shown in Figure 67 Removing a Fabric Interconnect F1 4 PSU on page 110 3 Simultaneously press the locking tab to the right 1 and pull the PSU out of the Fabric Interconnect F1 4 2 as shown in Figure...

Page 111: ...U 1 Orient the new PSU so that the locking tab is at the bottom left corner when the PSU is facing you 2 Align the PSU with the empty PSU bay and gently slide the PSU into the chassis by pressing on t...

Page 112: ...To perform this procedure you will need the following tools 2 Phillips cross head screwdriver an ESD wrist strap Caution When tightening screws make sure to tighten them to lightly snug Do not overti...

Page 113: ...Board s removal 3 Using a screwdriver loosen the captive screws in the release levers by turning them counterclockwise 1 See Figure 69 Unlocking the Fabric Interconnect F1 15 Fabric Board on page 113...

Page 114: ...Board The Fabric Interconnect F1 4 Fabric Board is on the rear of the chassis and connects to a threaded standoff on the mounting bracket To replace the Fabric Interconnect F1 4 Fabric Board you will...

Page 115: ...onnect F1 4 s Fabric Board on page 115 FIGURE 71 Unlocking the Fabric Interconnect F1 4 s Fabric Board 4 When the screws are loose grasp the Fabric Board s handles and simultaneously pivot them outwar...

Page 116: ...to disconnect the Fabric Board 5 After the Fabric Board has disconnected from the Fabric Interconnect F1 4 midplane gently slide the Fabric Board out of the chassis making sure to support the Fabric...

Page 117: ...erted you will feel some resistance when the connector at the rear of the Fabric Board contacts its socket on the inside of the chassis 3 When you feel the Fabric Board connector and socket meet grasp...

Page 118: ...5 Fabric Board is on the rear of the chassis To replace the Fabric Interconnect F1 4 Fabric Board you will need a 2 Phillips head screwdriver Note This procedure is applicable to replacing a QDR Fabri...

Page 119: ...turning them counterclockwise 1 See Figure 75 Unlocking the Fabric Interconnect F1 15 QDR Fabric Board on page 119 FIGURE 75 Unlocking the Fabric Interconnect F1 15 QDR Fabric Board 4 Grasp both of th...

Page 120: ...they are pointing directly towards you not flush with the module At the far end of each of the Fabric Board s handles notice there is a notch This notch will meet a part in the chassis and allow you t...

Page 121: ...ntal If you tip one side of the Fabric Board it possible to insert the Fabric Board incorrectly Make sure you hold the Fabric Board level while you insert it FIGURE 77 Inserting the QDR Fabric Board i...

Page 122: ...ainst the chassis Caution Do not force the levers They should glide easily when properly aligned If you feel uneven resistance or the release levers do not move easily gently swing the levers away fro...

Page 123: ...d a 2 Phillips head screwdriver Note This procedure is applicable to replacing a QDR Fabric Board with another QDR Fabric Board If you are upgrading from a non QDR Fabric Board to a QDR Fabric Board u...

Page 124: ...ure to pivot the Fabric Board handles in a horizontal plane Do not apply upward or downward pressure on the Fabric Board s handles when you are removing the Fabric Board You need to pivot the Fabric B...

Page 125: ...tly towards you not flush with the module At the far end of each of the Fabric Board s handles notice there is a notch This notch will meet a part in the chassis and allow you to lock the Fabric Board...

Page 126: ...oard is properly aligned gently slide it in until you feel some resistance then check the notches at the end of the Fabric Board s handles to make sure they are contacting the guides on the inside of...

Page 127: ...Fabric Interconnect F1 4 to a QDR Fabric Board on page 134 while paying attention to how the release levers contact the edge of the chassis 11 When the release levers have correctly locked the QDR Fa...

Page 128: ...you will need to rediscover the devices through the SNMP manager to correctly enumerate the devices port IDs Also due to the different number of ports on the QDR Fabric Board you might need to fan ou...

Page 129: ...his procedure 1 If the Fabric Interconnect is not running XgOS 3 0 or later upgrade your XgOS version to 3 0 or greater for Fabric Interconnects with InfiniBand server ports 2 Move or stop all traffic...

Page 130: ...d s hinges disconnect it from the Fabric Interconnect s midplane 6 Grasping both of the release levers slide the DDR Fabric Board halfway out of the chassis When the Fabric Board is halfway out place...

Page 131: ...andles so that they are pointing directly towards you not flush with the module At the far end of each of the Fabric Board s handles notice there is a notch This notch will meet a part in the chassis...

Page 132: ...erting the QDR Fabric Board into a Fabric Interconnect F1 15 11 When the Fabric Board is properly aligned gently slide it in until you feel some resistance then check the notches at the end of the Fab...

Page 133: ...d attempt Step 10 through Step 12 while paying attention to how the release levers contact the edge of the chassis FIGURE 86 Seating the QDR Fabric Board into a Fabric Interconnect F1 15 13 When the r...

Page 134: ...f your data center is being managed by an SNMP management tool through the SNMP Manager rediscover the devices on the new QDR fabric After rediscovering the devices the procedure is complete If you en...

Page 135: ...ups can be halted You can also turn down vNICs vHBAs or Server Profiles Or live traffic will be halted when you power off the Fabric Interconnect 3 Remove the InfiniBand cables from your DDR Fabric Bo...

Page 136: ...Fabric Interconnect F1 4 on page 136 shows removing the Fabric Board FIGURE 88 Removing the DDR Fabric Board from a Fabric Interconnect F1 4 7 Set the DDR Fabric Board on an ESD safe work surface or i...

Page 137: ...f you tip one side of the Fabric Board it possible to insert the Fabric Board incorrectly Make sure you hold the Fabric Board level while you insert it FIGURE 89 Inserting a QDR Fabric Board into a Fa...

Page 138: ...uneven resistance or the release levers do not move easily gently swing the levers away from each other partially remove the Fabric Board and attempt Step 10 through Step 12 while paying attention to...

Page 139: ...pansion switch to a port on the QDR Fabric Board The reason for connecting the IB expansion switch is to allow the servers that were on ports 21 through 24 to be connected to the QDR Fabric Board whic...

Page 140: ...e the system is running For information about removing and installing the Management module see Removing and Installing the Management Module on page 147 To perform this procedure you will need a 2 Ph...

Page 141: ...metal side is facing the left edge of the slot Also make sure that the module s top and bottom edges are correctly aligned with the upper and lower tracks at the left edge of each module slot 1 Slide...

Page 142: ...1 Port 10 GE module 10x1 will be available when the 4 Port 10 GE module boots up As a result if you will be using a 4 Port 10 GE module you can either install it in a slot that previously had no other...

Page 143: ...7 Wait for the I O card to power up 8 Insert cables 9 Set the vNICs back to the port s where you want them terminated For example if you want one vNIC terminated on each port set vnic vnic name if 4 1...

Page 144: ...screwdriver to lock or unlock an I O Module make sure to apply only enough force to move the locking mechanism and rotate the handle only enough to unlock or lock the module The I O module lock operat...

Page 145: ...RE 93 Removing a Fabric Interconnect F1 4 I O Module 4 Grasp the module handle and remove the I O module while keeping the module level 2 as shown in Figure 93 Removing a Fabric Interconnect F1 4 I O...

Page 146: ...down and the module s faceplate is facing you 2 Align the module with the slot 3 Holding the module level gently insert the I O module into the chassis 1 See Figure 94 Installing a Fabric Interconnec...

Page 147: ...agement Modules wear an ESD wrist strap When the hardware is out of its shipping package or the Fabric Interconnect chassis make sure you place it in an ESD safe bag or on a grounded work surface such...

Page 148: ...is facing towards the right edge of the chassis Also make sure that the module s top and bottom edges are correctly aligned with the upper and lower tracks at the left edge of the Management module s...

Page 149: ...to be copied off of the Fabric Interconnect to a removable device it might not comply with the strict data center security requirements As a result in XgOS 3 6 0 and later the USB drive is disabled by...

Page 150: ...Power on the Fabric Interconnect and watch the terminal window for a message that gives you the option of entering the system BIOS 4 When prompted with the option of entering BIOS enter the BIOS by pr...

Page 151: ...so be aware that there are some differences in behavior between the Fabric Interconnect F1 15 and the Fabric Interconnect F1 4 when a Front Panel is inserted which are due to how the SCP responds to b...

Page 152: ...mbly Screws 3 Simultaneously grasp both of the release levers and slowly raise them until they are horizontal 2 then use the levers to carefully slide the assembly out of the chassis 3 See Figure 97 R...

Page 153: ...4 front panel assembly you will need a 2 Phillips head screwdriver To remove a Fabric Interconnect F1 4 front panel follow this procedure 1 Power down the Fabric Interconnect 2 Using the screwdriver...

Page 154: ...as shown in Figure 98 Removing the Fabric Interconnect F1 4 Front Panel Assembly on page 154 When both arms are lifted you should feel the Front Panel disengage from the chassis 4 Holding the lever ar...

Page 155: ...right sides of the chassis 2 Holding the lever arms apply even pressure to both handles and slide the Front Panel into place on the chassis 1 See Figure 99 Installing the Fabric Interconnect F1 4 Fro...

Page 156: ...n Considerations on page 156 Power Down the Oracle Fabric Interconnect on page 157 Uncable the Oracle Fabric Interconnect on page 157 Prepare for the Procedure on page 158 Remove the Oracle Fabric Int...

Page 157: ...rconnect to service Power Down the Oracle Fabric Interconnect Issue the system shutdown command and wait for the Oracle Fabric Interconnect to complete its shutdown routine Uncable the Oracle Fabric I...

Page 158: ...will completely remove the chassis from the rack to get access to the mounting brackets Also you will find it helpful to have a cart or sturdy table nearby on which you can place the Oracle Fabric In...

Page 159: ...the Oracle Fabric Interconnect when it is removed from the equipment rack Caution Because of weight two people are required to remove the Oracle Fabric Interconnect from the rack Always follow safe l...

Page 160: ...to be removed you must disconnect the old front panel 1 Disconnect the existing front panel as needed for your model of Oracle Fabric Interconnect Remove and Install a Fabric Interconnect F1 15 Front...

Page 161: ...emove the Old Mounting Brackets Remove the Old Mounting Brackets 1 Remove the screws that attach the old mounting bracket to the chassis 2 Remove the old mounting brackets Performing Service Tasks 161...

Page 162: ...brackets See Install the New Mounting Brackets on page 162 Install the New Mounting Brackets With the old front panel and old mounting brackets removed you can now begin installing the new parts You c...

Page 163: ...Install the New Mounting Brackets 1 Align the new mounting brackets over the screw holes in the chassis Performing Service Tasks 163...

Page 164: ...the old front panel must already be removed and the new mounting brackets must already be installed 1 Align the FP 2 with the guides on the inside of the chassis Make sure that the ejector levers are...

Page 165: ...th the new parts installed rack install the Oracle Fabric Interconnect See Install the Oracle Fabric Interconnect on page 165 Install the Oracle Fabric Interconnect After rack installation the Oracle...

Page 166: ...Configuration on page 95 Cables and Connectors for 4 Port 10 GE Module Connection to the 4 Port 10 GE Module is supported through either optical or copper cables Cables and connectors come in either o...

Page 167: ...ort reach Opnext TRS2001EN 0001 Short reach Oplink TPP1XGDS0C000E2G Long reach Opnext TRS5020EN S002 Long reach Oplink TPP2XGFLRC000E2G TABLE 3 Supported SFP Copper Cables Mode Manufacturer Part Numbe...

Page 168: ...168 Oracle Fabric Interconnect Hardware User s Guide July 2016...

Page 169: ...d to create an ACL ACL rules A collection of conditions and an action that are compared to network traffic If the comparison of the rule to the network traffic results in a match then the action is en...

Page 170: ...database cleanup and so on Q Quality of Service The Quality of Service QoS object allows the data traffic of individual applications to be managed The performance of a particular application can be g...

Page 171: ...which is a Fibre Channel storage connection provided without a physical HBA VLAN Virtual Local Area Network A private independent logical network that is created within a physical network A VLAN beha...

Page 172: ...172 Oracle Fabric Interconnect Hardware User s Guide July 2016...

Page 173: ...15 width 13 15 clearance service 14 15 client servers 13 15 components chassis 58 control panel 61 I O modules 63 configuration wizard 95 connecting AC power 89 requirements 89 client servers 78 Fabri...

Page 174: ...nect 13 13 15 15 host channel adapter 75 hot swapping 107 140 I O modules 140 PSU 107 I I O modules 63 140 installing 70 LEDs 10 GE 65 10 Port GE 65 4 Port 10 GE 66 fibre channel 68 replacing 140 unpa...

Page 175: ...0 screws installation 24 51 unpacking 18 20 security disabling USB drive 149 serial port configuration 87 88 server connecting 78 installing HCA 75 servers 13 15 service clearance 14 15 service tasks...

Page 176: ...176 Oracle Fabric Interconnect Hardware User s Guide July 2016...

Search results

Summary of Contents for Fabric Interconnect F1-15

Reviews:

Related manuals for Fabric Interconnect F1-15

Brands by name

Popular brands

Oracle Fabric Interconnect F1-15, User Manual

Search results

Summary of Contents for Fabric Interconnect F1-15

Reviews:

Related manuals for Fabric Interconnect F1-15

Brands by name

Popular brands