background image

One Stop Systems 

 
 

 

EB4400 (5-SLOT BP)   

 

 

 

 

 

                                                                                        34 

 

 
 

9.3 

Verify Adapter Card LEDs 

 A working HIB adapter cards will illuminate the following LEDs (on both Host and Target cards). 

D11 

CE( Card edge) 

Solid green 

D10 

PWR (Power) 

Blinking green 

D2 

LED 0 

Solid green 

D4 

LED1 

Solid green 

D6 

LED2 

Solid green 

D8 

LED3 

Solid green 

CHO 

Link LED 

Solid green 

D9 

Aux Power 

Solid green 

 
 
 

x16 configuration (Four  x4 Cables connected) 

 

 
 
CHO LED will illuminate as solid green, indicates of a stable LINK between Target and Host cards. 
 

 

 
 
When there is no link between Target and Host cards, the CHO LED is turned OFF. 
 

 

 
 
The D9-Aux power LED will illuminate as solid green, which is an indication of power is present on the card. 
 

 

 

 

Содержание EB4400 5-SLOT Gen4

Страница 1: ...INSTALLATION GUIDE EB4400 5 SLOT GEN4 EB4400 5 SLOT Gen4 www onestopsystems com ...

Страница 2: ... 1 15 Items List 15 2 Getting Started 16 3 Installation Overview 16 4 Hardware Set up Installation 17 4 1 Remove Top Cover 17 4 2 Install Target Card 17 4 2 1 Target Card Configuration 17 4 3 Install Host Card 18 4 3 1 Host Card Configuration 18 4 4 Dip switch Settings 20 5 GPU PCIe Cards Installation 21 5 1 Before you begin 22 5 2 Install GPU or PCIe card 22 5 3 Connect Auxiliary Power Cables 23 ...

Страница 3: ...lation 38 10 1 Software Driver Installation 38 11 Verify HIB Device 39 11 1 Linux OS 39 11 2 Windows 10 Server 41 11 2 1 HIB Cards and Backplane 41 12 Verify PCIe cards 43 12 1 Linux 43 12 2 Windows 44 13 IPMI 46 13 1 Connect Ethernet Cables 46 13 2 Locate Mac Address IP Address 47 13 3 Start Internet browser 48 14 Other Technical Information 49 14 1 Upstream and Downstream Slots 49 14 2 Slot LEDs...

Страница 4: ...sumption breakdown per hardware 65 15 Troubleshooting 66 15 1 Device is not detected or recognized 66 15 2 My PCIe devices are showing UP with a Yellow Exclamation mark 66 15 3 No link between host and target cards 66 15 4 Broken OSS Backplane 66 15 5 My PCIe cards are not detected 66 15 6 Windows Error Codes 67 15 7 System board fails to power UP 67 15 8 PCIe Upstream and Downstream Ports are not...

Страница 5: ...l width PCIe 4 0 x16 FHFL downstream slot to two single width PCIe 4 0 x16 FHFL downstream slots per backplane Riser Adds an additional single width PCIe 4 0 FHFL downstream slot per backplane Environmental Specifications Temperature Operating temp 0 to 35 C ambient Short term 30 mins operating temp 5 C to 40 C ambient Storage temp 40 C to 70 C Operational Humidity Operating humidity 5 95 non cond...

Страница 6: ...rable slot and host uplinks to optimize throughput Integrated IPMI based systems monitoring AC and DC power inlet options 1 3 EB4400 Architecture 5 Slot 1 4 PCIe Slots Slot Type Closed ended PCIe slot connector all the slots are x16 mechanical Six x8 electrical slots slots 1 2 3 4 5 and 6 Three x16 electrical slots slots 0 7 and 8 ...

Страница 7: ...One Stop Systems EB4400 5 SLOT BP 7 1 5 Backplane Block Diagram ...

Страница 8: ...One Stop Systems EB4400 5 SLOT BP 8 1 6 Dimensions ...

Страница 9: ...One Stop Systems EB4400 5 SLOT BP 9 1 7 Parts Overview ...

Страница 10: ...One Stop Systems EB4400 5 SLOT BP 10 ...

Страница 11: ... LED A single x4 SFF 8644 cable must be inserted into port 0 of the Target card On the Host card side you can plug in a single x4 cable to any port as long as the Host card switch is set to x4 mode When using two x4 SFF 8644 cables it must be connected to port 0 and port 1 of the Target card only On the Host card side plug in the two cables to port 0 and portt 1 OR port 2 and port 3 ...

Страница 12: ...dicator when slot is populated or not Solid green when card is present Off when no card 9 Target Slot LED LED status indicator for Target card Solid green when Gen 4 adapter card is installed 10 Upstream Port Target Slot Designated slot for Target card only 11 Dip Switches For slot configuration 12 Board LEDs LED status indicator for the board 13 FPGA Connector FPGA Programming connector 14 PS_ON ...

Страница 13: ...ream slots You must have the ARC6 cables attached between the edge of the board and the slot connectors under the backplane Without those ARC6 cables nothing will work in SLOT 5 Configuration 2 Two Upstream slots Slot 0 and SLOT 5 with two partitions Slot 0 Partition 1 with two Downstream slots Slot 5 Partition 2 with two Downstream slots ...

Страница 14: ...d Target card 4 Downstream slots and 1 Option slot 4 x16 slots Slot 1 2 3 and 4 Configuration 2 OSS 538 backplane is linked to two host computers see diagram below Two partitions two Upstream slots Slot 0 and SLOT 5 with a total of 4 downstream slots Slot 0 Partition 1 with two Downstream slots o 2 x16 slots Slot 1 and 2 Slot 5 Partition 2 with two Downstream slots o 2 x16 slots Slot 3 and 4 ...

Страница 15: ...nitoring are configurable 1 13 Pre Installation Information Before using the One Stop Systems expansion unit you should perform the following steps Inventory the shipping carton contents for all of the required parts Gather all of the necessary tools required for installation Read this manual 1 14 Tools Required for Installation To complete the installation of the product you will need a Phillips ...

Страница 16: ...n on how to install the target card 3 Install the Host card a You should have another card that is configured as host card b Check the dipswitches make sure it is set to host mode prior to installing the card 4 Install PCIe GPU cards a Plug in your PCIe or GPU cards in the expansion unit 5 Connect the external link cables a Plug in the Mini SAS HD SFF 8644 cables between Target and Host cards 6 Co...

Страница 17: ...k of the unit to disengage it from the guides and then lift the cover off 4 2 Install Target Card By default the Target card is installed in the unit The Target card is plugged in or installed in the Target slot If the Target card is missing or not installed follow these steps Configure the card first set the card switches to Target mode Plug in the Target card in the designated target slot upstre...

Страница 18: ...switches on the Host card are set to OFF position Auto Negotiation mode You can leave the switches to default or you can set the switches SW1 and SW2 on the card for the desired Host operating mode See Host Card Configuration section for more details 4 3 1 Host Card Configuration The following are switch settings for the Host card x16 Dip switch Settings SW1 2 ON 5 ON SW2 1 ON 2 ON x8 Dip switch S...

Страница 19: ... the card during installation Align the host card PCIe connector on top of the PCIe slot and carefully push the card down until it is firmly seated Secure the card with the screw Below photo is an example of a x16 PCIe slot connectors The photo on the right is a PCI E 3 0 x16 slot The specification of the PCIe slot is printed on the board next to connector for easy identification Use a x16 PCIe sl...

Страница 20: ...One Stop Systems EB4400 5 SLOT BP 20 4 4 Dip switch Settings ...

Страница 21: ... is the Upstream slot aka Target Slot Slots 1 2 3 and 4 are downstream slots Slot 5 is an option slot Configurable to upstream or downstream modes o Downstream mode Use downstream slot for an end point device i e video card Ethernet sound card and etc o Upstream mode Use upstream slot for an OSS Gen4 target card only IMPORTANT You need the ARC6 cables attached between the edge of the board and the...

Страница 22: ... careful and cautious when plugging in a GPU into a PCIe slot Failure to align the GPU on the slot can damage the connector or some of the components on card See picture below as an example of a detached damaged components 5 2 Install GPU or PCIe card Prior to installing a full length PCIe cards or GPUs you must remove the top bracket and the air baffle To dismount top bracket remove four screws l...

Страница 23: ... will allow you to see the slot location and align the GPU connector easily on top of the slot b Align the card on top of the slot c Gently push the card down until it is firmly seated d Secure the cards 5 3 Connect Auxiliary Power Cables Use the supplied compatible auxiliary power cable for your GPU or PCIe card Photos below is an example of an auxilirary power cable available from OSS for purcha...

Страница 24: ...xiliary power connectors on the power distribution board see photo below in the expansion unit Photo below shows the GPU auxiliary power cable connected to the expansion unit auxiliary power distribution board Reinstall the air baffle and card hold down top bracket when done installing all the GPU PCIe cards ...

Страница 25: ...onnect two link cables Configured to operate at x4 mode connect one link cable See the following cable configurations for more details 6 1 1 x16 Configuration FOUR cables Plug in the 1st cable to Port 0 Top port on both Target and Host cards Plug in the 2nd cable to Port 1 on both Target and Host cards Plug in the 3rd cable to Port 2 on both Target and Host cards Plug in the 4th cable to Port 3 Bo...

Страница 26: ...ost cards On the host card side you can also use the two bottom ports PORTS 2 3 1st Cable to PORT 2 2nd cable to PORT 3 Note The two cables on the TARGET card must remain connected on PORT 0 and PORT 1 See diagrams below as an example Photo B1 The two cables are connected on the Target card PORTS 0 and 1 The other end of the cables are connected on the Host card PORTS 2 and 3 Photo B2 The two cabl...

Страница 27: ...ther end of the cable stays connected on Target card PORT 0 Photo A1 Cable is connected on the Target card PORT 0 The other end of the cable is connected on the Host card PORT 1 Photo B1 Cable is connected on the Target card PORT 0 The other end of the cable is connected on the Host card PORT 2 Photo C1 Cable stays connected on the Target card PORT 0 The other end of the cable is connected on the ...

Страница 28: ...SLOT BP 28 Diagrams below are different x4 cable configurations 6 2 Disconnecting Mini SAS HD SFF 8644 Cable To disconnect the link cable pull back the PLASTIC thumb tab to release metal clamp while slowly pulling the cable out ...

Страница 29: ...wer Cord s Connect the supplied power cord to the back of the power supply Ensure that the system s power supply unit is fully secured before connecting the power cord You should have either the 125v or the 250v power cord If you only have the 125V power cord and you require the 250V please contact our Sales Team sales onestopsystems com to place an order Power Cord Voltage Table Power Cord PSU Wa...

Страница 30: ...solid green see photos below Green LED PSU Good Amber LED PSU fault or power issue If Power LED indicator is showing Amber in color it indicates a fault or power issue The two front LEDs the OSS logo will illuminate as blue and the STANDBY MAIN PWR will come ON as solid green ...

Страница 31: ...in a x16 Gen3 Gen4 PCIe slot and the cables are firmly connected Upon powering up the Host computer it will initialize a link between the target and the host The Link LED on both target and host cards will illuminate as solid green Solid green Link LED it means the negotiated link width between host and target card is x16 Blinking green Link LED the link width is x8 ...

Страница 32: ...he target slot the LED will illuminate as solid green A fully operational back plane will illuminate the following LEDs Check LEDs D19 D18 and D16 make sure they are correctly illuminated D19 Blinking green LED 1 This will blink 8 times then will pause for 2 seconds and blink 8 times again D18 Solid green LED 0 D16 AUX power solid green ...

Страница 33: ...One Stop Systems EB4400 5 SLOT BP 33 9 2 Fault LEDs RED A solid RED led on the backplane signifies a fault or an error Below photos are list of RED LED locations and definitions ...

Страница 34: ...en D4 LED1 Solid green D6 LED2 Solid green D8 LED3 Solid green CHO Link LED Solid green D9 Aux Power Solid green x16 configuration Four x4 Cables connected CHO LED will illuminate as solid green indicates of a stable LINK between Target and Host cards When there is no link between Target and Host cards the CHO LED is turned OFF The D9 Aux power LED will illuminate as solid green which is an indica...

Страница 35: ...h corresponding group of two SFF cages 4 Host Mode x4x4x4x4 D1 D3 D5 D7 are the link indictors one for each SFF cage 9 5 Slot LEDs The SLOT LEDs will illuminate either solid green or blinking green depending on the Generation of the PCIe card that is occupying the slot By default the Target SLOT LED will illuminate as solid green Gen 4 Solid Gen4 Link Blink 2Hz Gen3 Link Blink 1Hz Gen2 Link Blink ...

Страница 36: ...U is working properly See photos below for the location of the PSU DC GOOD led 9 7 Front LED There are three visible LEDs located on the front of the unit The LOGO led will illuminate as solid BLUE Standby MAIN PWR Solid green when unit is fully powered ON Red when the unit is on standby mode IPMI This is optional Will only illuminate as solid green when IPMI module is installed in the unit and re...

Страница 37: ... the LED should be amber During protection mode 5Vsb rail the LED should be OFF When protection is cleared the LED should go back to the original intended status When the unit is on standby with AC is present the LED should be amber When the unit is on standby with no AC is present the LED should be OFF When the unit is turned ON properly the LED is green During wakeup redundancy mode the LED shou...

Страница 38: ...tallation One Stop Systems EB4400 expansion unit requires no driver on Windows 7 Windows 8 Windows 10 Windows Server Linux Unix Centos and Mac OS Before attempting to install any software drivers you should ensure that you have set a Restore Point or created a backup of your system data ...

Страница 39: ... The output below gives you a tree like structure of the PCI Device B D F numbers of b8 00 0 and bd 00 00 B Bus number D Device number F Function number The B D F numbers will vary from system to system When the OSS HIB cards and backplane are detected you should see three instances of devices enumerated see photo below If you are only seeing one device the host card is not linking up with the tar...

Страница 40: ...One Stop Systems EB4400 5 SLOT BP 40 The output below shows that the operating system is only detecting the Host card No link between Target card and Host card ...

Страница 41: ...indows Device Manager should look something like the screenshot below You will see multiple PCI standard PCI to PCI bridge or PCI Express standard Upstream Switch Ports and PCI Express standard Downstream Switch Ports 11 2 1 HIB Cards and Backplane Viewing devices by connection Displaying a link between Host and Target cards OSS backplane board with no PCIe cards installed the downstream slots on ...

Страница 42: ...00 5 SLOT BP 42 Viewing devices by type Both adapter cards host and target cards and backplane are recognized detected The devices are coming up with a Yellow Exclamation point this is normal No need to install any drivers ...

Страница 43: ...PCIe cards use the following commands on the terminal window lspci vtt command Output below is a screenshot of the lspci vtt showing the OSS backplane with five cards installed Output below shows four NVIDIA A100 are recognized You can also grep the vendor name of the PCIe card For example if you have an NVIDIA GPUs run the command on the terminal window lspci vvv grep NVIDIA ...

Страница 44: ...llapse all the or until you see multiple subsets of PCI standard PCI to PCI bridge See screenshot below Collapse or click the or sign next to PCI standard PCI to PCI bridge or PCI Express Upstream Switch Port and Downstream Switch Port and you will find all the PCIe devices that are detected The screenshot below shows the OSS backplane is populated with five PCIe cards but showing a yellow exclama...

Страница 45: ...One Stop Systems EB4400 5 SLOT BP 45 The screenshot below shows an Ethernet card is detected and it installed in slot 1 The image below was captured on a computer running Windows Server OS ...

Страница 46: ...ems com Unit equipped with IPMI below photo shows the location of IPMI module installed in the unit How to setup and access IPMI follow instructions below 13 1 Connect Ethernet Cables 1 Connect Ethernet cable to either front or back Ethernet port you can only use one or the other You must plug in the Ethernet cable first before you connect the power to the unit 2 Plug in the other end of the Ether...

Страница 47: ...e Mac address The photo below shows the location of the label with the Mac address numbers There are two Mac addresses one for each port Below photo shows thirteen characters 00184904C9E8 9 The last digit is the designated number for the Ethernet port location on the unit Based on the photo below number 8 is for the back end Ethernet port The last number 9 is for the front end Ethernet port The nu...

Страница 48: ...signed IP address Once you have identified the Mac address and the IP address use the IP address to access the IPMI web interface Below photo is an example of Windows powershell cmdlet for querying the IP address using the Mac address 13 3 Start Internet browser Launch your internet browser and type the IP address for example 192 168 1 153 Below photo is the Web interface of the IPMI monitoring th...

Страница 49: ...erate in an Upstream or Downstream modes Configured as a Downstream slot only plug in an end point device or a 3rd party PCIe card Configured as an Upstream slot only OSS Host card can be used in this slot 14 2 Slot LEDs Item Name Description When Lit Solid Green or Blinking When Off 1 Target Slot LED Upstream Slot LED Solid Gen4 Link OFF Not Linked No Card present in the slot Blink 2Hz Gen3 Link ...

Страница 50: ...nks 2 pause counts 8 blinks D10 CONFIG Config output from the FPGA but enabled as an FPGA option When RED board is not programmed OFF board is programmed 14 4 Slot Type Slot Type Closed ended PCIe slot connector al slots are x16 mechanical and x16 electrical Gen 4 14 5 PS_ON A two pin connector for a shunt jumper which allows the backplane to force power ON when the ATX supply is switched ON See p...

Страница 51: ...Mapping Each slot on the OSS backplane is mapped to a PCIe port on the 88096 PCIe switch Port mapping is hard coded it is essentially fixed No means of changing or modifying it Port Slot Slot Mapping 88096 Port Slot 0 0 Slot 1 48 Slot 2 64 Slot 3 80 Slot 4 32 Slot 5 16 Daisy chain If slot 5 is cabled to the daisy chain port it becomes port 16 of the 88096 regardless of pstream downstream configura...

Страница 52: ... ND Connector IEC 320 C13 Number of Conductors 3 Cord Type SJT Wire Gauge 14 AWG Shielding Unshielded Approval Marks CSA UL Approved Countries Canada USA Voltage Rating 125V Current Rating 15A Operating Temperature 60 C Digi Key Part Q944 ND Part Status Active Style Male pins Blades to Female Sockets slots 1 st Connector IEC 320 C14 2 ND Connector IEC 320 C13 Number of Conductors 3 Cord Type SJT W...

Страница 53: ...es With two power supply modules installed o Share the power load requirements during normal operations o Should one module fail for any reason the power load will be shifted to the other module LED indicator to keep you informed on normal abnormal conditions for your PSU o An indicator for the failure would be the LEDs on the back panel of the power supply behind the chassis o For non functioning...

Страница 54: ...LOT BP 54 14 9 Removing AC Power Supply 1 Disconnect the power cord from the power supply you are removing 2 Grasp the power supply handle 3 Press the black release latch upward and hold it 4 Pull the power supply out of the bay ...

Страница 55: ...ine voltage must not cause the power supply to go out of specified limits The power supply shall power off if the AC input is below VAClow_limit and shall start auto recovery if the VACrecover is reached Input of VAC below VACrecover shall not cause any damage to the power supply including the input fuse The power supply shall also operate at Vin 240Vdc Maximum Input Current Output Rating 1600W Po...

Страница 56: ...One Stop Systems EB4400 5 SLOT BP 56 14 9 2 LED Indicator ...

Страница 57: ...fans installed with sufficient capacity to provide cooling to the extreme high heat generating GPUs These are high CFM RPM replaceable fans The fans have a PWM controlled fan speed 4x lead wires regulated by the temperature sensors within the system 14 10 1 Fan Specifications ...

Страница 58: ...otos below 14 11 Fan Foam Air Filter The EB4400 can be configured to come with fan foam air filters with minimal airflow resistance to prevent dust from entering the expansion unit You can easily remove and clean the filter To access the foam air filter simply remove the fan first and pull the filter out see photos below ...

Страница 59: ...tion Connector of Connector 8 pin 290 010 037 RC 01 Cable Assy Aux Pwr 8 Pin NVIDIA 2 0 12 Expansion System M176 OSS 8 pin male to 8 pin male One 8 pin connector 290 010 037 RC 02 Cable Assy Aux Pwr 8 Pin NVIDIA 2 0 24 Expansion System M176 OSS 8 pin male to 8 pin male One 8 pin connector 6 2 pin 290 010 013 RC Cable Assy Canister External Pwr Dual 6 2 PCIe Graphics Only 8 pin male to 2 6 2 pin ma...

Страница 60: ...he auxiliary power cables are plugged in see photo below To plug in the 6 2 pin cable correctly connect the Y end connector of the cable to the power distribution board see photos below To plug in the 8 pin cable correctly you can use either X or Y end of the cable see photos below Ensure the cable is fully seated and secured NOTE Route cables away from FANs For safety and proper airflow avoid blo...

Страница 61: ...One Stop Systems EB4400 5 SLOT BP 61 14 12 2 Pin Outs PSU board aux port pin outs 8 pin aux power cable and pin outs ...

Страница 62: ...One Stop Systems EB4400 5 SLOT BP 62 6 2 pin aux power cable and pin outs ...

Страница 63: ... enough to meet the power requirement for a high end add in card with power consumption A direct connection to the power system is needed to obtain additional power This can be done by using the 6 2 pin or 8 pin auxiliary power cables The below photos represent how the 6 2 pin connector and 8 pin aux power cables are attached to the PCIe card or GPU card The photo below is an example of a PCIe car...

Страница 64: ... W to a graphics card directly from the power supply for a total of 150 W to the card PCI Express 225 W 300 W High Power Card Electromechanical Specification Published in March 2008 this standard defines an eight pin 2x4 auxiliary power connector capable of supplying an additional 150 W of power for a total of either 225 watts 75 150 or 300 watts 75 150 75 of available power Graphics Card Auxiliar...

Страница 65: ...The GPU power connector has a different keying to prevent interchanging with the 12 V power connectors NOTE We do not provide different aux power cables i e 8pin to 4pin Molex other than what we offer If your PCIe card requires a different power adapter or aux power cable you would have to buy it from other electronic stores 14 13 Expansion Unit Power Consumption The EB4400 expansion unit draws a ...

Страница 66: ...cables 6 If you are still having the same issue after replacing the host card target card and cables your next step is to replace the backplane with a known good board or contact Technical Support for assistance 15 4 Broken OSS Backplane 1 If you received a brand new DOA Dead on Arrival board please contact OSS to RMA board and request for a replacement 2 If you have an out of warranty board pleas...

Страница 67: ...em MS Windows MAC OS LINUX etc The BIOS hosts the first and the most fundamental code firmware that a computer executes upon boot up It is then that each PCI PCIe add in card be it located on the host system or on One Stop Systems expansions chassis is allocated Input output memory space for proper operation By installing multiple add in cards in one chassis or chaining multiple One Stop Systems c...

Страница 68: ... try another computer If you are still having problem try the following 1 Replace the target and host cards See if it fixes the problem If problem prevails go to step 2 2 Replace the link cables See if it fixes the problem If the problem prevails go to step 3 3 Replace the backplane 4 Send the unit for service repair 15 9 Support for 3 rd Party PCIe Cards One Stop Systems will provide reasonable t...

Страница 69: ...repair replacement or take advantage of the 30 day money back guarantee you will need to package the product in a manner similar to the manner in which it was received from our plant We cannot be responsible for any physical damage to the product or component pieces of the product such as the host or expansion interfaces for the expansion chassis that are damaged due to inadequate packing Physical...

Страница 70: ...One Stop Systems EB4400 5 SLOT BP 70 ...

Отзывы: