manualshive.com logo in svg

OSS OSS-KIT-EXP-61611-xM, Installation Manual

Share
Download
OSS OSS-KIT-EXP-61611-xM Installation Manual Download Page 8

One Stop Systems 

 

OSS-KIT-EXP-61611-XM  | 8

 

 

 

When ordering the Gen4 x16 PCIe HIB card and Gen4 SFF-8644 PCIe cable, use the following part numbers: 

Part Numbers 

Description 

OSS-PCIe-HIB616

-x16 ( main part#) 

HIB616

-x16 Host Configuration with Full-height bracket 

 

 

OSS-PCIe-HIB616

-x16-Half 

HIB616

-x16 Host Configuration with Half-height bracket 

OSS-PCIe-HIB616

-x16-T 

HIB616

-x16 Target configuration with Full-height bracket 

OSS-PCIe-HIB616

-x16-T-Half 

HIB616

-x16 Target configuration with Half-height bracket 

 

 

OSS-mSAS4-CBL-x4-C-XM

 

Mini HD SaS Cable 

OSS-mSAS4-CBL-x4-C-1M 

1 meter Gen4 Cable 

OSS-mSAS4-CBL-x4-C-2M 

2 meter Gen4 Cable 

OSS-mSAS4-CBL-x4-C-3M 

3 meter Gen4 Cable 

 

 
 

1.2 

Parts of HIB616-x16 

 

 

 

 

1.2.1 

x4 cable Ports 

There are four x4 cable ports available on the HIB card.  It is very important to know where port#0 is when connecting a single x4 PCIe SFF-8644 
cable.  Port #0 is the connector nearest the Link LEDs. A single x4 SFF-8644 cable must be inserted into port#0 of the Target card all the time.  
For the Host card, you can plug in a single x4 cable to any port as long as the Host card switch is set to operate in a x4 mode.   

When using two x4 SFF-8644 cables, it must be connected to port#0 and port#1 of the Target card only.  For the Host card, you can plug-in the 
two cables to port#0 and portt#1 

OR

 port#2 and port#3.  

Below are photos of the HIB cards in a different position when plugged into a PCIe slot. This will serve as a guide in determining where  port#0 
is located. 

 

 

Summary of Contents for OSS-KIT-EXP-61611-xM

Page 1: ...PCIe x16 Gen4 Host to Target Kit 61611 Model OSS KIT EXP 61611 xM www onestopsystems com PCIe x16 Gen4 Host to Target Kit Installation Manual SKU OSS KIT EXP 61611 XM ...

Page 2: ... 2 3 Expansion Chassis Gen4 Backplane 14 2 4 Host Card Mode Configuration 15 2 5 Target Card Mode Configuration 16 2 5 1 Target mode switch settings OSS Backplane 16 2 5 2 Target mode switch settings Magma Backplane 16 2 6 Supported Setup 17 2 7 Use Cases Configurations 17 2 7 1 Host to Host 17 2 7 2 Using 3rd Party Target Backplane 18 2 7 3 Connecting to 3rd Party backplane via on board SFF 8644 ...

Page 3: ...ed configurations 33 5 Identify HIB Device 36 5 1 Linux OS 36 5 2 Windows 10 Server 39 6 Software Installation 41 7 Troubleshooting 42 7 1 Device is not detected or recognized 42 7 2 Broken OSS 518 Board 42 7 3 Intermittent start up issue and PCIe cards are not getting recognized 42 7 4 Third Party Hardware and Software Support 43 7 5 There is no LINK between Host and Target 43 7 6 Does the OSS 51...

Page 4: ...tip to help you CAUTION Used to indicate and prevent the following procedure or step from causing damage to the equipment WARNING Used to indicate and prevent the following step from causing injury DANGER or STOP Used to indicate and prevent the following step from causing serious injury or significant data loss Disclaimer We have attempted to identify most situations that may pose a danger warnin...

Page 5: ...may cause your installation to produce emissions that could interfere with other electronic equipment in the area of your system When Working Inside a Computer 1 Before taking covers off a computer perform the following steps 2 Turn off the computer and any peripheral devices 3 Disconnect the computer and peripheral power cords from their AC outlets or inlets in order to prevent electric shock or ...

Page 6: ... which can include wrist straps and smocks when servicing equipment You can also take the following steps to prevent damage from electrostatic discharge ESD When unpacking a static sensitive component from its shipping carton do not remove the component s anti static packaging material until you are ready to install the component in a computer Just before unwrapping the anti static packaging be su...

Page 7: ...I Express Gen 4 Switch DMA Controller SSC Isolation Switch Latency 150ns Cable Types Supports the following cable types SFF 8644 PCIe CMI copper cables Mini SAS HD copper cables Cable Connection Modes One x16 host connection via edge card to One x16 cable connection Up to two x8 cable connections Up to four x4 cable connections Power 60W max 1 5A 3 3V 3A 12V 250mA 3 3V aux Operating Temperature 0 ...

Page 8: ...L x4 C 3M 3 meter Gen4 Cable 1 2 Parts of HIB616 x16 1 2 1 x4 cable Ports There are four x4 cable ports available on the HIB card It is very important to know where port 0 is when connecting a single x4 PCIe SFF 8644 cable Port 0 is the connector nearest the Link LEDs A single x4 SFF 8644 cable must be inserted into port 0 of the Target card all the time For the Host card you can plug in a single ...

Page 9: ...One Stop Systems OSS KIT EXP 61611 XM 9 1 2 2 HIB card seated flat horizontal position 1 2 3 HIB card seated in a vertical position ...

Page 10: ...One Stop Systems OSS KIT EXP 61611 XM 10 1 2 4 HIB Block Diagrams Target Card Host card ...

Page 11: ...One Stop Systems OSS KIT EXP 61611 XM 11 1 2 5 Pin out assignments of the SFF 8644 PCB Connectors Connector 0 and 1 Connector 2 and 3 ...

Page 12: ...pstream cable management device address A wire must not be provided within the cable CINT This signal is asserted by the cable assembly to indicate a need for service via the Cable Management Interface controller A wire must not be provided within the cable CMISDA Management interface data line Used for both initial link setup and sideband 355 messages when used with proper cables CMISCL Managemen...

Page 13: ... includes the CMI cable management interface and serialized EEPROMs in the cable backshell x4 one cable x8 two cables x16 4 cables Allows transfers to and from the host up to 6GB s Gen 4 cables are REQUIRED to support Gen 4 bandwidth and OSS Gen 4 products Specifications Cable Lengths 1m 2m 3m Cable Options x4 1 cable x8 2 cables x16 4 cables Wire Size AWG 28 30 Bend Radius 4 0 cable bend radius A...

Page 14: ...plane 2 1 OSS PCIe HIB616 x16 card A pair of HIB616 x16 card one is configured as a host card and the other is configured as a target card 2 2 SFF 8644 Gen4 x4 Cable This passive copper cable mates to the SFF 8644 connectors on the HIB6xx family of OSS host interface board Tested and validated with 1m 2m and 3m lengths Single or multiple cables can form larger PCIe links o x4 1 cable o x8 2 cables...

Page 15: ...KIT EXP 61611 XM 15 2 4 Host Card Mode Configuration x16 Dip switch Settings SW1 2 ON 5 ON SW2 1 ON 2 ON x8 Dip switch Settings SW1 2 ON 5 ON SW2 1 OFF 2 ON or 2 OFF and 1 ON x4 Dip switch Settings SW1 2 ON 5 ON SW2 All OFF ...

Page 16: ...t mode switch settings OSS Backplane Use the switch settings below when using the OSS backplane 2 5 2 Target mode switch settings Magma Backplane When using the legacy or Magma backplane use the switch settings below for Target mode If Target card is not linking up you can set SW1 5 to ON position see photo below ...

Page 17: ...ardware kit 2 7 Supported Setup Using a set of OSS PCIe HIB616 x16 card Target and Host cards OSS Gen4 backplane and PCIe Gen4 cables 2 8 Use Cases Configurations 2 8 1 Host to Host This configuration is NOT supported The OSS 518 board HIB616 x16 card is not programmed for this option nor will it work from hardware standpoint ...

Page 18: ...eserved PCI pin If customer expects remote turn ON then they need to add that to their backplane otherwise they need to turn on the backplane power not just AUX before powering on host 2 8 3 Connecting to 3rd Party backplane via on board SFF 8644 connector This should work as long as the 3rd party backplane creates its own REFCLK Reset and is powered on first If issue arises we do not provide supp...

Page 19: ...strap to prevent electrostatic discharge 3 2 Configure Card to Host and Target modes Set the switches on the card for the desired operating mode See Host and Target cards configuration section for more details Photos below are Host and Target mode settings The Host card is installed in the host computer The Target card is installed in the expansion OSS backplane The card is must be installed in a ...

Page 20: ...the power first prior to installing the card Install the Target card in the x16 PCIe upstream slot target slot on the expansion board Note Do not plug a Target configured card in a downstream slot The Target card will not function in a downstream slot and may cause damage Secure the card by screwing the card bracket to the chassis ...

Page 21: ...Ie connector on top of the PCIe slot and carefully push the card down until it is firmly seated Do not plug in the Host card while the board or the unit is ON or has power Disconnect the power first prior to installing the card Secure the card The photos below are reference of a x16 PCIe slot connector Below example is a photo of a PCI E 3 0 x16 slot The specification of the PCIe slot is printed o...

Page 22: ...ble to Port 1 on both Target and Host cards Plug in the 3rd cable to Port 2 on both Target and Host cards Plug in the 4th cable to Port 3 Bottom port on both Target and Host cards Note It is easier to plug in the cables from bottom to top 3 5 2 x8 configuration TWO cables Note Make sure the HIB616 x16 host card is set to x8 configuration see x8 switch setting section Plug in the 1st cable to Port ...

Page 23: ...rom PORT 0 and PORT 1 See diagrams below as an example 3 5 3 x4 Configuration ONE cable Plug in the single cable to Port 0 Top port on both Target and Host cards You can move the x4 cable on the HOST card to another port However the other end of the cable stays connected to PORT 0 on the Target card Photo A1 Cable on the Target card isconnected to PORT 0 The other end of the cable is connected to ...

Page 24: ...t card is connected to PORT 0 The other end of the cable is connected to PORT 2 on the Host card Photo C1 Cable on the Target card is connected PORT 0 The other end of the cable is connected to PORT 3 on the Host card Diagrams below are different x4 cable configurations ...

Page 25: ...ply switch to ON position LED1 LED2 LED3 LED4 are always ON solid green CE D11 will be ON either solid green or blinking depending on the PCIe Gen on the expansion board PWR D1 will be blinking when FPGA program is running properly AUX Solid green LED1 LED2 LED3 LED4 PWR and CE LEDS AUX LED Stand by Mode LED During Stand by Mode awaiting to power ON you will only see four LEDs on the Host and Targ...

Page 26: ...LED2 LED3 all solid green The following LEDs on the HOST Card will be illuminated D10 blinking green D11 CE Card Edge solid green Gen 4 assuming connection to a Gen4 server D1 CHO solid green D9 AUX solid green LED0 LED1 LED2 LED3 SOLID GREEN 3 9 LED Indicators per Configuration 3 9 1 x16 Configuration LEDs Target Card LED Photo below is the link LED on the Target card set to x16 with four cables ...

Page 27: ...ost and Target cards LINK LED will be OFF on both cards If the Host system is in the state of standby mode waiting to be powered UP LINK LED will be OFF on both cards o Only LED0 LED1 LED2 LED3 are ON solid green on the Host card 3 9 2 x8 Configuration LEDs Two Cables Target Card LED Photo below is the link LED on the Target card which set to x8 with and two cables attached 1st cable to PORT 0 AND...

Page 28: ...nnected to PORT 3 LED Status Description CH0 or CH2 ON Solid Green There is a link between Host and Target cards Either CHO or CH2 LED will be ON depending where the two cables are connected on the ports of the HOST CARD CH2 D3 Link LED 1 st cable is connected to PORT 0 2 nd cable is connected to PORT 1 CH0 D1 Link LED 1st cable is connected to BOTTOM PORT 3 2 nd cable is connected to PORT 2 LED0 ...

Page 29: ...2 D6 LED3 D8 ON Solid Green Power Good CE D11 ON Blinking Green Blinking Green The CARD EDGE connector is communicating to Gen3 PCIe switch on the expansion board backplane Solid Green Gen 4 on the expansion chassis switch D10 ON Blinking Green Power Good FPGA Healthy D9 ON Solid Green AUX Power Good Host Card LED When Expansion and Host systems are ON The Photo below is the link LED on the Host c...

Page 30: ...onnected to TOP PORT 0 CH2 Link LED Single x4 cable is connected to PORT 1 CH1 Link LED Single x4 cable is connected to PORT 2 CHO Link LED Single x4 cable is connected to Bottom PORT 3 LED0 D2 LED1 D4 LED2 D6 LED3 D8 ON Solid Green Power Good CE D11 ON Solid Green The CARD EDGE connector is communicating to Gen4 PCIe switch on the host computer motherboard Blinking Green The CARD EDGE connector i...

Page 31: ...n3 1Hz is Gen2 0 5Hz is Gen1 D7 CH3 Cable Link LED Solid Gen4 Blink 2Hz is Gen3 1Hz is Gen2 0 5Hz is Gen1 D11 CE Card Edge Link LED Solid Gen4 Blink 2Hz is Gen3 1Hz is Gen2 0 5Hz is Gen1 D10 Power Blinks when FPGA program running properly LED0 Debug LED Not defined always on LED1 Debug LED Not defined always on LED2 Debug LED Not defined always on LED3 Debug LED would be used for CMI Not defined a...

Page 32: ...top Systems OSS KIT EXP 61611 XM 32 4 3 Standard Bifurcated Configurations 4 3 1 Standard Configurations x16 Using four Gen4 SFF 8644 cables x8 Using two Gen4 SFF 8644 cables x4 Using a single SFF 8644 cable ...

Page 33: ...One Stop Systems OSS KIT EXP 61611 XM 33 4 3 2 Bifurcated configurations 1 x8 x8 Configuration This is supported 2 x4 x4 Configuration This is supported ...

Page 34: ...One Stop Systems OSS KIT EXP 61611 XM 34 3 x4 x4 x4 x4 Configuration This is supported 4 x4 x4 x4 Configuration This is supported ...

Page 35: ...tems OSS KIT EXP 61611 XM 35 5 x8 x4 x4 Configuration This is NOT supported The firmware is not programmed in the board to support x8 x4 x4 6 X8 x4 Configuration This is supported but it will just down train to x4 ...

Page 36: ...e PCI Device B D F numbers of b8 00 0 and bd 00 00 B Bus number D Device number F Function number The B D F numbers will vary from system to system You can use the SDevice Sub Device of the card 00b2 lspci m grep Device 00b2 The output below gives you B D F numbers the device Class the Vendor name and Sub Vendor name To check on the revision of the card use the command below lspci vmms ac 00 0 See...

Page 37: ...One Stop Systems OSS KIT EXP 61611 XM 37 To display more details or information lspci nvvs ac 00 00 ...

Page 38: ... Host card and the Target card The output below shows only the Host is being detected The Host card is not connected to the Target card To check or to identify whether the bus XX XX 0 is the Upstream port and Downstream port on the terminal window type lspci s ac 00 0 vvv grep Capabilities Port LnkSta LnkCap or lspci nvvs ac 00 00 grep Capabilities Port LnkSta LnkCap ...

Page 39: ...ew Menu and select View Devices by Connection When everything is functioning correctly your Windows Device Manager should look something like the screenshot below You will see multiple PCI standard PCI to PCI bridge or PCI Express standard Upstream Switch Ports and PCI Express standard Downstream Switch Ports These are the screenshots of Windows Device Manager running Windows Server 2012 R2 The ph...

Page 40: ...dard PCI to PCI bridges Displaying a link between Host and Target cards Showing a PCIe device i e NVIDIA card is recognized The PCIe device is the 3rd party PCIe card installed into the downstream slot of an expansion backplane The screenshot below depicts that only the Host card is detected ...

Page 41: ...One Stop Systems OSS KIT EXP 61611 XM 41 6 Software Installation No software or driver is required for the HIB616 x16 card ...

Page 42: ...t Note Purchasing a second hand used product is not covered under warranty 7 3 Intermittent start up issue and PCIe cards are not getting recognized If you are using a 4UValue chassis that has two backplanes and it is having issue starting up and the GPUs or PCIe cards are not detected do the following steps 1 Completely shut down the expansion unit and host server Physically disconnecting the pow...

Page 43: ...the issue 7 5 There is no LINK between Host and Target Troubleshooting Make sure are using a compatible hardware as stated in the hardware requirement section For more info on the hardware requirements go to Chapter 2 We strictly recommend to use an OSS Gen4 Host and Target cards Gen4 OSS expansion backplane and SFF 8644 Gen 4 PCIe x4 cable Ensure that the OSS Target and Host cards are configured ...

Page 44: ...gh highly recommended that you keep the packaging from the original shipment of your product However if you return a product for warranty repair replacement or take advantage of the 30 day money back guarantee you will need to package the product in a manner similar to the manner in which it was received from our plant We cannot be responsible for any physical damage to the product or component pi...

Page 45: ...es such as troubleshooting methods compatibility FAQ documentation and product technical information If you need technical support product assistance or have a technical inquiry we encourage you to submit it on line using our Technical Support Form If you need to send a unit for repair or diagnostic evaluation fill out our RMA Return Material Authorization online request form https www onestopsyst...

Page 46: ...One Stop Systems OSS KIT EXP 61611 XM 46 ...

Reviews:

No comments

Brands by name

Popular brands

Load more brands