Broadcom Stingray PS225 Quick Start Manual Download

Page: 1 / 31

Broadcom Confidential

5880X-PS225-UG101

December 12, 2018

Stingray™ PS225

Quick Start Guide

User Guide

Broadcom

Confidential

Summary of Contents for Stingray PS225

Page 1: ...Broadcom Confidential 5880X PS225 UG101 December 12 2018 Stingray PS225 Quick Start Guide User Guide B r o a d c o m C o n f i d e n t i a l ...

Page 2: ...tion please visit www broadcom com Broadcom reserves the right to make changes without further notice to any products or data herein to improve reliability function or design Information furnished by Broadcom is believed to be accurate and reliable However Broadcom does not assume any liability arising out of the application or use of this information nor the application or use of any product or c...

Page 3: ... the Serial Console Optional 11 3 4 Accessing the PS225 from an x86 Host 12 3 4 1 Installing L2 Driver on the x86 Host 12 3 4 2 Assigning an IP Address to the First New Host Interface 13 3 4 3 Establishing an SSH Connection to the PS225 16 4 Upgrading the PS225 Software 17 5 Setting Up a Linux Distribution rootfs on the PS225 19 5 1 Running Ubuntu on a PS225 19 5 1 1 Setting Up Ubuntu on a PS225 1...

Page 4: ...The adapters are available in a range of on board DDR4 memory sizes The PS225 H04 PS225 H08 and PS225 H16 adapters include 4 GB 8 GB and 16 GB of DDR4 memory respectively 1 1 Block Diagram Figure 1 shows the main functional blocks of the PS225 SmartNIC adapter cards Figure 1 PS225 Block Diagram PCIe 3 0 CPU Subsystem Ethernet 25GbE SerDes DDR4 Ch 1 8L 72b L3 DDR x16 DDR x16 DDR x16 DDR x16 DDR x16...

Page 5: ...E optical transceiver or direct attach copper DAC cables RDMA over Converged Ethernet RoCE v1 and v2 Advanced congestion avoidance Virtual network termination VXLAN NVGRE Geneve GRE Multiqueue NetQueue and VMQ Tunnel aware stateless offloads IPv4 and IPv6 TCP UDP and IP checksum Large send offload LSO Large receive offload LRO TCP segmentation offload TSO Receive side scaling RSS Transmit side sca...

Page 6: ...age Contents The PS225 package contains the following components PS225 adapter with low profile bracket installed Full height bracket The PS225 card with a low profile bracket installed is shown in Figure 2 Figure 2 PS225 with Low Profile Bracket B r o a d c o m C o n f i d e n t i a l ...

Page 7: ...ry PS225 H04 4 GB DDR4 part number BCM958802A8024C BCM958802A8044C PS225 H08 8 GB DDR4 part number BCM958802A8028C BCM958802A8048C PS225 H16 16 GB DDR4 part number BCM958802A8021C The back of the card contains a sticker that indicates the board type Figure 3 shows an example of the 4G card label on a preproduction adapter Figure 3 Example Label B r o a d c o m C o n f i d e n t i a l ...

Page 8: ...AIA console root bcm958802a8048c uname a Linux bcm958802a8048c 4 14 79 g5bb1623 1 SMP Tue Nov 27 01 48 50 UTC 2018 aarch64 aarch64 aarch64 GNU Linux PS225 board card type 8 GB 4 GB 16 GB On PS225 Stingray MAIA console root bcm958802a8048c hostname bcm958802a8048c Check the Nitro profile configuration NOTE By default the card is upgraded with 2 x 25G port mode and 8 8 PFs profile configuration with...

Page 9: ... pkg bcm958802a8048_2xAN_8 3_pf pkg bcm958802a8048_2xAN_8 2_baremetal pkg bcm958802a8048_2x25g pkg bcm958802a8048_2x25g_8 5_pf_rep pkg bcm958802a8048_2x25g_8 4_pf_rep pkg bcm958802a8048_2x25g_8 4_pf pkg bcm958802a8048_2x25g_8 3_pf pkg bcm958802a8048_2x25g_8 2_baremetal pkg bcm958802a8048_2x10g pkg bcm958802a8048_2x10g_8 5_pf_rep pkg bcm958802a8048_2x10g_8 4_pf_rep pkg bcm958802a8048_2x10g_8 4_pf p...

Page 10: ...stalling the PS225 To install the PS225 1 Power down the host system and remove the AC power 2 Insert the PS225 card into a PCIe 3 0 slot at least x8 size in the host system 3 Connect one end of the SFP cable to port 0 or port 1 on the PS225 see Figure 5 4 Connect the other end of the SFP cable to an Ethernet switch that supports 10G or 25G Ethernet see Figure 5 NOTE Both Ethernet ports must be co...

Page 11: ...For a Windows OS the driver for the UART USB transceiver is downloaded from the FTDI driver download site 2 12 28 http www ftdichip com Drivers CDM CDM21228_Setup zip For a Linux OS the device is automatically enumerated as one of the USB tty dev ttyUSBx If another operating system is used see the FTDI website for available drivers 3 Access the ARM A72 console using a terminal emulator and configu...

Page 12: ...can be changed by modifying etc network interfaces using either the serial console or after the first successful ssh to the card The change in etc network interfaces takes effect on the next reboot of the card If the IP address is changed during the active ssh session ensure that the ssh reconnect is to the new IP address 3 4 1 Installing L2 Driver on the x86 Host The L2 driver source code can be ...

Page 13: ...DCAST MULTICAST UP LOWER_UP mtu 1500 qdisc pfifo_fast state UP mode DEFAULT group default qlen 1000 link ether b0 6e bf 30 44 65 brd ff ff ff ff ff ff 19 enp1s0f0 BROADCAST MULTICAST UP LOWER_UP mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link ether 00 10 18 de 06 08 brd ff ff ff ff ff ff 20 enp1s0f1d1 BROADCAST MULTICAST UP LOWER_UP mtu 1500 qdisc mq state UP mode DEFAULT grou...

Page 14: ...gure 6 shows the connectivity of the first interface on the x86 host and the first interface on the ARM side 192 168 1 20 is assigned to enp1s0f0 on the x86 host and 192 168 1 10 to enP8p1s0f0np0 on the ARM host on the PS225 These two interfaces are connected through Nitro red arrow NOTE As shown in Figure 6 each interface can send packets out on the 25GbE port blue arrow for the x86 enp1s0f0 host...

Page 15: ...lowing commands auto enp1s0f0 iface enp1s0f0 inet static address 192 168 1 20 netmask 255 255 255 0 For CentOS create a new file using the following commands etc sysconfig network scripts ifcfg ens4f0 NOTE The previous example is provided for an interface named ens4f0 The interface name may be different on different systems Add the following content TYPE Ethernet PROXY_METHOD none BROWSER_ONLY no ...

Page 16: ... host on the PS225 by running ssh using the following command ssh root 192 168 1 10 No password is required The following command line prompt displays ssh root 192 168 1 10 Last login Fri Feb 16 22 19 21 2018 root bcm958802a8048c During the first run it is recommended to execute uname a to verify that the latest kernel available for the PS225 is being used verify the latest kernel with the Broadco...

Page 17: ...ootfs dtb Copies dtb only fip Copies fip only kernel Copies fip kernel only nitro Copies nitro firmware only nonitro Copies all but nitro noroot Copies fip dtb and kernel nitro no rootfs rootfs Copies rootfs only t transport Transport tftp or http default tftp u url URL link to image tarball This will use wget and will bypass tftp http n nitro_image Nitro Image to use default nitro c nitro_config ...

Page 18: ...5 Software NIC NIC Port0 Port1 A72 CPUs Host CPUs PF0 PF1 Host x86 to A72 MAIA cores enp1s0f0 PF8 PCIe x8 Port0 Port1 update me sh s 192 168 1 20 d nic i all t tftp Execute on the A72 MAIA console to upgrade the software image TFTP server or HTTP server 192 168 1 20 B r o a d c o m C o n f i d e n t i a l ...

Page 19: ... mmcblk0p5 is already created and it is 2 GB skip Step 3 NOTE mmcblk0p5 may have already been created during installation of the SmartNIC release NOTE In future releases the partition layout may change Check the release documentation before proceeding with Step 4 and Step 5 4 Use the fdisk command to create dev mmcblk0p5 Skip this step if it has already been completed Refer to the following exampl...

Page 20: ...25 scp the Ubuntu image with the following command root bcm958802a8048c scp byang 192 168 1 20 ubuntu 16 04 server cloudimg arm64 root tar xz d Set the correct date with the following commands so that tar accepts the future time root bcm958802a8048c date s 14 MAR 2018 20 00 00 root bcm958802a8048c cd mnt ubuntu root bcm958802a8048c mnt ubuntu tar numeric owner xf mnt ubuntu ubuntu 16 04 server clo...

Page 21: ...any key within 5 seconds AUTOBOOT SKIPPED Shell gpt list blk0 Shell select rootfs ordinal 5 Shell select Shell startup The login prompt and username password that was set up above is now available This may take several minutes to get to the login prompt See the following commands NOTE It is possible to switch back to yocto Linux by performing the following using the UEFI Shell select rootfs ordina...

Page 22: ...ed on the specific setup a On the example host the result from ifconfig is as follows byang byang PowerEdge 2950 temp bnxt_en 1 8 29 ifconfig eno2 Link encap Ethernet HWaddr 00 22 19 91 7c e4 inet addr 10 67 93 199 Bcast 10 67 93 255 Mask 255 255 254 0 inet6 addr fe80 116e caa 13f3 1dbf 64 Scope Link UP BROADCAST RUNNING MULTICAST MTU 1500 Metric 1 RX packets 23392 errors 0 dropped 0 overruns 0 fr...

Page 23: ...TU 1500 Metric 1 RX packets 437 errors 0 dropped 0 overruns 0 frame 0 TX packets 0 errors 0 dropped 0 overruns 0 carrier 0 collisions 0 txqueuelen 1000 RX bytes 151202 151 2 KB TX bytes 0 0 0 B enp8s0f7d1 Link encap Ethernet HWaddr 00 10 18 ad 05 0f UP BROADCAST MULTICAST MTU 1500 Metric 1 RX packets 437 errors 0 dropped 0 overruns 0 frame 0 TX packets 0 errors 0 dropped 0 overruns 0 carrier 0 col...

Page 24: ... it by pinging Google lab ubuntu ping google com g Install something useful with the apt command lab ubuntu sudo apt update Install gcc for example lab ubuntu sudo apt install gcc lab ubuntu sudo su root ubuntu sed s PasswordAuthentication PasswordAuthentication g i etc ssh sshd_config root ubuntu home lab dpkg reconfigure openssh server h On the host SSH from the host to the PS225 using the follo...

Page 25: ...lowing fdisk command Skip this step if this has already been done root bcm958802a8048c fdisk dev mmcblk0 type n to create a new partition used defaults will created mmcblk0p5 typed w to write changes 5 Format the partition with the following command root bcm958802a8048c mkfs ext4 dev mmcblk0p5 NOTE This step can take several minutes to complete 6 Mount the newly created partition to a directory of...

Page 26: ...ing commands chroot mnt centos adduser lab passwd lab gpasswd a lab wheel exit cd umount mnt centos reboot 9 Unmount the device and stop at the UEFI prompt NOTE At this point the new CentOS rootfs is ready to boot however the new rootfs to be used by the kernel must be set Instruct UEFI to use the CentOS rootfs for boot The UEFI sets up Linux args automatically Press any key within 5 seconds AUTOB...

Page 27: ...r example via a switch and DHCP server there is no need for the host to forward internet traffic Skip the following steps The results of ifconfig on the host are as follows NOTE Eno2 is the regular Ethernet interface that the host uses to access the Internet while enp8s0f0 is the first PF towards the PS225 card On different systems these items could be different Adjust these items based on your se...

Page 28: ...TX packets 1312 errors 0 dropped 0 overruns 0 carrier 0 collisions 0 txqueuelen 1000 RX bytes 65394 65 3 KB TX bytes 270596 270 5 KB enp8s0f3d1 Link encap Ethernet HWaddr 00 10 18 ad 05 0b UP BROADCAST MULTICAST MTU 1500 Metric 1 RX packets 437 errors 0 dropped 0 overruns 0 frame 0 TX packets 0 errors 0 dropped 0 overruns 0 carrier 0 collisions 0 txqueuelen 1000 RX bytes 151202 151 2 KB TX bytes 0...

Page 29: ...g line net ipv4 ip_forward 1 byang byang PowerEdge 2950 sudo iptables t nat A POSTROUTING o eno2 j MASQUERADE byang byang PowerEdge 2950 sudo iptables A FORWARD i eno2 o enp8s0f0 m state state RELATED ESTABLISHED j ACCEPT byang byang PowerEdge 2950 sudo iptables A FORWARD i enp8s0f0 o eno2 j ACCEPT 15 Test the configuration by accessing www google com lab ubuntu ping google com B r o a d c o m C o...

Page 30: ... PS225 UG101 30 PS225 User Guide Quick Start Guide Revision History 5880X PS225 UG101 December 12 2018 Updated Upgrading the PS225 Software 5880X PS225 UG100 October 4 2018 Initial release B r o a d c o m C o n f i d e n t i a l ...

Page 31: ...B r o a d c o m C o n f i d e n t i a l ...

Search results

Summary of Contents for Stingray PS225

Reviews:

Related manuals for Stingray PS225

Brands by name

Popular brands

Broadcom Stingray PS225, Quick Start Manual

Search results

Summary of Contents for Stingray PS225

Reviews:

Related manuals for Stingray PS225

Brands by name

Popular brands