Features
NetXtreme-E User’s Manual
February 26, 2018 • NetXtreme-E-UG100
Page 24
SR-IOV
The PCI-SIG defines optional support for Single-Root IO Virtualization (SR-IOV). SR-IOV is designed to allow
access of the VM directly to the device using Virtual Functions (VFs). The NIC Physical Function (PF) is divided
into multiple virtual functions and each VF is presented as a PF to VMs.
SR-IOV uses IOMMU functionality to translate PCI-E virtual addresses to physical addresses by using a
translation table.
The number of Physical Functions (PFs) and Virtual Functions (VFs) are managed through the UEFI HII menu,
the CCM, and through NVRAM configurations. SRIOV can be supported in combination with NPAR mode.
Network Partitioning (NPAR)
The Network Partitioning (NPAR) feature allows a single physical network interface port to appear to the system
as multiple network device functions. When NPAR mode is enabled, the NetXtreme-E device is enumerated as
multiple PCIe physical functions (PF). Each PF or “partition” is assigned a separate PCIe function ID on initial
power on. The original PCIe definition allowed for eight PFs per device. For Alternative Routing-ID (ARI) capable
systems, Broadcom NetXtreme-E adapters support up to 16 PFs per device. Each partition is assigned its own
configuration space, BAR address, and MAC address allowing it to operate independently. Partitions support
direct assignment to VMs, VLANs, etc., just as any other physical interface.
RDMA over Converge Ethernet – RoCE
Remote Direct Memory Access (RDMA) over Converge Ethernet (RoCE) is a complete hardware offload feature
in the BCM5741X that allows RDMA functionality over an Ethernet network. RoCE functionality is available in
user mode and kernel mode application. RoCE Physical Functions (PF) and SRIOV Virtual Functions (VF) are
available in single function mode and in mutli-function mode (NIC Partitioning mode). Broadcom supports RoCE
in Windows, Linux, and VMWare.
Please refer to the following links for RDMA support for each operating system:
Windows
https://technet.microsoft.com/en-us/library/jj134210(v=ws.11).aspx
Redhat Linux
VMware
Note:
In the
System Setup > Device Settings > [Broadcom 5741x Device] > Device Level
Configuration
page, the user can enable
NParEP
to allow the NXE adapter to support up to 16 PFs
per device. For 2 port devices, this means up to eight PFs for each port.