Dell EMC VxFlex Ready Node Скачать руководство пользователя страница 1

Страница: 1 / 354

Dell EMC VxFlex Ready Node

Version 3.x

AMS User Guide

P/N 302-005-733
REV 02
June 2019

Содержание EMC VxFlex Ready Node

Страница 1: ...Dell EMC VxFlex Ready Node Version 3 x AMS User Guide P N 302 005 733 REV 02 June 2019 ...

Страница 2: ...CATION AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE USE COPYING AND DISTRIBUTION OF ANY DELL SOFTWARE DESCRIBED IN THIS PUBLICATION REQUIRES AN APPLICABLE SOFTWARE LICENSE Dell Technologies Dell EMC Dell EMC and other trademarks are trademarks of Dell Inc or its subsidiaries Other trademarks may be the property of their respective owners Publ...

Страница 3: ...Fault Sets 31 Data layout 32 Volumes 33 Naming 33 Protection and load balancing 33 Rebuild 34 Rebuild throttling 34 Rebalance 35 Rebalance throttling 35 Checksum protection 36 ESXi vStorage APIs for Array Integration VAAI 37 Cache 38 Networking 40 IP Addresses 41 VLAN support 42 Networking and connectivity 13G servers 43 Networking and connectivity 14G servers 50 Virtual IP Address 59 Monitor of S...

Страница 4: ...and disconnection information 82 VxFlex OS GUI Features 83 VxFlex OS GUI overview 84 VxFlex OS GUI conventions 85 Alerts indicators 85 Color codes 85 Hardware view 86 Dashboard view 88 Navigation tree 88 System Settings and Logout menus 89 Dimmer 89 Widget 89 Dashboard tiles 90 Management MDM cluster status 93 Frontend views 95 Frontend Volumes 96 SDCs 97 Backend views 98 Filter 99 Command menu 10...

Страница 5: ...S system 135 Cluster operations 135 Adding a standby to the MDM cluster 136 Removing a standby from the MDM cluster 136 Extending an MDM cluster 137 Switching from 5 node cluster mode to 3 node cluster mode 138 Replacing a Master MDM 138 Transfer the MDM cluster component using the AMS 139 Managing the SDSs and cache 141 Modifying an SDS port during I O 141 Managing Read Flash cache 143 Managing r...

Страница 6: ...ware errors 184 Identifying the IP role of a node 184 Identifying the SDS running on a node 184 Identifying the SSD used for caching 185 MTU values 186 Viewing licensing information 186 Verifying your connection to the Management cluster 187 Collecting logs 187 Configuring the System using the VxFlex OS GUI 189 Configuring capacity 190 Adding nodes 190 Remove the node from the system 190 Adding de...

Страница 7: ...ice scanner 231 Enabling and disabling the background device scanner 232 Reset the background device scanner counters 232 Configure inflight checksum protection 233 Renaming objects 233 Approving pending security certificates 234 Customizing system preferences 234 Modifying system settings 237 Management and Data Network IP addresses 237 Default DNS and NTP IP addresses 238 ESRS 238 SNMP 240 Insta...

Страница 8: ... 280 Authentication 280 CLI commands 281 License and installation 282 MDM 284 SDC 286 SDS 286 Rebuild 290 SNMP Trap Support 293 General 294 Supported alerts and event numbering conventions 294 CLASS TYPE 294 VxFlex OS Alerts in SNMP VxFlex OS GUI REST and ESRS 295 VxFlex Ready Node specific Alerts in SNMP VxFlex OS GUI REST and ESRS 312 Configuring SNMP using the VxFlex OS GUI 320 VxFlex OS mib fi...

Страница 9: ...IOS and firmware settings 341 VxFlex OS ID module 341 BIOS and firmware 341 Configuration settings 342 Troubleshooting the Hardware ISO 343 Troubleshoot general iDRAC failures 343 iDRAC virtual console issues 344 iDRAC virtual media issues 344 DTK A08 BIOS set commands fail 344 Rebranding operation fails 345 Check the logs for error messages 345 Additional resources 346 VxFlex OS resources 346 Del...

Страница 10: ...Contents 10 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 11: ...es view 96 Frontend SDCs view 97 Backend Storage view 98 Backend filter 100 Alerts view 104 Multiple floating Property Sheets 107 Test ping to ensure mtu setting 118 Show interface output 119 Adapter properties 119 Ping output 120 Test ping to ensure mtu setting 121 Virtual Machine Properties 124 Target server 140 Source server now a standby MDM 141 Target server now an MDM 141 System Settings win...

Страница 12: ...Figures 12 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 13: ...40 server configuration for 10 25GbE 2CPU SFP SFP28 55 R640 single node server configuration 56 R740xd single node server configuration for 10 25GbE 2CPU SFP SFP28 56 13G PowerEdge Servers 75 14G PowerEdge Servers 76 Product limits 78 VxFlex OS GUI task overview 84 VxFlex OS GUIcolor codes 85 Alert symbols and color codes 86 Dashboard tiles 92 Legend 94 Management node icons with normal operationa...

Страница 14: ...Tables 14 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 15: ...Software and technical aspects apply equally regardless of the branding of the product Related documentation The release notes for your version includes the latest information for your product The following Dell EMC publication sets provide information about your VxFlex OS or VxFlex Ready Node product l VxFlex OS software downloadable as VxFlex OS Software version Documentation set l VxFlex Ready ...

Страница 16: ...r documentation release notes software updates or information about Dell EMC products go to Dell EMC Online Support at https support emc com Technical support Go to Dell EMC Online Support and click Service Center You will see several options for contacting Dell EMC Technical Support Note that to open a service request you must have a valid support agreement Contact your Dell EMC sales representat...

Страница 17: ...he benefits and system requirements of VxFlex OS Chapters include Chapter 1 Introduction to VxFlex Ready Node Chapter 2 Architecture Chapter 3 Opening the VxFlex OS GUI and Logging In Chapter 4 VxFlex OS GUI Features Dell EMC VxFlex Ready Node AMS User Guide 17 ...

Страница 18: ...Introduction 18 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 19: ...CHAPTER 1 Introduction to VxFlex Ready Node This section introduces VxFlex Ready Node l What is VxFlex OS 20 l System requirements 21 Dell EMC VxFlex Ready Node AMS User Guide 19 ...

Страница 20: ...nfiguration Because VxFlex OS is hardware agnostic the software works efficiently with various types of disks including magnetic HDD and solid state disks SSD flash PCI Express PCIe cards networks and hosts VxFlex OS can easily be installed in an existing infrastructure as well as in green field configurations VxFlex Ready Node VxFlex Ready Node is the combination of VxFlex OS software defined blo...

Страница 21: ...uirements Component Requirement Management AMS server l Physical requirements n Processor 2 vCPUs n Memory 3 GB n Storage 80 GB of free storage capacity l Operating systems all 64 bit n ESXi 6 7 Note AMS installed on a VM hosted on ESXi servers must use the vmxnet3 vmnic Use of the e1000 vmnic is not supported and causes network failure n Windows 2012 R2 2016 Server Core editions are not supported...

Страница 22: ...d per Storage Pool All VxFlex Ready Node nodes have the minimum disk size as part of the node specification The AMS server must be a separate server that resides outside of the VxFlex OS system Supported hardware configurations The supported hardware configurations are listed in the EMC Simple Support Matrix for your software version Download this file from https elabnavigator emc com eln elnhome ...

Страница 23: ...ode has at least four 25 GbE ports Two are used by VxFlex OS for internal network communication The other two ports are used for VMware high availability DRS and application network traffic n Each node has two 25 GbE ports both used for VxFlex OS internal network communication and application traffic The switches must have sufficient available network ports to accommodate the following Data networ...

Страница 24: ...Introduction to VxFlex Ready Node 24 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 25: ...r Array Integration VAAI 37 l Cache 38 l Networking 40 l Virtual IP Address 59 l Monitor of SDC and SDS connections 60 l S M A R T hardware monitoring 60 l Snapshots 61 l Performance 66 l Migrate volumes 66 l Other functions 66 l Implementing VxFlex OS 67 l Maintenance 73 l Management tools 74 l Firmware patching 75 l Product capabilities and system limits 78 Dell EMC VxFlex Ready Node AMS User Gu...

Страница 26: ...ta Server SDS and a Storage Data Client SDC The VxFlex OS virtual SAN consists of the following software components l Meta Data Manager MDM Configures and monitors VxFlex OS The MDM can be configured in redundant cluster mode with three members on three servers or five members on five servers or in single mode on a single server NOTICE It is not recommended to use single mode in production systems...

Страница 27: ...M or Tie Breaker is attached or locked to that specific system A standby MDM can be called on to assume the position of a Manager MDM or Tie Breaker MDM when it is promoted to be a cluster member l Manager MDM An MDM that can act as a Master or a Slave in the cluster Manager MDMs have a unique system ID and can be given unique names A manager can be a standby or a member of the cluster In VxFlex O...

Страница 28: ...M cluster failure 5 node l Master MDM l Two Slave MDM l Two Tie Breaker 5 node cluster has three copies of the repository thus can withstand two MDM cluster failure Single node l Master MDM Single node cluster has only one copy of the repository thus it cannot withstand failure It is not recommended to use Single Mode in production systems In addition to the cluster members you can prepare standby...

Страница 29: ...00 This enables the following l optimal performance l reduction of theoretical mean time between failure issues l ability to sustain multiple failures in different Protection Domains You can add Protection Domains during installation In addition you can modify Protection Domains post installation with all the management clients Storage Pools A Storage Pool is a set of physical storage devices in a...

Страница 30: ...pacity than the rest of the devices performance may be affected After adding devices you can define how much of the device capacity is available to VxFlex OS by using the SCLI modify_sds_device_capacity command Storage Pools support the following data layouts for HDD or SSD media l Medium Granularity MG space allocation occurs at 1MB units n suppports HDD and SSD media l Fine Granularity FG n requ...

Страница 31: ...mes the entire device which prevents other features being used l You can only have a single RFCache Acceleration Pool per Protection Domain l NDU creates a default RFCache Acceleration Pool l You can disable enable RFCache via PD SP and SDS l A storage device benefits from RFCache acceleration if RFCache is enabled on all three levels and if the SDS actually contains RFCache devices NVRAM Accelera...

Страница 32: ...utomated deployment and installation tools follow this order automatically You can only create and configure Fault Sets before adding SDSs to the system and configuring them incorrectly may prevent the creation of volumes An SDS can only be added to a Fault Set during the creation of the SDS You define Fault Sets and add SDSs to them during installation using the following management tools l Deplo...

Страница 33: ...ric and punctuation characters l Is unique within the object type VxFlex OS objects are assigned a unique ID that can be used to identify the object in CLI commands You can retrieve the ID via a query or via the object s property sheet in the VxFlex OS GUI It is highly recommended to give each volume a meaningful name associated with its operational role Naming Giving meaningful names to VxFlex OS...

Страница 34: ... Bandwidth Throttling Rebuild throttling sets the rebuild priority policy for a Storage Pool The policy determines the priority between the rebuild I O and the application I O when accessing SDS devices Please note that application I Os are continuously served Applying rebuild throttling will on one hand increase the time the system is exposed with a single copy of some of data but on the other ha...

Страница 35: ...anced across the devices in a Storage Pool This can occur as a result of several conditions such as SDS addition removal device addition removal or following a recovery from a failure VxFlex OS will move copies of the data from the most utilized devices to the least utilized ones Both Rebuild and Rebalance compete with the application IO for the system resources This includes network CPU and disks...

Страница 36: ...considered to be flowing by defining a minimal quiet period This quiet period is defined as a certain interval in which no application I Os occurred Note that the limits on the rebalance bandwidth and concurrent I Os are still imposed l Default Values n The default policy for rebalance Favor Application I O n Rebalance concurrent I O Limit 1 concurrent I O per SDS device n Rebalance bandwidth limi...

Страница 37: ...al machine and storage management operations to compliant storage hardware With the storage hardware s assistance the host performs these operations faster and consumes less CPU memory and storage fabric bandwidth VAAI uses these fundamental operations l Atomic Test Set ATS which is used during creation and locking of files on the VMFS volume l Clone Blocks Full Copy XCOPY which is used to copy or...

Страница 38: ...in order to avoid alerts about media type mismatches For example when the user adds an HDD device which the SDS perceives as being too fast to fit the HDD criteria Read Flash Cache RFcache and DAS Cache cannot be used simultaneously in the same Storage Pool However a node can contain devices using different caching types as long as the corresponding devices are allocated to different dedicated Sto...

Страница 39: ...loudLink Data at Rest Encryption D RE is not supported on devices used for the RFcache feature DAS Cache Read and write back caching performed by one or more dedicated SSD devices in the server DAS Cache uses the full capacity of one or more SSD devices to provide a large footprint of both read and write back caching resources to the SDS This caching mode moves hot active chunks of data from HDDs ...

Страница 40: ...rt matrix Table 4 Caching support matrix System RFcache RMcache DAS Cache CacheCad e VxFlex OS Yes Yes VxFlex Ready Node PowerEdge 13G servers Yes Yes Yes VxFlex Ready Node PowerEdge 14G servers Yes Yes VxRack Node 100 Series Yes Yes Yes Networking In VxFlex OS inter node communication for the purposes of managing data locations rebuild and rebalance and for application access to stored data can b...

Страница 41: ...he proxy is used for Discovery operations The formula to calculate IP address subnet pool or subnet needs is N Node_MGMT_IP N SVM_MGMT_IP N BMC_MGMT_IP Optional AMS server IP address The VxFlex OS data IP network subnet requirements l ESXi 2 separate subnets l RHEL 2 or 4 separate subnets Note Each pool can belong to a single subnet or to several subnets as long as the AMS server has routable netw...

Страница 42: ...nal interconnect IP addresses 2 SVM_DATA2_IP VxFlex OS Storage VM Management IP addresses 3 MDM_Cluster_Virtual_IP_DATA2 the Virtual IP addresses of the MDM cluster in the Data2 network For clarity the second subnet is referred to as Data2 SVM IP addresses are relevant for ESXi nodes only The formula to calculate the subnet pool or subnet needs is N Node_DATA2_IP N SVM_DATA2_IP MDM_Cluster_Virtual...

Страница 43: ...t way to use VLANs with VxFlex Ready Node is to configure the switch port to Mode Access and assign it to one VLAN A management switch that has only one use is recommended Usually this implies one IP subnet but the switch can contain several subnets on a single VLAN When using several VLANs on the same port the port must to be configured as Trunk and you must assign a VLAN ID on each vSwitch on th...

Страница 44: ...RAC side is that the AMS must have a routable IP Path to the iDRAC IP address on the node Figure 4 Single node R730xd 2U1N server storage only typical connection diagram Figure 5 Single node R730xd 2U1N server converged typical connection diagram Architecture 44 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 45: ...ly If you need to build your own table of reference correlate the ESXi physical ports to the vmnic logical port name Note In this AMS release Advanced Deployment mode enables you to dynamically select the port to be used in the server It is recommended but not mandatory that you use the VxFlex OS best practice ports If the VLAN ID is defined it must also be configured on the switch side connected ...

Страница 46: ...ard 10G Right PCI 10G Right PCI 10G Left Onboard 1G Left Onboard 1G Right Speed 1 GbE 10 GbE 10 GbE 10 GbE 10 GbE 1 GbE 1 GbE vSwitch N A sio_vSwitch1 User allocated User allocated sio_vSwi tch2 vSwitch0 N A VMkernel port vmk2 User configurable User configurable vmk3 vmk0 User configurable Physical Switch Mgmt Switch Switch 1 Switch 1 Switch 2 Switch 2 Mgmt Switch N A Note The expected slot locati...

Страница 47: ...g VxFlex OS Data1 VxFlex OS Client Network Port1 VxFlex OS Client Network Port2 VxFlex OS Data2 VxFlex OS Management Network Not in Use Interface name RHEL 7 N A enoXX enoXX enpXsXfX enpXsXfX enoXX enoXX Slot name N A Integrated NIC1 Integrated NIC2 PCIe Slot4 Port 1 PCIe Slot4 Port 0 Integrated NIC 3 Integrated NIC 4 Logical bus address N A Z 0 Z 1 Y 1 Y 0 X 0 X 1 Physical port on node iDRAC Onbo...

Страница 48: ...et persistency Instead in RHEL 7 x nodes the interface names are in the following format enXXX for example enp6s0f0 or eno3 Note In the following procedure the commands are being run on a RHEL 7 x node so the example outputs include interface names in the format enXXX Procedure 1 Find the correlation between physical slot names and interface names so that you can discover the correlation between P...

Страница 49: ... first two lines is 0000 01 00 0 which correlates to physical NIC Integrated NIC 1 Reference Designation Integrated NIC 1 Bus Address 0000 01 00 0 Reference Designation Integrated NIC 2 Bus Address 0000 01 00 1 Reference Designation Integrated NIC 3 Bus Address 0000 09 00 0 Reference Designation Integrated NIC 4 Bus Address 0000 09 00 1 c Correlate the list of OS interface names to a logical bus a...

Страница 50: ...ort on node PCI 10G Left Speed 0 GB Networking and connectivity 14G servers This section explains network connectivity cabling best practices and the most common port configurations for 14G VxFlex Ready Node servers Networking connectivity architecture and cabling best practice R640 R740XD servers This topic describes connectivity architecture cabling best practice information and cable connection...

Страница 51: ...litates a seamless onsite Add Node operation R640 and R740xd server NIC and BMC iDRAC port locations NIC and BMC iDRAC port designations for VxFlex Ready Node R640 and R740xd servers for various server configurations are described in this topic NICs may be located onboard or in PCI slots depending on the server configuration The following figure shows possible connector locations on the rear panel...

Страница 52: ...there are only 4 10G onboard ports n The left port is used for management n The left port and the third port from the left are used for VxFlex OS data n The second port from the left and the right port are used for application client traffic VxFlex Ready Node R640 and R740xd port designations ESXi Connect the cables and configure the system in an ESXi based system as shown in the following tables ...

Страница 53: ...Note The above configuration supports more than one PCIe slot based NIC Table 13 R740xd server configuration for 10 25GbE 12xNVMe SFP SFP28 Description BMC iDRAC Monitoring VxFlex OS Data1 VxFlex OS Client Network Port1 VxFlex OS Client Network Port2 VxFlex OS Data2 VxFlex OS Managemen t Network Not in Use Port BMC iDRAC vmnic0 vmnic1 vmnic4 vmnic5 vmnic2 vmnic3 PCI slot N A 2 0 2 1 7 1 7 0 N A N ...

Страница 54: ...lex OS Data1 VxFlex OS Client Network Port1 VxFlex OS Client Network Port2 VxFlex OS Data2 VxFlex OS Managemen t Network Not in Use Port BMC iDRAC vmnic0 vmnic1 vmnic3 vmnic2 vmnic0 N A PCI slot N A N A N A N A N A N A N A Physical Port on node BMC iDRAC remote KVM Onboard 10 GbE far Left Onboard 10 GbE second from Left Onboard 10 GbE far Right Onboard 10 GbE second from Right Onboard 10 GbE far L...

Страница 55: ...itch 1 Switch 2 Switch 2 Mgmt Switch Switch 2 N A Table 17 R640 server configuration for 10 25GbE 2CPU SFP SFP28 Description BMC iDRAC Monitoring VxFlex OS Data1 VxFlex OS Client Network Port1 VxFlex OS Client Network Port2 VxFlex OS Data2 VxFlex OS Managemen t Network Not in Use Port BMC iDRAC vmnic0 vmnic1 vmnic4 vmnic5 vmnic2 N A PCI slot N A N A N A N A N A N A N A Physical Port on node BMC iD...

Страница 56: ...ot3 Port 0 Integrated NIC 3 Integrated NIC 4 Logical bus address N A Z 0 Z 1 Y 1 Y 0 X 0 X 1 Physical port on node BMC iDRAC Onboard 10 GbE Left Onboard 10 GbE Right PCI 10 25 GbE Right PCI 10 25 GbE Left Onboard 1 GbE Left Onboard 1 GbE Right Speed 1 GbE 10 GbE 10 GbE 10 25 GbE 10 25 GbE 1 GbE 1 GbE Physical switch Mgmt Switch Data Switch1 Data Switch1 Data Switch2 Data Switch2 Mgmt Switch Not in...

Страница 57: ...L 7 nodes the interface names are in the following format enXXX for example enp6s0f0 or eno3 Procedure 1 Find the correlation between physical slot names and interface names so that you can discover the correlation between PCI slot locations and interface names in the operating system Note For each of the following commands write down the output and set it aside for use later in this task a Correl...

Страница 58: ...rated NIC 1 Reference Designation Integrated NIC 1 Bus Address 0000 01 00 0 Reference Designation Integrated NIC 2 Bus Address 0000 01 00 1 Reference Designation Integrated NIC 3 Bus Address 0000 09 00 0 Reference Designation Integrated NIC 4 Bus Address 0000 09 00 1 c Correlate the list of OS interface names to a logical bus address ip a grep awk print 2 tr d grep v lo xargs I sh c echo ethtool i...

Страница 59: ...000 05 00 0 Physical port on node PCI 10G Left Speed 0 GB Virtual IP Address Virtual IP addresses can be defined for the MDM cluster Up to two virtual IP addresses can be defined for the MDM cluster in AMS deployments SDCs are then mapped to the MDM cluster s virtual IP addresses instead of to static MDM IP addresses MDMs are sometimes switched during normal operation of the cluster and the virtua...

Страница 60: ...SDS IP address l All SDCs are disconnected from all SDSs l Multiple disconnections When the system s connectivity state changes to any state other than All Connected an alert is displayed in the VxFlex OS GUI and is written to the MDM event log Once an alert is generated you can use the SCLI to query details on the disconnection using the command scli query_sdc_to_sds_disconnections For more infor...

Страница 61: ... information physical device information such as serial number model name vendor etc temperature and wear level information for SSDs only is included in the returned response For information about the use of CLI commands see the VxFlex OS CLI Reference Guide For information about the use of REST API URIs see the VxFlex OS User Guide You can use the VxFlex OS GUI to monitor S M A R T related alerts...

Страница 62: ...The consistency group is only for convenience purposes There are no protection measures done by VxFlex OS to conserve the consistency group For example you can remove a snapshot that is a member of a consistency group Note Support of removal of a parent snapshot in the system You can merge the parent to a child snapshot Note It is recommended not to trim volumes that contain snapshots as the logic...

Страница 63: ...ranularity to Fine Granularity l Drain a protection domain maintain it and then fill it back up When running V tree you can run other tasks such as snapshots creation and deletion and maintenance mode Note Snapshots are not allowed when migrating from Multi Granularity to Fine Granularity When the user requests a V Tree migration the MDM first estimates whether the destination Storage Pool has eno...

Страница 64: ...emaining blocks active in the destination Storage Pool Note You can speed up the migration by using volume migration IO priority QoS The default favors applications with one concurrent IO and 10MB sec per device Increasing the 10MB sec increases the migration speed in most cases The max value can reach 25MB sec The faster the migration the higher the impact might be to the applications To avoid si...

Страница 65: ...unds of snapshots as well as the number of snapshots to retain in a multi level structure For example take snapshots every x minutes hours days weeks There are one to six levels with the first level having the most frequent snapshots Example Rule Take snapshots every 60 minutes Retention Levels l 24 snapshots l 7 snapshots l 4 snapshots After defining the parameters you must then select the source...

Страница 66: ... and the high performance profile see the VxFlex OS Configure and Customize Guide Migrate volumes You can migrate volumes to a different Storage Pool or Protection Domain within your VxFlex OS system You can migrate volumes from the following storage layers l From one Storage Pool to another within the same Protection Domain l From one Storage Pool to another across different Protection Domains l ...

Страница 67: ...e upgrade paths Should a required path be missing contact Customer Support l AMS management takeover of non managed nodes The AMS can take ownership of all the nodes on an existing VxFlex Ready Node system that is currently running VxFlex OS GUI without AMS management When the process is complete all the servers in the system are managed with the AMS The take ownership process is performed from th...

Страница 68: ... Slave MDMs and two Tie Breakers l Single node one master MDM NOTICE It is not recommended to use Single Mode in production systems except in temporary situations The MDM contains all the metadata required for system operation Single Mode has no protection and exposes the system to a single point of failure MDMs do not require dedicated nodes They can be installed on nodes hosting other VxFlex OS ...

Страница 69: ... devices to servers with installed and confiured SDCs The MDM cluster manages the entire system It aggregates the entire storage exposed to it by all the SDSs to generate a virtual layer virtual SAN storage Volumes can now be defined over the Storage Pools and can be exposed to the applications as a local storage device using the SDCs To expose the virtual SAN devices to your servers the ones on w...

Страница 70: ... 142 5 TB volume or a thick provisioned volume of 15 TB gross 2 Map volumes Designate which SDCs can access the given volumes This gives rise to the following l Access control per volume exposed l Shared nothing or shared everything volumes Once an SDC is mapped to a volume it immediately gets access to the volume and exposes it locally to the applications as a standard block device These block de...

Страница 71: ...tem after the deployment On factory installed VxFlex Ready Node servers the AMS configures DirectPath on the ESXi servers and adds devices to the system Note DirectPath architecture is the recommended best practice for RAID and SAS Controller managed drives l RDM PowerEdge 14G servers with any NVME devices cannot be added in a DirectPath based system AMS uses RDM for NVMe devices Using RDM mapping...

Страница 72: ... O performance Devices are added to the system after the deployment On factory installed VxFlex Ready Node servers the AMS configures the optimal device configuration on the Linux servers and adds devices to the system Deployment considerations Take the following into account l Pre deployment n Are there flash devices that will be added to the SDS n Do you want to create Fault Sets See the require...

Страница 73: ...intenance is limited to adding and removing hardware units and configuring them into VxFlex OS These operations are usually a result of l Scaling out when there is a need for additional capacity This usually results in adding more storage media to the existing servers or adding additional servers l Hardware failure In cases where there is a hardware storage media or server failure and it needs to ...

Страница 74: ...her SDSs for the additional backup force override can be used Note Use of force override options when entering maintenance mode can lead to data unavailability while maintenance mode is activated While an SDS is in maintenance mode it can be shut down with no danger to data Adding or removing a server When adding or removing servers VxFlex OS redistributes the data accordingly and seamlessly Maint...

Страница 75: ...to the correct version Firmware patching of hardware components primarily happens during an orchestrated non disruptive upgrade process On ESXi based systems firmware patching is not a service affecting operation because ESXi servers can operate in maintenance mode However in bare metal scenarios where SDCs are affected system restarts may be required In such cases user confirmation will be requir...

Страница 76: ... WI CW988 5HR3X L384 Samsung RI PM1633a ISE 7FNRX 086DD JR1HP DSL8 Toshiba PM4 RI ISE MWGK7 0FYFW XCRDV AS0B Toshiba PM4 MU3 ISE 503M7 V0K7V 3DDFT AS0B Toshiba PM4 WI ISE CN3JH GVTYD R1YFC AS0B Seagate 1 2TB ISE ST1200MM0198 FR6W6 UT71 HGST 1 2TB ISE HUC101812CSS200 0KV02 FU29 Samsung PM863a RI ISE T2G0Y 9W12R 9Y3HD GC57 Seagate Skybolt 1 2TB G2G54 ST31 Table 21 14G PowerEdge Servers Item Firmware...

Страница 77: ...X710 FW 18 8 9 In Linux follow doc instructions to set card network TSO LRO OFF NIC 10G X550 FW 3 3 0 X550 10 Gigabit Base T Network Connection NIC 10G X550 Driver ESXi6 7 1 7 10 1OEM 670 0 0 8169922 X550 10 Gigabit Base T Network Connection ESXi 6 5 6 0 4 5 1 1OEM 600 0 0 2494585 RHEL7 3 4 4 0 k rh7 RHEL7 4 5 2 4 RHEL7 5 5 3 8 ESXi 6 5 6 7 3 3 2 1414 ESXi 6 0 3 2 0 1172 Linux RHEL 3 3 0 1290 Stor...

Страница 78: ...2 4TB RWR8F ST51 Product capabilities and system limits The following table summarizes VxFlex OS capabilities Table 22 Product limits Item VxFlex OS Limit System raw capacity 300 GB 16 PB Device size 100 GB 8 TB Minimum Storage Pool capacity 300 GB Volume size 8 GB 4 PB Maximum number of volumes snapshots in system 32 768a Maximum number of volumes snapshots in Protection Domain 32 768 Maximum num...

Страница 79: ...ols per Protection Domain 64 Maximum Fault Sets per Protection Domain 64 Maximum IP addresses per server MDM and SDS 8 RAM Cache 128 MB 300 GB Fine Granularity max compression 10X of RAW Maximum Snapshot Policies per V tree 60 Maximum Snapshot Policies 1000 Maximum user accounts 256 Concurrent GUI REST CLI clients logged in 128 Maximum number of syslog clients 4 AMS does not support CloudLink Clou...

Страница 80: ...Architecture 80 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 81: ...x OS GUI and Logging In The following topics describe how to open the VxFlex OS GUI and log in procedures l Log in to the VxFlex OS GUI 82 l Connection and disconnection information 82 Dell EMC VxFlex Ready Node AMS User Guide 81 ...

Страница 82: ...n the login screen type the username and password and click Login Results The VxFlex OS GUI is displayed After you finish Users and passwords are configured with the VxFlex OS CLI For more information see the Security chapter of the VxFlex OS Ready Node User Guide Connection and disconnection information You can check at any time to which IP address your VxFlex OS GUI is connected using the follow...

Страница 83: ...cribe VxFlex OS GUI features l VxFlex OS GUI overview 84 l VxFlex OS GUI conventions 85 l Hardware view 86 l Dashboard view 88 l Frontend views 95 l Backend views 98 l Monitor Alerts view 103 l Property sheets 105 Dell EMC VxFlex Ready Node AMS User Guide 83 ...

Страница 84: ...dware view see Hardware view See detailed information about one or more backend system objects in table format filtering available Backend views see Backend views See detailed information about one or more frontend system objects in table format filtering available Frontend views see Frontend views See very detailed information about a specific system object Property Sheets see Property sheets Min...

Страница 85: ...an view details about the alerts active in the system in the Alerts view For more information about Alerts see Alerts view and VxFlex OS Alerts in SNMP VxFlex OS GUI REST and ESRS Figure 14 Alerts indicators Color codes Color codes provide quick visual feedback on the status of various objects in the system The following tables summarize the colors used in the system and their meaning The color co...

Страница 86: ...ONZE Volume capacity DARK BLUE Indicates selected items in the filter Table 25 Alert symbols and color codes Color Meaning Dashboar d View Backend View Alert View YELLOW Low alert status ORANGE Medium alert status RED High alert status LIGHT BLUE Information message no faults Hardware view The Hardware view shows the status of the physical hardware components in your node This view provides read o...

Страница 87: ...ts Display details about the selected component in the property sheet on the right Error states are indicated by a colored border around the relevant component Devices have context menus containing commands Below devices device type and caching configuration are shown Check marks below devices indicate that the devices are being cached Note Some models contain devices in the chassis midplane In th...

Страница 88: ...rrently selected 9 I O Workload toggles control the information displayed in this tile For more information see Customizing system preferences in the 4 Other tabs Display various views in the VxFlex OS GUI some tabs provide further options when clicked 10 Dimmer toggle Enables disables the dimmer 5 Username name of user currently logged in to the VxFlex OS GUI To the right of the username is the L...

Страница 89: ...chestrated by AMS as described in the VxFlex Ready Node AMS Upgrade Guide Upgrades performed using any method other than AMS may impact the AMS management capabilities in general and orchestrated upgrades in particular The Logout menu lets you do the following l View the username of the user currently logged in to the system default l Log out of the system Dimmer The Dimmer button toggles the dimm...

Страница 90: ...e information see the Some of the tiles contents differ depending on the navigation filter in use When the dimmer feature is enabled non essential tiles are dimmed unless the mouse pointer is positioned over them Active alert statuses relevant for specific tiles are indicated by red orange or yellow symbols on those tiles These indicators show that one or more alerts are active but not the number ...

Страница 91: ...Figure 18 Dashboard tiles 3 2 5 6 9 10 7 8 4 1 1a The following table describes the tiles displayed on the Dashboard VxFlex OS GUI Features Dell EMC VxFlex Ready Node AMS User Guide 91 ...

Страница 92: ...hot usage To get a more accurate idea of snapshot usage see the Backend Capacity Usage view Center circle Displays the total amount of available raw storage Note Total available raw storage does not represent the total amount of capacity available for volume allocation 1a Capacity Utilization To see this tile click the Capacity Utilization toggle at the bottom left corner of the Physical Capacity ...

Страница 93: ...he large number in the center is the number of Protection Domains This tile is displayed when the dashboard is filtering information according to cluster 8 Storage Pools Displays the number and status of all Storage Pools defined in the Protection Domain The large number in the center is the number of Storage Pools This tile is displayed when the dashboard is filtering information according to Pro...

Страница 94: ... tables show how management clusters are displayed on the Dashboard Table 28 Management node icons with normal operational status green Icon Description 5 node cluster 3 node cluster single node VxFlex OS GUI Features 94 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 95: ...e arrow An upgrade is in progress There is no communication with the Master MDM Frontend views The Frontend views provides detailed information about frontend objects in the system including volumes SDCs and snapshots and lets you perform various configuration operations You can access the following views from the Frontend menu Volumes and SDCs The main areas of the Frontend views are VxFlex OS GU...

Страница 96: ...the table For more information see Property sheets on page 105 For more information about the terminology used in the Property Sheets see the Glossary at the end of this publication Note Some objects in the system can be identified by ID numbers The ID numbers displayed in the GUI can be used in CLI commands to specify these objects Frontend Volumes The Frontend Volumes view displays information r...

Страница 97: ...ovide detailed read only information about the object selected in the table SDCs The Frontend SDCs view displays the SDC connection status and number of mapped volumes for each SDC as well as additional I O details Figure 20 Frontend SDCs view Adding Frontend objects to the filter About this task Add Frontend objects such as volumes SDCs and consistency groups to the Frontend filter The filter sim...

Страница 98: ...ile you display the properties of a different object for comparison or other purposes 3 Command menu contains a list of commands which you can perform on the row selected in the table For more information see Command menu on page 100 7 Table displays a summary of properties for the objects selected in the filter according to the selected table view option 4 Storage Pools SDS toggle toggles display...

Страница 99: ...Life State displays the endurance state of an SSD device 4 Media Type displays the device media type SSD HDD 8 LED Settings displays current LED state of the device Change the LED state by right clicking the device and using the LED Settings command LED settings are not supported on NVDIMM devices Filter The filter lets you filter out the information shown in the table so that only the objects rel...

Страница 100: ...ew options Selected objects rows in the table can be created configured and removed using context sensitive menu options or commands from the Command menu The columns in the table can be resized by dragging the borders in the heading row of the table The scrollbar at the bottom of the table lets you scroll through the columns in the table The following table describes the available table views Not...

Страница 101: ...ward Rebuild Rebalance Migration Related Property Sheet sections Alerts Rebuild Rebalance Provides a summary of rebuild rebalance and migration health status and workload per object Application I O IOPS and I O Size for Total Read Write and 2nd Write Related Property Sheet section Workload Displays workload information for applications reading writing to storage in the system 2nd Writes refer to t...

Страница 102: ...able is sorted by SDSs the Down arrow in each SDS row reveals all the devices in the SDS Note Information is shown only at Device level and there is no aggregation of information at higher levels If the background device scanner is enabled several device read statistics are dramatically affected Read RAM Cache State Size Used Hit Rate Write Mode Related Property Sheet section Read RAM Cache Lets y...

Страница 103: ... section I O Priority Displays bandwidth settings currently configured for Rebuild jobs These I O Priority settings apply only to Storage Pools These settings control system performance Advanced feature modify with caution Rebalance I O Priority Advanced Policy Concurrent I O limit Bandwidth Limit Application Threshold Quiet Period Related Property Sheet section I O Priority Displays I O priority ...

Страница 104: ...to System Protection Domain Storage Pool V Tree SDS Device SDC Snapshot Policy Physical Drive Node Appliance NIC NIC Port PSU Battery RAM Storage Controller Fan CPU CPU Cache Boot Drive Bmc 6 Item Type System Protection Domain Storage Pool V Tree SDS Device SDC Snapshot Policy Physical Drive Node Appliance NIC NIC Port PSU Battery RAM Storage Controller Fan CPU CPU Cache Boot Drive Bmc 3 Alert ind...

Страница 105: ...pshot l V Tree Capacity Utilization details about capacity use for the selected V Tree including base volume capacity snapshot capacity and total trimmed capacity l MDM Cluster details such as cluster mode and state IP addresses and ports including the Virtual IP address used for management and MDM functions and SSL version being used for secure communication The Virtual IP addresses and the Virtu...

Страница 106: ...tem for the selected Storage Pool or Protection Domain and for Alert messages The counters shown depend on the object selected in the table n Window the sliding time window for each interval Short Medium and Long n Threshold the number of errors that may occur before error reporting commences n Period the time interval of each Window in seconds l Maintenance Mode state of the selected SDS is shown...

Страница 107: ... to cache data and a list of the HDDs being cached n Physical drives devices each display location inventory specifications temperature and other health statuses endurance where relevant configuration and logical drive properties Acceleration properties for the selected device are also shown here in the Logical Drive Properties section of this Property Sheet You can view properties for multiple ob...

Страница 108: ...plicated property sheets toggle 2 Duplicate property sheet to a new window button 4 Multiple property sheets opened using the Duplicate property sheet to a new window button VxFlex OS GUI Features 108 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 109: ...OS Performance Fine Tuning This section provides an overview of the different tasks required to enhance VxFlex OS performance Chapter 5 VxFlex OS performance fine tuning Dell EMC VxFlex Ready Node AMS User Guide 109 ...

Страница 110: ...VxFlex OS Performance Fine Tuning 110 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 111: ...e 112 l Performance tuning post installation 112 l VxFlex OS system changes 113 l Optimize Linux 121 l Optimize ESXi 123 l Optimize the SVM 123 l Optimizing VM guests 124 l VxFlex OS Performance Parameters 126 l RAID controller virtual disk settings 127 l Apply Performance Profiles to system components 128 Dell EMC VxFlex Ready Node AMS User Guide 111 ...

Страница 112: ...ads are slower than in cases where compression is disabled There are exceptions to these rules For example Write Response Time is similar in FG and MG Another exception is using snaps In FG the snaps have no impact on the performance of applications and workloads running during the snap creation In MG snaps might have an impact on performance in some cases For this reason in cases that are very se...

Страница 113: ... involved with performance tuning VxFlex OS The following table describes the commands for specific tasks Task Command To view current settings Execute the command scli query_performan ce_parameters Default is High_performance If otherwise execute the command to change to High_performance Execute the command scli set_performance _parameters all_sds all_sdc apply_to_mdm profile high_performanc e To...

Страница 114: ...ng SSDs or flash PCI cards Note SSDs used for caching cannot be used for storage purposes The following table summarizes information about the caching modes provided by the system Mode Description Considerations Default Setting RAM Read Cache rmcache Read only caching performed by server RAM RAM Read cache the fastest type of caching uses RAM that is allocated for caching Its size is limited to th...

Страница 115: ...ore the writes have been offloaded all the HDD devices cached by DAS Cache acquire failed status and a rebuild process commences in VxFlex OS Once the rebuild is over the caching disk can be replaced all caching has stopped in the storage pool and the HDD members in the storage pool can be cleared of errors Disabled Read RAM Cache settings for SDS From version 2 x Read RAM Cache is disabled by def...

Страница 116: ...perly enabled query output will look like this Read Flash Cache settings for SDS Read Flash Cache is available from version 2 x and later This feature is a Read Cache used to increase read performance and buffers writes to increase the performance of Read after Write I Os It allows users to create and configure an RFcache device for any SSD or Flash card VxFlex OS will cache user data depending on...

Страница 117: ...d to using and configuring Read Flash Cache refer to the VxFlex OS Deployment Guide and VxFlex OS User Guide at https support emc com Jumbo Frames and the potential impact on performance When enabling jumbo frames one can expect approximately 10 improvement in performance if all network components fully support jumbo frames If some network components do not fully support jumbo frames it is recomme...

Страница 118: ...e 25 Test ping to ensure mtu setting Jumbo Frame configuration for Windows Configure Jumbo Frames for NIC cards in the Windows based VxFlex OS servers About this task Perform the following steps for all the NIC cards in the VxFlex OS system Procedure 1 Change the Maximum Transmission Unit mtu setting to 9 000 or the highest value that is supported by the switch and the connected nodes 2 Determine ...

Страница 119: ...ed tab of the Adapter Properties dialog for your vendor and driver change the value of Jumbo Packet to 9000 as illustrated in the following figure Figure 27 Adapter properties 5 Click OK The network connection may disconnect briefly during this phase 6 Verify that the configuration is working by typing the command ping f l 8972 Destination_IP_Address Output similar to the following should be displ...

Страница 120: ...commands a esxcfg vswitch d b esxcfg vswitch A vmkernel vSwitch c esxcfg vmknic a i ip address n netmask m 9000 portgroup name Note Changing Jumbo Frames on a vSwitch will not change the VMKernel MTU size For older vCenter versions check to ensure the MTU setting has been changed If not successful users may need to delete and recreate the VMKernel For newer vCenter versions modify the MTU of VMKer...

Страница 121: ...ure 29 Test ping to ensure mtu setting Optimize Linux When using the SSD devices it is recommended that the I O scheduler of the devices be modified Type the following on each server for each SDS device echo noop sys block device_name queue scheduler For example echo noop sys block sdb queue scheduler When CPUs have more than twelve physical cores and more performance is required from the node For...

Страница 122: ...en the GRUB template for editing vim etc default grub 2 Find the GRUB_CMDLINE_LINUX configuration option and append the following to the line intel_idle max_cstate 1 intel_pstate disable Example GRUB_CMDLINE_LINUX crashkernel auto rd lvm lv rhel root rd lvm lv rhel swap rhgb intel_idle max_cstate 1 intel_pstate disable quiet 3 Compile the new GRUB grub2 mkconfig o boot efi EFI redhat grub cfg 4 St...

Страница 123: ... 16bb852c56d3b93e3888003b00000000 O 256 Optimize the SVM Optimize the SVM Procedure 1 Configure the CPU and memory assigned to the Storage Virtual Machine SVM l In general 8 vCPUs are sufficient but this may vary in your environment It is recommended to increase vCPUs to 12 if CloudLink is installed Note this is only relevant if the CPU has 12 or more physical cores l Cores per socket should be se...

Страница 124: ...n using SSD devices it is recommended that you modify the devices I O scheduler Type the following on each server for each SDS device echo noop sys block device_name queue scheduler Example echo noop sys block sdb queue scheduler VxFlex OS performance fine tuning 124 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 125: ...verParameter t REG_SZ d RequestRingPages 32 MaxQueueDepth 254 2 Reboot the virtual machine 3 Verify the successful creation of a registry entry a Open the registry editor by running the REGEDIT command from the command line b Browse to HKLM SYSTEM CurrentControlSet services pvscsi Parameters Device c Verify that the DriverParameter key exists with a value of RequestRingPages 32 MaxQueueDepth 254 L...

Страница 126: ...nterval 1 120 1 1 MDM mdm_sds_capacity_counters_polling_ interval 1 120 5 5 MDM mdm_sds_volume_size_polling_interv al 1 120 15 15 MDM mdm_sds_volume_size_polling_retry_ interval 1 120 5 5 MDM mdm_number_sds_tasks_umt 1 2048 1024 1536 MDM mdm_initial_sds_snapshot_capacity 1 10 1024 1024 1024 MDM mdm_sds_snapshot_capacity_chunk_ size 1 50 1024 5 1024 5 1024 MDM mdm_sds_snapshot_used_capacity_t hresh...

Страница 127: ..._max_inflight_requests 1 10000 100 100 SDC sdc_max_in_flight_data 1 10000 10 10 SDC sdc_number_io_retries 1 100 12 12 SDC sdc_volume_statistics_interval 1000 600000 5000 5000 SDC sdc_optimize_zero_buffers 0 FALSE 1 TRUE 0 FALSE 0 FALSE SDC sdc_number_unmap_blocks 1 200 100 100 SDC sdc_number_non_io_os_threads 1 16 3 3 RAID controller virtual disk settings RAID controller virtual disk settings and ...

Страница 128: ...profile of an SDS on an SVM you must perform manual memory allocation on the SVM as described in the VxFlex OS Deployment Guide To apply a profile to system components perform the following steps Procedure 1 Depending on the system component that you want to configure in either the Backend Storage or Frontend SDCs view navigate to and select the desired objects Note If you want to apply the Perfor...

Страница 129: ...lling the license The topics in this part of the guide describe how to use the CLI to manage and monitor VxFlex OS activity and components Chapters include Chapter 6 Managing System Objects Chapter 7 Security Management Chapter 8 Monitoring the System using the VxFlex OS GUI Chapter 9 Configuring the System using the VxFlex OS GUI Dell EMC VxFlex Ready Node AMS User Guide 129 ...

Страница 130: ...Managing and Monitoring 130 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 131: ...VxFlex Ready Node system objects l CLI basics 132 l Syntax 133 l Managing the VxFlex OS system 135 l Cluster operations 135 l Managing the SDSs and cache 141 l SDC operations 144 l Managing ESX servers 152 l Restarting the AMS service on Linux 155 Dell EMC VxFlex Ready Node AMS User Guide 131 ...

Страница 132: ...for login do not use mdm_port l To run commands from a Linux server to a remote AMS from location of the SCLI bin on the local server enter scli command mdm_ip AMS_IP_Address mdm_port 6611 l To run commands from Windows to a remote AMS from the location of SCLI bin on the local server enter scli exe command mdm_ip AMS_IP_address mdm_port 6611 Description Execute a CLI command Parameter Description...

Страница 133: ...munication 0 scli conf txt Note For more information on how to set up secure or non secure mode see the VxFlex OS User Guide Note After renewing certificates changing from secure mode to non secure mode is not supported Syntax All names of objects in the system will be capitalized for example Protection Domain In the case where the name is in fact initials it will be in uppercase for example MDM T...

Страница 134: ...e one of the options separated by Selecting an option is OPTIONAL indicated by l Options indicates that you may choose one of the options that will be described in the table under Options It is OPTIONAL indicated by Getting help with the CLI The CLI supports auto completion To complete a command or parameters press the TAB key while typing CLI commands Alternately you can run the help command Comm...

Страница 135: ... MDM cluster from 3 to 5 node Cluster operations Use the VxFlex OS GUI Hardware view to perform cluster operations such as adding and removing standby servers adding and removing Managers and TieBreakers and replacing a Master MDM The following cluster operations can be performed using the Cluster menu in the Hardware view l Adding a standby server as described in Adding a standby to the MDM clust...

Страница 136: ...e Nodes list on the left side right click the required node and select Add as Standby The Add Standby Node window is displayed 3 In the Standby Name box type a name for the standby 4 From the Role list select one of the following Option Description MDM Creates a standby with the MDM role TieBreaker Creates a standby with the Tie Breaker role 5 Click OK Results The MDM Tie Breaker package is instal...

Страница 137: ... the MDM cluster Before you begin Ensure that a standby MDM and a standby Tie Breaker are already defined in the MDM cluster For information about adding standby servers see Adding a standby to the MDM cluster on page 136 About this task A 5 node cluster provides better high availability than a 3 node cluster and therefore better protection in fault scenarios Standby servers can be added to a 3 no...

Страница 138: ... Hardware view click the Cluster menu and select Decrease to 3 Node Cluster Mode The Switch to 3 Node Cluster Mode window is displayed 2 Select one MDM and one Tie Breaker for removal from the cluster 3 Click OK Results The cluster switches to 3 node cluster mode The nodes that you removed from the MDM cluster revert to standbys Replacing a Master MDM Replace a Master MDM with a Slave MDM using th...

Страница 139: ...servers must be part of the VxFlex OS system About this task The source is the server from which the MDM or TB will be moved and the target is the server to which the MDM or TB will be moved If there is no server in the system that can accept the role of an MDM or Tie Breaker component you must add one before performing this procedure Procedure 1 If there is no standby node in the system add a sta...

Страница 140: ...elect Replace Cluster Member 3 In the Replace Cluster Member dialog box select the source server the faulted server and then click OK 4 When the cluster component has been successfully transferred from the source to the target server a success message is displayed Click Close The Node Properties sheet displays the source server as a standby MDM and the target server as an MDM in the cluster Managi...

Страница 141: ...m s cache including Read Flash cache and Read RAM cache Modifying an SDS port during I O About this task If you need to modify an SDS port on the fly while there is I O running perform the following steps Note Sometimes your network topology needs to be prepared for the addition of new port and this may take some time VxFlex OS does not prevent unnecessary degraded status or disconnection of SDS T...

Страница 142: ...figuration file with a text editor Operating System File name Linux opt emc scaleio sds cfg conf txt Windows C Program Files EMC scaleio sds cfg conf txt 4 Add the parameter tgt_port NEW_PORT_NUM to the file where NEW_PORT_NUM represents the new port number 5 Perform one of the following Operating System Task Linux Run the script opt emc scaleio sds bin open_firewall_port sh Windows From command l...

Страница 143: ...Fcache devices to the SDSs If you want to stop using the RFcache feature or remove a specific RFcache device use the following work flow 4 Stop RFcache usage in the Storage Pool 5 Remove command the RFcache device from the SDS 6 You can then do one of the following l Physically remove the device from the chassis and then restart RFcache usage in the Storage Pool l Add the device to the SDS as a st...

Страница 144: ...bled and the relevant Storage Pool and the relevant volume are both configured to use cache SDC operations Many SDC operations use drv_cfg The drv_cfg command line is a local CLI utility that affects only the client on which the SDC is running Possible SDC operations include updating the SDC driver with IP changes detecting new volumes querying volumes loading a configuration file adding an MDM mo...

Страница 145: ...epending on the row selected in the table For more information about Property Sheets see Property Sheets Syntax opt emc scaleio sdc bin drv_cfg rescan Description Notes Volumes are always exposed to the operating system as devices with the prefix scini such as dev scinia dev scinib and so on Unique names can be found under dev disk by id VxFlex OS periodically scans the system to detect new volume...

Страница 146: ...pdate the SDC parameters in VMware based HCI or Compute node Example opt emc scaleio sdc bin drv_cfg query_vols Query tgt objects using drv_cfg Command drv_cfg query_tgts Note This is not a CLI command but rather an executable that is run on the SDC server Syntax opt emc scaleio sdc bin drv_cfg query_tgts Description Notes This utility retrieves information about all known active tgt objects SDSs ...

Страница 147: ...io sdc bin drv_cfg l Windows C Program Files emc scaleio sdc bin drv_cfg l ESXi Refer to Update the SDC parameters in VMware based HCI or Compute node Note If the SDC was removed and reinstalled the GUID of the SDC will be different to its original GUID In such a case you may need to remove the SDC if two SDCs now have the same GUID Example opt emc scaleio sdc bin drv_cfg query_guid Query MDMs usi...

Страница 148: ... but rather an executable that is run on the SDC server This command can not be used on ESX servers Instead follow the steps described in Modifying configuration parameters on ESX servers Syntax opt emc scaleio sdc bin drv_cfg load_cfg_file FILE_NAME Description Notes This utility reads a configuration file containing MDM IP addresses and calls the kernel to connect to them Location of drv_cfg com...

Страница 149: ...c bin drv_cfg l ESXi Refer to Update the SDC parameters in VMware based HCI or Compute node Note Extending your VxFlex OS system with another MDM requires that you update all SDCs in your system with the new MDM IP address Run the drv_cfg utility with the mod_mdm_ip option see Modifying an MDM IP address using drv_cfg and to make the change persistent use the file parameter In addition any additio...

Страница 150: ...changed or when MDMs are added removed from to the system The command must be run on every SDC in the system To bring the changes into effect a server restart is required Location of drv_cfg command l Linux opt emc scaleio sdc bin drv_cfg l Windows C Program Files emc scaleio sdc bin drv_cfg l ESXi Refer to Update the SDC parameters in VMware based HCI or Compute node Note Extending your VxFlex OS...

Страница 151: ...ice if a timeout value is reached the ESXi will be notified that the device is in a PDL state The timeout value can be manually set Once a device is in a PDL state the ESXi host no longer attempts to re establish connectivity or issue commands to the device Recovering a device from PDL state is described in the VMware documentation for your operating system version The following link is for ESXi v...

Страница 152: ...C l The SDC s GUID needs to be changed Specifically the SDC s GUID or IP address needs to be identified and then used to add or modify the MDM IP addresses or GUID depending on the parameter that you want to modify If you want to add additional MDM IP addresses to existing ones you must list both old and additional IP addresses in the esxcli command For more information about SDC tuning see VxFlex...

Страница 153: ...allowed a To replace the old MDM IP addresses with new MDM IP addresses omit the old addresses from the command b To add MDM IP addresses to the existing IP addresses type both the existing IP addresses and the new IP addresses in the command MDM IP addresses for MDMs in same cluster must be comma separated To configure more than one cluster use to separate between IP addresses in different cluste...

Страница 154: ...identified in the previous step You must include these IP addresses in the command For example esxcli system module parameters set m scini p IoctlIniGuidStr 28a78184 4beb 4a42 bf89 4cc7e55a1e5b IoctlMdmIPStr 9 99 101 22 9 99 101 23 8 To apply the new configuration restart the ESXi server Checking the SDC state on ESX servers On an SDC running on an ESX server an esxcli command can be used to check...

Страница 155: ... 1 Run one of the following commands to stop the service service scaleio ams stop or systemctl stop scaleio ams 2 Stop all processes manually using either the killall command or by PIDs For example l ps ef grep java l kill 9 PID 3 Run one of the following commands to restart the AMS service or service scaleio ams start systemctl start scaleio ams 4 Check the status of the service systemctl status ...

Страница 156: ...Managing System Objects 156 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 157: ...GUI 160 l Modifying AMS MDM connection security via AMS CLI 162 l Back up SSH public keys using the VxFlex OS GUI 164 l Backing up SSH public keys using CLI commands 165 l Changing the emergency password 166 l Setting credentials for existing Monitor users 167 l Changing login credentials for existing Management users 167 l Login banner overview 168 l MDM and LDAP integration in an AMS managed sys...

Страница 158: ... option The System Settings window is displayed 2 In the left panel click Connection 3 Export a certificate a Scroll down to the Export AMS Certificate section set the required Certificate Key Length and click Get Certificate A certificate file is created in CSR format and a Save window is displayed b Navigate to a location of your choice and save the file 4 On your CA server sign the certificate ...

Страница 159: ...nux based AMS server a Perform either of the following l Access full path java jar opt emc scaleio ams webapps ROOT resources scaleio_repository l Relative path cd opt emc scaleio ams webapps ROOT resources scaleio_repository b Run this command EMC ScaleIO ams cli 3 0 build XXX jar username USERNAME password PASSWORD generate_certificate_request file_name NAME_FILE An unsigned certificate appears ...

Страница 160: ...icate in the AMS server Modifying AMS MDM connection security via GUI Set up secure or non secure connectivity between AMS and MDM using the VxFlex OS GUI The default setting is secure AMS MDM connectivity Before you begin Ensure that you have l The VxFlex OS GUI installed on your computer l The username and password for logging in to the VxFlex OS GUI About this task It is recommended to always u...

Страница 161: ...tatus option do any of the following depends on the default secure non secure setting l To disable AMS MDM secure connectivity to move from secure to non secure connectivity a Verify that the Enable AMS Secured Connection checkbox is selected default selection b Deselect the Enable AMS Secured Connection checkbox Security Management Dell EMC VxFlex Ready Node AMS User Guide 161 ...

Страница 162: ...e secure or non secure connectivity between AMS and MDM using the AMS CLI The default setting is secure AMS MDM connectivity Before you begin Ensure that you have l The user name and password for logging in to the AMS server About this task It is recommended to always use a secure AMS MDM connection for accessing the VxFlex OS MDM Only when access to the MDM is denied for reasons such as expiratio...

Страница 163: ...o ams webapps ROOT resources scaleio_repository EMC ScaleIO ams cli version jar set_ams_secure_mode disable_secure_mode l To run the command from a relative path type cd opt emc scaleio ams webapps ROOT resources scaleio_repository and then java jar EMC ScaleIO ams cli version jar set_ams_secure_mode disable_secure_mode l To change connectivity from non secure mode to secure mode perform the follo...

Страница 164: ... the VxFlex OS GUI The VxFlex OS GUI can be used to back up SSH public keys Before you begin Ensure that you can authenticate to the VxFlex OS GUI with an admin user About this task It is recommended that you back up SSH public keys to your local drive for recovery purposes When using secure mode during VxFlex OS system recovery process it is recommended that you back up SSH public keys after you ...

Страница 165: ...tem recovery process it is recommended that you back up SSH public keys after you perform system deployment or add remove a server node If you do not backup SSH public keys you can run the Recovery process in non secure mode However for the reason of system security it is recommended that you always use SSH public keys for system access Procedure 1 Log in to the AMS server 2 For Linux as the AMS o...

Страница 166: ...ency password is defined during system deployment It can be used to log in to the VxFlex OS GUI when there is no connectivity to the system s MDM The following procedure explains how to change the emergency password Procedure 1 From the System Settings menu at the top right side of the window select the System Settings option The System Settings window is displayed 2 In the left panel click Techni...

Страница 167: ...ayed 2 In the left panel click Technical Users The Set Credentials for Existing Technical Users panel is displayed on the right side of the window Figure 34 System Settings window Technical Users pane Monitor User 3 In the User name box type the local or LDAP user name that has Monitor privileges 4 In the Password box type the password 5 Click Save Results The Monitor User credentials have been de...

Страница 168: ...r displays differently in the VxFlex OS GUI and CLI interfaces l VxFlex OS GUI n When logging in the login banner is displayed and must be approved l CLI n When logging in the user is prompted to press any key after which the banner is displayed n To continue the banner must be approved Limitations l Only users with administrative security rights can set up update or remove the login banner l Text...

Страница 169: ...nd the login banner can be bypassed using a CLI command Before you begin To enable or disable the preemptive acceptance option you must have administrative rights Procedure 1 Log in to VxFlex OS scli login username admin password PASSWORD 2 Run the following command to enable preemptive acceptance scli set_cli_login_banner_preemptive_acceptance enable 3 Run the following command to disable preempt...

Страница 170: ...nd to the user roles offered by VxFlex OS 3 Set the system wide authentication method use with caution because it is complex to roll back this operation 4 Log in again to apply the changes that you made User roles The authorization permissions of each user role are defined differently for local authentication and for LDAP authentication Although the role names are similar the permissions granted t...

Страница 171: ...nfigure Configurator and Monitor users Security Roles No No No No May define Administrator users and control LDAP Super User only one Super User is allowed per system and it must be a local user Yes Not applicabl e Yes Not applicable Yes Not applicabl e Authenticating with the management server To access the CLI you must first log in using a terminal application Once logged in you can set the user...

Страница 172: ...d user into the management system Every user must log in before performing CLI commands When a user is authenticated by the system all commands performed will be done with their respective role until a logout is performed or until the session expires by reaching one of the following timeouts l Maximum session length default 8 hours l Session idle time default 10 minutes To log in to the AMS from a...

Страница 173: ...User password If you do not type your password you will be prompted to do so Note In Linux to prevent the password from being recorded in the history log leave out the password flag and enter the password interactively ldap_authentication Login with LDAP authentication method LDAP authentication parameters should be configured and LDAP authentication method should be set native_authentication Logi...

Страница 174: ...ics Description Notes This command sets user authentication method for the system Note Use this command with caution because it is complex to roll back this operation Parameters Parameter Description ldap_authentication LDAP based authentication method where users are managed in LDAP compliant server In order to switch to this authentication method LDAP service parameters should be configured nati...

Страница 175: ...r_role Monitor Configure BackEndConfigure FrontEndConfigure Security Administrator Actual command syntax is operating system dependent For more information see CLI basics Description Notes This command only available to administrator roles adds a user to the system A randomly generated password for the created user is returned Note When adding users you may need to use the or characters to enable ...

Страница 176: ...istrator roles deletes the specified user from the system Parameters Parameter Description user_ID ID ID of the user to be deleted username NAME User name of the user to be deleted Example scli delete_user username siouser2 Modifying user credentials Command modify_user Syntax scli modify_user user_id ID username NAME user_role Monitor Configure BackEndConfigure FrontEndConfigure Security Administ...

Страница 177: ...e l BackEndConfigure l FrontEndConfigure l Security l Administrator For more information about the roles see Table 20 Example scli modify_user username siouser3 user_role Monitor Displaying system users and their roles Command query_users Syntax scli query_users Actual command syntax is operating system dependent For more information see CLI basics Description Notes This command only available to ...

Страница 178: ...in the user ID via the query_users command or when adding the user username The name of the user Example scli query_user username sio_user Resetting user passwords Command reset_password Syntax scli reset_password user_id ID username NAME Actual command syntax is operating system dependent For more information see CLI basics Description Notes This command only available to administrator roles gene...

Страница 179: ...s operating system dependent For more information see CLI basics Description Notes This command changes the password of the user that is currently logged in to the system Parameters Parameter Description old_password User s current password Note In Linux to prevent the password from being recorded in the history log leave out the old_password flag and enter the password interactively new_password ...

Страница 180: ...tor in the earlier versions This is the default user for setting up the system It has all the privileges of all the user roles The Super User is only available in the local domain and cannot be an LDAP user One may disable the Super User in order to ensure that all users are associated with specific people The Super User role should be used in two cases l When setting up a new system l When there ...

Страница 181: ...Parameters Parameter Description i_am_sure Preemptive approval Example scli disable_admin i_am_sure Security Management Dell EMC VxFlex Ready Node AMS User Guide 181 ...

Страница 182: ...Security Management 182 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 183: ...the system using the VxFlex OS GUI l Viewing object properties in Backend and Frontend views 184 l Viewing detailed hardware properties 184 l Viewing licensing information 186 l Verifying your connection to the Management cluster 187 l Collecting logs 187 Dell EMC VxFlex Ready Node AMS User Guide 183 ...

Страница 184: ...re components Identifying hardware errors There are two ways of identifying hardware errors in the system l From Monitor Alerts view alerts for hardware components are displayed in the Alerts table l From the Hardware view components with error states are shown with a colored outline The error state colors are uniform throughout the VxFlex OS system An error state outline is displayed around the c...

Страница 185: ...heet 2 2 1 2 In the uppermost part of the Physical Drive Properties Property Sheet check if the Type is SSD or HDD a If the drive type is SDD proceed to the next step b If the drive type is HDD click other drives in the Front view until you find an SSD and then proceed to the next step 3 Expand the Logical Drive Properties section If the SSD drive is used for caching the property Used as Read Flas...

Страница 186: ...re a permanent license is installed a banner is displayed at the top of the VxFlex OS GUI window that provides links for purchasing a license and for registering for VxFlex OS newsletters Information required for licensing purposes is located in the About window as described in the following steps Procedure 1 From the System Settings menu at the top right side of the window in any view select the ...

Страница 187: ...ress to which you are connected is also displayed in the top left corner of the VxFlex OS GUI For more information about MDM statuses see Management MDM cluster status If the connection is lost the VxFlex OS GUI is dimmed and a dialog box is displayed Collecting logs Use the VxFlex OS GUI to collect a downloadable log file in ZIP file format from the system This operation collects logs from MDM SD...

Страница 188: ...Monitoring the System using the VxFlex OS GUI 188 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 189: ...build Rebalance advanced 231 l Using the background device scanner 231 l Configure inflight checksum protection 233 l Renaming objects 233 l Approving pending security certificates 234 l Customizing system preferences 234 l Modifying system settings 237 l Changing login credentials for existing Management users 242 l Creating dedicated networks for SDS to SDS traffic in a Red Hat Linux System 243 ...

Страница 190: ...ake place You may want to plan this procedure for a scheduled maintenance window l On ESXi nodes if the faulty server is up migrate all VMs except for the Storage VM to another server If the server is not up use the vCenter client to start these VMs on another server Note If VMware HA is enabled VMs can migrate without service interruption l If the node includes an SDC volumes may be mapped to the...

Страница 191: ... the following l Removes the SDS from the system l Removes the SDS software from the server l Unconfigures and removes the SDC from the server l Reboots the server l Removes the SDC from the system Note This may trigger a rebalance Wait until the rebalance process completes before continuing This may take over 24 hours which will cause a timeout error to be displayed for the Remove command 7 After...

Страница 192: ...2 Ensure that the new device was installed correctly and is in the proper state a From the VxFlex OS GUI Hardware view click the new device b Find the device s state in the Physical Drive Properties sheet 3 From the Hardware view right click the device and choose the required option l For a storage device choose Add to Storage Pool In the Add Devices window select a Storage Pool If the device was ...

Страница 193: ...ts from the system Use the Remove command with caution In general if you want to remove and replace a device follow these steps 1 Gather information about the faulty device and the SDS 2 Remove the faulty device from the VxFlex OS system 3 Remove the faulty physical device from the server 4 Add the replacement device to the server 5 Add the replacement device to the VxFlex OS system 6 Ensure that ...

Страница 194: ...an be Read Flash Cache or DAS Cache SSD devices 13G servers only Procedure 1 Remove the faulty disk from the VxFlex Ready Node system a From the VxFlex OS GUI Hardware view right click the faulty disk and choose Remove Acceleration Drive Note If you remove a DAS Cache caching device and there is another caching device in the same node both of them should appear in the Remove Cache Device dialog bo...

Страница 195: ...that is being used for storage Procedure 1 Remove the faulty disk from the VxFlex Ready Node system a From the VxFlex OS GUI Hardware view right click the faulty disk and choose Remove from Storage Pool b In the Remove Device dialog for NVMe SSD devices that you want to physically retain in the chassis clear the Prepare Devices for Removal option For physical NVMe SSD device removal leave this opt...

Страница 196: ...left it open or using the Abort command from the Command menu NOTICE The Remove command deletes the specified objects from the system Use the Remove command with caution Procedure 1 In the Backend view navigate to the desired device in the table and select its row 2 Right click the desired device and select the desired Remove command a In the Remove Device dialog for NVMe SSD devices that you want...

Страница 197: ... on identification LEDs About this task You can locate a specific node or device in a rack by activating their flashing LEDs from the VxFlex OS GUI This can help you to identify a specific rack or node for maintenance activities Note The LEDs flash until they are turned off It is recommended to turn off the flashing LEDs before removing the drive or node Use the same windows mentioned in the proce...

Страница 198: ...pplication I O and disable access to volumes l Move the DRL mode of all SDSs to harden in preparation for restarting the server l Reload of all SDSs before re enabling data access For each of the following procedures after you click OK the progress and result of the operation is displayed at the bottom of the window Note Protection Domain removal is only possible if the Protection Domain is empty ...

Страница 199: ...protecting your data against hardware failure Fault Sets are subsets of a given Protection Domain Note When defining Fault Sets you must follow the guidelines described in Fault Sets Failure to do so may prevent creation of volumes Procedure 1 In the Backend Storage view navigate to and select the Protection Domain 2 Right click the Protection Domain and select Add Fault Set 3 Type a name in the F...

Страница 200: ...M Cache features see Managing RAM read cache 7 Click OK Activate devices Activate a device that was inactivated or that was added to a system using the Test only option About this task Use the Activate Device command in the following situations l Storage devices were added to the system using the Test only option for Device Tests and successfully passed the tests l Storage devices were inactivated...

Страница 201: ...rotection Domain level and then designate individual SSDs as caching devices Within a Protection Domain only one mode of caching can be enabled A maximum of two SSDs can be configured as DAS Cache Note Before performing any cache removal or addition operations it is recommended to stop caching on the Protection Domain and start caching again after those operations are complete This section include...

Страница 202: ... caching or acceleration device and will no longer appear in the list of devices shown in the Backend Storage views In the Hardware view the type of caching provided by the device is shown below each device and in the associated Physical Device Properties sheet For Read Flash Cache and other acceleration features further configurations are required in the Backend Acceleration view Stopping caching...

Страница 203: ...icy 2 Perform one of the following a For DAS Cache and CacheCade in the Set Caching_Method Caching Policy window select Don t use Caching_Method and click OK When the status shows Does not use cache click Close b For Read Flash Cache in the Set Read Flash Cache Policy window clear the Enable Read Flash Cache checkbox and click OK 3 From the Hardware view right click the disk and choose Remove Acce...

Страница 204: ...isabled on volumes To change Read RAM Cache settings on volumes perform these steps Procedure 1 In Frontend Volumes select the Volumes or Volumes Monitor view 2 Navigate to the volumes and select them 3 Right click the volumes and select Set Volume Read RAM Cache The Set Volume Use Read RAM Cache window is displayed showing a list of the volumes that will be modified 4 Select or clear the Use Read...

Страница 205: ...Per SDS controls Read RAM Cache for one or more SDSs Caching can be enabled or disabled for the specified SDS and the capacity allocated for caching on an SDS can be specified Caching will only begin after one or more storage devices are added to the SDSs Ensure that the feature is also enabled at Storage Pool level Note Only I Os that are multiples of 4k bytes can be cached To configure caching p...

Страница 206: ...nstalled in order to select this option l For Medium Granularity data layout select SSD You must have at least one SSD installed that can be used for the RFcache feature in order to select this option 5 Click Add Devices and then click the Add device icon to add a row to the New Devices table 6 Enter the following information in the relevant row of the table l In the Path cell enter the location o...

Страница 207: ...of the device changes especially in Linux and any disk including NVDIMM devices To fix this run the following command scli update_sds_original_paths sds_id SDS ID The update is displayed Name dev dax0 0 Path dev dax2 0 Original path dev dax2 0 ID ff9e65d600010000 Acceleration Pool ac1 Capacity 15 7 GB 16052 MB Used 2 9 GB 3003 MB State Normal Also if the current SDS device includes the name field ...

Страница 208: ...vice 5 Click Advanced and configure the optional settings l Test and activate device l Device test timeout x seconds l Force devices takeover takes over devices that were previously used in a VxFlex OS system 6 If you want to add more devices click the Add device icon again and configure the fields in the new row 7 Click OK Removing acceleration devices Acceleration devices must be removed in a gr...

Страница 209: ...an NVDIMM device Note For more information refer to the AMS NVDIMM FRU Guide Identify a NVDIMM N module and correlate its storage devices Identify the failed NVDIMM N memory module and the correlating storage devices that interact with the module in the VxFlex OS Fine Granularity Storage Pool This task is also required when replacing the NVDIMM battery on the node or replacing the system board Bef...

Страница 210: ...om the Dell console main window select System Inventory Hardware Inventory 7 Expand the entry for the relevant DIMM The console displays information regarding the DIMM you identified in the previous steps If an NVDIMM s battery needs to be replaced proceed to the task Gracefully shut down the node The DIMM s PrimaryStatus should appear as Degraded 8 Using SSH log in to the Linux server 9 View info...

Страница 211: ...ate disabled health health_state ok temperature_celsius 255 life_used_percentage 32 12 In the output from the previous step find the device dev with the id that partially correlates with the serial number you discovered previously for the failed device For example l The NVDIMM output displays serial number 16492521 for the NVDIMM device l In the previous step the output displays the ID of device n...

Страница 212: ...wn namespaces dev namespace1 0 mode devdax map dev size 16909336576 uuid 0a438fbc 91e4 427d 8068 1f26330d85cc daxregion id 1 size 16909336576 align 4096 devices chardev dax1 0 size 16909336576 numa_node 1 dev region0 size 17179869184 available_size 0 max_available_extent 0 type pmem numa_node 0 mappings dimm nmem0 offset 0 length 17179869184 position 0 persistence_domain unknown namespaces dev nam...

Страница 213: ...MM serial number displayed in the output in Step 11 In the above example where nmem0 s namespace is namespace0 0 the DAX device name is dax0 0 16 Record the device s namespace and DAX device name in the NVDIMM information table Results You have discovered the namespace and DAX device name for the storage devices that interact with the failed NVDIMM or in the case of a failed NVDIMM battery all NVD...

Страница 214: ...ol accp_for_sp2_NVDIMM Figure 40 FG Storage Pool with DAX device 5 Record the name of the FG Storage Pool the Acceleration Pool the storage devices and the DAX devices in the relevant rows in the NVDIMM information table In the above example the information you need to record is l Storage Pool sp2_FG l Acceleration Pool accp_for_sp2_NVDIMM l Storage devices dev sdb dev sdc l Acceleration devices d...

Страница 215: ...ns procedures for adding removing and managing volumes and snapshots It explains how to remove volumes create snapshots and set volume bandwidth and IOPS limits It also describes setting the SDC restriction mode and how to approve SDCs before mapping volumes Adding volumes Add volumes to a system Before you begin There must be at least three SDS nodes in the system and there must be sufficient cap...

Страница 216: ...will be assigned to all the volumes created in this operation 4 Type a name for the volume l If you are adding one volume enter the name in the Name box l If you are adding multiple volumes enter the base name in the Base name box The volumes will all be created with the same name and a number will be appended instead of the characters i These characters can be positioned anywhere in the name The ...

Страница 217: ...e restricted SDC setting has the following modes l No restriction Volumes can be mapped without pre approving SDCs l GUID restriction SDCs are approved using their GUID Only once the SDC is approved can it be used for mapping volumes l Approved IP restriction SDCs must be approved using their GUID and IP address Only once the SDC is approved using both GUID and IP address can it be used for mappin...

Страница 218: ...before you can map volumes Approve SDCs using the VxFlex OS GUI When the system s restricted SDC mode is set to GUID restriction you must approve SDCs before you can map volumes Procedure 1 In the Frontend SDCs view right click on one or several SDCs that you want to approve and select Approve SDC 2 In the Approve SDC window verify that the SDCs listed are the ones you want to approve and click OK...

Страница 219: ...s perform these steps Procedure 1 In any of the Frontend Volumes views navigate to the volumes and select them 2 From the Command menu or context sensitive menu select Map Volumes The Map Volumes window is displayed showing a list of the volumes that will be mapped 3 In the Select Nodes panel select one or more SDCs to which you want to map the volumes l You can use the search box to find SDCs l I...

Страница 220: ...aded to avoid causing a Data Unavailability status Note Removal of a volume erases all the data on the corresponding volume Procedure 1 In any of the views of the Frontend Volumes view navigate to the volume or volumes you want to remove and select them 2 From the Command menu or context sensitive menu select Remove The Remove Volumes window is displayed showing a list of the volumes that will be ...

Страница 221: ...created are displayed in the right pane of the window 4 Type a number in the Size box representing the volume size in GB basic allocation granularity is 8 GB 5 Select either Thick default or Thin provisioning options 6 If you want to enable the RAM Read Cache feature select Use RAM Read Cache 7 Click Create The Map Volumes step is displayed showing a list of the volumes that will be mapped 8 In th...

Страница 222: ...e assigned a unique ID that can be used to identify the object in CLI commands You can retrieve the ID via a query or via the object s property sheet in the VxFlex OS GUI Note The consistency group is for convenience purposes ONLY There are no protection measures to conserve the consistency group You can delete members from it To take a snapshot perform these steps Procedure 1 In the Frontend Volu...

Страница 223: ...ants select Remove with Descendants l To retain the parent volume and remove only its snapshots select Remove Descendants Only The Remove Volumes window is displayed showing a list of the objects that will be removed 3 Click OK The progress of the operation is displayed at the bottom of the window It is recommended to keep the window open until the operation is completed and until you can see the ...

Страница 224: ...mits for volumes on a per SDC basis This enables you to control the quality of service QoS Before you begin Ensure that the volumes are mapped before you set these limits About this task Procedure 1 In Frontend Volumes view select the Volumes or Volumes Monitor view 2 Navigate to the volumes and select them 3 From the Command menu or context sensitive menu select Set Volume Limits The Set Volume L...

Страница 225: ...data will not be lost it will be rebuilt using the temporary copy Procedure 1 To put an SDS into Maintenance Mode perform these steps a In the Backend Storage view navigate to and select the desired SDS b From the Command menu or context sensitive menu select Enter Maintenance Mode The Enter Maintenance Mode window is displayed c If you want to force entry into Maintenance Mode even though there i...

Страница 226: ...ou have fixed a problem and want to ensure that an alert is no longer active in the system Configure Oscillating Failure counter parameters Configure Oscillating Failure counter parameters for the entire system or for specific Protection Domains or Storage Pools About this task Procedure 1 Perform one of the following Option Description To configure counter parameters for all SDCs Protection Domai...

Страница 227: ...e entire system per Protection Domain or per Storage Pool About this task l To reset oscillating failure counters for all SDCs Protection Domains or Storage Pools in the system go to step 1 l To reset counters for a specific Protection Domain or Storage Pool in the Backend Storage view navigate to and select the relevant Protection Domain or Storage Pool Procedure 1 In the Backend Storage view sel...

Страница 228: ...w the file for example more Oscillating_Network_Failures_Counters_2016 01 28 13 31 57 json l SDCs 1 In the Frontend SDCs view select the required SDC 2 Open the Property Sheet and click the Oscillating Failure Counters section Note When there are no oscillating failures counters for SDC the Oscillating Failures Counters section displays None Found l SDSs and devices Procedure 1 In the Backend Stor...

Страница 229: ...click the object and select Set Performance Profile for XXX where XXX represents one of the following l MDMs l All SDSs l SDS l All SDCs l SDC The Set Performance Profile for window is displayed 3 Select a profile from the drop down list and click OK Configuring I O priorities and bandwidth use advanced VxFlex OS includes advanced settings which control I O priorities and bandwidth use which can b...

Страница 230: ...plication IOPS threshold Application bandwidth threshold and Application threshold quiet period Default values for these features are provided in the VxFlex OS CLI Reference Guide NOTICE These features affect system performance and should only be configured by an advanced user Configure I O prioritization for Rebuild Rebalance and Migration by performing these steps Procedure 1 In the Backend Stor...

Страница 231: ...commended to disable the Rebuild feature except in very special circumstances Rebalancing is an essential part of VxFlex OS and should only be disabled temporarily in special circumstances Disabling rebalance may cause the system to become unbalanced even if no capacity is added or removed For example during a recovery from an SDS or device failure some rebalance activity may be needed to ensure o...

Страница 232: ...owing l To enable the scanner select the check box and proceed to the next step l To disable the scanner clear the check box and click OK to finish 4 Select an option selected enable clear disable a Device only b Data comparison 5 In the Bandwidth Limit box accept the default or type a number in KB per second per device The given value should be in the range 10 KB 10 MB default 1 MB Note High band...

Страница 233: ...w is displayed 3 Do one of the following a To enable the Checksum feature select the Enable Inflight Checksum check box b To disable the Checksum feature clear the Enable Inflight Checksum check box 4 Click OK Renaming objects About this task Object names are used to identify the objects in the VxFlex OS GUI and can also be used to specify objects in CLI commands You can view an object s name in i...

Страница 234: ...m Settings menu in the top right corner select System Settings The System Settings window appears showing approved and pending certificates 2 Scroll to connections that are Pending Approval and expand the rows 3 For each one scroll to the bottom of the information about the required certificate and click Confirm Customizing system preferences About this task You can customize various features in t...

Страница 235: ... window Table 32 User Preferences Item Description General Refresh data every n seconds Controls the rate at which data displayed in the VxFlex OS GUI is refreshed in seconds Default 10 seconds Configuring the System using the VxFlex OS GUI Dell EMC VxFlex Ready Node AMS User Guide 235 ...

Страница 236: ...the last n seconds n can be configured in Dashboard I O Workload in this window The symbol means that the number displayed is from the last data sample that was taken The period between automatic refreshes can be configured in Dashboard I O Workload in this window System Clock Show system clock on the Dashboard Show Property Sheet in advanced mode Displays additional details in Property Sheets l C...

Страница 237: ... right side of the window select the System Settings option The System Settings window is displayed 2 Select the type of network to which you want to allocate IP addresses Management Network or Data Network l The AMS uses management networks to communicate with and control the appliance objects No I O passes through these networks Management networks can be on different subnets as long as the AMS ...

Страница 238: ...pply on ESX check boxes are selected 6 When you have finished click Save ESRS This section explains how to configure connection properties to allow communication between the VxFlex OS system and ESRS EMC Secure Remote Support servers ESRS can be used by ASP Partners for remote hardware support For more information about using ESRS refer to ESRS documentation You can only use the ESRS feature if yo...

Страница 239: ...Click Save 9 Edit the esrs properties file and add the SWID to the ForcedSWID field l Linux opt emc scaleio ams webapps ROOT WEB INF classes l Windows C Program Files EMC scaleio AMS webapps ROOT WEB INF classes 10 Restart the AMS service Results ESRS configuration properties have been saved in the VxFlex OS system To validate the connection proceed to Validating ConnectEMC Dial Home on page 239 V...

Страница 240: ... an alert occurs and will only be sent again if the resend interval has passed since it was last sent Note For detailed information about SNMP support in the system see SNMP Trap Support on page 293 To configure SNMP properties perform the following steps Procedure 1 From the System Settings menu at the top right side of the window in any view select the System Settings option The System Settings ...

Страница 241: ... Settings window is displayed 2 In the left panel click License The Set License panel is displayed on the right side of the window 3 From the license activation email or from the downloaded file copy the license key and paste it in the Update License box a When copying from the license key file lic open the file in a text editor and copy all the text in the file 4 Click Save Results The license ha...

Страница 242: ...System Settings window is displayed 2 In the left panel click Discovery The Set Discovery Configuration panel is displayed on the right side of the window 3 In the Auto Discovery proxy IP address box type the proxy server s IP address 4 Select the Use Auto Discovery check box 5 Click Save Results The Auto Discovery proxy server connection properties have been added to your system Changing login cr...

Страница 243: ...s that also service customer I O Expand the data network to four NICs in an RHEL system You can expand the data network from two to four NICs in a RHEL storage only system using the AMS Before you begin Ensure that two additional data ports are available on each server Procedure 1 From the System Settings menu upper right GUI select System Settings 2 In the System Settings pane select Management a...

Страница 244: ...or MDM and SDS New installation procedures have been instituted from v2 x and later that eliminate many of the manual tasks involved with performance tuning VxFlex OS The following table describes the commands for specific tasks Task Command To view current settings Execute the command scli query_performan ce_parameters Default is High_performance If otherwise execute the command to change to High...

Страница 245: ... for a list containing all default and performance profile parameters Set V Tree compression mode You can enable compression per V Tree for Fine Granularity Storage Pools About this task Compression is done by applying a compression algorithm to the data For more information on compression mode see V Trees on the Getting to Know guide Procedure 1 From Frontend Volumes V Tree Migration view or V Tr...

Страница 246: ...the Are you sure dialog box click OK 6 Click Close Results Compression Mode is now enabled for the Fine Granularity Storage Pool Snapshot Policies Snapshot Policies enable you to define policies where you can configure the number of snapshots to take at a given time for one or more volumes The snapshots are taken according to the rule defined You can define the time interval in between two rounds ...

Страница 247: ...ove auto snapshots they are deleted l If the source volume has locked auto snapshots you can choose to detach all snapshots They become regular snapshots as if the user created them manually If you remove them those that are not locked are removed while the auto snapshots which are locked are detached Migrate volume trees V Trees Migrate a volume and all of its snapshots to a different Storage Poo...

Страница 248: ...st priority in the migration priority queue Ignore destination capacity Allow the migration to start regardless of whether there is enough capacity at the destination Convert V Tree from Convert a thin provisioned V Tree to thick provisioned or vice versa at the destination depending on the provisioning of the source volume Note SDCs with a version earlier than v3 0 do not fully support converting...

Страница 249: ...olumes that are currently being migrated 3 Right click the volume and select Set V Tree Migration Priority 4 In the Set V Tree Migration Policy dialog box select whether to move the current V Tree migration to the head or the tail of the migration queue and click OK Pause V Tree migration You can pause a V Tree migration at any time About this task The following ways are used to pause the V Tree m...

Страница 250: ... migration is paused you can roll back the migration so that the volume and all of its snapshots are returned to the source Storage Pool Procedure 1 In the Frontend Volumes view select the V Trees display 2 Expand the list of Protection Domains and Storage Pools and select the V Tree whose migration you wish to roll back To easily identify the V Tree search the Migration column for the following i...

Страница 251: ...topics related to advanced management Chapters include Chapter 10 Common Tasks Chapter 11 System events Chapter 12 SNMP Trap Support Chapter 13 Server Factory Reset and Power Operations Chapter 14 DTK Hardware Update Bootable ISO Dell EMC VxFlex Ready Node AMS User Guide 251 ...

Страница 252: ...Reference 252 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 253: ...inux 254 l Port usage and changing default ports 255 l Prepare lockbox files for Java upgrade 257 l Move ESXi hosts to a new vCenter and reconfigure AMS 257 l Best practices for using VMware vMotion 257 l Update the hardware using the iDRAC virtual console 259 l AMS management takeover of non managed nodes 261 l Shutdown or restart a node gracefully 270 Dell EMC VxFlex Ready Node AMS User Guide 25...

Страница 254: ...s well as other volume information Volume information Linux On the SDC host run the following command to get the operating system volume information that correlates to the VxFlex OS scini device name ls l dev disk by id grep scini Output similar to the following appears This output shows the scini volume name and the volume ID By matching the volume ID in both outputs you can match the operating s...

Страница 255: ...Note Cannot be modified and must be available MDM Cluster member 9011 Protobuf over TCP opt emc scaleio mdm cfg conf txt actor_cluste r_port NEW_ PORT SVM host ADC auto detect client 33333 UDP Note Cannot be modified and must be available The ADC uses this port to listen to broadcasts and set IP requests from the ADS during the discovery process AMS ADS auto detect server 33833 UDP Note Cannot be ...

Страница 256: ...example 25641 25642 SDBG for MDM Tie Breaker 25600 SDBG for SDS 25640 AMS secure 22 SSH Note Cannot be modified and must be available The AMS uses this port to connect to the SVM and hosts via SSH during deployment and post deployment for management and monitoring AMS ICMP N A ICMP Note Cannot be modified and must be available Internet Control Message Protocol ICMP is a supporting protocol in the ...

Страница 257: ...he AMS accordingly Before you begin About this task The following steps summarize the workflow for moving ESXi hosts to a different vCenter Procedure 1 Verify that the target vCenter is up and running and is accessible 2 Connect the ESXi hosts to the new vCenter Refer to VMware guidelines on how to perform this based on your vCenter version The AMS will display alerts indicating that hosts are not...

Страница 258: ...ffic P4 1G management port 1G left port onboard AMS management network Minimal impact to AMS management traffic Figure 43 Network ports Disable VMware Admission Control Enable ESXi servers to enter maintenance mode by disabling the VMware Admission Control feature About this task Admission Control must be disabled before upgrading a VxFlex Ready Node system This procedure is relevant for administr...

Страница 259: ... to the VxFlex Ready Node firmware About this task Note For additional instructions regarding version updates following SATADOM replacement see Update the SATADOM firmware 13G servers only on page 261 Procedure 1 Make sure that the laptop or server is configured with access to the iDRAC network For details see Set up the BIOS in this publication 2 Download the VxFlex Ready Node Hardware Update Boo...

Страница 260: ...ful competition a After the update script completes press Alt F2 to access a user console and then Enter to log in b Check the log contents for errors less bundleapplicationlogs apply_components log For more information see Troubleshooting the Hardware ISO on page 343 c Press q to exit the log viewer and then Alt F1 to access the original console screen 11 Reboot the VxFlex Ready Node server and a...

Страница 261: ... virtual console on page 259 3 After the update script completes press Alt F2 to access a user console 4 Press Enter to login 5 Execute the SATADOM firmware tmp S130710K_read_log_issue satadom sh 6 Press y to begin the SATADOM update 7 Press Alt F1 to access the original console screen and then press Enter to reboot the server AMS management takeover of non managed nodes The AMS can take ownership...

Страница 262: ...ed as DirectPath n On 13G servers running ESXi all devices must be configured as DirectPath Prerequisites l On RHEL nodes ensure that the following packages are installed on every node n libx86emu n hwinfo n perccli n ipmitool n smartmontools n lshw n sg3_utils n ntp n pciutils n sas3ircu copy the file to an executable path and assign it execute permissions l Each VxFlex OS data network belongs to...

Страница 263: ...the credentials for the following n MDM admin user or LDAP admin user n iDRAC n Storage virtual machine SVM if applicable n Host ESXi Linux n Data IP addresses n Monitor user if using LDAP l All nodes must be reachable l In the AMS setup the default is to use the same credentials AMS management SVM and iDRAC for each node To assign different credentials per node SVM prepare a CSV as described in A...

Страница 264: ... change the temporary password Type and confirm a new password then click Login The AMS Initial Setup Wizard begins For a full description of this process see Deploying VxFlex Ready Node 4 In the System screen set general system preferences a Type a system name optional b Select the operating system environment Your choice here will customize the AMS setup and deployment process for the selected o...

Страница 265: ...nt Networks screen type IP address ranges for the management networks a Select the IP address version IPv4 or IPv6 in IP address version b Type IP address ranges for each management network using the options described below Note If the non AMS managed system has both ESXi and Linux nodes only type the addresses for the ESXi hosts in this step c Click Next To do this Use this Use VLAN tagging Selec...

Страница 266: ...ials b Click Test connection c Select a data center to use for the ESXi nodes d Click Finish The AMS setup is complete 10 If the non AMS managed system has both ESXi and Linux nodes add the Linux nodes otherwise skip to the next step a From the VxFlex OS GUI select System Settings Management and Data IPs b Select Disable range validation Mixed mode c Select the IP address version IPv4 or IPv6 in I...

Страница 267: ...anagement NIC renaming in CentOS 7 5 a Retrieve the NIC name and the MAC address of the management NIC by running the command ip addr b Find the NIC with the management IP address in the output 2 eno3 BROADCAST MULTICAST UP LOWER_UP mtu 1500 qdisc mq state UP qlen 1000 link ether 24 6e 96 42 3f a4 brd ff ff ff ff ff ff inet 10 234 210 3 20 brd 10 234 223 255 scope global eno3 valid_lft forever pre...

Страница 268: ...c For each MDM run the following VxFlex OS CLI SCLI command scli modify_virtual_ip_interfaces target_mdm_id MDM_ID new_mdm_virtual_ip_interface sio_d_1 sio_d_2 15 From a command line on the AMS server run this AMS CLI command Operating System of AMS server Command to run Windows C Program Files EMC scaleio AMS webapps ROOT resources scaleio_repository java jar EMC ScaleIO ams cli VERSION jar usern...

Страница 269: ... command replace_nodes_certificates l From the VxFlex OS GUI select System Settings Renew Certificates Results The AMS can now be used to manage all the nodes in the previously non managed system After you finish Perform the mandatory and optional post deployment steps described in the Post deployment section Creating a management takeover CSV file During the management takeover process you can up...

Страница 270: ...ssword2 Leading and trailing blank spaces are not supported in the username or password fields They will be truncated Shutdown or restart a node gracefully When performing tasks on a node that require it to be shutdown or restarted do so gracefully Operating system upgrades and patches as well as other maintenance activities like part replacement require shutting down or rebooting a node Gracefull...

Страница 271: ...the node is not the Master MDM anymore scli query_cluster Output similar to the following should appear with the relevant node configuration and IP addresses for your deployment Cluster Mode 5_node State Normal Active 5 5 Replicas 3 3 Virtual IP Addresses 9 20 10 100 9 20 110 100 Master MDM ID 0x775afb2a65ef1f02 IP Addresses 9 20 10 104 9 20 110 104 Management IP Addresses 10 136 215 239 Port 9011...

Страница 272: ...By SDSs table view 5 Right click the SDS node you are shutting down rebooting and select Enter Maintenance Mode 6 In the Enter maintenance mode window wait for rebuild rebalance operations to finish ensure that there are no errors and then click OK 7 When the operation finishes successfully click Close The node s IP address appears with a wrench next to it 8 On an ESXi node a Log in to the vCenter...

Страница 273: ...cally power it on manually 3 After the node is up perform the following checks in the VxFlex OS GUI a In the Monitor Alerts view make sure that no SDS disconnect message appears b If the node was an MDM cluster member in the Dashboard Management tile verify that the cluster is no longer degraded c In the Frontend tab SDCs view check the SDC to which the node IP is assigned and make sure that it is...

Страница 274: ...Common Tasks 274 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 275: ...tem events The following topics describe VxFlex Ready Node system events and alerts l System events overview 276 l Event format 276 l Viewing events 277 l Event list 280 Dell EMC VxFlex Ready Node AMS User Guide 275 ...

Страница 276: ...e failure SDC_DISCONNECTED Error An error alarm was raised by the system This error requires your attention The system is stable but could be degraded MDM_DATA_DEGRADE D Critical A major error alarm was raised by system The system requires immediate attention Some data is unavailable MDM_DATA_FAILED Event entries are documented as follows Name The name associated with the event Message The message...

Страница 277: ...nNum 0 The following is a breakdown of the event according to the fields in the event record as described above Parameter Description ID 139 Date 2013 07 22 17 21 11 694571 Name CLI_COMMAND_RECEIVED Severity INFO Message Command MAP_VOL_TO_SCSI_INITIATOR Received Extended Command MAP_VOL_TO_SCSI_INITIATOR Received Vol Name snap_raw iSCSI Initiator Name ini 21 bAllocateLunNum 1 lunNum 0 Viewing eve...

Страница 278: ... all events ending at the given date grep TEXT Displays events containing the specified text full Extends message verbosity Example opt emc scaleio mdm bin showevents py severity ERROR Viewing events in Syslog The MDM syslog service can send VxFlex OS events via TCP IP to RFC 6587 compliant remote or local Syslog servers Messages are sent with facility local0 by default Once the syslog service is ...

Страница 279: ...event message disabled by default Example scli start_remote_syslog remote_syslog_server_ip 192 168 1 10 remote_syslog_server_port 1500 Stop posting events to remote syslog servers Syntax scli stop_remote_syslog remote_syslog_server_ip IP Actual command syntax is operating system dependent For more information see CLI basics Description Notes Stops posting events to remote syslog servers Parameters...

Страница 280: ...he facility field of the event legal values 0 23 default 16 Example scli set_syslog_facility remote_syslog_server_ip 192 168 1 10 192 168 1 20 syslog_facility 20 Event list This section lists all VxFlex Ready Node events grouped by the following categories l Authentication l CLI commands l License and installation l MDM l SDC l SDS l Rebuild Authentication Authentication Failed Parameter Descripti...

Страница 281: ... Action None CLI Command Succeeded Parameter Description Name CLI_COMMAND_ SUCCEEDED Message Command X ended successfully Severity Info Description CLI command X was executed successfully Action None CLI Command Failed Parameter Description Name CLI_COMMAND_FAILED Message Command X failed with error E Severity Warning Description The CLI command X entered by user failed with error E Action Look up...

Страница 282: ...d by name Parameter Description Name SNAPSHOT_VOLUMES_FAILED_BY_NAME Message Could not snapshot volumes because a volume was not found Name s Severity Error Description This message is posted if a snapshot_volume command contains an invalid volume name out of many The CLI will only get an error code but in the event you can see which volume name is invalid Action Verify the parameters entered for ...

Страница 283: ... Parameter Description Name LICENSE_EXPIRATION_CRITICAL Message License will expire in X days Severity Critical Description System license will expire in 2 days or less Action Contact EMC Support for license renewal If you have already renewed your license install it License Expired Parameter Description Name LICENSE_EXPIRED Message License has expired Severity Critical Description The system s li...

Страница 284: ... Info Description An upgrade procedure completed successfully Action Not needed Upgrade has failed Parameter Description Name UPGRADE_FAILED Message Upgrade was not successful Reason s Severity Error Description An upgrade procedure was not able to complete Action Fix the error and retry the upgrade MDM MDM Started Parameter Description Name MDM_STARTED Message MDM Process started Severity Info De...

Страница 285: ...eter Description Name MDM_DATA_FAILED Message Some Storage Pool data is now unavailable Severity Critical Description Multiple failures have occurred Some Storage Pool data is now unavailable This data cannot be accessed Action Locate and fix the failed hardware If the problem is not resolved contact EMC Support MDM Data Normal Parameter Description Name MDM_DATA_NORMAL Message All of the Storage ...

Страница 286: ...nnected Parameter Description Name SDC_CONNECTED Message SDC IP X ID Y GUID Z reconnected Severity Info Description An existing SDC IP X ID Y GUID Z has reconnected to the MDM Action None SDC Disconnected Parameter Description Name SDC_DISCONNECTED Message SDC IP X ID Y GUID Z disconnected Severity Warning Description SDC IP X ID Y GUID Z has disconnected from the MDM Action Make sure it is expect...

Страница 287: ...erity Info Description SDS X IP Y ID Z has reconnected to the MDM If this event appears multiple times subsequently for the same SDS and not directly after SDS_DISCONNECTED it can indicate a bad network connection Action Check network connections SDS Remove Done Parameter Description Name SDS_REMOVE_DONE Message SDS X IP Y ID Z was removed successfully Severity Info Description The asynchronous pr...

Страница 288: ...ed device D on SDS X IP Y ID Z Severity Error Description Error reported on storage device D on SDS X IP Y ID Z Action Check the storage device on the server Device capacity is high Parameter Description Name DEV_CAPACITY_USAGE_HIGH Message Capacity usage on s is HIGH Severity Warning Description Capacity is high due to capacity used by snapshots thin volumes Action Remove unnecessary snapshots or...

Страница 289: ...NVALID Message CLI_TARGET_NAME_CAP s ID MOS_OBJID__FORMAT configuration is invalid Severity Critical Description The SDS cannot access its configuration files Action Contact EMC Support SDS disk errors were fixed Parameter Description Name SDS_FIX_DISK_ERROR Message CLI_TARGET_NAME_CAP s ID MOS_OBJID__FORMAT device s fixed d disk errors via reads Severity Warning Description There were read errors...

Страница 290: ...omparison of two copies of data on different devices Action Check storage device for hardware malfunction Rebuild No Rebuild Progress Warning Parameter Description Name NO_REBUILD_PROGRESS _WARNING Message No rebuild progress for 30 minutes Severity Warning Description Rebuild did not progress for 30 minutes during the current recovery Action Contact EMC Support No Rebuild Progress Error Parameter...

Страница 291: ... the current recovery Action Contact EMC Support Rebuild Progress Resumed Parameter Description Name REBUILD_PROGRESS_RESUMED Message Rebuild progress resumed Severity Info Description Following a detection of a rebuild not progressing the system has now detected that the rebuild progress has resumed The system is currently recovering Action None System events Dell EMC VxFlex Ready Node AMS User G...

Страница 292: ...System events 292 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 293: ...ing topics describe VxFlex Ready Node support for SNMP l General 294 l Supported alerts and event numbering conventions 294 l Configuring SNMP using the VxFlex OS GUI 320 l VxFlex OS mib file 321 Dell EMC VxFlex Ready Node AMS User Guide 293 ...

Страница 294: ...e event number Only TRAP commands messages are supported and are initiated by the VxFlex OS SNMP traps manager GET SET operations are not supported or more specifically GET GET NEXT GET BULK SET INFORM RESPONSE In addition to SNMP traps alert messages are also displayed in the VxFlex OS GUI Supported alerts and event numbering conventions The following alerts can be sent as SNMP traps by VxFlex OS...

Страница 295: ... GUI REST and ESRS This table summarizes alerts generated by VxFlex OS systems Table 34 VxFlex OS Alerts in SNMP VxFlex OS GUI REST and ESRS Alert Message in VxFlex OS GUI Alert Message in REST Alert Message in SNMP Trap Alert Code for ESRS Severity Recommended Action License expired LICENSE_EXPIRED System License License_Expire d SIO01 02 000 0001 5 Critical To resume operational mode contact EMC...

Страница 296: ...blem with network links fix and restart the counters Invalid MDM monitoring credentials are configured in the AMS AMS_CONFIGURATION _INVALID_MDM_CRED ENTIALS System Creden tials Ams_Confi guration_Invalid _Mdm_Credent ials SIO01 04 000 0003 5 Critical Check the MDM credentials configured in the AMS and modify them if necessary The AMS cannot connect to the MDM cluster but the cluster itself is ope...

Страница 297: ...s is not possible reduce the spare policy while maintaining enough spare to sustain a rebuild if necessary The MDM cluster is degraded and data is not protected CLUSTER_DEGRADED MDM MDM_Cl uster CLUSTER _DEGRADED SIO02 01 000 0007 3 Error 5 Critical Check that all MDM cluster nodes are functioning correctly and fix and replace faulty nodes if necessary in order to return to full protection Cannot ...

Страница 298: ...Pool has degraded capacity STORAGE_POOL_HAS_ DEGRADED_CAPACITY MDM Storage_ Pool Storage_P ool_has_Degra ded_Capacity SIO02 04 000 0002 3 Error For the given Storage Pool for some blocks one of the two copies is inaccessble Check if a server is offline or if there is another server hardware related issue Check if a storage device is down Capacity utilization above critical threshold CAPACITY_UTILI...

Страница 299: ...isks from the large SDS to the others or add disks to the smaller SDS in order to approximate the capacity of the large SDS as much as possible Storage Pool does not meet the minimum requirement of 3 fault units NOT_ENOUGH_FAULT _UNITS_IN_SP MDM Storage_ Pool Not_Enou gh_Fault_Units SIO02 04 000 0010 3 Error Add more SDSs to the Storage Pool to meet the minimum requirement of 3 hosts In the Storag...

Страница 300: ...TED SIO02 05 00 00005 5 Critical Check the certificate and trust it if you see fit to do so MDM does not support secure connections MDM_SECURE_CONNE CTION_NOT_SUPPORT ED MDM CERTIFIC ATE MDM_SEC URE_CONNEC TION_NOT_SU PPORTED SIO02 05 00 00006 5 Critical Check MDM cluster nodes The validity period of the certificate presented by the Master MDM starts in the future MDM_CERTIFICATE_N OT_YET_VALID MD...

Страница 301: ...was switch related Otherwise the issue may be due to a faulty NIC which requires NIC replacement Memory allocation for RAM Read Cache failed on SDS SDS_RMCACHE_MEM ORY_ALLOCATION_FAI LED SDS SDS SDS_ Rmcache_Mem ory_allocation_ Failed SIO03 01 000 0003 2 Warning The system failed to allocate memory to the SDS RAM Read Cache For 32 GB RAM or less up to 50 of the memory can be allocated for caching ...

Страница 302: ...l operation Increase the amount of available RAM RFcache driver path is invalid RFCACHE_INVALID_DR IVER_PATH SDS SDS RFCA CHE_INVALID_ DRIVER_PATH SIO03 01 000 0009 2 Warning The Read Flash cache driver xcache is either not installed or was installed in the wrong location Install the driver and contact Customer Support if the problem persists RFcache source configuration is not consistent RFCACHE_...

Страница 303: ...vice is pending activation DEVICE_PENDING_ACT IVATION SDS Device De vice_Pending_ Activation SIO03 02 000 0002 2 Warning The SDS device has been added and tested Activate the SDS device Device has fixed read errors FIXED_READ_ERROR_ COUNT_ABOVE_WARN ING_THRESHOLD SDS Device FIX ED_READ_ERR OR_COUNT_A BOVE_WARNI NG_THRESHO LD SIO03 02 000 0003 3 Error if counter 0 Read from the SDS device failed Da...

Страница 304: ...ESHOLD Storage_Contr oller Physical_D rive Endurance _Used_Above_ Threshold SIO06 01 000 0004 5 Critical Replace the SSD device The Physical Disk temperature has exceeded the configured threshold PHYSICAL_DRIVE_INVA LID_TEMPERATURE Storage_Contr oller Physical_D rive INVALID_T EMPERATURE SIO06 01 000 0005 5 Critical 3 Error Ensure that the server and its environment are properly cooled Ensure that...

Страница 305: ...Y Storage_Contr oller Logical_Di sk INVALID_CA CHE_POLICY SIO06 02 00 00005 3 Error Access the storage controller and change the RAID0 caching policy for the Logical Disk to DirectIO Logical disk is no longer being cached LOGICAL_DISK_NO_LO NGER_CACHED Storage_Contr oller Logical_Di sk LOGICAL_DI SK_NO_LONG ER_CACHED SIO06 02 00 00006 3 Error Disable the Physical Drive physical cache Note This may...

Страница 306: ...ntroller Invali d_State SIO07 02 000 0001 5 Critical The storage controller may be faulty and should be replaced The storage controller temperature has exceeded the configured threshold STORAGE_CONTROLL ER_INVALID_TEMPERA TURE Node Storage_ Controller Invali d_Temperature SIO07 02 000 0002 5 Critical 3 Error Ensure that the server and its environment are properly cooled and that all the chassis fa...

Страница 307: ...ctive The CPU Voltage Regulator s temperature is higher than the configured threshold CPU_SOCKET_INVALID _VR_TEMPERATURE Node Cpu_Soc ket INVALID_V R_TEMPERAT URE SIO07 03 000 0005 5 Critical 3 Error Make sure that the server is properly cooled and that the CPU and internal chassis fans are active The CPU Voltage Regulator s voltage is not within the configured threshold CPU_SOCKET_INVALID _VR_VOL...

Страница 308: ...nctional The voltage values on the node are not within the configured threshold NODE_INVALID_VOLTA GE Node Node INV ALID_VOLTAG E SIO07 05 000 0002 5 Critical 3 Error 1 Verify that the power supply is functioning correctly and then try to replace a port in the Power Distribution Unit or check with external power 2 Replace the power cable 3 Replace the Power Supply Module Unable to connect to monit...

Страница 309: ... state in vCenter and try to open the SSH or the console via BMC http to it Then check the messages log for errors Unable to connect to monitoring agent VCenter NODE_FAILED_TO_CO NNECT_TO_VCENTER Node Node FAI LED_TO_CON NECT_TOVCE NTER SIO07 05 000 0008 5 Critical Ensure that the vCenter configuration is correct and ensure that the node s Mgmt port is routable to the vCenter IP address Node seria...

Страница 310: ... the AMS Failed to connect to the host The SSH key has been changed and is not trusted by the AMS NODE_FAILED_TO_CO NNECT_TO_HOST_SS H_KEY_MISMATCH Node Node Nod e_Failed_To_C onnect_To_Hos t_Ssh_Key_Mis match SIO07 05 000 0018 5 Critical This is a security issue Remove the node and add the node again to the AMS Failed to connect to the SVM The SSH key has been changed and is not trusted by the AM...

Страница 311: ...t your Support Sales representative to get an EMC ESRS support package ESRS number of messages received has been reached No more messages will be sent in the next 8 hours ESRS_REACHED_CAPA CITY_LIMIT Esrs Esrs REAC HED_CAPACIT Y_LIMIT SIO10 01 000 0005 5 Critical ESRS has a limit of receiving up to 200 alerts per 8 hours The limit has been reached so no ESRS messages will be sent in the following ...

Страница 312: ... have an approved IP address SDC_DOES_NOT_HAV E_APPROVED_IPS System SDC Sd c_Does_Not_H ave_Approved_ Ips SIO01 07 000 0009 2 Warning Update the list of approved IP addresses for this SDC SDC has an IP address that is not approved by the MDM SDC_HAS_UNAPPROV ED_IP System SDC Sd c_Has_Unappr oved_Ips SIO01 07 000 0010 3 Error Add the IP address for this SDC to the list of approved IP addresses Some...

Страница 313: ...006 3 Error Disable the Physical Drive physical cache Note This may cause DI issues in power cycle scenarios Device was requested to use as DAS Cache but it is not DEVICE_SHOULD_ USE_AS_DAS_CAC HE_BUT_IT_IS_NO T Storage_Controller Physical_Drive Devi ce_Should_Use_As _Das_Cache_But_It _Is_Not SIO06 01 000 0007 3 Error The Logical Disk read policy is not set to Read Ahead LOGICAL_DISK_INV ALID_READ...

Страница 314: ...ackup battery in the storage controller may be nearing the end of its working life Replace the battery The storage controller battery temperature is not within the configured threshold BATTERY_INVALID _TEMPERATURE Storage_Controller Battery INVALID_TE MPERATURE SIO06 03 000 0003 3 Error Check the temperature in the server and at the data center Check if a fan alert is raised in the node Check the ...

Страница 315: ... NODE_FAILED_TO _QUERY_RAID_CO NTROLLER_INVALI D_PERMISSIONS Node Storage_Cont roller NODE_FAILE D_TO_QUERY_RAI D_CONTROLLER_I NVALID_PERMISSI ONS SIO07 02 000 0005 5 Critical Verify that the user name and password of the Storage VM match the user name and password configured in the AMS System Settings menu System Settings Security option Resolve the differences and try again The physical CPU sock...

Страница 316: ...nment are properly cooled and that all the chassis fans are functional RAM voltage regulator s temperature is not within threshold RAM_INVALID_VR_ TEMPERATURE Node Ram INVALID _VR_TEMPERATUR E SIO07 04 000 0002 5 Critical 3 Error Ensure that the server and its environment are properly cooled and that all the chassis fans are functional RAM voltage regulator s voltage is not within threshold RAM_IN...

Страница 317: ...tical The SVM IP address or User credentials do not respond to AMS queries Check the SVM state in vCenter and try to open the SSH or the console to it Then check the message log for errors Unable to connect to monitoring agent ESX NODE_FAILED_TO _CONNECT_TO_E SX Node Node FAILED_ TO_CONNECT_TO _ESX SIO07 05 000 0007 5 Critical The ESX IP address or User credentials do not respond to AMS queries Ch...

Страница 318: ...che device from the cache pool and add it back again Host certificate is about to expire HOST_CERTIFICAT E_ABOUT_TO_EXP IRE Node Node HOST_ CERTIFICATE_ABO UT_TO_EXPIRE SIO07 05 000 0014 3 Error Renew the AMS certificate and then run renew certificate process CMOS battery state is invalid NODE_INVALID_C MOS_BATTERY Node Node Invalid_ Cmos_Battery SIO07 05 000 0015 3 Error Check the node s CMOS bat...

Страница 319: ...l Disable AMS secure connection and enable it again in order to automatically sign the MDM certificate If the previous solution does not work remove and add the the MDM again in secure mode CPU cache is not enabled SOCKET_CACHE_D ISABLED Cpu_Socket Socket _Cache Disabled SIO08 01 000 0001 3 Error Enable the CPU cache in the server BIOS CPU cache size is not optimal SOCKET_CACHE_S IZE_NOT_MAX_SIZ E...

Страница 320: ... 5 Critical Enable NVDIMM interleave in BIOS settings Persistent Memory must be enabled in BIOS when NVDIMM devices are present NVDIMM_PERSIST ENT_MEMORY_DIS ABLED Node Ram Invalid_P ersistent_Memory_ Bios_setting SIO07 04 000 0005 5 Critical Enable Persistent Memory in BIOS settings NVDIMM battery state is low NVDIMM_BATTERY _INVALID_STATE Node Ram NVDIMM _Battery Invalid_Sta te SIO07 04 000 0006...

Страница 321: ... the new Port box 5 Type a number in the Resend Frequency box Typing 0 will make the system use the default which is a resend frequency of 10 seconds 6 To send a test SNMP trap click Test 7 Click Save Results The SNMP configuration has been added to the system VxFlex OS mib file The following text is the content of the scaleio mib file Note The object source identifier in the trap MDM MDM_Cluster ...

Страница 322: ...ertSourceObjectId OBJECT TYPE SYNTAX DisplayString SIZE 0 255 MAX ACCESS accessible for notify STATUS current DESCRIPTION Object id for which the alert was created scaleioAlert 3 1 3 6 1 4 1 1139 101 1 4 scaleioAlertActionCode OBJECT TYPE SYNTAX DisplayString SIZE 0 255 MAX ACCESS accessible for notify STATUS current DESCRIPTION Action code of the alert scaleioAlert 4 1 3 6 1 4 1 1139 101 1 5 scal...

Страница 323: ...eioAEAlert STATUS current DESCRIPTION scaleio MIB V2 NOTIFICATION GROUP scaleioGroups 2 scaleioAEAlert NOTIFICATION TYPE OBJECTS scaleioAlertSeverity scaleioAlertType scaleioAlertSourceObjectId scaleioAlertActionCode STATUS current DESCRIPTION ScaleIO Alert scaleio 2 END SNMP Trap Support Dell EMC VxFlex Ready Node AMS User Guide 323 ...

Страница 324: ...SNMP Trap Support 324 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 325: ...Operations The following topics explain how to open a Dell iDRAC console session how to perform power operations and how to perform a factory reset l Perform a factory reset 326 l KVM activities 335 Dell EMC VxFlex Ready Node AMS User Guide 325 ...

Страница 326: ... update the BIOS firmware and settings as described in Updating the BIOS firmware and settings Note For deployments using AMS the AMS updates the firmware during deployment 5 Map the ISO file as described in Map the ISO file on a server Set up the iDRAC IP address and BIOS Set up the iDRAC IP address and set up or validate the BIOS on the VxFlex Ready Node servers Before you begin Ensure that you ...

Страница 327: ...the IPv4 parameter values for the iDRAC port l Enable IP IPv4 Enabled l Enable DHCP Disabled l Static IP Address Static IP address l Static Gateway Gateway IP address l Static Subnet Mask Subnet mask IP address d From the IPv6 Settings pane configure the IPv6 parameter values for the iDRAC port e From the IPMI Settings pane verify the following parameter values l Enable IPMI Over LAN Enabled l Cha...

Страница 328: ...evices a Select Integrated Devices The System BIOS Settings Integrated Devices screen appears b Set SR IOV Global Enable to Enabled c Verify that the Internal USB Port parameter is set to Off d Click Back to return to the System BIOS Settings screen 10 From the System BIOS Settings screen click Finish Yes and then OK to return to the System Setup Main Menu screen 11 Select Finish to exit the BIOS ...

Страница 329: ...For example PERC H730 Mini Embedded 6 In the navigation pane select Storage Physical Disks Information about the physical disks is displayed in a table in the Health and Properties pane 7 Verify that no disk is in failed state If any of the disks is failed refer to the relevant Disk Replace FRU 8 In the navigation pane select Server 9 In the System Inventory pane verify that the server drivers and...

Страница 330: ...ation pane select Storage Physical Disks A table displays information regarding the physical disks and an option to Blink Unblink the selected disk 7 Verify that no disk is in failed state If any of the disks is failed refer to the relevant Disk Replace FRU 8 In the navigation pane select System 9 In the Inventory pane verify that the server drivers and firmware in the Firmware Inventory list matc...

Страница 331: ...ur browser perform the following steps Browser Steps Firefox a Click Launch Virtual Console The What should Firefox do with this file window appears with the Open with Java Web Start Launcher option selected b Click OK c Scroll through the successive pop up windows then click Run to launch the console Google Chrome a Click Show all downloads b In the Downloads window at the warning message click K...

Страница 332: ...f downloads run automatically the console window appears If not follow the instructions given in the next step to open the console window 5 Depending on your browser perform the following steps Browser Steps Firefox a Click Launch Virtual Console The What should Firefox do with this file window appears with the Open with Java Web Start Launcher option selected b Click OK c Scroll through the succe...

Страница 333: ...e DTK ISO for initial firmware update For information see DTK Hardware Update Bootable ISO in the reference section of this publication 6 From the Next Boot menu choose the Virtual CD DVD ISO This option will make the server install the ISO the next time that the server boots up 7 To reset the server in the main DELL System Setup console window select Power Reset System warm boot to display the li...

Страница 334: ...lect Power Rest System warm boot to display the list of keyboard keys with related functionality b Refer to the best practices of DELL OS installation How to Install an Operating System on Dell PowerEdge Servers Ensure that you select the BOSS device as the OS install target drive The server boots using the OS ISO file and finishes the installation 7 If the node contains a factory installed OS the...

Страница 335: ...The LED stops blinking Retrieve the chassis serial number a Click the Properties menu option in the menu bar select Details The System Details window is displayed b In the Main System Chassis pane check the chassis serial number in the Node Id field Power up down the server a In the Quick Launch Tasks pane click Power ON OFF b Click OK Additional tasks using the KVM console for VxFlex Ready Node R...

Страница 336: ... LEDs are displayed 2 To retrieve the chassis serial number in the dashboard click System Details The service tag is displayed with the corresponding serial number 3 To power the server off or on use of the following methods l From the dashboard click Graceful Shutdown Power Off and then click OK l From the dashboard select Power Management Power Control Power Off System Power On System Server Fac...

Страница 337: ...section provides additional information on using the VxFlex Ready Node Hardware Update Bootable ISO Hardware ISO to update drivers BIOS and firmware on VxFlex Ready Node servers l Dell OpenManage DRAC Tools RACADM 338 l Update the SATADOM firmware 13G servers only 340 l Recommended BIOS and firmware settings 341 l Troubleshooting the Hardware ISO 343 l Additional resources 346 Dell EMC VxFlex Read...

Страница 338: ...ool from any management system with access to the iDRAC network The remote RACADM command set is useful in this situation to mount and execute the Hardware ISO to a large number of VxFlex Ready Node servers This prevents the need for multiple web browser windows and manual keyboard and mouse clicks for each server About this task Note For additional instructions regarding version updates following...

Страница 339: ... in a state in which it can be power cycled The OS should be in maintenance mode as needed 9 Power cycle the VxFlex Ready Node server racadm r dracIP u root p password serveraction graceshutdown 10 Repeat steps 6 on page 339 9 on page 339 for each VxFlex Ready Node server needing the BIOS and firmware updates and configuration All servers can be updated in parallel 11 Wait for the configuration an...

Страница 340: ...eue view Any job failures may require running the bootable ISO again or further troubleshooting 15 For each server after the hardware updates are finalized clean up the iDRAC job queue racadm r dracIP u root p password jobqueue delete all 16 Continue with OS installation and configuration VxFlex OS deployment and other required tasks Update the SATADOM firmware 13G servers only The Dell factory sh...

Страница 341: ...dy Node servers In the event of a system board failure the Hardware ISO can assist with the reinstallation of the ID module on the replacement system board BIOS and firmware The Hardware ISO runs a script that automatically forces the server to install the necessary firmware updates This firmware is consistent with the qualified Dell EMC VxFlex Ready Node Driver and Firmware Matrix located at l Po...

Страница 342: ...erver Boot Mode BIOS BiosBootSettings Boot Mode Bios SRIOV Global Enablement BIOS IntegratedDevices Sriov GlobalEnable Enabled Memory Performance Tuning BIOS MemSettings SnoopMo de EarlySnoop System Change Tracking BIOS MiscSettings InSystem Characterization Disabled CPU Virtualization Features BIOS ProcSettings ProcVirtu alization Enabled CPU Cores BIOS ProcSettings ProcCores All CPU X2APIC Mode ...

Страница 343: ... r dracIP u root p password jobqueue create BIOS Setup 1 1 value Troubleshooting the Hardware ISO This section describes troubleshooting procedures for problems you may encounter while using the Hardware ISO Troubleshoot general iDRAC failures When problems occur with iDRAC or Lifecycle Controller jobs you can delete all jobs with a single iDRAC command All of the completed jobs plus any orphaned ...

Страница 344: ...ry l In the server s Attached Media screen disconnect the iDRAC Remote File Share from the iDRAC browser l Disconnect the iDRAC remote image racadm r dracIP u root p password remoteimage d Where n dracIP is the iDRAC IP address n password is the password for the server Note The default password is calvin for 13G nodes and Scaleio123 for 14G nodes 2 Issues when booting to iDRAC virtual media may ca...

Страница 345: ...ess Alt F2 to access a user console and then press Enter 2 Open the log to check the contents for errors less bundleapplicationlogs apply_components log 3 You can also view the script for the Hardware ISO which is useful in helping to identify and troubleshoot log entries less opt dell toolkit systems drm_files apply_bundles sh Results The script attempts to configure several boot order commands r...

Страница 346: ...ntinue this functionality At the heart of the servers embedded management is the iDRAC with Lifecycle Controller LC technology This technology allows users to perform useful tasks such as configuring BIOS and hardware settings deploying operating systems updating drivers changing RAID settings and saving hardware profiles Together they provide a robust set of management functions that can be lever...

Страница 347: ...For more information visit the Dell OpenManagement Deployment Toolkit wiki homepage DTK Hardware Update Bootable ISO Dell EMC VxFlex Ready Node AMS User Guide 347 ...

Страница 348: ...DTK Hardware Update Bootable ISO 348 Dell EMC VxFlex Ready Node AMS User Guide ...

Страница 349: ...ache RMcache as well as SSD Flash devices RFcache for caching reads VxFlex OS cache uses recently accessed LRU data readily available to manage caching I Os read from cache have a lower response time than I Os serviced by the drives In addition cached I Os reduce the data drive workload which in many cases is a performance bottleneck in the system CacheCade Read and Write caching of storage device...

Страница 350: ...lure scenarios if rack power outages occur Forward Rebuild Data in storage will be rebuilt on another server due to planned or unplanned shutdown of a server I ID Identifier a unique sequence of characters that identifies an object in the system In some CLI commands an ID can be used to specify a system component IP Role The role of the IP address configured for an SDS Each SDS can have several IP...

Страница 351: ...ight chassis and is the equivalent of a standard rack mounted server 2U 4 Node the nodes can be supplied with various processor RAM and I O profiles Each node occupies a specific slot in the 2U height chassis and uses 6 disks out of 24 in the chassis Each node is independent of the others in the same chassis similar to blade servers P Page Size The page size typically in KB used for caching purpos...

Страница 352: ...hich the SDC is installed SDS Storage Data Server which manages the capacity of a single server and acts as a back end for data access The SDS is installed on all servers contributing storage devices to VxFlex OS Secondary MDM See Slave MDM Single Mode A single MDM manages the VxFlex OS network This mode has no backup protection and should not be used in production environments Slave MDM An MDM in...

Страница 353: ...ool by configuring rebuild and rebalance policies Tie Breaker The Tie Breaker TB is an MDM that does not have a manager role whose sole purpose is to help determine which MDM module is the manager that will become the master MDM and take control over the VxFlex Ready Node cluster The Tie Breaker ensures that there will always be one Master MDM achieving cluster quorum In a 3 node cluster there is ...

Страница 354: ...Glossary 354 Dell EMC VxFlex Ready Node AMS User Guide ...

Результаты поиска

Содержание EMC VxFlex Ready Node

Отзывы:

Похожие инструкции для EMC VxFlex Ready Node

Бренды по названию

Популярные бренды

Dell EMC VxFlex Ready Node, Руководство пользователя

Результаты поиска

Содержание EMC VxFlex Ready Node

Отзывы:

Похожие инструкции для EMC VxFlex Ready Node

Бренды по названию

Популярные бренды