manualshive.com logo in svg

HP VMA Series, Installation And Service Manual

Share
Download
HP VMA Series Installation And Service Manual Download Page 222

Appendix D - CLI Reference

222

VMA-series Memory Array Installation and Service Guide

HP-AM456-9002A Rev 01

Syntax

context controller

The system prompt changes to the following:

context fan-tray

Moves to the specified Fan-tray context level. See 

Fan-tray Context Commands

 

on page 243.

Syntax

context fan-tray {1 | 2}

Where:

The system prompt changes to the following for the top fan tray:

The system prompt changes to the following for the bottom fan tray:

chassis controller>

1

Indicates the top fan tray context level.

2

Indicates the bottom fan try context level

chassis fan-tray 1>

chassis fan-tray 2>

Summary of Contents for VMA Series

Page 1: ...rray This document is intended for experienced service technicians HP assumes that you are qualified in the servicing of computer equipment are trained in recognizing hazards in products with hazardous energy levels and are familiar with weight and stability precautions for rack installations HP VMA series Memory Array Installation and Service Guide ...

Page 2: ...ls and licenses are identified in this document and or at www violin memory com legal Violin assumes no responsibility for any typographical technical or other error or omission in this document Violin reserves the right to periodically change the information contained in this document but Violin makes no commitment to provide any such changes updates enhancements or other additions in a timely ma...

Page 3: ...ction against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case you ar...

Page 4: ...4 VMA series Memory Array Installation and Service Guide HP AM456 9002A Rev 01 ...

Page 5: ...terfaces 29 Storage Interfaces 29 System Specifications 31 Direct attached Host Computer Requirements 31 CHAPTER 2 Violin Intelligent Memory Modules 33 Violin Intelligent Memory Modules VIMMs 34 VIMM Types 34 VIMM Configurations 35 VIMM Slot Locations 35 42 Module Configuration 36 PART II Operation CHAPTER 3 Installing the Array 39 Installation and Configuration Overview 40 Required Installation T...

Page 6: ...omain Name System DNS 67 Configuring the DNS Name 67 Configuring the DNS Search Domain Name 68 Displaying the DNS Mode and Pre provisioned Information 68 Setting the DNS Mode 69 Verifying the Ethernet Connection 70 Displaying and Setting System Log Syslog Options 71 Displaying the Configured IP Address of the Syslog Host 71 Setting the IP Address for the Syslog Host 72 Determining the Status of th...

Page 7: ...g the Memory Array 98 Rebooting the System 98 Canceling a Scheduled Reboot 98 Displaying the Scheduled Reboot 99 Upgrading the System Software 100 Using SCP 101 Restoring the Factory Default Settings 103 Displaying the Upgrade Path 105 Updating the System Software Factory Image 105 CHAPTER 6 Servicing the Array 107 Guidelines for Servicing the System 108 Safety Precautions 108 ESD Precautions 108 ...

Page 8: ...es 145 Verifying Devices Are Attached As SCSI Devices 147 Expand the Disk Drives node to view the Memory Array SCSI Disk Device 148 Removing the Violin Utilities 148 A dialog box appears confirming that the Violin Utilities have been deleted 148 CHAPTER 9 Violin Utilities 149 Understanding the Violin Utilities 150 Installing the Violin Utilities 150 Running the Violin Utilities 150 Violin Utilitie...

Page 9: ...ffecting Alarms 190 Equipment Service Affecting Alarms 191 Flash Service Affecting Alarms 191 Port Service Affecting Alarms 192 Power Service Affecting Alarms 192 RAID Service Affecting Alarms 193 System Service Affecting Alarms 194 Temperature Service Affecting Alarms 195 VIMM Service Affecting Alarms 196 Non Service Affecting Alarms 196 Temperature Non Service Affecting Alarms 197 Equipment Non ...

Page 10: ...hernet 0 237 Ethernet 0 Context Commands 238 set dhcp 238 set ip address 239 clear ip address 239 set dns config 239 set dns nameserver 240 clear dns nameserver 240 set dns search 240 clear dns search 241 show 241 reset 242 Fan tray Context Commands 243 context fan 243 Fan Context Commands 244 show 244 CLI Context Commands 245 set columns 245 set edit mode 246 set history size 246 set idle timeout...

Page 11: ... 266 show clock source 267 show log 267 show messages 268 show name 269 show reboot 269 show status 270 Alarms Context Commands 273 show 273 Boot params Context Level 275 set stagger mem clear 275 show stagger mem clear 276 LED state Context Commands 277 show 277 Logging Context Commands 279 context in memory 279 context syslog 280 In memory Context Commands 281 context category 281 set default le...

Page 12: ...Table of Contents 12 VMA series Memory Array Installation and Service Guide HP AM456 9002A Rev 01 show path 296 Uptime Context Commands 297 show 297 Version Context Commands 298 show 298 ...

Page 13: ...cations 48 Figure 3 7 Connecting the Serial Cable to the Memory Array 51 Figure 3 8 Connecting the Serial Cable to the Host Computer 51 Figure 3 9 Connecting the Ethernet Cable to the Memory Array 52 Figure 3 10 Connecting the PCIe Cable to the Host Computer 53 Figure 6 1 Replacing a Fan Module 111 Figure 6 2 Replacing an AC Power Supply 112 Figure 6 3 Inserting the Replacement VIMM 114 Figure 7 1...

Page 14: ...RAID Group Maps Context Level 255 Figure D 15 System Context Level 257 Figure D 16 System Alarms Context Level 273 Figure D 17 System Boot params Context Level 275 Figure D 18 System LED State Context Level 277 Figure D 19 System Logging Context Level 279 Figure D 20 System Logging In Memory Context Level 281 Figure D 21 System Logging In Memory Category Context Level 285 Figure D 22 System Loggin...

Page 15: ...ngs 58 Table 4 2 Changing the Default System Settings 62 Table 4 3 Syslog Definition Mappings 71 Table 5 1 Displaying IP Information 87 Table 5 2 Upgrade Image Names 100 Table 5 3 Downloading Methods and Example Paths 101 Table 7 1 Memory Array Commands for Viewing Linux Driver Information 127 Table 8 1 Command Line Utilities for Displaying Windows Driver Information 144 Table 9 1 vring Utility Pa...

Page 16: ...s 253 Table D 16 Maps Context Commands 255 Table D 17 System Context Commands 257 Table D 18 Alarms Context Commands 273 Table D 19 Boot params Context Commands 275 Table D 20 LED State Context Commands 277 Table D 21 Logging Context Commands 279 Table D 22 In memory Context Commands 281 Table D 23 Message Categories 282 Table D 24 Category Context Commands 285 Table D 25 Syslog Context Commands 2...

Page 17: ...mory Array and its features components and specifications Chapter 2 Violin Intelligent Memory Modules Describes the VIMM technology including types configurations and slot locations PART II Operation Chapter 3 Installing the Array Describes how to install the Memory Array Chapter 4 Configuring the Array Describes how to perform the initial configuration of the Memory Array Chapter 5 Operating the ...

Page 18: ...pliance Information Contains compliance notices and information for the Memory Array Appendix C Alarm Reference Describes the various system alarms that may occur when using the Memory Array Appendix D CLI Reference Describes the commands available in the Memory Array command line interface Document Conventions Safety Icons The table below summarizes warning caution and note icons used in this doc...

Page 19: ...e hp com country us en wwcontact html For HP technical support In the United States for contact options see the Contact HP United States webpage http welcome hp com country us en contact_us html To contact HP by phone Typographical Conventions Format Meaning Bold User Interface text Italic Provides emphasis and identifies variables and document titles Courier Command names examples and output Cour...

Page 20: ...Packs refer to the HP website http www hp com hps In other locations see the Contact HP worldwide in English webpage http welcome hp com country us en wwcontact html For software drivers and firmware downloads 1 Go to http www hp com support downloads 2 In the Search field on the right hand side of the page enter the exact product name 3 Select your product 4 Select your operating system or Cross ...

Page 21: ...PART I Product Overview Chapter 1 VMA series Overview Chapter 2 Violin Intelligent Memory Modules ...

Page 22: ......

Page 23: ...y is the result of a partnership with Violin Memory Inc and is based on the Violin 3000 Series Memory Array HP and Violin have jointly tested and certified the system with Linux Windows and HP UX servers Features on page 24 Physical Components on page 24 Connectivity and Interfaces Overview on page 28 System Specifications on page 31 Direct attached Host Computer Requirements on page 31 ...

Page 24: ...e configuration it directly connects via PCI Express PCIe to one or two host computers running Windows or Linux or to a Memory Gateway Alternatively it may be connected to a storage area network SAN via Fibre Channel or Ethernet iSCSI Is designed for highly reliable data center operation The system is built with spare Power Supplies Fans and Violin Intelligent Memory Modules VIMMs Physical Compone...

Page 25: ...ds The LCD should display that the system is shutdown and it is safe to remove the power cords if desired Note The array is not actually powered off when using the power button Instead the array is logically shut down and the data paths are disabled placing the array in a safe mode for removing power cords Before turning off power to the Memory Array shut down any direct attached hosts Rear View T...

Page 26: ... A B AC OK Indicates that the AC power feed to Power Supplies A and B are connected correctly Green DC OK Indicates that the DC power feed from Power Supplies A and B are operational Green RAID ADMIN Status Indicates the system status When lit the LED could be Flashing slowly Indicates that the system monitor is booting up Flashing quickly Indicates that the system software is booting up the VIMMs...

Page 27: ...Description Color When Lit Status Indicates the system status When lit the LED could be Flashing slowly Indicates that the system monitor is booting up Flashing quickly Indicates that the system software is booting up the VIMMs are being detected and programmed and no RAID groups have been created Solid green Indicates that the VIMMs are programmed that the RAID groups are created and that the sys...

Page 28: ...ng This level of power cannot be supplied through a single 110 V power supply It is required that each power supply be provided a circuit of over 200 V with 7 A budgeted 42 VIMM and below configurations require less than 700 W of power A circuit of over 200 V is recommended but 110 V may be used Fans Six fans are located in the front of the chassis and provide forced ventilation for the Memory Arr...

Page 29: ...Ie x8 Gen1 default interface or dual PCIe x4 Gen2 option interfaces that can directly connect to a host computer via a PCIe driver or to a Memory Gateway The optional memory gateways provide specific network interfaces and functions such as SAN block storage or NFS caching Note The VMA series Memory Array does not currently support dual PCIe connections PCIe Direct Attach PCIe provides the lowest ...

Page 30: ...configuration allows each host to read and write to the same address space When two hosts write to the same address however no guarantees are made for the order in which the operations are performed hosts must manage potential conflicts via a clustered file system e g GPFS or some other technique Fibre Channel and iSCSI SAN Attach vSHARE vSHARE provides scale out block storage SAN capability Memor...

Page 31: ...Ambient Operating Temperature 5 C to 35 C Short Term 5 C to 40 C Operating Humidity 5 to 85 Non Condensing Short Term 5 to 90 Non Condensing Interfaces x8 PCIe Interface 2 Note When both PCIe interfaces are used they become x4 Serial Interface via DB 9 male DTE port 10 100 Ethernet port Logging Syslog Management CLI Serial Telnet SSH Physical Height 5 19 3U 132 mm Depth 28 38 721mm Width 16 915 43...

Page 32: ...t Computer or Memory Gateway on page 53 for more information Supported Operating Systems Red Hat Enterprise Linux 5 6 SUSE Linux Enterprise Server 11 SP1 Windows Server 2008 R2 Serial communications application such as vtkermit tip minicom kermit hyperterm teraterm and PuTTY Table 1 4 Direct attached Host Computer Requirements Minimum Requirements ...

Page 33: ...telligent Memory Modules This chapter describes the Violin Intelligent Memory Module VIMM technology types configurations and slot locations in the following sections Violin Intelligent Memory Modules VIMMs on page 34 VIMM Types on page 34 VIMM Configurations on page 35 VIMM Slot Locations on page 35 ...

Page 34: ...ty VIMMs and four spare VIMMs for failure protection All memory modules are hot swappable with automated rerouting that will not interrupt data service In the case of a module failure where the module must be replaced the Memory Array does not have to be powered down Figure 2 1 VIMMs WARNING Insert VIMMs or VIMM blanks only otherwise permanent system damage will result VIMM Types The Memory Array ...

Page 35: ... VIMM Configurations The Memory Array holds up to 84 VIMMs which operate in the VIMM configurations listed in the following table VIMM Slot Locations The Memory Array is available in several VIMM configurations Table 2 3 lists the VIMM slot numbers used for each configuration Use the information in the table when adding removing or replacing a non working VIMM to ensure that the VIMMs are still in...

Page 36: ... following figure Figure 2 2 VIMM Slot Locations 42 Modules All remaining slots must contain blank filler VIMMs The default spare VIMMs are located at slots 71 and 75 54 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 00 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 09 08 07 06 05 04 03 02 01 30 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37...

Page 37: ...PART II Operation Chapter 3 Installing the Array Chapter 4 Configuring the Array Chapter 5 Operating the System via the CLI Chapter 6 Servicing the Array ...

Page 38: ......

Page 39: ...ns Installation and Configuration Overview on page 40 Rack Mounting the Chassis on page 42 Connecting the PCIe Cable to the Memory Array on page 46 Connecting Power on page 47 Connecting Management Network on page 50 Connecting the PCIe Cable to a Host Computer or Memory Gateway on page 53 Routing the Cables onto the Cable Management Arm on page 55 Powering up the Memory Array on page 56 ...

Page 40: ...ng the Array Phase 3 direct attach storage configuration is described in Chapter 7 Linux Drivers and Chapter 8 Windows Drivers for Linux and Windows respectively for SAN vSHARE configuration details refer to the vSHARE Memory Gateway Installation and User s Guide Phase 4 performance testing and tuning is described in Chapter 10 Performance Tuning and Troubleshooting and 2 Rack Mounting the Chassis...

Page 41: ...nstallation Tools and Equipment The table below lists the tools and equipment required during the installation process Table 3 1 Required Installation Tools and Equipment Item Item Description Quantity 1 Laptop for console access DB 9 serial connector or USB to DB 9 cable dongle 1 2 CAT 5 Ethernet Cable with RJ 45 Connectors straight through or cross over depending on your installation 1 per array...

Page 42: ... rack must allow good front to back airflow Caution Improperly spaced mounting brackets and slide rails can cause the Memory Array to fall out of the rack Because of the weight of the Memory Array two people are required to lift and place the system in an equipment rack If installed in a closed or multi unit rack assembly the operating ambient temperature of the rack environment may be greater tha...

Page 43: ...ce Position the Memory Array above the rails and slide the buttons at the rear sides of the chassis into the rear slots on the rails 4 Slip the remaining sets of buttons into the remaining cutouts in the rails Push the whole assembly back into the equipment rack and secure the rack mounting brackets to the front of the equipment rack with the thumb screws located on the front mounting brackets as ...

Page 44: ...hassis Securely tighten the thumb screws into the chassis 3 Using the four 4 shoulder screws and shims that were set aside in step 1 secure the cable management arm mounting bracket to the rear equipment frame mounting bracket placing the shim between the shoulder screws and the cable management arm mounting bracket with the enclosed Hex key The cable management arm mounting bracket slides the arm...

Page 45: ...Rack Mounting the Chassis HP AM456 9002A Rev 01 VMA series Memory Array Installation and Service Guide 45 Figure 3 4 Installing the Cable Holder ...

Page 46: ...ble to the Memory Array PCIe connector 1 Locate the appropriate PCIe connector port at the rear of the Memory Array This is indicated by the flashing LED that is associated with the port Figure 3 5 Connecting the PCIe Cable to the Memory Array 2 Orient one connector of the PCIe cable so it aligns appropriately with the PCIe connector at the rear of the Memory Array 3 Securely plug the cable into t...

Page 47: ...G Only authorized qualified and trained personnel should attempt to work on this equipment Install the Memory Array with a 50 A maximum branch circuit rating by an end use application using a UL listed circuit breaker rated at 50 A The Memory Array chassis has the AC power supplies installed prior to shipping Connect the AC power cord to either power receptacle on the Memory Array or both Connecti...

Page 48: ...e Management Arm on page 55 Connecting Equipment Ground Connect equipment ground from the equipment rack to the Memory Array only after installing the system into the equipment rack Note Use appropriately sized wire for your equipment application Minimum acceptable wire gauge is 8 AWG Maintain reliable earthing of rack mounted equipment Supply extra connections other than the direct connections to...

Page 49: ...en the screw on the lug to secure the cable to the lug 5 Using the grounding screw provided with the Memory Array attach the lug to the ground point on the rear of the equipment Note Attach the lug with the cable pointing up Attaching the lug with the cable pointing down may cause interference between the ground cable and equipment mounted directly below the Memory Array which would prevent the Me...

Page 50: ...serial cable to the male DB 9 connector on the rear of the Memory Array see Figure 3 7 Secure the cable to the chassis by tightening the screws on the DB 9 connector Table 3 4 Default Serial Port Settings Setting Value Speed baud rate 9600 Parity No of data bits character 8 of stop bits character 1 Carrier Detect No Flow Control xon xoff Table 3 5 DB 9 to DB 9 Serial Null Modem Cable Pinout DB 9 C...

Page 51: ...Ethernet Cable The Ethernet cable connects the host computer to the system s command line interface CLI for configuration operations and retrieving system status For a direct host to system Ethernet connection use a straight through or cross over RJ 45 to RJ 45 CAT5 Ethernet cable You can also use a straight through or cross over cable to connect the Memory Array to a router hub or other network d...

Page 52: ...ting the Cables onto the Cable Management Arm on page 55 3 If directly connecting the Memory Array to a host machine plug the other end of the cable into the Ethernet connector on the host 4 If connecting to a network device such as a router plug the other end of the cable into the Ethernet connector on the network device Use a second Ethernet cable to connect the host computer to the network devi...

Page 53: ...performance to scale as needed The host requires a PCIe Host Interface Board HIB for each memory array that is to be connected Host Computer The steps for connecting the Memory Array to a host computer are 1 Install the necessary PCIe HIB card into an available PCIe slot in the host computer ensuring that it is securely seated 2 Orient the unconnected end of the PCIe cable s to align with the PCIe...

Page 54: ...he back of the Memory Gateway The PCIe cable is keyed and only goes in one way 2 Securely plug the cable s into the PCIe connector 3 Power up the Memory Array see Powering up the Memory Array on page 56 Ensure the RAID ADMIN Status LED is solid green indicating the PCIe ports have stabilized before continuing approximately 1 minute 4 Power up the Memory Gateway 5 Verify the PCIe connection s Refer...

Page 55: ...nt rack holding the chassis brackets and pulling out the Memory Array from the equipment rack Do not remove the system from the rack 2 At the rear of the chassis route the installed ground wire serial cable and power cables along the length of the cable management arm and secure them with cable ties Slip the cable ties around the slits in the arm and secure the ties around the routed cables 3 Rout...

Page 56: ... have power buttons Note Power up the Memory Array before the host computer to ensure PCIe communication because PCIe hotplug is not supported by some current BIOS versions An alternate method is to reboot the host computer after powering up the Memory Array to ensure that the host computer recognizes the system 3 During the boot up process the green Status and the red Alarm LEDs will flash The Me...

Page 57: ...ins how to log into the Memory Array s command line interface CLI to change system settings such as the hostname IP address DNS and syslog options in the following sections Memory Array Default Settings on page 58 Connecting to the CLI on page 59 Changing the Default System Settings on page 62 Configuring DHCP Settings on page 65 Configuring Domain Name System DNS on page 67 Verifying the Ethernet...

Page 58: ...tings on page 62 Table 4 1 Memory Array System Default Settings Setting Default Value Host Name violin IP Address 192 168 1 2 static IP Netmask 255 255 255 0 Gateway undefined DHCP disabled User Login Name admin User Password admin DNS Config manual DNS Name Server undefined DNS Search undefined Clock Source host Shell Connectivity Serial Telnet port 23 SSH port 22 Serial Port Settings 9600 Baud N...

Page 59: ...gging in via a Windows host computer The following procedure shows how to connect to the Memory Array using a terminal emulation application For example using PuTTY to connect to the CLI through the serial connection 1 Log into the host computer as an administrator 2 From the Windows Start menu select Programs Accessories Communications PuTTY The New Connection PuTTY1 window opens 3 In the Connect...

Page 60: ...e serial connection 1 Log into the host computer as root 2 At the host computer s command line prompt type or 3 Specify the line of the Kermit connection At the Kermit prompt type Note The device name may vary depending on the host and the Linux operating system that is running on the host 4 Specify the flow control mode At the Kermit prompt type 5 Specify the speed of the Kermit connection At the...

Page 61: ...Service Guide 61 9 At this point you are connected to the CLI of the Memory Array and can access the various CLI commands To close the Kermit application do one of the following a At the CLI prompt type Ctrl c and then q b Close the terminal window which terminates the Kermit connection ...

Page 62: ... punctuation Be a combination of upper and lower case letters and numbers Not be similar to a previous password Not be a palindrome If you specify an unacceptable password you will get a message that the password is too simple By increasing the length of the password you can use all lower case or all upper case characters In other words the longer the password the less complicated it needs to be T...

Page 63: ...P is disabled For convenience the Ethernet port supports automatic medium dependent interface crossover Auto MDIX With this you can connect the Ethernet port on the system to a computer s Ethernet port such as a laptop for provisioning before connecting to a network switch You can switch between using DHCP and static addressing When switching from DHCP to static addressing the Memory Array uses th...

Page 64: ...ult value 1 Log into the Memory Array 2 Navigate to the system context level At the root prompt type 3 At the system command prompt type Where Note Depending on your network you may need to modify the DNS setting to Telnet to the Memory Array via the hostname Changing the hostname ensures that you are connecting to the intended memory array if there are multiple memory arrays on the network See Co...

Page 65: ...ompt type When viewing DHCP status information similar to the following displays Enabling DHCP Enable DHCP to automatically set the Memory Array s IP address 1 Log into the Memory Array 2 Navigate to the Ethernet 0 context level At the root prompt type 3 At the Ethernet 0 context prompt type 4 To commit the changes made to DHCP at the System context level command prompt type context chassis contro...

Page 66: ...the System context level command prompt type If DHCP is disabled you must manually configure the system s IP address See Changing the Default IP Address Netmask and Gateway on page 63 Once you have manually configured the IP address while DHCP is disabled you will see that the manually provisioned IP addresses takes effect context chassis controller ethernet 0 set dhcp disabled save config chassis...

Page 67: ... DHCP server that supports specifying the DNS name If DHCP is disabled then the DNS mode is automatically changed to manual Note Pre provision the DNS configuration information before disabling DHCP Disabling DHCP forces the DNS mode to change to manual and use the default values making the system unreachable Configuring the DNS Name When in automatic DNS mode and you set the IP address of the DNS...

Page 68: ...ollowing example the DNS name server IP address and the DNS search domain values have been pre provisioned Displaying the DNS Mode and Pre provisioned Information To display the current DNS mode and various pre provisioned DNS information on the Memory Array 1 Log into the CLI via a serial connection or the Ethernet interface see Connecting to the CLI on page 59 2 Navigate to the Ethernet 0 contex...

Page 69: ...on page 59 2 Navigate to the Ethernet 0 context level At the root prompt type 3 At the Ethernet 0 context prompt type Where You can pre provision the IP address of the name server and the search domain name while the DNS mode is set to automatic See Configuring the DNS Name on page 67 and Configuring the DNS Search Domain Name on page 68 Change the DNS mode to manual to use the pre provisioned val...

Page 70: ...and returns the system s IP address and other Ethernet settings b Connect to your DHCP server and retrieve the IP address it assigned to your Memory Array 3 Open a terminal or command line window and at the command prompt type Where If the host computer can connect to the Memory Array then it will return a successful ping message If it cannot connect then a failed ping message is returned You can ...

Page 71: ...ost they are written to whatever logging device is configured Frequently this means that warn messages are written to a file such as var log messages or var adm messages and emerg level messages are written to all root consoles On the Memory Array messages that are set to the WARNING ERROR or FATAL level are sent to the host Displaying the Configured IP Address of the Syslog Host To display the IP...

Page 72: ...o the Memory Array 2 Navigate to the Syslog context level At the root prompt type 3 At the Syslog context prompt type Where 4 To commit the change made to the IP address from the System context level command prompt type Or from the Syslog context level type Or Determining the Status of the System Log Service Display the status of the service that sends the system log messages to a host 1 Log into ...

Page 73: ...vice 1 Log into the Memory Array 2 Navigate to the Syslog context level At the root prompt type 3 At the Syslog context prompt type Where 4 To commit the change made from the System context level command prompt type Or from the Syslog context level type Or system logging syslog show service service on context system logging syslog set service on off on Starts the service that sends the system log ...

Page 74: ...o the Memory Array 2 At the root CLI prompt type Where Higher usable percentages provide more usable capacity where needed Lower usable percentages increase system write performance endurance and reliability For advice on selecting a good usable percentage consult with HP Customer Support format flash capacity value value Specifies the percentage of usable flash capacity Valid values are 50 65 78 ...

Page 75: ...ow to use the CLI to perform various procedures in the following sections Connecting to the CLI on page 76 Displaying and Setting the CLI Window Options on page 79 Displaying and Setting System Information on page 83 Displaying and Setting Hardware Information on page 92 Displaying Alarms and Logs on page 96 Rebooting the Memory Array on page 98 Upgrading the System Software on page 100 See Append...

Page 76: ...the admin user is Emacs You can change the default editor to vi see Setting the Command Line Editor on page 80 Connecting via SSH Connect to the CLI via SSH through your host computer On a Linux host use your preferred command shell On a Windows host use a GUI application such as PuTTY to SSH to the Memory Array The following is an example of what you will see after successfully connecting to the ...

Page 77: ...mory Array from a Linux desktop 1 Right click on the desktop and select Open Terminal At the command prompt in the terminal window type Where 2 At the login prompt type the user login name default is admin 3 At the password prompt type the user password default is admin 4 The following is an example of what you will see after successfully connecting to the CLI telnet ip_address ip_address Specifie...

Page 78: ...cted to 10 10 20 4 Escape character is violin login admin Password ___ ___ o o _ _ ___ ___ ___ _ _ __ __ ___ __ http www violin memory com __ OAM CLI Operations Administration Maintenance Command Line Interface Copyright c 2006 2010 Violin Memory Inc All Rights Reserved S W Build Info Date 17 15 13 swbuild violintech net by user common Release R3 4 You are at the root node ...

Page 79: ...Array 2 Navigate to the CLI context level At the root prompt type 3 At the CLI context prompt type The command displays information similar to the following Setting the Number of Columns Set the number of columns in the display window using the set columns command Set the number of columns in the range of 80 200 inclusively with the default setting of 80 This determines where the display lines are...

Page 80: ...ent CLI session The default editing mode is Emacs 1 Log into the Memory Array 2 Navigate to the CLI context level At the root prompt type 3 At the CLI context prompt type Where Displaying the History Buffer Size 1 Log into the Memory Array 2 Navigate to the CLI context level At the root prompt type 3 At the CLI context prompt type context cli show edit mode cli show edit mode Current edit mode set...

Page 81: ...Number of Window Lines This command is used by the paginator feature to scroll within large amounts of displayed data such as when the log is viewed 1 Log into the Memory Array 2 Navigate to the CLI context level At the root prompt type 3 At the CLI context prompt type The command displays information similar to the following Setting the Number of Window Lines 1 Log into the Memory Array 2 Navigat...

Page 82: ...s information similar to the following Setting the Pagination Mode Enable or disable pagination in the CLI window When pagination is disabled data displays on screen without pausing To enable or disable pagination in the CLI window 1 Log into the Memory Array 2 Navigate to the CLI context level At the root prompt type 3 At the CLI context prompt type Where context cli show pagination cli show pagi...

Page 83: ...Memory Array 2 Navigate to the System context level At the root prompt type 3 At the System context prompt type By default the display paginates The example below shows representative text that may be displayed Actual text that is displayed is determined by your system s configuration context system show status system show status alarm mgr running data mgr running diagnostics mgr running hardware ...

Page 84: ...played in tenths of a second and in year day HH MM SS format To display how long the system has been operational 1 Log into the Memory Array 2 Navigate to the System context level At the root prompt type 3 At the System context prompt type The command displays information similar to the following Where slot port 2 state enabled protocol pcie link width 4 neg link width 4 max data rate 10 Gb s cfg ...

Page 85: ...s how long the system has been operational since the last power cycle or system reboot in year day hour formats context system show clock system show clock clock 2009 07 04T15 39 27 clock Displays the date and time in the format yyyy mm ddThh mm ss The T is a delineator between the date and the time context system set clock yyyy mm dd T hh mm ss yyyy mm dd Sets the date in the format yyyy The 4 di...

Page 86: ...at the system has been operational It does not keep an accurate calendar date and time If the system is rebooted then the elapsed time is not accounted for when the system finishes the reboot process and is again operational 1 Log into the Memory Array 2 Navigate to the System context level At the root prompt type 3 At the System context prompt type Where Displaying the Software Version 1 Log into...

Page 87: ... swbuild violintech net by user common CPL bootloader version release OAM bootloader version release CPL OS version release OAM OS version release CPL factory image version release OAM factory image version release upgrade image version release _x8ans date 14 55 controller version info 15749_x8a date 11 39 saxpow version info 8418 03 12 08 15 26 saxled version info 7642 01 25 08 13 48 Table 5 1 Di...

Page 88: ...to the System context level At the root prompt type 3 At the System context prompt type The command displays information similar to the following Retrieving the MAC Address The MAC address of the Memory Array s Ethernet port can be found on the back of the system or in the system attribute files To retrieve the device MAC address and serial number do one of the following context chassis controller...

Page 89: ...he Ethernet 0 context prompt type The command displays information similar to the following Clearing Provisioned DNS Information Clear provisioned DNS name server and DNS search domain information 1 Log into the CLI via a serial connection or the Ethernet interface see Connecting to the CLI on page 76 2 Navigate to the Ethernet 0 context level At the root prompt type show chassis controller ethern...

Page 90: ...ne contains parity information Each RAID group can tolerate a single VIMM failure with no loss of data To display the mapping of the RAID groups across the VIMMs 1 Log into the Memory Array 2 Navigate to the RAID Group context level At the root prompt type Where 3 At the RAID Group context prompt type The command displays information similar to the following Where clear dns nameserver clear dns se...

Page 91: ...vel At the root prompt type 3 At the RAID context prompt type The command displays information similar to the following state Indicates the state of the VIMM in the 5 VIMM RAID group Valid values are data VIMM is being used for data either user data or parity data REBUILDING VIMM is currently being rebuilt by the RAID engine to recover from a prior failure FAULT A fault has occurred for this VIMM ...

Page 92: ... 1 Log into the Memory Array 2 Navigate to the desired Slot context level At the root prompt type Where 3 At the context prompt type This command displays text similar to the following context chassis board 0 slot n n Specifies the VIMM slot number to move to Valid values are in the range of 0 83 inclusive show vimm chassis board 0 slot 56 show vimm admin state up oper state up vimm state active r...

Page 93: ...v 1 14 sensor 1 8v 1 79 sensor 2 5v 2 42 sensor 3 3v 3 35 run time stats run time 0 years 0 days 15 22 04 stats date Wed Feb 17 10 37 39 2010 format date Tue Feb 16 19 41 08 2010 user reads 130 233 145 user read bytes 133 358 740 480 user writes 130 233 037 user write bytes 133 358 629 888 ecc cor counts one bit 3 two bits 0 three bits 0 four plus bits 0 total cor 3 ecc corrected 3 rate 2 30e 08 r...

Page 94: ...pe Where 3 At the context prompt type Where show vimm summary chassis board 0 show vimm summary num vimms 42 installed vimm ids 3 8 12 18 22 27 35 38 45 48 60 64 69 71 75 76 78 80 flash vimm ids 3 8 12 18 22 27 35 38 45 48 60 64 69 71 75 76 78 80 admin down vimm ids 39 installed mem raw 2886 2GB 2688GiB usable mem raw 2199 0GB 2048GiB parity mem raw 549 8GB 512GiB spare mem raw 68 7GB 64GiB unavai...

Page 95: ...ay 2 Navigate to the Board 0 context level At the root prompt type 3 At the context prompt type The command displays information similar to the following chassis fan tray 1 show fan left speed high rpm 4800 context chassis board 0 show info chassis board 0 show info part number 1000074S C 08 version 0 serial number 16095R00000237 mfg date 20090723 environment ambient temp 36C OK controller temp 57...

Page 96: ...acting HP on page 19 Displaying the Current Alarms 1 Log into the Memory Array 2 Navigate to the System context level At the root prompt type 3 At the System context prompt type The command displays information similar to the following Displaying the System Log Display the data contained in the log on the Memory Array The log is displayed in a paginator window unless you have disabled the paginato...

Page 97: ...000010 INFO main S W Rel release Built date 12 16 39 on swbuild violintech net by user common context system show messages system show messages Nov 30 00 28 22 kernel Linux version 2 6 17 11719 common swbuild violintech net gcc version 3 4 6 2 PREEMPT Mon Dec 22 12 38 51 EST 2008 Nov 30 00 28 22 kernel O M Nov 30 00 28 22 kernel Nov 30 00 28 22 kernel uClinux Nios II Nov 30 00 28 22 kernel Altera ...

Page 98: ...tration function such as user logins system administration and the CLI software Rebooting the System Set the system reboot to run immediately or to be delayed in minutes up to 1 day 1 Log into the Memory Array 2 At the root prompt type Where If you do not specify the time delay you are also prompted whether you want to reboot the system immediately Answer y to reboot immediately If you answer n th...

Page 99: ...onfirm cancelling the reboot or type n to keep the scheduled reboot Displaying the Scheduled Reboot To display when a reboot is scheduled to run 1 Log into the Memory Array 2 Navigate to the System context level At the root prompt type 3 At the System context prompt type The command displays information similar to the following cancel reboot context system show reboot system show reboot There is a...

Page 100: ...e factory image Note If you are upgrading from a previous release to the most current release see the user documentation associated with the previous release for detailed upgrade instructions If you are upgrading from a release prior to R2 2 0 before rebooting you must use the following command to make the upgrade partition active upon reboot set system sw upgrade active upgrade The file name of t...

Page 101: ...http host_ip_addr path upgr_image upg http 10 10 0 15 vtms array firmware x8 A3 7 2 18919 upg NFS nfs host_ip_addr path upgr_image upg nfs 10 10 0 15 vol vol1 home common vtms array firmware x8 A3 7 2 18919 upg SCP user scp host_ip_addr path upgr_image upg You may be asked to establish the authenticity of the host when connecting Type yes to continue downloading the software image from the host to...

Page 102: ...e Make sure to use the appropriate image for your application set system sw upgrade path bob scp 10 10 0 15 home bob_home vtms array firmware x8 R3 4 0 15954 upg Do you wish to download this upgrade image Y N y Downloading OK Verifying image Violin S W Upgrade Image Header Ver 1 Name R3 4 0 15954_x8ans Created Tue July 10 2010 16 47 10 2009 Revision 13208 Data Size 15630085 Bytes 14 91 MB Num Part...

Page 103: ...nection use a PCIe x8 host card in your host computer 6 You may need to update your device driver at this time If so you will receive the device driver files from HP Customer Support To restore your system to the factory default settings see Restoring the Factory Default Settings Restoring the Factory Default Settings You can return to the factory default settings at any time 1 Log into the Memory...

Page 104: ...formation similar to the following reboot system all reboot system all Do you wish to reboot all processors now Y N y Scheduling an immediate reboot SYSTEM REBOOTING The reboot request has succeeded Booting Violin 1010 Starting Management Interfaces Restored configuration settings from flash Verifying configuration settings ___ ___ o o _ _ ___ ___ ___ _ _ __ __ ___ __ http www violin memory com __...

Page 105: ... the context prompt type The command displays information similar to the following Updating the System Software Factory Image Update the system software factory image if you have both factory and upgrade images installed on the Memory Array and you want to make the current upgrade image the factory image 1 Copy the current firmware image into the factory partition At the root prompt type 2 You are...

Page 106: ...Chapter 5 Operating the System via the CLI 106 VMA series Memory Array Installation and Service Guide HP AM456 9002A Rev 01 ...

Page 107: ...bes how to service the Memory Array by following safety precautions while replacing the fan trays AC power supplies and VIMMs in the following sections Guidelines for Servicing the System on page 108 Testing the LEDs on page 109 Replacing the Fans on page 111 Replacing the AC Power Supplies on page 112 Replacing VIMMs on page 113 ...

Page 108: ...ntact with the moving parts When using metal tools such as screwdrivers exercise caution to ensure that they do not come in contact with any part of the system other than to remove the necessary screws Failure to observe these precautions creates the potential risk of creating a short circuit within the system The VIMMs are hot swappable but remove both of the power feeds from the system to elimin...

Page 109: ...e System LEDs This test lights all system and VIMM LEDs for two seconds turns them off for two seconds then reverts the LEDs to their previous states The exceptions to this are the Power A and Power B LEDs which are controlled by the presence of power To test the system LEDs 1 Log into the Memory Array 2 Navigate to the System context level At the root prompt type 3 At the context prompt type Disp...

Page 110: ...l The LEDs stay lit for two seconds blink fast for two seconds blink slowly for two seconds then return to the previous state To test the VIMM LEDs 1 Log into the Memory Array 2 Navigate to the Slot context level At the root prompt type Where 3 At the context prompt type n Specifies the VIMM slot ID Valid values are in the range of 0 83 inclusive show led state chassis board 0 slot 12 show led sta...

Page 111: ...he latch clockwise on the VIMM top cover The latch holds both the top cover and the fan cover in place Then pull on the rubber tabs to remove the lid 2 Pull the handle on the fan to remove it from the chassis and replace with a new fan module 3 Place a new fan tray module in the empty fan slot and push it into the chassis until the connector is securely seated in the chassis connector 4 Put the li...

Page 112: ... the AC power cord from the system and the wall outlet 2 Remove the module by pushing on the green tab at the right of the power supply faceplate and pulling the power supply firmly by the handle over the fan as illustrated in the figure below Figure 6 2 Replacing an AC Power Supply 3 Orient the power supply as shown in the figure above with the faceplate towards the installer and the AC cord rece...

Page 113: ...in system board The red LED on the VIMM and the associated slot LED on the main board will be lit See System LEDs on page 25 for detailed information on the system LEDs WARNING If you are replacing a functioning VIMM then the red LED on the VIMM and the associated slot LED will not be lit solid red indicating the power has been removed from the slot until you manually change the administrative sta...

Page 114: ... the pins and place in a static bag 6 Align the new VIMM with the empty slot as shown in the following figure Figure 6 3 Inserting the Replacement VIMM 7 Firmly press the VIMM into the slot until the latches click close After a short time interval when the system software recognizes the new VIMM program the FPGA on the VIMM and clear the alarm for that slot The red LED will turn off indicating no ...

Page 115: ...PART III Host Utilities Chapter 7 Linux Drivers Chapter 8 Windows Drivers Chapter 9 Violin Utilities Chapter 10 Performance Tuning and Troubleshooting ...

Page 116: ......

Page 117: ...overed include system prerequisites installation of the Linux drivers installation of the Violin Utilities and creation of block device partitions Linux Drivers Overview on page 118 Installing Linux Driver Prerequisites on page 119 Installing Linux Drivers on page 120 Loading and Unloading Linux Drivers on page 125 Installing the Violin Utilities on page 127 Configuring Partitions and Storage Devi...

Page 118: ...to the Memory Array enabling the host to create and mount block storage This chapter describes the steps required to install and configure Linux drivers as block devices only If you plan to use the Linux driver to enable character or SCSI connections contact HP Customer Support Installation and Configuration Overview The Linux driver enables a direct attached connection between a Memory Array and ...

Page 119: ...ray Step 5 Configuring Partitions and File Systems If the Linux driver is used as a block device you may create partitions and file systems Installing Linux Driver Prerequisites The first step towards configuring a direct attached Memory Array system with a Linux host is to ensure that all of the required packages are installed on the Linux host Three packages must be installed on the Linux host b...

Page 120: ...erf_test utility and asynchronous I O testing see Network Layer Performance Testing on page 172 Install both the libaio and libaio devel packages before installing the Violin Utilities The following example installs the required packages on a CentOS 5 5 x86_64 system At the root prompt type Installing Linux Drivers The second step towards configuring a direct attached Memory Array system with a Li...

Page 121: ...1 Installing Linux Drivers on Non Running Linux Kernels on page 123 Installing Linux Drivers on Running Linux Kernels To load the Linux driver onto the host computer 1 Power up the Memory Array and verify the PCIe connectivity between the Memory Arrayand the host computer before you install and load the Linux driver onto the host Because the PCIe Hot Plug is not supported by most current BIOS vers...

Page 122: ...Linux driver for use If you installed the Linux driver in the lib modules directory see Loading Linux Drivers as Modules on page 126 for detailed instructions If you did not install the Linux driver in the lib modules directory see Loading Linux Drivers Manually on page 125 vtms linux driver release run Copying to a temporary location Creating directory vtms linux driver release Verifying archive ...

Page 123: ...process 3 Download the Linux driver install file vtms linux driver release run from the HP Support page Where release indicates the release number for example D4 5 4 1 4 Save the Linux driver install file to a suitable location on the host 5 Open a terminal shell window and navigate to the location of the Linux driver install script 6 To run the Linux driver install script type The script begins i...

Page 124: ...If you did not install the Linux driver in the lib modules directory see Loading Linux Drivers Manually on page 125 11 To check to see if the Linux driver is installed type Preventing Linux Drivers from Loading on Boot Up To prevent the kernel from loading the Linux driver at boot up add the Linux driver to the etc modprobe d blacklist file Type modprobe vtms once the system is booted to load the ...

Page 125: ... The third step towards configuring a direct attached Memory Array system with a Linux host is to load the Linux driver Linux drivers may be configured to be loaded automatically as modules by the Linux host or to require manually loading This section describes the loading and unloading of Linux drivers in three topics Loading Linux Drivers Manually on page 125 Loading Linux Drivers as Modules on ...

Page 126: ...puter before installing and loading the Linux driver onto the host computer 2 Log into the Linux host as root 3 Open a terminal window 4 Optional To update the dependency mappings of newly installed modules at the system prompt type You may need to run depmod for modprobe to detect the new module cd tmp vtms linux driver release kernel_version architecture_type release Indicates the release number...

Page 127: ...the Violin Utilities The Violin Utilities are tools designed to enable you monitor the performance of a direct attached Memory Array system Using the Violin Utilities you may retrieve detailed information about the Memory Array and data transfer counts that enable you to configure the system for optimal performance Use the Violin Utilities commands in the usr local bin directory to display informa...

Page 128: ...se tgz from the HP Support page Where release indicates the release number such as D4 5 4 1 3 Extract the contents of the compressed file to a suitable location on the host 4 Open a terminal shell window and navigate to the location of the Violin Utilities install script vtms linux release tar 5 To run the Violin Utilities install script type Where release indicates the release number such as D4 5...

Page 129: ... 4kB alignment on created partitions For more information see Memory Array Flash 4kB Alignment on page 169 Creating Block Device Partitions To create a block device partition on the Memory Array 1 Log into the host computer as root The following command is only needed when splitting the block device into multiple partitions 2 First open the device for adding partitions by typing the following at t...

Page 130: ...than one partition on the device or accept the default value of 1 by pressing the Enter key The default value to set the beginning cylinder to is 1 which can be changed if needed Specify the size of the block device or accept the default value of the available memory by pressing the Enter key 5 Next at the Command prompt write the new partition by typing Where w writes the partition table to disk ...

Page 131: ... that uses the new block device partition creating the new mount path and mounting the new block device file system 6 Create a file system on the block device by typing Where Command m for help w The partition table has been altered Calling ioctl to re read partition table Syncing disks mkfs t ext3 dev vtmsa n t ext3 Specifies the type of file system to be built dev vtmsa n Specifies the name of t...

Page 132: ...ystem blocks 4294967296 10752 block groups 32768 blocks per group 32768 fragments per group 16384 inodes per group Superblock backups stored on blocks 32768 98304 163840 229376 294912 819200 884736 1605632 2654208 4096000 7962624 11239424 20480000 23887872 71663616 78675968 102400000 214990848 Writing inode tables done Creating journal 32768 blocks done Writing superblocks and filesystem accountin...

Page 133: ...ecifies the partition name mnt mount_pth Specifies the default mount path fs_type Specifies the file system type of the device mount_opt Specifies the mount options which are separated by commas for the file system The available options are auto noauto Specifies whether to automatically mount the device or not With noauto the device can only be mounted explicitly user nouser Specifies whether a ty...

Page 134: ...002A Rev 01 dump_opt Specifies whether the device is backed up by the dump utility or not If 0 is specified the device will not be backed up 1 specifies that the device will be backed up fsck_opt Specifies what order the devices are checked If 0 is specified the device won t be checked by fsck ...

Page 135: ...indows Drivers This chapter describes the installation of the Memory Array Storport driver and Violin Utilities on a Windows host computer Windows Driver Overview on page 136 Installing Prerequisites on page 136 Installing Windows Drivers on page 137 Installing the Violin Utilities on page 144 ...

Page 136: ... that all of the required packages are installed on the Windows host before you install the Windows driver Step 2 Installing Windows Drivers Install Windows drivers on the host Step 3 Installing the Violin Utilities Package The Violin Utilities enable you to monitor and fine tune the performance of the Memory Array Before you can use the direct attached Memory Array for data storage you must first...

Page 137: ...edures and examples provided in this chapter were created using a Windows Server 2008 host computer If you are using a different version of Windows your installation procedure may be different This section contains the following topics Installing the Windows Drivers on page 137 Manually Installing the Windows Drivers on page 141 Removing the Windows Drivers on page 143 Installing the Windows Drive...

Page 138: ...ice Guide HP AM456 9002A Rev 01 The Welcome to the Violin Array Storport Setup Wizard window appears 5 Click the Next button The License Agreement window appears 6 Select the I Accept the Agreement option and click the Next button The Select Destination Location window appears ...

Page 139: ...e Browse button and navigate to the desired location otherwise do nothing to accept the default directory Click the Next button The Select Start Menu Folder window appears 8 To change the destination folder click the Browse button and navigate to the desired location Click the Next button The Ready to Install window appears 9 Click the Install button ...

Page 140: ...mpleting the Violin Array Storport Setup Wizard window appears 10 To view the readme file select the View README TXT check box 11 Click the Finish button The Welcome to the Device Driver Installation Wizard window appears 12 Click the Next button The Completing the Device Driver Installation Wizard window appears ...

Page 141: ...oceed with the installation of the Windows device driver For step by step instructions see Installing the Violin Utilities on page 144 Manually Installing the Windows Drivers To manually install the Storeport driver 1 Log into the host as administrator 2 Download the Windows driver zip file driver storport Dx x x zip from the HP Support page 3 Save the zipped file to a suitable location on the hos...

Page 142: ...wn Device window appears 6 Select the Browse My Computer for Driver Software option The Browse for Driver Software On Your Computer window appears 7 Click the Browse button and navigate to the directory where you saved the zipped file driver storport Dx x x zip 8 Ensure that the Include Subfolders option is selected and click the OK button ...

Page 143: ...the installation of the Windows device driver For step by step instructions see Installing the Violin Utilities on page 144 Verifying Host Computer Connections 1 After installing the Windows Storport driver and rebooting the system log into the host as administrator The Found New Hardware window appears The window verifies that the Memory Array is properly connected to the host and is ready to be ...

Page 144: ...direct attached configuration the Violin Utilities are installed on the host machine and may be used to view valuable information about the driver and the performance of the Memory Array system The Violin Utilities package includes the following tools Table 8 1 Command Line Utilities for Displaying Windows Driver Information Utility Description perf_test A multi threaded AIO capable disk benchmark...

Page 145: ...s To install the Violin Utilities 1 Log into the host as administrator 2 Download the appropriate Violin Utilities zip file driver utils Dx x x zip from the HP Support page 3 Extract the contents of the zipped file to a suitable location on the host 4 Run the setup exe file from the utils xxx folder The Welcome to the Violin Array Utilities Setup Wizard window appears 5 Click the Next button vzero...

Page 146: ...appears 6 Select the I Accept the Agreement option and click the Next button The Select Destination Location window appears 7 To change the destination folder click the Browse button and navigate to the desired location otherwise do nothing to accept the default directory Click the Next button The Select Start Menu Folder window appears ...

Page 147: ...he Next button The Ready to Install window appears 9 Click the Install button The Completing the Violin Array Storport Setup Wizard window appears 10 Click the Finish button 11 Reboot the host A desktop icon is created to the Violin Utilities cmd shell Verifying Devices Are Attached As SCSI Devices To verify that the system is connected as a SCSI device 1 Log into the host as administrator 2 Open ...

Page 148: ...s 1 Log into the host as administrator 2 Open the Control Panel and click Add or Remove Programs The Uninstall or Change a Program manager appears 3 Double click the Violin Array Utilities program in the list The Violin Array Utilities Uninstall confirmation dialog box appears 4 To delete the Violin Utilities click the Yes button A dialog box appears confirming that the Violin Utilities have been ...

Page 149: ...in Utilities This chapter describes the Violin Utilities used for configuring and performance testing the Memory Array system These commands are common to the Linux and Windows drivers and to the Memory Gateway Understanding the Violin Utilities on page 150 Violin Utilities Reference on page 150 ...

Page 150: ...ling the Windows Drivers on page 137 Running the Violin Utilities As with any command that modifies the configuration of the Memory Array system Violin Utilities commands must be issued as the root user on a Linux computer or as an Administrator on a Windows computer In each Violin Utilities command specify the optional device index device_index to list the information for a particular Memory Arra...

Page 151: ...isplays data transfer counters for the Memory Array Syntax vcounts device_index Example The vcounts utility returns information similar to the following when run on a Linux host vcounts Violin Memory Inc Version vtms linux utils D4 5 4 05 23 2011 Device vtmsa Index 0 Target Counts IRQ calls 2 IRQ calls for V1010 2 IRQ calls for errors 0 Completed I O bytes 0 Completed read bytes 0 Completed write ...

Page 152: ...en to a Memory Array Completed I O s The total I O read write requests from and to Memory Array This is not the individual DMA descriptors completed but for each of the user requested I Os Completed read I O s The total I O read requests from a Memory Array This is not the individual DMA descriptors completed but for each of the user requested I Os Completed write I O s The total I O write request...

Page 153: ...mented when an unaligned host address required special buffer byte copying to service the DMA request Requested DMA reads Incremented for each read DMA descriptor added to the descriptor ring A single I O may result in multiple DMA descriptors to complete a single I O request Requested DMA writes Incremented for each write DMA descriptor added to the descriptor ring Note that a single I O may resu...

Page 154: ...n utils date Device scsi5 Index 0 EEPROM info Part 1000074S C 08 Serial 6C057CWX00134 Board Ver 0 Mfg Date 20071226 Mgmt MAC 00 1b 97 00 00 86 Part Displays the part number of the main board Serial Displays the serial number of the main board Board Ver Displays the version of the main board Mfg Date Indicates the manufacturing date of the main board Mgmt MAC Displays the MAC address of the managem...

Page 155: ...script is installed on the host server as part of the Violin Utilities package For more information see Installing the Violin Utilities on page 150 for Linux hosts or Installing the Violin Utilities on page 150 for Windows hosts Syntax vincident tty_device ip_address max timeout secs vincident may be run using the IP address of the Memory Array ip_address or using a serial cable connected from the...

Page 156: ... vinfo utility returns information similar to the following example when run on a Windows host vincident 10 1 10 123 Gathering information from host Gathering information from target Incident report created in vincident 20110624T110149 C violin utils vinfo Violin Memory Inc Version vtms win utils date Device scsi5 Index 0 Disk physicaldrive1 Target Info Host Driver vtms win storport f path 14643 d...

Page 157: ...unted Granularity Displays the smallest access granularity for I O request in bytes RingSize Displays the size of driver DMA descriptor ring per Memory Array Must be power of 2 with range of 2 4096 IrqTune Displays the Interrupt combining tunable with 0 disabled and 4095 being the highest value IoTimeout Displays the time in seconds before the device driver declares an I O as stuck and disables Me...

Page 158: ...vice vtmsa Index 0 Target Unaligned Partial Counts Completed read I O s 1995280246 Unaligned host buf reads 0 Flash partial page reads 10326 Completed write I O s 1903433508 Unaligned host buf writes 0 Flash partial page writes 4535553 Completed read I O s Displays the total I O read requests from a Memory Array This is not the individual DMA descriptors completed but for each of the user requeste...

Page 159: ...e between 512 and 3584 for transfer size since two read modify write operations occur for each 4kB of data Syntax vring p partition_name Completed write I O s Displays the total I O write requests to a Memory Array This is not the individual DMA descriptors completed but for each of the user requested I Os Unaligned host buf writes Displays the total I O write requests to a Memory Array but only i...

Page 160: ...ndex Table 9 1 vring Utility Parameters Parameter Description p Specifies that a partition is to be selected partition_name Specifies the name of the partition vring Violin Memory Inc Version vtms linux utils D4 5 4 05 23 2011 INDX CMD FLAGS TRGT_ADDR HOST_ADDR SIZE 0 0x00000000 0x0000001b32acc000 0x0000000044736000 4096 1 0x00000000 0x0000001b32acd000 0x0000000063e77000 4096 2 0x00000000 0x000000...

Page 161: ...Index 0 Target Status Status LED ON Alarm LED OFF PWR_A LED ON PWR_B LED OFF ready 1 formatting 0 format_done 0 paused 0 link 1 lid_ajar 0 raid_rebuild 0 write_buffer 1 linkwidth 8 maxlinkwidth 8 cur_payload 128 max_payload 1024 cur_read_req 512 dma_active 569 io_pend 525 Status LED Indicates whether the Status LED is on or not Alarm LED Indicates whether the Alarm LED is on or not If it is on it ...

Page 162: ...Indicates the pause interval for I Os link Indicates whether the PCIe connection is online or offline lid_ajar Indicates whether the lid is closed or not raid_rebuild Indicates the status of a RAID group rebuild write_buffer Indicates whether flash write buffering is enabled or disabled linkwidth Indicates how many active PCIe lanes are available maxlinkwidth Indicates the maximum number of active...

Page 163: ...inux host perf_test The perf_test utility is a lightweight yet powerful tool for measuring the I O performance of storage devices This utility is designed to push the I O device as hard as possible by a variety of methods including POSIX threads variable block sizing asynchronous I O direct communication as well as sequential and random read write operations to data over a user defined address ran...

Page 164: ...s the read weight relative to the write weight Specify 0 to not do any reads at all w write weight Specifies the write weight relative to the read weight Specify 0 to not do any writes at all s memory size Specifies the system memory size in GB if no units are provided Recognized unit size qualifiers include k K m M g and G for the appropriate binary multipliers d duration Specifies the duration o...

Page 165: ...start Useful with the C option for sequential reads and writes c char Specifies a character in hex to write when performing write operations Example 0xCA V Verifies writes with a read to ensure data integrity This option can have a significant impact on overall I O throughput I Ignores errors on read write operations to the device R Selects addresses to read write randomly C Selects addresses to r...

Page 166: ...mand perf_test s 640 R A64 t8 o Running with options threads 8 block_size 4096 memory size 640 GB memory start addr 0x0 write read ratio 0 1 random mode 1 duration 0 secs path dev vtms strad MB 1000000 bytes no cache mode 1 AIO depth 64 Time sec Read BW Write BWTotal BWRead IOPSWrite IOPSTotal IOPS 1 817 181 MB s0 000 MB s817 181 MB s199507001995070 2 817 132 MB s0 000 MB s817 132 MB s199495019949...

Page 167: ...s chapter provides an overview of Memory Array performance tuning and testing describes flash layer performance tuning and network layer performance testing techniques using the perf_test utility Performance Tuning and Testing Overview on page 168 Flash Layer Performance Tuning on page 169 Network Layer Performance Testing on page 172 ...

Page 168: ...erconnects and PCIe hubs Operating System layer The Linux or Windows operating system and its buffer and I O settings File System layer The file system and its settings such as block size snapshots and logging Database layer The database if used and its configuration and optimizations In general performance tuning and testing is a six step process by which each layer of the Memory Array system is ...

Page 169: ...hat you verify whether the file system and operating system are 4kB aligned For more information see Memory Array Flash 4kB Alignment on page 169 Random workloads with high IOPS are well supported by flash memory Unlike hard disk drives sequential accesses are not significantly faster For this reason it is typically better that higher layers are tuned for 4kB 16kB block sizes and high IOPS Where a...

Page 170: ... on Windows Hosts on page 171 Checking Flash 4kB Alignment and Partial Pages The vpartial utility shows the number of read write I O requests processed and partial 4kB flash pages For more information on the vpartial utility see vpartial on page 158 Checking Flash 4kB Alignment and Request Ring The vring utility debugs the internal Memory Array I O request ring at a low level and checks for unalig...

Page 171: ...per track and specify a different number of sectors for use by the partition tables Running fdisk S56 provides 4kB alignment automatically provides 4kB alignment on created partitions For example Addressing 4kB Alignment Issues on Windows Hosts Windows Server 2008 and Windows 7 Servers Windows Server 2008 and Windows 7 operating systems automatically align Windows 2003 and Windows XP Servers On Wi...

Page 172: ...d prompt type Assign Letter DriveLetter 8 After the drive letter is assigned type exit to exit the diskpart utility 9 Use the Disk Management snap in or the Format command to format the partition as an NTFS formatted partition Note When formatting select an Allocation Unit Size that is a multiple of 4kBs Reference Microsoft Technet article http technet microsoft com en us library aa998219 aspx Net...

Page 173: ...r worse Be mindful of the PCIe slot routing for your host server to make the best use for IOPS and bandwidth PCIe Slots Rated for x4 Even though a PCIe slot connector may appear to physically support a x8 or even x16 card the connected electrical lanes may only be x4 Many host servers have a mixture of PCIe slots available such as x4 and x8 Check the data sheet for your host computer to make sure ...

Page 174: ...ry Array system Running the perf_test Utility on page 174 Baselining the Memory Array System on page 176 Testing Read Bandwidth on page 177 Testing Write Bandwidth on page 177 Running the perf_test Utility For best results use the R option to randomly access a specific range s using multiple threads t direct I Os o and asynchronous I Os A For example the command perf_test s 640 R A64 t8 o returns ...

Page 175: ...ter than a larger number of threads High amounts of I O can be achieved by understanding the operating system behavior and using a combination of thread counts and asynchronous I O 2 817 132 MB s0 000 MB s817 132 MB s1994950199495 3 817 160 MB s0 000 MB s817 160 MB s1995010199501 4 817 096 MB s0 000 MB s817 096 MB s1994860199486 s memory size Specifies the system memory size in GB if no units are ...

Page 176: ...n qualifying the speed of the device itself To better qualify the speed of the device being tested use the o option which tells perf_test to use the O_DIRECT flag when attaching to the device thus circumventing the buffer cache Specify less threads using the t option for Windows and Linux drivers and specify more asynchronous I Os using the A option as it reduces CPU context switching On Linux the...

Page 177: ... the read bandwidth of the Memory Array The example shows that the read bandwidth is roughly 1 2 GB s which is what you might expect on a PCIe bus with the payload set to the lowest setting of 128 bytes Testing Write Bandwidth To check the write bandwidth use the w and r options to define the ratio of writes to reads at 1 0 This ratio enables you to determine the random percent of 1 Os that are wr...

Page 178: ...dsk vtms2v1 Running with options threads 4 block_size 16384 memory size 393216 MB memory start addr 0 MB write read ratio 1 0 random mode 1 duration 5 secs path dev rdsk vtms2v1 MB 1000000 bytes Time sec Read BW Write BW Total BW Read IOPS Write IOPS Total IOPS 1 0 000 MB s 1005 936 MB s 1005 936 MB s 0 61397 61397 2 0 000 MB s 1005 924 MB s 1005 924 MB s 0 61396 61396 3 0 000 MB s 1006 266 MB s 1...

Page 179: ...ENDIX A Product Models This appendix describes the differences between the various Memory Array models Table A 1 Memory Array Models Model Configuration 3205 21 x 256 GB VIMMs or 42 x 128 GB VIMMs 3210 42 x 256 GB VIMMs or 84 x 128 GB VIMMs 3120 42 x 512 GB VIMMs 3140 84 x 512 GB VIMMs ...

Page 180: ...Appendix A Product Models 180 VMA series Memory Array Installation and Service Guide HP AM456 9002A Rev 01 ...

Page 181: ...ischarge ESD Precautions on page 182 Lithium Battery Caution on page 183 Cabinet Safety Precautions on page 183 Disposal of Waste Equipment by Users in Private Households in the European Union on page 184 Perchlorate Material Special Handling May Apply on page 184 European Union RFI Statement on page 184 USA Radio Frequency Interference FCC Notice on page 184 Japan Radio Frequency Interference VCC...

Page 182: ...d information When requesting certification information for this product always refer to this regulatory model number Note Do not confuse the regulatory model number with the marketing or model number Electrical Safety This product has not been evaluated for connection to an IT power system AC distribution system having no direct connection to earth according to IEC 60950 Installation Conditions S...

Page 183: ...or equivalent type recommended by the manufacturer Dispose of used batteries according to the manufacturer s instructions and local disposal requirements Note Switzerland Annex 4 10 of SR 814 013 applies to batteries Cabinet Safety Precautions WARNING Cabinets are heavy even when empty Exercise caution when moving cabinets whether equipment is installed in the cabinet or not Avoid rolling cabinets...

Page 184: ...chlorate and may require special handling when recycled or disposed of in California Refer to the product user documentation to determine if this product contains batteries and if so the battery type s that are used European Union RFI Statement This is a Class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measu...

Page 185: ...1 VMA series Memory Array Installation and Service Guide 185 Japan Radio Frequency Interference VCCI Korea RFI Statement Canada RFI Statement This Class A digital apparatus complies with Canadian ICES 003 Australia C Tick Label Figure B 1 Australian C Tick Label ...

Page 186: ...Appendix B Compliance Information 186 VMA series Memory Array Installation and Service Guide HP AM456 9002A Rev 01 ...

Page 187: ...mory Array system alarms The chapter describes service affecting and non service affecting alarms which may occur during operation of the Memory Array and provides information on resolving those alarms in the following sections Understanding Memory Array Alarms on page 188 Service Affecting Alarms on page 190 Non Service Affecting Alarms on page 196 ...

Page 188: ... on the front of the chassis The Alarm LED is red The Alarm LED identifies the occurrence and severity of an error by its state no light a steady light or a flashing light Many alarms occur during bootup and automatically clear as soon as the system stabilizes For example the Data Plane Unavailable alarm frequently occurs Figure C 1 Front System Status LEDs No Light No alarm Steady Light A service...

Page 189: ...ory Array show system messages command displays the current contents of the var log messages file The show system alarms command and show system messages command may be run on either the Memory Array or a Syslog server on the host show system alarms command The show system alarms command displays the current alarms on a Memory Array The command may be run by entering show system alarms at the root...

Page 190: ...verely impacted or completely disabled Unless noted otherwise service affecting alarms are indicated when the Alarm LED flashes The LED stops flashing when the alarm clears and the system returns to a normal operational state This section is organized into eight topics system show messages Jun 13 10 12 07 syslog oam_clkd OAM 1 sec time correction src host Jun 13 10 37 01 last message repeated 4 ti...

Page 191: ...ing Suspended Fan tray Missing alarm indicates that one or more fan trays are missing on the Memory Array To clear the alarm insert the missing fan tray s Booting Suspended Fans Missing Alarm The Booting Suspended Fans Missing alarm indicates that booting has been suspended because an insufficient number of fans were detected The alarm indicates the number of fans missing Flash Service Affecting A...

Page 192: ...ated to 0 Lanes Alarm on page 192 No PCIe Host Detected on Enabled Port Alarm The No PCIe Host Detected on Enabled Port alarm indicates that the PCIe cable has not been connected to the specified enabled port The PCIe port is specified as 1 or 2 To clear the alarm connect a PCIe cable between the enabled port and an active PCIe card on a host computer Port Negotiated to 0 Lanes Alarm The Port Nego...

Page 193: ...rror Alarm on page 193 RAID Group Faulted Alarm on page 194 FATAL RAID Error Alarm The FATAL RAID Error alarm indicates that a fatal RAID group error has been detected at the displayed vector A properly configured RAID group configuration is necessary for the system to be operational To clear the alarm restart the system Contact HP Customer Support for assistance Multiple RAID Errors Alarm The Mul...

Page 194: ...Unable to Poll VIMM Temperatures System Shutdown Alarm on page 195 System Booting Alarm on page 195 System Shut Down Alarm on page 195 Data Plane Unavailable Alarm The Data Plane Unavailable alarm indicates that the data plane is unavailable This alarm occurs under various conditions including during a system boot if the system experiences an unrecoverable PCIe error and if the host does not recei...

Page 195: ...system is shut down to prevent a overheating System Booting Alarm The System Booting alarm indicates that the system is in the bootup process To clear the alarm wait for the system to successfully complete the bootup process System Shut Down Alarm The alarm indicates the system has been shut down Temperature Service Affecting Alarms There is one service affecting temperature alarm Mozart Overheate...

Page 196: ...ied VIMM type Flash or DRAM Multiple VIMMs Failed System Shut Down Alarm The Multiple VIMMs Failed System Shut Down alarm indicates that multiple VIMMs are not operational and the system must shut down because the non functional VIMMS have made the current VIMM configuration invalid To clear the alarm replace the non functioning VIMMs Call HP Customer Support for replacement parts After replacing ...

Page 197: ... on page 202 VIMM Non Service Affecting Alarms on page 202 Temperature Non Service Affecting Alarms Two non service affecting temperature alarms may be raised by the system Mozart Overheating Alarm on page 197 High Temperature on Board Sensor Alarm on page 197 Mozart Overheating Alarm The Mozart Overheating alarm indicates that the main processor of the system is experiencing temperatures over the...

Page 198: ...ble alarm indicates that the specified board sensor is unreadable and that the system cannot retrieve system environment information To clear the alarm check for equipment failure and contact HP Customer Support Lid Removed Alarm The Lid Removed alarm indicates that the lid has been removed The system is still operational but the temperature of the system could be compromised and the lid must be r...

Page 199: ...top 1 or bottom 2 fan tray and the fan within that fan tray left center or right To clear the alarm replace the fan tray in the system Flash Non Service Affecting Alarms There are five non service affecting flash alarms Flash CPL IRQs on VIMM Alarm on page 199 Flash Format Failed on VIMM Alarm on page 199 Flash Sequence Number Mismatch Alarm on page 200 Preparing Flash on VIMM Alarm on page 200 VI...

Page 200: ...larm The VIMM Flash Format In Progress alarm indicates that the flash VIMMs formatting is in progress To begin the flash formatting the system must be rebooted first The alarm LED flashes To clear the alarm 1 Wait for the system to successfully complete the boot up process 2 Type show system alarm to display the percentage of the flash format progress Port Non Service Affecting Alarms There are tw...

Page 201: ...rate is x4 or higher but the alarm is logged If the rate drops to less than x4 service is affected and the Alarm LED flashes See Booting Suspended Fan tray Missing Alarm on page 191 for details of what happens when PCIe lane negotiation fails To clear the alarm change the PCIe card host computer or PCIe slot to compatible components Power Non Service Affecting Alarms There are three non service af...

Page 202: ...MMs on page 113 The Alarm LED turns off when the system returns to a normal operational state and the alarm clears RAID Rebuild in Progress Alarm The RAID Rebuild in Progress alarm indicates that a RAID group rebuild is in progress for the specified RAID and lists the group VIMM ID that is built To clear the alarm wait for the system to complete the RAID group rebuild and return to a normal operat...

Page 203: ...Capacity Alarm on page 206 VIMM in Maintenance State Alarm on page 206 VIMM Isolated Alarm on page 207 VIMM Temperature Unreadable VIMM Shut Down Alarm on page 207 VIMM Unformatted Alarm on page 207 VIMM Voltage VIMM Shut Down Alarm on page 207 VIMM Threshold Exceeded Alarm on page 207 Fan Running Too Slowly Alarm on page 207 Excessive ECC Errors on VIMM Alarm The Excessive ECC Errors on VIMM alar...

Page 204: ...that the specified VIMM is currently being programmed by the system software To clear the alarm wait for the system to complete the programming of the VIMM Unsupported VIMM Configuration Alarm The Unsupported VIMM Configuration alarm indicates that the current VIMM configuration consisting of a specified number of RAID group s is invalid and unsupported To clear the alarm replace the missing VIMM ...

Page 205: ...M in Celsius To clear the alarm High temperature threshold exceeded The alarm indicates that the highest temperature that the system can run under has been exceeded Failed to read temperature The alarm indicates that the system has failed to read the current temperature Voltage out of range The alarm indicates that the systems voltage is either too high or too low Isolated The alarm indicates that...

Page 206: ... the specified VIMM is reaching its maximum temperature within the acceptable temperature range The alarm specifies the VIMM ID and the current temperature in Celsius The VIMM shuts down if the temperature reaches the maximum acceptable temperature To clear the alarm 1 Check for any airflow restrictions including the filter in the front panel 2 If there are no airflow issues and the environment is...

Page 207: ...rm replace the VIMM VIMM Unformatted Alarm The VIMM Unformatted alarm indicates that the specified VIMM is unformatted and is thus not being used VIMM Voltage VIMM Shut Down Alarm The VIMM Voltage VIMM Shut Down alarm indicates an over under voltage condition and the voltage reading just before shutdown for a specific VIMM To clear the alarm replace the VIMM VIMM Threshold Exceeded Alarm The VIMM ...

Page 208: ...Appendix C Alarm Reference 208 VMA series Memory Array Installation and Service Guide HP AM456 9002A Rev 01 ...

Page 209: ... Commands on page 213 Chassis Context Commands on page 221 Board 0 Context Commands on page 223 Slot Context Commands on page 227 VIMM Context Commands on page 230 VIMM summary Context Commands on page 233 Controller Context Commands on page 236 Ethernet 0 Context Commands on page 238 Fan tray Context Commands on page 243 Fan Context Commands on page 244 CLI Context Commands on page 245 RAID Conte...

Page 210: ... HP AM456 9002A Rev 01 In memory Context Commands on page 281 Category Context Commands on page 285 Syslog Context Commands on page 287 Status Context Commands on page 290 Sw upgrade Context Commands on page 294 Uptime Context Commands on page 297 Version Context Commands on page 298 ...

Page 211: ...in one of two ways 1 Define the context level while entering the command from the root context level 2 Navigate to the context level then enter the command Define the context level while entering the command from the root context level Include the context level when typing a command For example to display the speed of the left fan in the top fan tray in one command at the root level From the root ...

Page 212: ... The context level command lets you navigate into a lower level of the CLI command hierarchy Specify the various levels that are depicted in Figure D 1 Context Levels on page 214 For example to display the speed of the left fan in the top fan tray where 1 is top and 2 is bottom 1 Move to the context level for the left fan by typing the following command at the root level 2 Type the following comma...

Page 213: ...stem resource context Moves to lower context level exit Exits the CLI format Formats flash capacity help Displays this list of commands history Retrieves the most recently typed user commands ping Sends an ICMP ECHO_REQUEST to another network host reboot Reloads restarts the indicated processor reset Resets the Ethernet Interface See the Ethernet 0 Context Commands on page 238 restore Restores sys...

Page 214: ... various levels that are depicted in the figure below Figure D 1 Context Levels Syntax context context_level cli Cancels the CLI system Cancels a scheduled reboot session session_id Cancels the specified CLI session reboot Cancels a system reboot chassis board 0 slot n controller group n root system fan tray 1 2 led state sw upgrade uptime status version logging alarms boot params vimm ethernet 0 ...

Page 215: ...ormat command will be rejected if there are any open files accessing the memory array storage device dev vtmsa Close any open files or unmount any mounted filesystems using the storage device To unmount the file system use the umount Linux command e g umount dev vtmsa Syntax format flash capacity value context_level Specifies the context level to navigate to Valid values are chassis See Chassis Co...

Page 216: ...ntage consult with HP Customer Support help Lists the available general commands or information on a specific command Syntax help command Where history Displays the most recently used CLI commands Syntax history Example To display the most recently issued CLI commands type value Specifies the percentage of usable flash capacity Valid values are 50 65 78 84 87 90 Not recommended for high performanc...

Page 217: ...lost and you will have to log back into the interface Syntax reboot system all oam delay n Where chassis board 0 slot 67 history 01 context chassis 02 help 03 04 up 05 context chassis 06 context board 0 07 context slot 4 08 context vimm 09 top 10 context system version hostname Specifies the hostname to send the ICMP ECHO_REQUEST messages to ip_address Specifies the IP address to send the ICMP ECH...

Page 218: ...more information reset Resets the Ethernet interface During a reset active Telnet and SSH sessions are terminated which is useful if the session is hung Syntax reset chassis controller ethernet 0 set Runs the specified command parameters Syntax set parameter value Where show Displays the results for the specified requested information Syntax show parameter parameter The command parameter to run Th...

Page 219: ...d able to be managed via the CLI Use the reboot CLI command to bring the Memory Array back online Syntax shutdown top Moves back up to the root level topmost context level of the CLI parameter Specifies the information to display This parameter may include a context level including vimm slot vimm summary ethernet fan speed alarms uptime version show chassis board 0 info chassis board 0 show info p...

Page 220: ...text level of the CLI Syntax up Example If you are at the Chassis board 0 context level and you want to move up one level of the CLI at the chassis board 0 prompt type You will be moved to the Chassis context level which displays the following prompt Lists the available selections for a specified command If no command is specified then the General Commands are listed Syntax command Where chassis b...

Page 221: ...the CLI context board 0 Moves to the Board 0 context level Syntax context board 0 The system prompt changes to the following context controller Moves to the Controller context level Table D 2 Chassis Context Commands Command Description context board 0 Moves the user to the Board 0 context level context controller Moves the user to the Controller context level context fan tray Moves the user to th...

Page 222: ...ves to the specified Fan tray context level See Fan tray Context Commands on page 243 Syntax context fan tray 1 2 Where The system prompt changes to the following for the top fan tray The system prompt changes to the following for the bottom fan tray chassis controller 1 Indicates the top fan tray context level 2 Indicates the bottom fan try context level chassis fan tray 1 chassis fan tray 2 ...

Page 223: ... Moves the user into the context level for the specified slot See Slot Context Commands on page 227 set flash scrubbing Sets whether the flash memory is scrubbed or not show flash scrubbing Displays whether the flash memory scrubbing function has been enabled or not Note Use this command only on a flash based Memory Array show info Displays information about the main board in the system set write ...

Page 224: ... Memory Array Enables or disables flash memory scrubbing Syntax set flash scrubbing enabled disabled Where The command displays information similar to the following n Moves the user into the context level for the specified slot n Valid values are in the range of 0 83 inclusive See Slot Context Commands on page 227 chassis board 0 slot n context slot 56 chassis board 0 context slot 56 chassis board...

Page 225: ...acturing and environmental information about the main board in the system Syntax show info The command displays information similar to the following set write buffer Note Use this command only on a flash based Memory Array Enables or disables write buffer on the flash VIMMs Syntax set write buffer enabled disabled chassis board 0 show flash scrubbing flash scrubbing disabled chassis board 0 show i...

Page 226: ... D CLI Reference 226 VMA series Memory Array Installation and Service Guide HP AM456 9002A Rev 01 Where enabled Enables the write buffer on the flash VIMMs disabled Disables the write buffer on the flash VIMMs ...

Page 227: ...the context level for the VIMM in the previously specified slot Syntax context vimm The system prompt changes to the following Example To move into the VIMM context level for slot 56 at the Slot 56 context prompt type Table D 4 Slot Context Commands context vimm Moves into the VIMM context level See VIMM Context Commands on page 230 set led test Initiates a functional test of the slot s LED show l...

Page 228: ...state Syntax set led test start Example To start a functional test of the LED associated with slot 56 at the Slot 56 context prompt type The command displays information similar to the following show led state Displays the current status of the LED associated with the slot specified in the context slot command Syntax show led state Example To display the current status of the LED associated with s...

Page 229: ...Context Commands HP AM456 9002A Rev 01 VMA series Memory Array Installation and Service Guide 229 The command displays information similar to the following chassis board 0 slot 56 show led state led state on ...

Page 230: ...the state to down you turn off power to the specific VIMM so it can be removed without electrical damage to the VIMM the slot in which it is located or the main board The LED on the main board that is associated with the slot is then lit solid red to indicate that the VIMM can be removed safely The LED turns off when the VIMM is removed Syntax set admin state down up Where Table D 5 VIMM Context C...

Page 231: ...loss will occur show Displays configuration information for the VIMM in the specified slot Syntax show Example To display the configuration information for the flash VIMM in slot 56 at the VIMM context prompt type The command displays information similar to the following show chassis board 0 slot 56 vimm show admin state up oper state up vimm state active raid group 0 vimm type FLASH mem type SLC ...

Page 232: ... 2010 user reads 130 233 145 user read bytes 133 358 740 480 user writes 130 233 037 user write bytes 133 358 629 888 ecc cor counts one bit 3 two bits 0 three bits 0 four plus bits 0 total cor 3 ecc corrected 3 rate 2 30e 08 raid corrected 0 rate 0 00e 00 blk boot fails 0 blk erase fails 0 blk prog fails 0 blk ecc thresh 0 blk ecc uncor 0 erase counts blk erase target 100 000 blk erase avg 18 20 ...

Page 233: ...MM summary context level of the CLI Specify the VIMM number when moving into the Board 0 context level See context slot on page 223 show Displays which VIMMs are present in the system the corresponding slot ID numbers and the VIMM type Syntax show Example To display which VIMM locations are populated at the VIMM summary context prompt type Table D 6 VIMM summary Context Commands Command Descriptio...

Page 234: ...rmatted percentage 78 1 usable mem formatted 1718 0GB 1600GiB chassis board 0 show vimm summary num vimms 42 installed vimm ids 0 41 flash vimm ids 0 41 admin down vimm ids 37 installed mem raw 1894 1GB 1764GiB usable mem raw 1443 1GB 1344GiB parity mem raw 360 8GB 336GiB spare mem raw 90 2GB 84GiB unavailable mem raw 42 2GB 40GiB formatted percentage 78 1 usable mem formatted 1126 9GB 1000GiB adm...

Page 235: ...some memory is reserved for spares and RAID support usable mem raw Indicates in GB the amount of usable memory advertised to the host parity mem raw Indicates in GB the amount of memory dedicated to RAID parity spare mem raw Indicates in GB the amount of spare memory ready to be used in case of a VIMM failure unavailable mem raw Indicates in GB the amount of memory that is installed but unusable T...

Page 236: ...speed of the serial port to either 9600 or 115200 After the changing the serial speed setting reboot the Memory Array Syntax set serial speed 9600 115200 show serial speed Shows the speed of the serial port at either 9600 or 115200 Table D 8 Controller Context Commands Command Description context ethernet 0 Moves the user to the Ethernet 0 context level See Ethernet 0 Context Commands on page 238 ...

Page 237: ...v 01 VMA series Memory Array Installation and Service Guide 237 Syntax show serial speed context ethernet 0 Moves into the Ethernet 0 context level Syntax context ethernet 0 The system prompt changes to the following chassis controller ethernet 0 ...

Page 238: ...es or disables using DHCP to automatically set the system s IP address set ip address Manually sets the IP address of the system clear ip address Clears the provisioned ip netmask gateway to use when DHCP is disabled set dns config Sets the current DNS configuration type of the system when DHCP has been enabled set dns nameserver Sets the IP address for the DNS server to use when dns config is set...

Page 239: ... the provisioned ip netmask gateway to use when DHCP is disabled Syntax clear ip address Use the save config command to save the changes across system reboots set dns config Sets the current DNS configuration type of the system when DHCP has been enabled Set the DNS configuration type either manually or automatically enabled Enables using DHCP to automatically set the system s IP address disabled ...

Page 240: ...r Where Use the save config command to save the changes across system reboots clear dns nameserver Clears the provisioned DNS server address to be used when the set dns config command is set to manual Syntax clear dns nameserver Use the save config command to save the changes across system reboots set dns search Provisions domain name for host name lookup to be used when the set dns config command...

Page 241: ...isplays the IP netmask gateway and MAC addresses of the Memory Array Syntax show Example To display the system Ethernet information at the Controller context prompt type The command displays information similar to the following value The local domain name show chassis controller ethernet 0 show dhcp enabled ip address 10 10 0 125 netmask 255 255 255 0 gateway 10 10 0 1 mac address 00 1B 97 00 00 0...

Page 242: ...01 reset Resets the Ethernet port Syntax reset Example To reset the Ethernet port at the Controller context prompt type WARNING If the Ethernet port is reset while logged in vial Telnet or SSH then the CLI session will be lost Run this command only when running the CLI from the serial console port reset ...

Page 243: ...21 context fan Moves into the context level for the specified fan The fans are labeled from left to right when facing the chassis Syntax context fan left center right Where The system prompt changes similar to the following Table D 10 Fan tray Context Commands Command Description context fan Moves into the Fan context level See Fan Context Commands on page 244 left Moves the user into the context ...

Page 244: ...s available at the Fan context level of the CLI Access the Fan context level through the Fan tray context level See Fan tray Context Commands on page 243 show Displays the current speed setting of the fan Syntax show The command displays text similar to the following Table D 11 Fan Context Commands Command Description show Displays the current fan speed and rpm chassis fan tray 1 fan left show spe...

Page 245: ...ut Sets the time in minutes before exiting due to user inactivity set lines Sets the number of lines in the display window set pagination Enables disables pagination in the display window show columns Displays the number of columns in the display window show edit mode Displays the command line edit mode show history size Displays the size of the history buffer show idle timeout Displays the time i...

Page 246: ...cified size Syntax set history size n Where set idle timeout Sets the time in minutes before exiting due to user inactivity Syntax set idle timeout n Where set lines Sets the window size to the specified number of lines vi Sets the command line editing mode to vi emacs Sets the command line editing mode to emacs n The number of lines to set for the history buffer Valid values are in the range of 1...

Page 247: ...are listed in the table below show columns Displays the number of columns in the display window Syntax show columns n The number of lines for the window size Valid values are in the range of 10 100 on Enables the pagination setting of the display window off Disables the pagination setting of the display window Table D 13 Pagination Controls Key Description return Print the next line space Print th...

Page 248: ...x show edit mode The command displays information similar to the following show history size Displays the current size of the history buffer Syntax show history size The command displays information similar to the following show idle timeout Displays the time in minutes before exiting due to user inactivity Syntax show idle timeout cli show columns columns 80 cli show edit mode edit mode vi cli sh...

Page 249: ... command displays information similar to the following show pagination Displays the pagination setting for the display window which can be on or off Syntax show pagination The command displays information similar to the following show session Displays the Operation Administration and Maintenance OAM oam_cli session Syntax show session n cli show idle timeout idle timeout 30 minutes cli show lines ...

Page 250: ... Service Guide HP AM456 9002A Rev 01 The command displays information similar to the following cancel session Cancels the oam_cli session Syntax cancel session cli show session Session ID Terminal Active Since Source 97 pts 0 Jun 24 09 59 10 10 0 113 Current cli session ...

Page 251: ...group Syntax context group n Where The system prompt changes to the following Example To move into the context level for RAID group 5 at the RAID context prompt type Table D 14 RAID Context Commands Command Description context group Moves the user into the context level for the specified RAID group See RAID Group Context Commands on page 253 show spare ids Displays the IDs of the spare VIMMs in a ...

Page 252: ...Ds of the spare VIMMs in a Memory Array These spares are used during RAID group rebuilding when a VIMM becomes unstable and is moved out of service Syntax show spare ids The command displays the information shown below If no spares are available then the following is displayed raid context group 5 raid group 5 raid show spare ids spares 30 31 32 52 raid show spare ids spares none ...

Page 253: ...See RAID Context Commands on page 251 context maps Moves into the context level for the Maps group Syntax context maps The system prompt changes to the following Where Example To move into the Maps context level for RAID group 5 at the RAID context prompt type Table D 15 RAID Group Context Commands Command Description context maps Moves the user into the context level for the RAID group mapping Se...

Page 254: ...Appendix D CLI Reference 254 VMA series Memory Array Installation and Service Guide HP AM456 9002A Rev 01 The command displays the following information raid context group 5 maps raid group 5 maps ...

Page 255: ...lays the VIMM mapping for the specified RAID group Four VIMMs in a RAID group contain data and one contains parity information Each RAID group can tolerate a single VIMM failure with no loss of data Syntax show Example To display the VIMM mapping information for RAID group 4 at the Maps context prompt type The command displays information similar to the following Table D 16 Maps Context Commands C...

Page 256: ...s the physical VIMM ID The valid range of values is 0 83 inclusively state Indicates the state of each VIMM in the 5 VIMM RAID group Valid values are data VIMM is being used for data either user data or parity data REBUILDING VIMM is currently being rebuilt by the RAID engine to recover from a prior failure FAULT A fault has occurred for this VIMM If a spare is available a rebuild occurs for this ...

Page 257: ...context boot params Moves into the boot params context level context led state Moves into the LED State context level See LED state Context Commands on page 277 context logging Moves into the Logging context level See Logging Context Commands on page 279 context oam Moves into the oam context level context status Moves into the Status context level See Status Context Commands on page 290 context s...

Page 258: ...he date time in ISO 8601 format yyyy mm ddThh mm ss set clock source Sets the clock source for the system save config Saves system changes to the flash restore config Reverts back to factory settings set led test Initiates a functional test of the system s LEDs set name Sets the name of the Memory Array show boot params Displays the systems boot parameters show clock Displays the system date and t...

Page 259: ...xt alarms Moves into the Alarms context level to access the alarm related commands Syntax context alarms The system prompt changes to the following context all Moves into the all context level to reboot all system processors Syntax context all The system prompt changes to the following context boot params Moves into the boot param context level to access system boot parameters clear log system cle...

Page 260: ...e LED state related commands Syntax context led state The system prompt changes to the following context logging Moves into the Logging context level to access the logging related commands Syntax context logging The system prompt changes to the following context oam Moves into the OAM context level to reboot OAM processor Syntax context oam The system prompt changes to the following system boot pa...

Page 261: ...ontext sw upgrade Moves into the software upgrade context level to access the software upgrade commands Syntax context sw upgrade The system prompt changes to the following context uptime Moves into the Uptime context level to access operational time related commands Syntax context uptime The system prompt changes to the following context version Moves into the Version context level to access soft...

Page 262: ...ng requirements Have a length between 6 12 alphanumeric characters If six characters are used then you must mix upper lower case letters with numbers or punctuation Be a combination of upper and lower case letters and numbers Cannot be similar to a previous password Cannot be a palindrome If you specify an unacceptable password you will get a message that the password is too simple By increasing t...

Page 263: ...default password for the admin user Use the save config command to save the changes across system reboots set clock Sets the system date and time Syntax set clock yyyy mm dd T hh mm ss Where system set admin foobar Changing password for admin Enter the new password minimum of 6 maximum of 12 characters Please use a combination of upper and lower case letters and numbers Enter new password Bad pass...

Page 264: ...accurate calendar date and time If the system is rebooted then the elapsed time is not accounted for when the system finishes the reboot process and is again operational Syntax set clock source host local Where save config Commits the admin login password and system log service changes to flash or reverts back to the factory default settings If the changes are not committed before the system is re...

Page 265: ...nformation similar to the following set led test Starts a functional test of the system LEDs Syntax set led test start Example To start a functional test of the system LEDs at the System context prompt type The command displays information similar to the following system save config Config operation succeeded Validity check succeeded system restore config factory Running this command requires a no...

Page 266: ...save the changes across system reboots show boot params Displays the system boot parameters Syntax show boot params stagger mem clear The command displays information similar to the following show clock Displays the current time and date of a Memory Array Syntax show clock The command displays information similar to the following name Specifies the new name for the system system show boot params s...

Page 267: ...g Where show log Displays the current entries in the log buffer The display of the log is controlled by whether pagination has been enabled or not in the current CLI session See set pagination on page 247 for more information Syntax show log clock Displays the date and time in the format yyyy mm ddThh mm ss The T is a delineator between the date and the time system show clock source clock source h...

Page 268: ...message log file created on the Memory Array contains system log and typical boot up messages in addition to any set CLI commands that are run on the system Syntax show messages Example To display the log messages at the System context prompt type system show log xxx xx xx xx xx 000000000 INFO vtu_log_init LOG RESTART xxx xx xx xx xx 000000010 INFO ecpu_hwmgr_init Running fans at full speed xxx xx...

Page 269: ...22 kernel uClinux Nios II Date 00 28 22 kernel Altera Nios II support C 2004 Microtronix Datacom Ltd Date 00 28 22 kernel On node 0 totalpages 32512 Date 00 28 22 kernel DMA zone 32512 pages LIFO batch 7 Date 00 28 22 kernel Built 1 zonelists Date 00 28 22 kernel Kernel command line CONSOLE dev ttyS0 root dev ram0 r w panic 10 mtdparts violin 0 256k BOOTROM ro 128k ENV1 128k ENV2 1536k FLATFS3 32m...

Page 270: ... AM456 9002A Rev 01 The command displays information similar to the following show status Displays the status of the various software modules and the validity of the current VIMM configuration Syntax show status system show reboot There is a reboot scheduled in 14 minute s and 8 seconds ...

Page 271: ...ory mgr running raid mgr running vimm mon running data plane available raid rebuild active group 2 vimm 07 47 complete vimm config out of spec 42 vimm admin down vimm ids 60 missing vimm ids 15 host interfaces slot port 1 state enabled protocol pcie link width 4 neg link width 4 max data rate 10 Gb s cfg data rate 10 Gb s host detected slot port 2 state enabled protocol pcie link width 4 neg link ...

Page 272: ...ing raid mgr running vimm mon running data plane available raid rebuild active group 2 vimm 07 47 complete vimm config out of spec 42 vimm failed vimm ids 32 61 admin down vimm ids 60 missing vimm ids 15 host interfaces slot port 1 state enabled protocol pcie link width 4 neg link width 4 max data rate 10 Gb s cfg data rate 10 Gb s host detected slot port 2 state enabled protocol pcie link width 4...

Page 273: ...em context level See System Context Commands on page 257 show Displays the current alarms on a Memory Array The following are possible alarms Lid has been removed Fan tray has been removed Fan is not operating at its correct speed VIMM is experiencing low voltage VIMM is over the maximum allowable temperature Syntax show Example To display the current alarms on a system at the Alarms context promp...

Page 274: ...ing 45 complete alarm2 Lid removed alarm3 Top fan tray removed alarm4 Bottom left fan running too slowly 2000 RPM alarm5 VIMM 14 low 1 8V 1 68 volts VIMM shut down alarm6 VIMM 68 hot 71 C show system alarms alarm1Data plane disabled alarm2Scheduler paused alarm3VIMM flash format in progress 2 complete alarm4VIMM configuration OUT OF SPEC 2 missing 0 failed from 5 VIMM system alarm5CPL IRQs on VIMM...

Page 275: ...or disables the staggered VIMM boot up process When enabled the VIMMs boots up in a staggered sequence upon a system reboot Syntax set stagger mem clear disabled enabled Example To enable the staggered VIMM boot up process at the Boot params context prompt type Table D 19 Boot params Context Commands Command Description set stagger mem clear Enables or disables the staggered VIMM boot up process s...

Page 276: ...plays the current state of the VIMM boot up process Syntax show stagger mem clear Example To display the current state of the VIMM boot up process at the Boot params context prompt type The command displays information similar to the following show stagger mem clear system boot params show stagger mem clear stagger mem clear enabled ...

Page 277: ...at the LED State context sublevel of the CLI Access the LED State context sublevel through the System context level See System Context Commands on page 257 show Displays the current status of the system LEDs Syntax show Example To display the current status of the system LEDs at the LED State context prompt type Table D 20 LED State Context Commands Command Description show Displays the current st...

Page 278: ...I Reference 278 VMA series Memory Array Installation and Service Guide HP AM456 9002A Rev 01 The command displays information similar to the following system led state show power a on power b on status on alarm off ...

Page 279: ...Context Commands on page 257 context in memory Moves into the In memory context level to access the message category related commands Syntax context in memory Where The system prompt changes to the following Table D 21 Logging Context Commands Command Description context in memory Moves into the In memory context level See In memory Context Commands on page 281 context syslog Moves into the Syslog...

Page 280: ... Service Guide HP AM456 9002A Rev 01 context syslog Moves into the Syslog context level to access the syslogd related commands Syntax context syslog Where The system prompt changes to the following context syslog Moves into the Syslog context level system logging syslog ...

Page 281: ...ands on page 279 context category Moves into the Category context level to access the message category related commands Syntax context category category_name Where Table D 22 In memory Context Commands Command Description context category Moves into the Category context level See Category Context Commands on page 285 set default level Sets the default logging level for all message categories show ...

Page 282: ...ol Plane ctpl tree Tree construction logic in control plane data mgr Data Manager diag mgr Diagnostics Manager dispatcher Message Dispatcher dtl Data Transport Layer ecpu Embedded CPU hal Hardware Abstraction Layer hw mgr Hardware Manager inv mgr Inventory Manager pcblayout PCB Layout perf mon Performance Monitor portstatus VIMM Port Status priq Priority Queue rbtree Red Black tree implementation ...

Page 283: ... fatal error warn info debug Where show default level Displays the default logging level of messages stored in the system log of the Memory Array The message logging level can be set to DEBUG INFO WARN ERROR FATAL default The default value which is currently info fatal Sets the system default message level to fatal error Sets the system default message level to error warn Sets the system default m...

Page 284: ...284 VMA series Memory Array Installation and Service Guide HP AM456 9002A Rev 01 Syntax show default level The command displays information similar to the following system logging in memory show default level default level info ...

Page 285: ...mory Context Commands on page 281 set level Sets the logging level of the specified message category stored in the system log of the Memory Array Setting the category logging level overrides the default level set in the In memory context command The logging level can be set to DEBUG INFO WARN ERROR FATAL Syntax set level default fatal error warn info debug Table D 24 Category Context Commands Comm...

Page 286: ...g level can be set to DEBUG INFO WARN ERROR FATAL Syntax show level The command displays information similar to the following default Sets the category message level to the currently defined default level fatal Sets the category message level to fatal error Sets the category message level to error warn Sets the category message level to warn info Sets the category message level to info This is the...

Page 287: ...hat will receive the system log This host must have syslogd configured correctly The Memory Array sends messages to only one syslog server at a time See your host s syslogd documentation for instructions Display the man page for syslog conf on your host for more information Syntax set host ip_address Table D 25 Syslog Context Commands Command Description set host Sets the IP address for the syslog...

Page 288: ...ve the changes across system reboots show host Displays the IP address of the host that receives the system log This host must have the syslogd configured correctly See your host s syslogd documentation for instructions Display the man page for syslog conf on your host for more information Syntax show host The command displays information similar to the following ip_address Specifies the IP addres...

Page 289: ... Array Installation and Service Guide 289 show service Displays the status of the service that sends the system log to a host running syslogd Syntax show service The command displays information similar to the following system logging syslog show service service on ...

Page 290: ... See System Context Commands on page 257 show Displays the status of various software modules Syntax show The command displays information similar to the following when the system is operating correctly Table D 26 Status Context Command Command Description show Displays the current status of the system software modules system status show alarm mgr running data mgr running diagnostics mgr running h...

Page 291: ...lot port 2 state disabled host undetected slot port 0 state disabled host undetected system status show alarm mgr running data mgr running diagnostics mgr running hardware mgr running inventory mgr running raid mgr running data plane available raid rebuild inactive vimm config in spec 84 vimm failed vimm ids 32 61 host interfaces slot port 1 state enabled protocol pcie link width 8 neg link width ...

Page 292: ...arm mgr running data mgr running diagnostics mgr running hardware mgr running inventory mgr running raid mgr running data plane available raid rebuild inactive vimm config in spec 84 vimm failed vimms 32 missing vimms 61 host interfaces slot port 1 state enabled protocol pcie link width 8 neg link width 8 max data rate 20 Gb s cfg data rate 20 Gb s host detected slot port 2 state disabled host und...

Page 293: ...tatus show alarm mgr running data mgr running diagnostics mgr running hardware mgr running inventory mgr running raid mgr running data plane available raid rebuild active group 15 vimm 30 vimm config in spec 84 vimm host interfaces slot port 1 state enabled protocol pcie link width 8 neg link width 8 max data rate 20 Gb s cfg data rate 20 Gb s host detected slot port 2 state disabled host undetect...

Page 294: ...ade images installed on the Memory Array and you want to make the current upgrade image the factory image Syntax copy system sw upgrade Table D 27 Sw upgrade Context Commands Command Description copy system sw upgrade Updates the system software factory image if you have both factory and upgrade images installed on the Memory Array and you want to make the current upgrade image the factory image s...

Page 295: ...sh Syntax set path path Where show active Displays the specified partition in flash to be activated during the next reboot of the Memory Array Use this command after the set active command during an upgrade procedure Syntax show active upgrade Sets the upgrade partition in flash to be activated during the next system reboot The upgrade partition contains the downloaded upgrade software factory Set...

Page 296: ...g system sw upgrade show active Checking partition information The active partition is set to factory upgrade Specifies that the upgrade partition in flash is set to be activated during the next system reboot The upgrade partition contains the downloaded upgrade software factory Specifies that the factory partition in flash is set to be activated upon the next system reboot The factory partition c...

Page 297: ... Access the Uptime context sublevel through the System context level show Displays how long the system has been operational The time is displayed in tenths of a second and in years days and hours Syntax show The command displays information similar to the following Table D 28 Uptime Context Command Command Description show Displays how long the Memory Array has been operational system uptime show ...

Page 298: ...e software modules Syntax show The command displays information similar to the following Table D 29 Version Context Command Command Description show Displays the versions of the software modules system version show software version release software build date date 12 44 52 software build info built on swbuild violintech net by user common CPL bootloader version release OAM bootloader version relea...

Page 299: ...Commands HP AM456 9002A Rev 01 VMA series Memory Array Installation and Service Guide 299 controller version info 12954_x8a 05 28 09 11 39 saxpow version info 8418 03 12 08 15 26 saxled version info 7642 01 25 08 13 48 ...

Page 300: ...Appendix D CLI Reference 300 VMA series Memory Array Installation and Service Guide HP AM456 9002A Rev 01 ...

Reviews:

No comments

Brands by name

Popular brands

Load more brands