Dell EMC PowerEdge VRTX Скачать руководство пользователя | Manualshive

Страница: 178 / 208

background image

NOTE: The Encrypt Virtual Disk option is available only if unsecure virtual disks are configured in the SED.

Encrypting Virtual Disks Using RACADM

To encrypt virtual disks by running a RACADM command, use the following syntax:

racadm raid encryptvd:Disk.Virtual.0:RAID.ChassisIntegrated.1-1

For more information, see the

Chassis Management Controller PowerEdge VRTX RACADM Command Line Reference Guide

.

Unlocking Foreign Configuration

Drives which are part of secure virtual disks are called secured drives. Secured drives can be migrated from one controller to another
controller. If a different encryption or security key is configured for the destination controller, the security status of these drives is
displayed as ‘locked’ and cannot be seen as part of ‘preview foreign config’. The ‘Import foreign config’ does not detect these foreign
drives.
While running the unlock command, provide the source controller passphrase and key ID for these drives. Even after unlocking, the
‘foreign controller key’ still secures these drives. However, you can see these drives while searching for foreign drives in the existing
‘preview foreign config’. You can import or clear the foreign configuration on these secure drives.
If foreign drives with different security keys are migrated from more than one controller, then unlock and import or clear the set of
drives from one foreign controller before unlocking the drives migrated from another controller. This action ensures that unlock is not
allowed on a controller, if the controller has drives that are unlocked but not imported or cleared.
Once drives are unlocked, you can import the foreign configuration using the CMC web interface or RACADM.
If the controller is power cycled after the unlock and before the import phase, the drives are locked again.
If the system has multiple foreign configurations, unlock and import each foreign configuration before unlocking the foreign
configuration.
The key ID used in unlocking is used only to identify the drives with matching the key ID. After the matching drives are found, the
passphrase is used for unlocking the drives.

Unlocking Foreign Configuration Using CMC Web Interface

To unlock the foreign configuration:

1.

In the left pane, click

Chassis Overview

→

Storage

→

Controllers

→

Setup

.

2.

Navigate to the

Setup

page.

3.

Click

Click here to Unlock

.

The

Physical Disks

page is displayed.

4.

Select the physical disks that you want to unlock.

5.

Check if the Physical disk is associated with the key identifier.

6.

From the

Actions

drop-down, select

Unlock Drive.

A dialogue box is displayed prompting you to enter the security key phrase.

7.

Enter a passphrase in the

Security Key Passphrase

text box.

8.

Re-enter the passphrase and click

Unlock

.

The physical drive is unlocked and the drive does not appear in the

Recover Physical Disks

list.

Unlocking Foreign Configuration Using RACADM

To unlock foreign configuration by running a RACADM command, use the following syntax:

racadm raid unlock:<Controller FQDD> -key <Key id> -passwd <passphrase>

For more information, see the

Chassis Management Controller PowerEdge VRTX RACADM Command Line Reference Guide

.

178

«
...
176
177
178
179
180
...
»

Содержание EMC PowerEdge VRTX

Страница 1: ...Dell Chassis Management Controller Version 3 0 for Dell EMC PowerEdge VRTX User s Guide ...

Страница 2: ... to hardware or loss of data and tells you how to avoid the problem WARNING A WARNING indicates a potential for property damage personal injury or death Copyright 2017 Dell Inc or its subsidiaries All rights reserved Dell EMC and other trademarks are trademarks of Dell Inc or its subsidiaries Other trademarks may be trademarks of their respective owners 2017 09 Rev A01 ...

Страница 3: ...ment Console Applications 23 How to use this Guide 23 Other Documents You May Need 23 Accessing documents from the Dell EMC support site 24 2 Installing and Setting Up CMC 25 Before You Begin 25 Installing CMC Hardware 25 Checklist To Set up Chassis 25 Basic CMC Network Connection 26 Installing Remote Access Software on a Management Station 26 Installing RACADM on a Linux Management Station 26 Uni...

Страница 4: ...ton 37 Configuring LCD 37 Accessing a Server Using KVM 38 3 Logging in to CMC 39 Accessing CMC Web Interface 39 Logging in to CMC as a Local User Active Directory User or LDAP User 39 Logging in to CMC Using a Smart Card 40 Logging in to CMC Using Single Sign on 41 Logging In To CMC Using Serial Telnet Or SSH Console 41 Accessing CMC Using RACADM 41 Logging in to CMC Using Public Key Authenticatio...

Страница 5: ...Interface 54 Viewing Firmware Inventory Using RACADM 55 Saving Chassis Inventory Report Using CMC Web Interface 56 Configuring Network Share Using CMC Web Interface 56 Lifecycle Controller Job Operations 56 Reinstalling Server Component Firmware 57 Rolling Back Server Component Firmware 57 Rolling Back Server Component Firmware Using the CMC Web Interface 57 Upgrading Server Component Firmware 58 ...

Страница 6: ... 73 Configuring IPv4 and IPv6 DNS Settings 73 Configuring Auto Negotiation Duplex Mode and Network Speed for IPv4 and IPv6 74 Setting the Maximum Transmission Unit for IPv4 and IPv6 74 Configuring CMC Network and Login Security Settings 74 Configuring IP Range Attributes Using CMC Web Interface 74 Configuring IP Range Attributes Using RACADM 75 Configuring Virtual LAN Tag Properties for CMC 75 Con...

Страница 7: ...ing Rules 89 Viewing and Ending CMC Sessions 90 Viewing and Ending CMC Sessions Using Web Interface 90 Viewing and Ending CMC Sessions Using RACADM 90 7 Configuring Servers 91 Configuring Slot Names 91 Configuring iDRAC Network Settings 92 Configuring iDRAC QuickDeploy Network Settings 92 Assigning QuickDeploy IP Address to Servers 94 Modifying iDRAC Network Settings for Individual Server iDRAC 94...

Страница 8: ...nching iDRAC using Single Sign On 106 Launching Remote Console 107 8 Configuring CMC To Send Alerts 108 Enabling Or Disabling Alerts 108 Enabling Or Disabling Alerts Using CMC Web Interface 108 Filtering Alerts 108 Configuring Alert Destinations 109 Configuring SNMP Trap Alert Destinations 109 Configuring Email Alert Settings 110 9 Configuring User Accounts and Privileges 112 Types of Users 112 Mo...

Страница 9: ...le Features 134 CMC Command Line Interface Commands 134 Using Telnet Console With CMC 134 Using SSH With CMC 135 Supported SSH Cryptography Schemes 135 Configure Public Key Authentication Over SSH 135 Configuring Terminal Emulation Software 137 Configuring Linux Minicom 137 Connecting to Servers or Input Output Module Using Connect Command 138 Configuring the Managed Server BIOS for Serial Console...

Страница 10: ...s To Servers 158 Assigning Priority Levels To Servers Using CMC Web Interface 158 Assigning Priority Levels To Servers Using RACADM 158 Viewing Power Consumption Status 158 Viewing Power Consumption Status Using CMC Web Interface 158 Viewing Power Consumption Status Using RACADM 158 AC Power Recovery 159 Viewing Power Budget Status Using CMC Web Interface 159 Viewing Power Budget Status Using RACA...

Страница 11: ...ation 171 Configuring Storage Controller Settings 171 Configuring Storage Controller Settings Using CMC Web Interface 171 Configuring Storage Controller Settings Using RACADM 172 Shared PERC Controllers 172 Enabling or Disabling RAID Controller Using CMC Web Interface 172 Enabling or Disabling RAID Controller Using RACADM 174 Enabling or disabling fault tolerance of external RAID controller using ...

Страница 12: ...eb Interface 183 Assigning PCIe Slots To Servers Using CMC Web Interface 183 Managing PCIe Slots Using RACADM 184 PCIe Power Ride Through 184 Viewing PCIe Ride through Properties Using CMC Web Interface 185 Viewing PCIe Ridethrough Properties Status Using RACADM 185 Configuring PCIe Ride through Properties Using CMC Web Interface 185 Configuring PCIe Ride through Properties Status Using RACADM 185...

Страница 13: ... 18 Using LCD Panel Interface 198 LCD Navigation 198 Main Menu 199 KVM Mapping Menu 199 DVD Mapping 199 Enclosure Menu 199 IP Summary Menu 200 Settings 200 Diagnostics 200 Front Panel LCD Messages 201 LCD Module and Server Status Information 201 19 Frequently Asked Questions 205 RACADM 205 Managing and Recovering a Remote System 205 206 Active Directory 206 FlexAddress and FlexAddressPlus 207 IOM ...

Страница 14: ...Engagement DPSE mode This mode enables CMC to improve power efficiency by setting the power supplies while the server in standby mode and dynamically managing the load and redundancy requirements CMC reports real time power consumption which includes logging high and low points with a time stamp CMC supports setting an optional enclosure maximum power limit System Input Power Cap which alerts and ...

Страница 15: ...e of server components such as BIOS network controllers storage controllers and so on across multiple servers in the chassis using Lifecycle Controller Dell OpenManage software integration Enables you to launch the CMC web interface from Dell OpenManage Server Administrator or OpenManage Essentials OME 1 2 CMC alert Alerts you about potential managed node issues through Remote syslog email message...

Страница 16: ...d 40 bit SSL 3 0 encryption for countries where 128 bit is not acceptable NOTE Telnet does not support SSL encryption Configurable IP ports if applicable Login failure limits per IP address with login blocking from the IP address when the limit is exceeded Configurable session auto time out and more than one simultaneous sessions Limited IP address range for clients connecting to CMC Secure Shell ...

Страница 17: ...Table 2 CMC back panel parts Item Indicator Button or Connector 1 PCIe expansion card slots low profile 5 2 PCIe expansion card slots full height 3 3 CMC GB Ethernet port CMC 2 4 CMC GB Ethernet port CMC 1 5 Serial Connector 6 Blower modules 4 7 I O module ports 8 PSU 4 9 PSU 3 10 PSU 1 11 PSU 2 A Front Panel view of the chassis is given here with a table that lists the parts and devices available...

Страница 18: ...on indicator power button The power on indicator glows when the enclosure power is on The power button controls the PSU output to the system 6 Hard disk drives HDD 2 5 inch hard drive enclosure Up to twenty five 2 5 inch hot swappable hard disk drives 3 5 inch hard drive enclosure Up to twelve 3 5 inch hot swappable hard disk drives 7 Information tag A slide out label panel which allows you to rec...

Страница 19: ...ing table lists the supported Remote Access Controllers Table 6 Supported Remote Access Connections Connection Features CMC Network Interface ports GB port Dedicated network interface for the CMC web interface DHCP support SNMP traps and e mail event notification Network interface for the iDRAC and I O Modules IOMs Support for Telnet SSH command console and RACADM CLI commands including system boo...

Страница 20: ...ways available through CMC Web interface and RACADM Types of Licenses The types of licenses offered are 30 day evaluation and extension The license expires after 30 days that can be extended for 30 days Evaluation licenses are duration based and the timer runs when power is applied to the system Perpetual The license is bound to the service tag and is permanent Acquiring Licenses Use any of the fo...

Страница 21: ...ites in the Security Settings For more information see the Internet Explorer help documentation License Component State or Condition and Available Operations The following table provides the list of license operations available based on the license state or condition Table 7 License Operations Based on State and Condition License Component state or condition Import Export Delete Replace Learn More...

Страница 22: ...cap setting only Restore Power Cap is allowed with an Express license Restore Power Cap will reset the Power Cap settings to factory default Dynamic Power Supply Engagement No Yes For non default DPSE settings only Restore DPSE is allowed with an Express license Restore DPSE will reset the DPSE to factory default Multi chassis management No Yes Advanced Configuration No Yes Enclosure level backup ...

Страница 23: ...nterface To access the Online Help click Help on the CMC web interface The Chassis Management Controller Version 3 0 for Dell PowerEdge VRTX RACADM Command Line Reference Guide provides information about using the VRTX related RACADM features The Dell Chassis Management Controller CMC for Dell PowerEdge VRTX Version 3 0 Release Notes available at dell com cmcmanuals provides last minute updates to...

Страница 24: ...ing and managing your system including those pertaining to the operating system system management software system updates and system components that you purchased with your system For more information on the system scan the Quick Resource Locator QRL available on your system and the system setup placemat that shipped with your system Download the QRL application from your mobile platform to enable...

Страница 25: ...ctive port to the management network 2 Install the I O module in the chassis and connect the network cable to the chassis 3 Insert the servers in the chassis 4 Connect the chassis to the power source 5 Press the power button or turn on the chassis from the CMC web interface after completing the task in step 7 NOTE Do not turn on the servers 6 Using the LCD panel navigate to the IP Summary and clic...

Страница 26: ...Tools from support dell com Installing RACADM on a Linux Management Station 1 Log in as root to the system running a supported Red Hat Enterprise Linux or SUSE Linux Enterprise Server operating system where you want to install the managed system components 2 Insert the Dell Systems Management Tools and Documentation DVD into the DVD drive 3 To mount the DVD to a required location use the mount com...

Страница 27: ... instructs the browser to bypass the proxy server while accessing the management network Internet Explorer To edit the exception list in Internet Explorer 1 Start Internet Explorer 2 Click Tools Internet Options Connections 3 In the Local Area Network LAN settings section click LAN Settings 4 In the Proxy server section select the Use a proxy server for your LAN These settings will not apply to di...

Страница 28: ...in web pages option Setting Up Initial Access to CMC To remotely manage the CMC connect the CMC to your management network and then configure the CMC network settings NOTE To manage the PowerEdge VRTX solution it must be connected to your management network For information about configuring CMC network settings see Configuring Initial CMC Network This initial configuration assigns the TCP IP netwo...

Страница 29: ...lighted select the language by pressing the Center button The Network Settings panel is displayed For a chassis that has been configured earlier the Main Menu panel is displayed From the Main Menu select Settings and then Network Settings 2 On the Network Settings panel select the required mode of setup Quick Setup DHCP Select this mode to set up CMC quickly using DHCP addresses For information on...

Страница 30: ...DHCP or Static mode Go to step 8 Else if you select IPv6 the Configure iDRAC panel is displayed Go to step 11 later in this procedure 8 On the Mode panel select the mode in which the CMC must obtain the NIC IP addresses If you select DHCP CMC retrieves IP configuration IP address mask and gateway automatically from a DHCP server on your network CMC is assigned a unique IP address that is allotted ...

Страница 31: ...enter button 16 On the next iDRAC Configuration panel the following message is displayed Auto Apply settings to newly inserted servers To apply all iDRAC network settings to the newly installed servers select the check icon and press the center button When a new server is inserted in the chassis the LCD prompts you whether or not to automatically deploy the server using the previously configured n...

Страница 32: ...command line interface and the connect command which is used to connect to the serial console of a server or IO module are available from the CMC command line NOTE Telnet is not a secure protocol and is disabled by default Telnet transmits all data including passwords in plain text When transmitting sensitive information use the SSH interface SSH Use SSH to run RACADM commands It provides the same...

Страница 33: ...e see Updating CMC Firmware Setting Chassis Physical Location and Chassis Name You can set the chassis location in a data center and the chassis name to identify the chassis on the network default name is Dell Rack System For example an SNMP query on the chassis name returns the name you configure Setting Chassis Physical Location and Chassis Name Using Web Interface To set the chassis location an...

Страница 34: ...he Chassis Configuration Administrator privilege Configuring LED Blinking Using CMC Web Interface To enable blinking for one multiple or all component LEDs In the left pane go to any of the following pages Chassis Overview Troubleshooting Chassis Overview Chassis Controller Troubleshooting Chassis Overview Server Overview Troubleshooting NOTE Only servers can be selected on this page Chassis Overv...

Страница 35: ...available at dell com support manuals Configuring Login Lockout Policy Attributes Using CMC Web Interface NOTE To perform the following tasks you must have Chassis Configuration Administrator privilege The Log in Security enables you to configure the IP range attributes for CMC login using the CMC web interface To configure the IP range attributes using CMC web interface 1 In the left pane go to C...

Страница 36: ...n the active CMC See the racreset command section in the Chassis Management Controller for PowerEdge VRTX RACADM Command Line Reference Guide available at dell com support manuals Reset the active CMC from web interface See the Reset CMC option for Power Control Operations that is described in Executing Power Control Operations Remove the network cable from the active CMC Remove the active CMC fro...

Страница 37: ...e chassis management Active CMC Election Process There is no difference between the two CMC slots that is slot does not indictate precedence Instead CMC that is installed or started first assumes the role of an active CMC If AC power is applied with two CMCs installed CMC installed in CMC chassis slot 1 normally assumes the active role The active CMC is indicated by a blue LED If two CMCs are inse...

Страница 38: ...to a KVM and then click Apply NOTE The KVM allows mapping to all the server slots Inserting a full height or replacing a half height server with full height server does not change the mapping behavior However if the KVM is mapped to a lower slot and the slot has a full height server then the KVM is available only through the upper slot You must remap the KVM to the upper slots Mapping the Server t...

Страница 39: ...P address If the default HTTPS port number port 443 was changed type https CMC IP address port number To access CMC using IPv6 address https CMC IP address If the default HTTPS port number port 443 was changed type https CMC IP address port number where CMC IP address is the IP address for CMC and port number is the HTTPS port number The CMC Login page appears NOTE While using IPv6 you must enclos...

Страница 40: ...ty Physical smart card device Secret code such as a password or PIN Users must verify their credentials using the smart card and the PIN NOTE You cannot use the IP address to log in to CMC using the Smart Card login Kerberos validates your credentials based on the Fully Qualified Domain Name FQDN Before you log in as an Active Directory user using a Smart Card make sure to Upload a Trusted Certifi...

Страница 41: ...ormal CMC login page NOTE If you are not logged in to the Active Directory domain and are using a browser other than Internet Explorer the login is unsuccessful and the browser displays a only blank page Logging In To CMC Using Serial Telnet Or SSH Console You can log in to CMC through a serial Telnet or SSH connection After you configure your management station terminal emulator software and mana...

Страница 42: ...ods to automates the method On client systems running Windows you can use the Pageant application It runs in the background and makes entering the passphrase transparent For client systems running Linux you can use the ssh agent For setting up and using either of these applications see their product documentation Multiple CMC Sessions A list of multiple CMC sessions that are possible by using the ...

Страница 43: ... Guide available at dell com support manuals Enabling or Disabling Default Password Warning Message You can enable or disable the display of the default password warning message To do this you must have Configure Users privilege Enabling or Disabling Default Password Warning Message Using Web Interface To enable or disable the display of the default password warning message after logging in to iDR...

Страница 44: ... slot 6 Workflow 1 Power down chassis Disconnect all SAS cables from External Shared PERC 8 cards to MD12x0 enclosures 2 Power Up chassis 3 Login to CMC web interface and navigate to the Storage Controllers Troubleshooting and enable Fault tolerance from the drop down menu for External Shared PERC 8 card in slot 5 click Apply and select disable for slot 6 and then click Apply 4 Resetting both the ...

Страница 45: ...8 cards to MD12x0 enclosures 2 Power Up chassis 3 Login to CMC Racadm and run the following command when the servers are in powered off state racadm raid set controllers RAID ChassisSlot 5 1 p HighAvailabilityMode ha 4 Run the command racadm raid set controllers RAID ChassisSlot 6 1 p HighAvailabilityMode ha on External Shared PERC 8 card in slot 6 5 Resetting both the PERCs may take two minutes t...

Страница 46: ...and save it to your local system While updating VRTX Chassis firmware it is recommended to update the firmware versions of the chassis components in the following order 1 Blade components firmware 2 CMC firmware 3 Chassis infrastructure firmware 4 Shared PERC8 firmware integrated and external 5 Internal Storage Backplane firmware and external enclosure s expanders 6 HDD firmware external and integ...

Страница 47: ... chassis that is configured with 1600W PSU CMC firmware update or roll back is supported only for firmware versions 1 2 1 25 1 3 1 31 1 35 1 36 2 0 2 01 and 2 04 later For any version other than these first update to any of these versions and then update to the required version The Active CMC resets and becomes temporarily unavailable after the firmware has been uploaded successfully If a standby ...

Страница 48: ...ble at dell com support manuals The external shared storage adapter requires that you update the CMC v2 20 or later and mainboard v2 21 or later to support External Shared PERC 8 card You cannot downgrade the CMC firmware prior to 2 2 with external shared adapters To update the CMC and mainboard firmware 1 Update CMC firmware 2 Update mainboard firmware 3 Power down the chassis and install shared ...

Страница 49: ...ate process the browser session and connection with CMC is lost temporarily because the active CMC is not connected to the network You must log in after a few minutes when the active CMC has restarted After CMC resets the new firmware is displayed on the Firmware Update page NOTE After the firmware update delete the files from the web browser cache For instructions about clearing the browser cache...

Страница 50: ...AC Firmware You can update firmware for iDRAC using the CMC Web interface or the RACADM To use this feature you must have an Enterprise License The iDRAC firmware version must be 1 40 40 or later for servers with iDRAC The iDRAC on a server resets and is temporarily unavailable after a firmware update NOTE To update an iDRAC firmware using the Chassis Management Controller an SD card must be avail...

Страница 51: ...le Controller Go to the Hardware Inventory page by selecting Hardware Configuration Hardware Inventory On the Hardware Inventory page click Collect System Inventory on Restart The Update from File method enables you to update the server component firmware using DUP files stored on a local system You can select the individual server components to update the firmware using the required DUP files You...

Страница 52: ...all the component modules of a server to be updated together This enables Lifecycle Controller to use its optimized algorithms to update the firmware reducing the number of reboots To update the server component firmware using the CMC Web interface click Chassis Overview Server Overview Update Server Component Update If the server does not support the Lifecycle Controller service the Component Dev...

Страница 53: ...s and devices across all servers is retrieved at one time To manage this large amount of information Lifecycle Controller provides various filtering mechanisms NOTE To use this feature you must have an Enterprise License The Component Device Update Filter section in the Server Component Update page that allows you to filter the information based on the component is available only for the Update by...

Страница 54: ...ate of a component or device is made on the inventory section then the filter associated with that selection is automatically enabled Further filtering may occur where the inventory section displays all the servers that have a match for the selected component in terms of model type or some form of identity For example if a BIOS component on one of the servers is selected for update the filter is a...

Страница 55: ...on on the server Table 12 Component and Devices Information Field Description Slot Displays the slot occupied by the server in the chassis Slot numbers are sequential IDs from 1 to 4 for the four available slots in the chassis that help to identify the location of the server in the chassis When there are less than four servers occupying slots only those slots populated by servers are displayed Nam...

Страница 56: ...erface in the system tree go to Server Overview and then click Network Share The Edit Network Share page is displayed NOTE When you have same folder for chassis server and boot identity profile you may see performance issues if there is more than 100 profiles 2 In the Network Share Settings section configure the following settings as required Protocol IP Address or Host Name Share Name Update fold...

Страница 57: ...on After an operation has been submitted for scheduling ensure that the confirmation message indicating that the operation has been successfully scheduled is acknowledged Reinstalling Server Component Firmware You can reinstall the firmware image of the currently installed firmware for selected components or devices across one or more servers The firmware image is available within the Lifecycle Co...

Страница 58: ...er All Lifecycle Controller updates are scheduled for immediate execution However the system services can delay this execution sometimes In such situations the update fails as a result of the remote share that is hosted by the CMC being no longer available Upgrading Server Component Firmware From File Using CMC Web Interface To upgrade the server components firmware version to the next version usi...

Страница 59: ...omponent firmware using Network Share mode The servers must belong to 12th or later generations and must have iDRAC Enterprise license CMC version must be at version 2 0 or later Lifecycle controller must be enabled on the servers iDRAC Version 1 50 50 or later must be available on the 12th generation servers Dell Repository Manager 1 8 or later must be installed on the system You must have CMC Ad...

Страница 60: ...eduled on the server The job status is dynamically updated Supported Firmware Versions for Server Component Update The following section provides the Server Component Update for CMC The following table lists the supported firmware versions for server components in a scenario where the existing CMC Firmware version is 3 0 and the server components are updated from N 1 version to N version NOTE Serv...

Страница 61: ...layed in the Browse field 4 Click Upload The DUP is uploaded to CMC The Storage Component Update section displays only the components that are supported by the downloaded DUP file The current version latest available version and the Update check box are displayed for the components 5 Select the appropriate Update check boxes for the required components 6 Click Update The firmware update action is ...

Страница 62: ...the health of the chassis and its components It displays a graphical view of the chassis and its components It is dynamically updated and the component sub graphic overlays and text hints are automatically changed to reflect the current state To view the chassis health click Chassis Overview The system displays the overall health status of the chassis active and standby CMCs server modules IO Modu...

Страница 63: ...hat component Table 14 Server Icon States Icon Description A server is present turned on and is operating normally A server is present but turned off A server is present but reporting a noncritical error A server is present but reporting a critical error A server is not present Selected Component Information Information for the selected component is displayed in three independent sections Health a...

Страница 64: ...e Tag Host Name iDRAC CPLD BIOS OS CPU Information Total System Memory Server Status Launch Remote Console Launch iDRAC GUI Power Off Server Graceful Shutdown Remote File Share Deploy iDRAC Network Server Component Update NOTE Quick links for Power Off Server and Graceful Shutdown are displayed only if the server power state is On If the server power state is Off the quick link for Power On Server...

Страница 65: ...PCIe Setup Fans Speed PWM of Max Fan Offset Warning Threshold Critical Threshold Fans Status Fan Configuration Blower Speed PWM of Max Enhanced Cooling Mode Warning Threshold Critical Threshold Fans Status Fan Configuration SPERC Slot Installed Assigned Model Server Slot Mapping Vendor ID Device ID Slot Type Allocated Power Fabric Power Status Controller Status Controller Setup External Shared PER...

Страница 66: ...hassis Server health status is indicated by the overlay of the server subgraphic For more information about the chassis health see the Online Help Click Chassis Overview Server Overview The Servers Status page provides an overview of the servers in the chassis For more information see the Online Help Viewing Health Status and Information for Individual Server To view health status for individual s...

Страница 67: ...mcmanuals NOTE The CMC monitors the temperature sensors in the chassis and automatically adjust the fan speed as needed However you can override to maintain a minimum fan speed by the racadm fanoffset command When overriden using this command the CMC will always run the fan to the selected speed even though the chassis does not require the fans to run at that speed CMC generates an alert and incre...

Страница 68: ... Line Reference Guide available at dell com support Manuals Enhanced Cooling Mode ECM Is a feature in the CMC that allows increased cooling capacity for the servers installed within the PowerEdge VRTX chassis Example uses for ECM are operation in a high ambient environment or using servers with high power 120W CPUs installed The increased cooling capacity is achieved by allowing the four chassis b...

Страница 69: ...rature probes value cannot be edited Any change beyond the threshold generates an alert that causes the fan speed to vary For example if the CMC ambient temperature probe exceeds the threshold the speed of the fans on the chassis increases Viewing Storage Capacity and Status of the Storage Components To view the capacity and fault tolerant status of the storage components do one of the following 1...

Страница 70: ...NOTE For more information see the Online Help 70 ...

Страница 71: ...ers with privileges Configure and enable e mail alerts and SNMP traps Set the power cap policy if required NOTE The following characters cannot be used in the property strings of both the CMC interfaces GUI and CLI and together semicolon Viewing and Modifying CMC Network LAN Settings The LAN settings such as community string and SMTP server IP address affect both the CMC and the external settings ...

Страница 72: ... the CMC IPv4 addressing type racadm config g cfgLanNetworking o cfgNicIPv4Enable 1 racadm config g cfgLanNetworking o cfgNicIPv4Enable 0 NOTE The CMC IPv4 addressing is enabled by default To enable or disable the CMC IPv6 addressing type racadm config g cfgIpv6LanNetworking o cfgIPv6Enable 1 racadm config g cfgIpv6LanNetworking o cfgIPv6Enable 0 NOTE Note the following There is a 30 seconds delay...

Страница 73: ...addresses NOTE The static DNS IP addresses settings are not valid unless the DCHP for DNS address feature is disabled For IPv4 to set the preferred primary and secondary DNS IP server addresses type racadm config g cfgLanNetworking o cfgDNSServer1 IP address racadm config g cfgLanNetworking o cfgDNSServer2 IPv4 address For IPv6 to set the preferred and secondary DNS IP Server addresses type racadm...

Страница 74: ... Security Settings The IP address blocking and User blocking features in CMC allow you to prevent security issues due to password guessing attempts This feature enables you to block a range of IP addresses and users who can access CMC By deafult the IP address blocking feature is enabled in CMC You can set the IP range attributes using CMC web interface or RACADM To use the IP address blocking and...

Страница 75: ...gRacTuning group cfgRacTuneIpRangeMask Configuring Virtual LAN Tag Properties for CMC Virtual LANfunctionality enables multiple VLANs to coexist on the same physical network cable and to segregate the network traffic for security or load management purposes When you enable the VLAN functionality each network packet is assigned a VLAN tag Configuring Virtual LAN Tag Properties for CMC Using RACADM ...

Страница 76: ... also access this page from the Chassis Overview Servers Setup VLAN Federal Information Processing Standards The agencies and contractors of the Federal government of the United States use Federal Information Processing Standards FIPS a computer security standard which is related to all applications that have communicative interfaces The 140 2 comprises of four levels Level 1 Level 2 Level 3 and L...

Страница 77: ...M RACADM Enable access to CMC using RACADM SNMP Enable CMC to send SNMP traps for events Remote Syslog Enable CMC to log events to a remote server To use this feature you must have an Enterprise license CMC includes a web server that is configured to use the industry standard SSL security protocol to accept and transfer encrypted data from and to clients over the Internet The web server includes a...

Страница 78: ...erver does not support a feature configuring a property related to that feature displays an error For example using RACADM to enable remote syslog on an unsupported iDRAC displays an error message Similarly when displaying the iDRAC properties using the RACADM getconfig command the property values are displayed as N A for an unsupported feature on the server For example racadm getconfig g cfgSessi...

Страница 79: ...oup You can delete the chassis from a group and add it later to a different group To set up the Chassis Group using the CMC web interface 1 Log in with chassis administrator privileges to the leader chassis 2 Click Setup Group Administration 3 On the Chassis Group page under Role select Leader A field to add the group name is displayed 4 Type the group name in the Group Name field and then click A...

Страница 80: ...emoval process Disabling an Individual Member at the Member Chassis Sometimes a member cannot be removed from a group by the lead chassis This can happen if network connectivity to the member is lost To remove a member from a group at the member chassis 1 Log in with chassis administrator privileges to the member chassis 2 In the left pane click Chassis Overview Setup Group Administration 3 Select...

Страница 81: ...whenever you want to propagate the chosen settings to member chassis For more information on propagation of leader chassis properties to member chassis see the Online Help Server Inventory for MCM group A group is a lead chassis that has 0 to 8 chassis group members The Chassis Group Health page displays all the member chassis and allows you to save the server inventory report to a file using stan...

Страница 82: ...ise shown as blank of CPUs 2 NOTE Requires VRTX CMC 1 0 or later on member otherwise shown as blank CPU Info Intel R Xeon R CPU E5502 1 87GHzn NOTE Requires VRTX CMC 1 0 or later on member otherwise shown as blank Data Format The inventory report is generated in a CSV file format such that it can be imported to various tools such as Microsoft Excel The inventory report CSV file can be imported int...

Страница 83: ...nostics OS Drive RAID devices up to 2 and NIC devices up to 6 for which you want to view the firmware version The firmware versions of the selected component for all the servers in the selected member chassis are displayed Chassis Configuration Profiles The Chassis Configuration Profiles feature enables you to configure the chassis with the chassis configuration profiles stored in the network shar...

Страница 84: ...e xml or bak on the local management station or the network share to which the chassis configurations were saved The configurations include all the properties available through the CMC web interface RACADM commands and settings To restore the chassis configuration perform the following tasks 1 Go to the Chassis Configuration Profiles page In the Restore Configuration Restore Chassis Configuration ...

Страница 85: ... Chassis Configuration Profiles Stored Profiles section select the required profile and then click Edit Profile The Edit Profile window is displayed 2 Enter a desired profile name in the Profile Name field and click Edit Profile Operation Successful message is displayed 3 Click OK Deleting Chassis Configuration Profiles You can delete a chassis configuration profile that is stored on the network s...

Страница 86: ... VRTX RACADM Command Line Reference Guide RACADM parses the cfg file when it is first loaded on to the CMC to verify that a valid group and object names are present and that simple syntax rules are being followed Errors are flagged with the line number that detected the error and a message explains the problem The entire file is parsed for correctness and all errors display If an error is found in...

Страница 87: ... Command Line Reference Guide The following example displays a group name object and the object s property value cfgLanNetworking group name cfgNicIpAddress 143 154 133 121 object name object value All parameters are specified as object value pairs with no white space between the object or value White spaces that are included after the value are ignored A white space inside a value string remains ...

Страница 88: ...orking cfgLanNetworking cfgNicIpAddress 10 35 9 143 comment the rest of this line is ignored cfgNicGateway 10 35 9 1 The command racadm config f myfile cfg parses the file and identifies any errors by line number A correct file updates the proper entries Additionally you can use the same getconfig command from the previous example to confirm the update Use this file to download company wide change...

Страница 89: ...figuration profiles from network share to another chassis by using the set command 1 To import the chassis configuration profiles from CIFS network share type the following racadm set f clone xml t xml l xx xx xx xx PATH u USERNAME p PASSWORDCMC 2 To import the chassis configuration profiles from NFS network share type the following racadm set f clone xml t xml l xx xx xx xx PATH You can import ch...

Страница 90: ...y logged in to iDRAC7 and end the user sessions NOTE To end a session you must have Chassis Configuration Administrator privilege Viewing and Ending CMC Sessions Using Web Interface To view or end a session using the web interface 1 In the left pane go to Chassis Overview and click Network Sessions The Sessions page displays the session ID username IP address and session type For more information ...

Страница 91: ... slot For example Server 3 is a valid name for slot 3 but not for slot 4 However Server 03 is a valid name for any slot NOTE To change a slot name you must have the Chassis Configuration Administrator privilege The slot name setting in the web interface resides on CMC only If a server is removed from the chassis the slot name setting does not remain with the server The slot name setting in the CMC...

Страница 92: ...ickDeploy Settings Setting Description Action When Server is Inserted Select one of the following options from the list No Action The action is not performed when the server is inserted QuickDeploy Only Select this option to apply iDRAC network settings when a new server is inserted in the chassis The specified auto deployment settings are used to configure the new iDRAC which includes the root us...

Страница 93: ...d prefix length from a DHCPv6 server and also enables stateless address auto configuration By default this option is enabled iDRAC IPv6 Gateway Specifies the default IPv6 gateway to be assigned to the iDRACs The default value is iDRAC IPv6 Prefix Length Specifies the prefix length to be assigned for the IPv6 addresses on the iDRAC The default value is 64 Use CMC DNS Settings Communicates the CMC D...

Страница 94: ...r the server s NOTE You must select the Enable LAN option to specify the IPv4 or IPv6 settings For information about the fields see the Online Help 3 To deploy the setting to iDRAC click Apply iDRAC Network Settings Any changes made to the QuickDeploy Settings are also saved The iDRAC Network Settings table reflects future network configuration settings the values shown for installed servers may o...

Страница 95: ...racadm setniccfg m server n v The valid values for n are 1 4 For example racadm setniccfg m server 1 v Configuring iDRAC Virtual LAN Tag Settings Using Web Interface To configure Vitual LAN VLAN for server 1 Go to any of the following pages In the left pane click Chassis Overview Network VLAN In the left pane click Chassis Overview Server Overview and click Setup VLAN 2 On the VLAN Tag Settings pa...

Страница 96: ...iDRAC login privileges To set the first boot device for multiple servers 1 In the left pane click Server Overview Setup First Boot Device A list of servers is displayed 2 In the First Boot Device column from the drop down menu corresponding to a server select the boot device you want to use for a server 3 If you want the server to boot from the selected device every time it boots clear the Boot On...

Страница 97: ...edia device NOTE Before you click the Deploy button make sure that you save all the working files because this action restarts the server When you click Deploy the following tasks are executed The remote file share is connected The file is selected as the first boot device for the servers The server is restarted Power is supplied to the server if the server is turned off Configuring Profile Settin...

Страница 98: ...e extended storage media prevents access to stored profile and disables the Server Configuration Replication feature To add or save a profile 1 Open the Server Profiles page In the Server Profiles section click Apply and Save Profiles 2 Select the server from whose settings you want to generate the profile and then click Save Profile The Save Profile section is displayed 3 Select Extended Storage ...

Страница 99: ... is displayed that CSIOR is not enabled for the servers To complete the blade cloning operation make sure to enable CSIOR option on the servers 4 Click OK to apply the profile to the selected server The selected profile is applied to the server s and the server s may be restarted immediately if necessary For more information see the CMC Online Help Importing Profile You can import a server profile...

Страница 100: ...er profile stored on the remote share To edit a stored profile 1 Go to the Server Profiles page In the Stored Profiles section select the required profile and then click Edit Profile The Edit Server Profile Profile Name section is displayed 2 Edit the profile name and description of the server profile as required and then click Edit Profile NOTE You can edit the profile description only for profil...

Страница 101: ...ions 4 Click View Log link to view the results of Lclogview from the iDRAC Lifecycle Controller for the specific server The results displayed for the completion or failure are similar to the information displayed in the iDRAC Lifecycle Controller log for the specific server Quick Deploy of Profiles The Quick Deploy feature enables you to assign a stored profile to a server slot Any server supporti...

Страница 102: ...AC and WWN As these are available across multiple chassis through a CIFS or NFS share you can quickly and remotely move an identity from a non functional server in a chassis to a spare server located in the same or another chassis and thus enabling it to boot with the operating system and applications of the failed server The main advantage of this feature is the use of a virtual MAC address pool ...

Страница 103: ... in progress After the action is complete Operation Successful message is displayed NOTE The process to gather the settings occurs in the background Hence it may take some time before the new profile is displayed If the new profile is not displayed check the profile log for errors Applying Boot Identity Profiles You can apply boot identity profile settings if the boot identity profiles are availab...

Страница 104: ...the displayed settings see the CMC Online Help Importing Boot Identity Profiles You can import boot identity profiles that are stored on the management station to the network share To import a stored profile on to the network share from the management station perform the following tasks 1 Go to the Server Profiles page In the Boot Identity Profiles Stored Profiles section click Import Profile The ...

Страница 105: ...Virtual MAC Address Pool section 2 Enter the starting MAC address of the MAC address pool in the Starting MAC Address field 3 Enter the count of the MAC addresses in the Number of MAC Addresses field 4 Click Create MAC Pool to create the MAC address pool After the MAC address database is created in the network share the Manage Virtual MAC Address Pool displays the list and status of the MAC addres...

Страница 106: ...A CMC user who has server administrative privilege is automatically logged in to iDRAC using single sign on Once on the iDRAC site this user is automatically granted Administrator privileges This is true even if the same user does not have an account on iDRAC or if the account does not have the Administrator s privileges A CMC user who does NOT have the server administrative privilege but has the ...

Страница 107: ...th JRE Java Runtime Environment 6 Update 16 or later The browser on host system allows pop up windows pop up blocking is disabled Remote Console can also be launched from the iDRAC Web interface For more details see the iDRAC User s Guide available at dell com support manuals Launching Remote Console from Chassis Health Page To launch a remote console from the CMC Web interface 1 In the left pane ...

Страница 108: ...ng option This property overrides the individual alert setting Make sure that the SNMP or email alert destinations are configured to receive the alerts Enabling Or Disabling Alerts Using CMC Web Interface To enable or disable generating alerts 1 In the left pane click Chassis Overview Alerts 2 On the Chassis Events page under the Chassis Alert Enablement section select the Enable Chassis Event Ale...

Страница 109: ...at is consistent with the networking technology or infrastructure The Test Trap functionality cannot detect incorrect choices based on the current network configuration example use of an IPv6 destination in an IPv4 only environment In the Community String field enter a valid community name to which the destination management station belongs This community string differs from the community string o...

Страница 110: ...You can configure up to four destinations to receive traps alerts To add more destinations do the tasks in steps 2 6 NOTE The commands in steps 2 6 overwrites any existing settings configured for the index specified 1 4 To determine whether an index has previously configured values type racadm getconfig g cfgTraps i index If the index is configured values appear for the cfgTrapsAlertDestIPAddr and...

Страница 111: ...adm config g cfgEmailAlert o cfgEmailAlertEnable 1 i index where index is a value between 1 4 CMC uses the index number to distinguish up to four destination email addresses that can be configured 5 Specify a destination email address to receive the email alerts racadm config g cfgEmailAlert o cfgEmailAlertAddress email address i index where email address is a valid email address and index is the ...

Страница 112: ...not create a server user from CMC or vice versa This rule protects the security and integrity of the servers Table 19 User Types Privilege Description CMC Login User User can log in to CMC and view all the CMC data but cannot add or modify data or execute commands It is possible for a user to have other privileges without the CMC Login User privilege This feature is useful when a user is temporari...

Страница 113: ... privilege a user created on the chassis can only execute a command on a server when all of the following conditions are true The same user name exists on the server The same user name must have the same password on the server The user must have the privilege to execute the command When a CMC user who does not have Server Administrator privilege issues an action to be performed on a server CMC sen...

Страница 114: ...NOTE If you select Administrator Power User or Guest User and then add or remove a privilege from the pre defined set the CMC Group automatically changes to Custom Table 20 CMC Group Privileges User Group Privileges Granted Administrator CMC Login User Chassis Configuration Administrator User Configuration Administrator Clear Logs Administrator Server Administrator Test Alert User Debug Command Ad...

Страница 115: ...e User Configuration page select the Change Password option 4 Type the new password in the Password field and then type the same password in Confirm Password 5 Click Apply The password is changed for the 1 user ID Configuring Local Users You can configure up to 16 local users in CMC with specific access privileges Before you create a CMC local user verify if any current users exist You can set use...

Страница 116: ...y that user name When you manually enable or disable a user with the racadm config subcommand you must specify the index with the i option The character in the command objects indicates that it is a read only object Also if you use the racadm config f racadm cfg command to specify any number of groups objects to write the index cannot be specified A new user is added to the first available index T...

Страница 117: ...access to CMC allowing you to add and control CMC user privileges to your existing users in your directory service This is a licensed feature NOTE On the following Operating Systems you can recognize the users of CMC users by using Active Directory Microsoft Windows 2000 Microsoft Windows Server 2003 Microsoft Windows Server 2008 You can configure user authentication through Active Directory to lo...

Страница 118: ...roller open Active Directory Users and Computers Snap in 2 Using the CMC Web interface or RACADM a Create a group or select an existing group b Configure the role privileges 3 Add the Active Directory user as a member of the Active Directory group to access CMC Configuring Active Directory With Standard Schema Using CMC Web Interface NOTE For information about the various fields see the CMC Online...

Страница 119: ...2 Select Chassis in the system tree and navigate to the Network tab The Network Configuration page is displayed 13 Under Network Settings if Use DHCP for CMC Network Interface IP Address is selected select Use DHCP to obtain DNS server address To manually enter a DNS server IP address clear Use DHCP to obtain DNS server addresses and type the primary and alternate DNS server IP addresses 14 Click ...

Страница 120: ...tes and classes for specific requirements Dell has extended the schema to include the necessary changes to support remote management authentication and authorization using Active Directory Each attribute or class that is added to an existing Active Directory Schema must be defined with a unique ID To maintain unique IDs across the industry Microsoft maintains a database of Active Directory Object ...

Страница 121: ...ciation Object 1 A01 Priv1 as Privilege Objects in A01 and RAC1 RAC2 as RAC Devices in A01 6 Add User3 as Members in Association Object 2 A02 Priv2 as Privilege Objects in A02 and RAC2 as RAC Devices in A02 To configure the objects for the multiple domain scenario 1 Make that the domain forest function is in Native or Windows 2003 mode 2 Create two Association Objects A01 of Universal scope and A0...

Страница 122: ... the schema extension use the MMC and the Active Directory Schema Snap in to verify that the classes and attributes exist For more information on classes and attributes see Classes and Attributes See the Microsoft documentation for details about using the MMC and the Active Directory Schema Snap in Classes And Attributes Table 23 Class Definitions for Classes Added to the Active Directory Schema C...

Страница 123: ... Authorization Rights Class Type Structural Class SuperClasses User Attributes dellRAC4Privileges Table 28 dellProduct Class OID 1 2 840 113556 1 8000 1280 1 1 1 5 Description The main class from which all Dell products are derived Class Type Structural Class SuperClasses Computer Attributes dellAssociationMembers Table 29 List of Attributes Added to the Active Directory Schema Assigned OID Syntax...

Страница 124: ... 1 8000 1280 1 1 2 7 Boolean LDAPTYPE_BOOLEAN 1 3 6 1 4 1 1466 115 121 1 7 TRUE Attribute dellIsTestAlertUser Description TRUE if the user has Test Alert User rights on the device OID 1 2 840 113556 1 8000 1280 1 1 2 10 Boolean LDAPTYPE_BOOLEAN 1 3 6 1 4 1 1466 115 121 1 7 TRUE Attribute dellIsDebugCommandAdmin Description TRUE if the user has Debug Command Admin rights on the device OID 1 2 840 1...

Страница 125: ... each object perform the following Create a RAC device Object Create a Privilege Object Create an Association Object Add objects to an Association Object Creating RAC Device Object To create RAC device object 1 In the MMC Console Root window right click a container 2 Select New Dell Remote Management Object Advanced 3 On the New Object page type a name for the new object The name must be identical...

Страница 126: ...lick Add 2 Enter RAC devices or RAC device group name and click OK 3 In the Properties window click Apply and click OK Click the Products tab to add one or more RAC devices to the association The associated devices specify the RAC devices connected to the network that are available for the defined users or user groups Multiple RAC devices can be added to an Association Object Configuring Active Di...

Страница 127: ...tain the DNS server addresses automatically Manually configure a DNS server IP address by leaving the Use DHCP to Obtain DNS Server Addresses check box unchecked and then typing your primary and alternate DNS server IP addresses in the fields provided 12 Click Apply Changes The Active Directory settings for extended schema is configured Configuring Active Directory With Extended Schema Using RACAD...

Страница 128: ...ypes of Users Configuring the Generic LDAP Directory to Access CMC The CMC s Generic LDAP implementation uses two phases in granting access to a user user authentication and then the user authorization Authentication of LDAP Users Some directory servers require a bind before a specific LDAP server can be searched for To authenticate a user 1 Optionally bind to the Directory Service The default is ...

Страница 129: ...ke and click Upload The certificate is uploaded to CMC and the details are displayed 9 Click Apply The generic LDAP directory service is configured Configuring Generic LDAP Directory Service Using RACADM To configure the LDAP directory service use the objects in cfgLdap and cfgLdapRoleGroup RACADM groups There are many options to configure LDAP logins In most of the cases some options can be used ...

Страница 130: ...s as the authentication mechanism for SSO and smart card login For information about Kerberos see the Microsoft Website System Requirements To use the Kerberos authentication the network must include DNS server Microsoft Active Directory Server NOTE If you are using Active Directory on Microsoft Windows 2003 make sure that you have the latest service packs and patched installed on the client syste...

Страница 131: ...the ktpass tool 1 Run the ktpass utility on the domain controller Active Directory server where you want to map CMC to a user account in Active Directory 2 Use the following ktpass command to create the Kerberos keytab file ktpass princ HTTP cmcname domainname com DOMAINNAME COM mapuser keytabuser crypto DES CBC MD5 ptype KRB5_NT_PRINCIPAL pass out c krbkeytab NOTE The cmcname domainname com must ...

Страница 132: ...tory SSO or smart card login for CMC NOTE For information about the options see the Online Help 1 While configuring Active Directory to set up user account perform the following additional steps Upload the keytab file To enable SSO select the Enable Single Sign On option To enable smart card login select the Enable Smart Card Login option NOTE If these two options are selected all command line out...

Страница 133: ...ard Schema 3 In the Kerberos Keytab section click Browse select a keytab file and click Upload When the upload is complete a message is displayed indicating whether or not the keytab file is successfully uploaded Configuring CMC SSO Or Smart Card Login For Active Directory Users Using RACADM In addition to the steps performed while configuring Active Directory run the following command to enable S...

Страница 134: ...m RACADM commands begin with the keyword racadm and then followed by a subcommand For more information see Chassis Management Controller for PowerEdge VRTX RACADM Command Line Reference Guide connect Connects to the serial console of a server or I O module For more information see Connecting to Servers or I O Module Using Connect Command NOTE You can also use the connect RACADM command exit logout...

Страница 135: ...Manuals CMC also supports Public Key Authentication PKA over SSH This authentication method improves SSH scripting automation by removing the need to embed or prompt for user ID password For more information see Configuring Public Key Authentication over SSH SSH is enabled by default If SSH is disabled then you can enable it using any other supported interface To configure SSH see Configuring Serv...

Страница 136: ...running Windows or ssh keygen CLI for clients running Linux This section describes simple instructions to generate a public private key pair for both applications For additional or advanced usage of these tools see the application Help To use the PuTTY Key Generator to create a basic key for clients running Windows 1 Start the application and select SSH 2 RSA or SSH 2 DSA for the type of key to ge...

Страница 137: ...xfff f public key file NOTE You can use only the file upload option with remote RACADM For more information see Chassis Management Controller for PowerEdge VRTX RACADM Command Line Reference Guide To add a public key using the text upload option enter racadm sshpkauth i svcacct k 1 p 0xfff t public key text Deleting Public Keys To delete a public key run the following command racadm sshpkauth i sv...

Страница 138: ... name 12 To exit Minicom press Ctrl a x Enter Make sure that the Minicom window displays a login prompt When the login prompt appears your connection is successful You are now ready to login and access the CMC command line interface Required Minicom Settings See the following table to configure any version of Minicom Table 32 Minicom Settings Setting Description Required Setting Bps Par Bits 11520...

Страница 139: ...and enables the user to access the server s serial port After this connection is established the user can view the server s console redirection through CMC s serial port that includes both the BIOS serial console and the operating system serial console NOTE To view the BIOS boot screens serial redirection has to be enabled in the servers BIOS setup Also you must set the terminal emulator window to...

Страница 140: ...himage directive comment it out The following example shows the changes described in this procedure grub conf generated by anaconda Note that you do not have to rerun grub after making changes to this file NOTICE You do not have a boot partition This means that all kernel and initrd paths are relative to e g root hd0 0 kernel boot vmlinuz version ro root dev sdal initrd boot initrd version img boo...

Страница 141: ... rc sysinit l0 0 wait etc rc d rc 0 l1 1 wait etc rc d rc 1 l2 2 wait etc rc d rc 2 l3 3 wait etc rc d rc 3 l4 4 wait etc rc d rc 4 l5 5 wait etc rc d rc 5 l6 6 wait etc rc d rc 6 Things to run in every runlevel ud once sbin update Trap CTRL ALT DELETE ca ctrlaltdel sbin shutdown t3 r now When our UPS tells us power has failed assume we have a few minutes of power left Schedule a shutdown for 2 mi...

Страница 142: ...e etc securettyfile as follows Add a new line with the name of the serial tty for COM2 ttyS1 The following example shows a sample file with the new line vc 1 vc 2 vc 3 vc 4 vc 5 vc 6 vc 7 vc 8 vc 9 vc 10 vc 11 tty1 tty2 tty3 tty4 tty5 tty6 tty7 tty8 tty9 tty10 tty11 ttyS1 142 ...

Страница 143: ...s not support FlexAddress the factory assigned WWN MAC addresses are used CMC VRTX chassis is shipped with the SD card which supports FlexAddress FlexAddress Plus and Extended Storage features If the VRTX chassis is shipped with an optional second CMC the second CMC has an SD card that supports only Extended Storage NOTE Data contained on the SD card is encrypted and may not be duplicated or alter...

Страница 144: ...e chassis Table 34 Status Messages Returned by the featurecard s Command Status Message Actions No feature card inserted Check CMC to verify that the SD card was properly inserted In a redundant CMC configuration ensure that the CMC with the SD feature card installed is the active CMC and not the standby CMC The feature card inserted is valid and contains the following feature s FlexAddress bound ...

Страница 145: ...able the feature on a per slot basis After you enable the feature on a per fabric basis you can select slots to be enabled For example if Fabric A is enabled any slots that are enabled have FlexAddress enabled only on Fabric A All other fabrics use the factory assigned WWN MAC on the server NOTE FlexAddress does not take effect on a server module until the next reboot When the FlexAddress feature ...

Страница 146: ...dge VRTX it is preinstalled and enabled for all slots and fabrics To purchase this feature contact Dell at dell com NOTE By using the racresetcfg subcommand you can reset the Flex Address of a CMC to its factory default setting which is disabled The RACADM syntax is racadm racresetcfg c flex For more information about the FlexAddress related RACADM commands and data about the other factory default...

Страница 147: ...played in the basic mode and all the MAC types Server Assigned Flex Address and IO Identity You can filter using any or all of the fields displayed In both the Basic mode and the Advanced mode the WWN MAC Addresses information is displayed in a collapsed form Click the plus symbol corresponding to a slot or click Expand Collapse All to view the information for a specific slot or all the slots You ...

Страница 148: ...ric types to view details for all or specific type of management or I O fabric associated with the servers 7 From the Protocol drop down menu select All Protocols or one of the listed network protocols to view all the MACS or the MACs associated with the selected protocol 8 In the WWN MAC Addresses field enter the MAC address to view only the slots associated with the specific MAC address 9 From t...

Страница 149: ...inserted is valid and contains the following feature s FlexAddress bound to another chassis svctag Service tag Number SD card SN Valid flex address serial number SD card in the active CMC module that is bound to the same service tag racadm featurecard s The feature card inserted is valid and contains the following feature s FlexAddress bound SD card in the active CMC module that is not bound to an...

Страница 150: ...ditional licenses until the number of licenses equals the number of users before allowing additional users to use the Software If you are a commercial customer of Dell or a Dell affiliate you hereby grant Dell or an agent selected by Dell the right to perform an audit of your use of the Software during normal business hours you agree to cooperate with Dell in such audit and you agree to provide De...

Страница 151: ...L DAMAGES INCLUDING BUT NOT LIMITED TO PROCUREMENT OF SUBSTUTUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILTIY WHETHER IN CONTRACT STRICT LIABITLY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE EVEN IF ADVISED OF THE POSSIBILTIY OF SUCH DAMAGE U S GOVERNMENT RESTRICTED RIGHTS The so...

Страница 152: ...itch are allowed in the same group if their fabric is identical Switches and pass through modules can exist in the same group even if they are manufactured by different vendors Monitoring IOM Health For information about monitoring IOM health see Viewing Information and Health Status of the IOM Configuring Network Settings for IOM You can specify the network settings for the interface used to mana...

Страница 153: ...red for the IOM NOTE If allowed you can reset the VLANs network properties and IO ports to its default configuration values Configuring Network Settings for IOM Using RACADM To configure the network settings for an IOM by using RACADM set the date and time See the deploy command section in the Chassis Management Controller for PowerEdge VRTX RACADM Command Line Reference Guide You can set the user...

Страница 154: ...the two redundancy policies that affect PSU behavior and determine how chassis Redundancy state is reported to administrators You can also control Power management through OpenManage Power Center OMPC When OMPC controls power externally CMC continues to maintain Redundancy policy Remote power logging Dynamic power supply engagement DPSE OMPC then manages Server power Server priority System Input P...

Страница 155: ...is kept in online reserve for this purpose This forms a Power Supply redundancy pool PSUs beyond those required for power and redundancy are still available and is added to the pool in the event of a failure Unlike Grid redundancy when power supply redundancy is selected CMC does not require the PSU units to be present in any specific PSU slot positions NOTE Dynamic Power Supply Engagement DPSE al...

Страница 156: ...c PSU Engagement Setting Two PSUs DC Redundancy Disabled Four PSUs DC Redundancy Disabled Grid Redundancy In Grid redundancy mode with four PSUs all four PSUs are active The two PSUs must connect to one AC power grid while the other two PSUs are connect to the other AC power grid CAUTION To avoid a system failure and for Grid redundancy to work effectively there must be a balanced set of PSUs prop...

Страница 157: ...ity servers getting maximum power priority 2 servers getting power after priority 1 servers and so on Lower priority servers may get less power than priority one servers based on System Input Max Power Capacity and the user configured setting of System Input Power Cap Configuration changes such as an additional server shared HDDs or PCIe cards in the chassis may require the System Input Power Cap ...

Страница 158: ...k Server Overview Power Priority The Server Priority page lists all the servers in the chassis 2 From the Priority drop down menu select a priority level 1 9 where 1 is the highest priority for one multiple or all servers The default value is 1 You can assign the same priority level to multiple servers 3 Click Apply to save your changes Assigning Priority Levels To Servers Using RACADM Open a seri...

Страница 159: ... overall power health is typically OK If the PSU installed on a chassis fails owing to some reason the overall power health status of the chassis is displayed as Non Critical However if the conditions for operating with Grid redundancy cannot be met the redundancy status is No and the overall power health is Critical This is because the system is not able to operate in accordance with the configur...

Страница 160: ...ctioning it results in a non critical health state and a PSU failure event is generated The removal of a PSU results in a PSU removal event If either event results in a loss of redundancy on the basis of power allocations a loss of redundancy event is generated If the subsequent power capacity or the user power capacity is greater than the server allocations servers have degraded performance or in...

Страница 161: ...wer to different modules based on the requirement You can configure the following System Input Power Cap Redundancy Policy Enable Dynamic Power Supply Engagement Disable Chassis Power Button Max Power Conservation Mode Remote Power Logging Remote Power Logging Interval Server Based Power Management Disable AC Power Recovery Power Conservation and Power Budget CMC conserves power when the user conf...

Страница 162: ...still insufficient after reducing power allocations of the lower priority servers CMC lowers the performance of servers until sufficient power is freed to power the new server CMC reduces server power allocation in two cases Overall power consumption exceeds the configurable System Input Power Cap A power failure occurs in a non redundant configuration 110V PSUs AC Operation By default the 110V PS...

Страница 163: ...ing CMC Web Interface NOTE To perform power management actions you must have the Chassis Configuration Administrator privilege To configure power budget 1 In the left pane click Chassis Overview Power Configuration 2 On the Budget Redundancy Configuration page select any or all of the following properties as appropriate For information about the field descriptions see the Online Help Enable Server...

Страница 164: ...erval enter the following command racadm getconfig g cfgRemoteHosts o cfgRhostsSyslogPowerLoggingInterval The power remote logging feature is dependent on previously configured remote syslog hosts having been Logging to one or more remote syslog hosts must be enabled otherwise power consumption is logged This can be done either through the web GUI or the RACADM CLI For more information see the rem...

Страница 165: ...werdown powercycle nongraceshutdown or reset Executing Power Control Operations on a Server You can remotely perform power management actions for multiple servers at a time or an individual server in the chassis NOTE To perform power management actions you must have the Chassis Configuration Administrator privilege Executing Power Control Operations for Multiple Servers Using CMC Web Interface To ...

Страница 166: ...e I O Module 1 In the left pane click Chassis Overview I O Module Overview Power 2 On the Power Control page for the IOM from the drop down menu select the operation you want to execute power cycle 3 Click Apply Executing Power Control Operations on the IOM Using RACADM To execute power control operations on the IOM using RACADM open a serial Telnet SSH text console to CMC log in and type racadm c...

Страница 167: ...sis and their status View the summary of all the storage components with links to their respective pages View the used capacity and total capacity of the storage View controller information NOTE In case of a fault tolerant controller the name format is Shared PERC number Integrated number For example the active controller is Shared PERC8 Integrated 1 and the peer controller is Shared PERC8 Integra...

Страница 168: ... PERCs are installed in different fabrics Shared PERCs and EMMs are connected correctly Correct firmware on Shared PERCs Shared PERCs have the same settings Click to view the following attributes when the external controller is not in fault tolerant mode One Shared PERC detected One expanders detected Shared PERC and expanders correctly cabled View the status of each attribute that indicates if th...

Страница 169: ...s installed on them Use of this mode without Cluster Services may lead to corrupted or lost data NOTE You can assign a virtual disk to multiple virtual adapters from CMC CLI even when the Assignment Mode is set to Single Assignment in the CMC web interface 3 In the Virtual Adapters Mapped table from the Action drop down list select one of the following options and then click Apply Slot Select the ...

Страница 170: ...Mismatch You can create a security key on a controller using an Encryption keyID and a Passphrase The controller compares only the Passphrase used while creating security key to identify whether the two controllers have the same security keys Therefore two controllers joining a cluster are fault tolerant even if they have different Encryption Key ID as long as they have the same passphrase If a se...

Страница 171: ...oller Settings You can modify existing properties of a storage controller or configure the properties of a newly installed storage controller Configuring Storage Controller Settings Using CMC Web Interface Make sure at least one storage controller is installed in the chassis Toconfigure the storage controller settings 1 In the CMC Web interface go to Chassis Overview Storage Controllers Setup 2 On...

Страница 172: ...ller If the command lists RAID ChassisIntegrated 1 1 RAID ChassisIntegrated 2 1 your system has two Shared PERC controllers Second Integrated Shared PERC 8 and External Shared PERC 8 cards in slot 5 and slot 6 can be enabled or disabled To change the operation mode using the CMC Web Interface go to the Controllers Troubleshooting page by navigating to Chassis Overview Storage Controllers in the le...

Страница 173: ...select one of the following and then click Apply Disable RAID Controller Disables the peer controller in fault tolerant mode Enable RAID Controller Enables the peer controller in fault tolerant mode If the Integrated 2 PERC is already disabled then the Enable Raid Controller option is available in the drop down menu To enable or disable External Shared PERC 8 card controllers On the Controller Tro...

Страница 174: ...al RAID controller using RACADM To enable the fault tolerance racadm raid controllers FQDD of External Shared PERC8 p HighAvailabilityMode ha To disable the fault tolerance racadm raid set controllers FQDD of External Shared PERC8 p HighAvailabilityMode None Viewing Physical Disk Properties Using the CMC Web Interface Make sure that physical disks are installed on the chassis To view the propertie...

Страница 175: ...sing RACADM run the command racadm raid hotspare assign yes type ghs For more information about using RACADM commands see the Chassis Management Controller for PowerEdge VRTX RACADM Command Line Reference Guide Recovering Physical Disks To recover a physical disks 1 In the CMC Web Interface go to Chassis Overview Storage Physical Disks Setup 2 On the Setup page under Recover Physical Disks section...

Страница 176: ...thout initialization This option overrides the default behavior where a fast initialization process starts when a virtual disk is created The Encrypt Virtual Disk option allows you to create secure virtual disks on Self Encryption Drives SEDs NOTE The Encrypt Virtual Disk option is enabled only if the encryption key is configured for the specific controller on the Controller Settings page Managing...

Страница 177: ...Setup 2 From the Security Key drop down select Delete Security Key A confirmation message is displayed 3 Click OK to proceed After you delete the encryption key all the SEDs that are not part of the virtual disks are secure erased For more information see the Online Help Deleting Encryption Key Using RACADM To delete an encryption key by running a RACADM command use the following syntax racadm rai...

Страница 178: ...hat unlock is not allowed on a controller if the controller has drives that are unlocked but not imported or cleared Once drives are unlocked you can import the foreign configuration using the CMC web interface or RACADM If the controller is power cycled after the unlock and before the import phase the drives are locked again If the system has multiple foreign configurations unlock and import each...

Страница 179: ...lick Yes to proceed All data from the selected physical disk is removed Applying Virtual Adapter Access Policy To Virtual Disks Make sure that physical disk drives are installed and the virtual disks are created To apply the virtual adapter access policy 1 In the left pane click Chassis Overview Storage Virtual Disks Assign 2 On the Assign Virtual Disks page under the Access Policy for Virtual Ada...

Страница 180: ...iew the status and attributes of the EMM For more information see the CMC Online Help Viewing EMM Status and Attributes Using RACADM To view the status of EMM use racadm raid get emms o p Status command To view the attributes of EMM use racadm raid get emms o command For more information see the Chassis Management Controller for PowerEdge VRTX RACADM Command Line Reference Guide available at dell ...

Страница 181: ...set asset tag of the enclosure use racadm raid set enclosures Enclosure External 0 0 RAID ChassisSlot 5 1 p AssetTag value command To set asset name of the enclosure use racadm raid set enclosures Enclosure External 0 0 RAID ChassisSlot 5 1 p AssetName value command For more information see the Chassis Management Controller for PowerEdge VRTX RACADM Command Line Reference Guide available at dell c...

Страница 182: ...dell com support manuals Viewing Fan Status and attributes of the Enclosure Fan status and attributes displays the status of the enclosure fan and contains a status value that is unique from the enclosure You can have up to two fans and the enclosure firmware creates a status for each fan You must have CMC Login privileges to view fan status NOTE If a PSU is missing the corresponding fan of the PS...

Страница 183: ...ed If an external PCIE slot is occupied by a shared adapter PCIE slot may not map or unmap to or from a blade server If a user attempts to map or unmap shared adapter an EEMI message is logged For more information about assigning and remove an assigned PCIe slot from the servers see the Online Help NOTE Without a license you can assign a maximum of four PCIe slots to full height server two to the ...

Страница 184: ...can assign or unassign a PCIe slot to a server by using the RACADM commands Some of the commands are given here For more information about the RACADM commands see the Chassis Management Controller for PowerEdge VRTX RACADM Command Line Reference Guide available at dell com support Manuals To view the current assignment of PCIe devices to servers run the following command racadm getpiecfg a To view...

Страница 185: ...Overview PCIe Overview The PCIe Status page is displayed The General Settings section displays the following PCIe Ride through properties status Ridethrough Status Enabled or Disabled Ridethrough Timeout Indicates the time for which the Ride through feature is enabled Viewing PCIe Ridethrough Properties Status Using RACADM To view the information about PCIe power ridethrough properties enter the f...

Страница 186: ... To set the acceptable timeout range run the command racadm setpciecfg help ridethru For more information see the Chassis Management Controller for PowerEdge VRTX RACADM Command Line Reference Guide 186 ...

Страница 187: ...ad of WinRM Resetting Forgotten Administrative Password The following procedure explains how to reset the forgotten administrative password Remove CMC module from the chassis Short the Password recovery header pins using jumper Re insert the CMC module to chassis after the CMC is in online state the default credential is active User Name root Password calvin Login to CMC using default credential a...

Страница 188: ...n gettracelog RAC event log getraclog System event log getsel Downloading SNMP Management Information Base File The CMC SNMP Management Information Base MIB file defines the chassis types events and indicators CMC enables you to download the MIB file using the web interface To download the CMC s SNMP MIB file using the CMC web interface 1 In the left pane click Chassis Overview Network Services SN...

Страница 189: ...gagement cannot be fully supported Problem Inserted a new server into the enclosure with sufficient power supplies but the server does not power on Resolution A Check for the system input power cap setting it might be configured too low to allow any additional servers to be powered up Resolution B Check for the maximum power conservation setting If this is set then this issue occurs For more detai...

Страница 190: ... System Software event log cleared was asserted Wed May 09 16 06 00 2007 warning System Software event predictive failure was asserted Wed May 09 15 26 31 2007 critical System Software event log full was asserted Wed May 09 15 47 23 2007 unknown System Software event unknown event Viewing Hardware Logs Using CMC Web Interface You can view save and clear the hardware log You can sort the log entrie...

Страница 191: ...CLI commands if you are an advanced user or a user under the direction of technical support NOTE To modify these settings you must have the Debug Command Administrator privilege To access the Diagnostic Console 1 In the left pane click Chassis Overview Troubleshooting Diagnostics The Diagnostic Console page displays 2 In the Command text box type a command and click Submit For information about th...

Страница 192: ... Server 3 settings Invalid host name or IP address may have been accidentally entered Network connectivity problem that prevents CMC from communicating with any of the configured NTP servers DNS problem preventing any of the NTP server host names from being resolved To troubleshoot the NTP related problems check the information in the CMC trace log This log contains an error message for NTP relate...

Страница 193: ...re upload during which the unit is not operational It does not indicate a fault A blinking amber LED on a module indicates a fault on that module Blue blinking LEDs are configurable by the user and used for identification For more information about configuration see Configuring LEDs to Identify Components on the Chassis Table 42 LED Color and Blinking Patterns Component LED Color Blinking Pattern ...

Страница 194: ...teadily AC OK Oval Green blinking Not used Oval Green dark AC Not OK Amber glowing steadily Not used Amber blinking Fault Amber dark No fault Circle Green glowing steadily DC OK Circle Green dark DC Not OK Enclosure Blue When the host server is identifying the enclosure Amber Turned on or Reset fault state Troubleshooting Non responsive CMC If you cannot log in to CMC using any of the interfaces t...

Страница 195: ...Press the Enter key If a recovery prompt appears additional information is available The prompt indicates the CMC slot number and failure type To display failure reason and syntax for a few commands type recover and then press Enter Sample prompts recover1 self test CMC 1 self test failure recover2 Bad FW images CMC2 has corrupted images If the prompt indicates a self test failure there are no ser...

Страница 196: ...exported to your local system Discard Pinned Cache Deletes data that is stored in RAID controller cache NOTE If there is pinned cache the option to clear it is present If there is no pinned cache this option is not displayed Disable RAID Controller Disables the peer controller This option is available in the drop down menu only for the Shared PERC8 Integrated 2 and external Shared PERC8s Enable RA...

Страница 197: ...Power cycle the chassis after disconnecting the enclosures and before reconnecting enclosures as the drives retain the previous SCSI 3 Reservation until the chassis is power cycled 197 ...

Страница 198: ...e down and up arrow buttons To select and save an item on a screen and move to the next screen use the center button The up down left and right arrow buttons change the selected menu items or icons on the screen The selected item is shown with a light blue background or border When messages displayed on the LCD screen are longer than what fits on the screen use the left and right arrow buttons to ...

Страница 199: ...g information map another server to the KVM or unmap the existing connection To use the KVM for a server select KVM mapping from the main menu navigate to the appropriate server and then press the center Check button DVD Mapping By using this page you can view the DVD to server mapping information map another server to the DVD drive on the chassis or unmap the existing connection To give a server ...

Страница 200: ...uage 2 Press the center button The Accept icon appears and is highlighted 3 Press the center button to confirm the change The LCD Setup menu is displayed Default Screen The Default Screen allows you to change the screen that the LCD panel displays when there is no activity at the panel The factory default screen is the Main Menu You can choose from the following screens to display Main Menu Front ...

Страница 201: ...rs is displayed Else error messages are listed where critical ones are first listed and then the warning related Firmware Version Only displays on an active CMC Displays Standby for the standby CMC IP4 enabled disabled Displays current IPv4 enabled state only on an active CMC IP4 Address address acquiring Only displays if IPv4 is enabled only on an active CMC IP6 enabled disabled Displays current ...

Страница 202: ...r On Indicates whether the IOM is functioning Model Model of the IOM Fabric Type Networking type IP address Only shows if IOM is turned on This value is zero for a pass through type IOM Service Tag The factory assigned service tag Table 49 KVM Mapping Status Item Description Server number Displays a list of servers to which the KVM can be mapped Error Messages If there are no errors No Errors is d...

Страница 203: ...Manufacturer name State Offline Online or Standby Indicates the power status of a SPERC Table 53 PCIe Card Status Item Description PCIe Card number Displays the PCIe Card name in the format PCIe Card n where n is the PCIe Card number Example PCIe Card 1 PCIe Card 2 and so on Error Messages If there are no errors No Errors is displayed Else error messages are listed where critical ones are first li...

Страница 204: ...ges string iDRAC Firmware Version Displays if iDRAC finished booting NOTE iDRAC version 1 01 is displayed as 1 1 There is no iDRAC version 1 10 IP4 enabled disabled Displays the current IPv4 enabled state IP4 Address address acquiring Only displays if IPv4 is enabled IP6 enabled disabled Only displays if iDRAC supports IPv6 Displays current IPv6 enabled state IP6 Local Address address Only display...

Страница 205: ...and racadm chassislog help clear CMC related error messages Problems where the CMC is unable to perform an action The following error message is displayed racadm command failed To view information about a chassis type the following command racadm gettracelog While using firmware RACADM the prompt changes to a and the prompt is not displayed again If a non matched double quotation mark or a non mat...

Страница 206: ...SNMP authentication traps from being generated enter input community names that are accepted by the agent Since CMC only allows one community name enter the same get and set community name for IT Assistant discovery setup When accessing the CMC Web interface a security warning stating that the host name of the SSL certificate does not match the host name of CMC is displayed CMC includes a default ...

Страница 207: ...re card is removed There is no visible change if a feature card is removed Feature cards can be removed and stored or can be left in place What happens if a feature card that was used in one chassis is removed and put into another chassis The Web interface displays the following error message This feature card was activated with a different chassis It must be removed before accessing the FlexAddre...

Страница 208: ...e the FlexAddress The SD card is properly installed and all the firmware or software updates are installed The FlexAddress is active the server deployment screen does not display the options to deploy it What is wrong This is a browser caching issue Log off from the browser and relaunch What happens to FlexAddress if I need to reset my chassis configuration using the RACADM command racresetcfg The...

Отзывы:

Нет отзывов

Похожие инструкции для EMC PowerEdge VRTX

615 Series ANSI

Бренд: ABB Страницы: 60

Бренд: MADRIX Страницы: 36

Бренд: Ickle Bubba Страницы: 23

Бренд: Datalogic Страницы: 15

Бренд: Eaton Страницы: 28

Бренд: Parallel Страницы: 16

Бренд: V2 Страницы: 46

Бренд: Oldham Страницы: 32

Бренд: H3C Страницы: 14

Бренд: Hama Страницы: 8

Бренд: Jandy Страницы: 28

Бренд: Jands Страницы: 6

Бренд: jbc Страницы: 44

Бренд: jbc Страницы: 8

Бренд: Taco Electronic Solutions Страницы: 28

Бренд: WABCO Страницы: 4

Бренд: Rayrun Страницы: 4

Бренд: Parker Страницы: 29

Бренды по названию

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Популярные бренды

Загрузить еще бренды