manualshive.com logo in svg

Dell EMC VxRail P470, Руководство пользователя, Страница: 72 / 140

Поделиться
Скачать
Dell EMC VxRail P470 Скачать руководство пользователя страница 72

Figure 30. Installing a cooling fan

1

cooling fan assembly

2

cooling fan connector (6)

3

fan release tab (6)

4

cooling fan (6)

5

cooling fan connector on the system board (6)

Next steps

Follow the procedure listed in the After working inside your appliance section.

Expansion cards and expansion card riser

An expansion card in the appliance is an add-on card that can be inserted into an expansion slot on the system board or riser card to add 
enhanced functionality to the appliance through the expansion bus.

NOTE: 

A System Event Log (SEL) event is logged if an expansion card riser is unsupported or missing. It does not prevent your 

appliance from turning on and no BIOS POST message or F1/F2 pause is displayed.

Expansion card installation guidelines

Your appliance supports PCI Express Generation 3 expansion cards.

Table 28. Guidelines for appliance supporting three PCIe expansion cards

Riser

PCIe Slot

Processor Connection

Height

Length

Link Width

Slot Width

1

1

Processor 2

Low Profile

Half Length

x8

x16

1

2

Processor 2

Low Profile

Half Length

x8

x16

1

3

Processor 2

Low Profile

Half Length

x8

x16

2

4

Processor 2

Full Height

Full Length

x16

x16

2

5

Processor 1

Full Height

Full Length

x8

x16

72

Installing and removing components

Содержание VxRail P470

Страница 1: ...Dell EMC VxRail P470 P470F V470 V470F Appliance Owner s Manual Regulatory Model E31S Series Regulatory Type E31S001 ...

Страница 2: ... to hardware or loss of data and tells you how to avoid the problem WARNING A WARNING indicates a potential for property damage personal injury or death Copyright 2016 Dell Inc or its subsidiaries All rights reserved Dell EMC and other trademarks are trademarks of Dell Inc or its subsidiaries Other trademarks may be trademarks of their respective owners 2016 12 Rev A00 ...

Страница 3: ...ag number 20 2 Documentation matrix 21 3 Technical specifications 22 Chassis dimensions 22 Chassis weight 22 Processor specifications 23 PSU specifications 23 Battery specifications 23 Expansion bus specifications 23 Memory specifications 23 Drive specifications 24 Hard drive specifications 24 Ports and connectors specifications 24 USB ports 24 NIC ports 24 Serial connector 24 VGA ports 24 Interna...

Страница 4: ...ur appliance 50 After working inside your appliance 50 Recommended tools 50 Front bezel optional 51 Removing the front bezel 51 Installing the front bezel 52 Appliance cover 52 Removing the appliance cover 52 Installing the appliance cover 53 Inside the appliance 54 Cooling shroud 55 Removing the cooling shroud 55 Installing the cooling shroud 56 System Memory 57 General memory module installation...

Страница 5: ... 78 Removing expansion card risers 79 Installing expansion card risers 83 GPU card installation guidelines 86 Removing the GPU card 87 Installing a GPU card 88 Internal dual SD Module 89 Removing an internal SD Card 89 Installing an internal SD card 90 Removing the internal dual SD module 90 Installing the internal dual SD module 92 Integrated storage controller card 93 Removing the integrated sto...

Страница 6: ...ngs 126 System board jumpers and connectors 127 Disabling a forgotten password 129 9 Troubleshooting your appliance 130 Safety first for you and your appliance 130 Troubleshooting appliance startup failure 130 Troubleshooting external connections 131 Troubleshooting the video subsystem 131 Troubleshooting a USB device 131 Troubleshooting iDRAC Direct USB XML configuration 132 Troubleshooting iDRAC...

Страница 7: ...g a storage controller 137 Troubleshooting expansion cards 138 Troubleshooting processors 139 10 Getting help 140 Contacting Dell EMC 140 Registering for online support 140 Accessing support resources 140 Contents 7 ...

Страница 8: ...upports only internal hot swappable hard drives NOTE In this document HDD generically refers to both HDD and SSD Topics Supported configurations Front panel LCD panel Back panel Hard drive indicator codes NIC indicator codes Power supply unit indicator codes iDRAC Direct LED indicator codes Locating serial number of your appliance Supported configurations The Dell EMC VxRail P470 P470F V470 V470F ...

Страница 9: ...in the cooling fan assembly 6 2 Processor 2 3 DIMMs 24 4 PCIe card holder 5 Internal USB port 6 Power supply unit 2 7 Expansion card riser 3 8 Network daughter card 9 Expansion card riser 2 10 Expansion card riser 1 11 Hard drive backplane Overview 9 ...

Страница 10: ...Indicator button or connector Icon Description 1 Power on indicator power button The power on indicator lights when the appliance power is on The power button controls the power supply output to the appliance NOTE On ACPI compliant operating systems when the power button is used to shutdown the appliance the operating system performs a graceful shutdown before the appliance power is turned off 2 N...

Страница 11: ... compliant 11 USB management port or iDRAC Direct The USB management port is USB 2 0 compliant Enables you to connect USB devices to the appliance or provides access to the iDRAC Direct features For more information see the Integrated Dell Remote Access Controller User s Guide at Dell com idracmanuals LCD panel The LCD panel of your appliance provides appliance information status and error message...

Страница 12: ...pliance is in standby mode the LCD backlight turns off after a few minutes of inactivity if there are no error messages 1 To view the Home screen press one of the three navigation buttons Select Left or Right 2 To navigate to the Home screen from another menu complete the following steps a Press and hold the navigation button till the up arrow is displayed b Navigate to the using the up arrow c Se...

Страница 13: ...NOTE When you select an option in the View menu you must confirm the option before proceeding to the next action Option Description iDRAC IP Displays the IPv4 or IPv6 addresses for iDRAC8 Addresses include DNS Primary and Secondary Gateway IP and Subnet IPv6 does not have Subnet MAC Displays the MAC addresses for iDRAC iSCSI or Network devices Name Displays the name of the Host Model or User Strin...

Страница 14: ... connector Icon Description 1 Appliance identification button The identification buttons on the front and back panels can be used to locate a particular appliance within a rack Press to toggle the appliance identification ID on or off If the appliance stops responding during POST press and hold the appliance ID button for more than five seconds to enter BIOS progress mode To reset iDRAC if not dis...

Страница 15: ... PSU1 AC 1100 W or DC 1100 W 11 Power supply unit PSU2 AC 1100 W or DC 1100 W 12 Hard drive 2 back Up to two hot swappable 3 5 inch hard drives Hard drive indicator codes Each hard drive carrier has an activity indicator and a status indicator The indicators provide information about the current status of the hard drive The activity LED indicates whether hard drive is currently in use or not The s...

Страница 16: ...s are off The NIC is not connected to the network B Link indicator is green The NIC is connected to a valid network at its maximum port speed 1 Gbps or 10 Gbps C Link indicator is amber The NIC is connected to a valid network at less than its maximum port speed D Activity indicator is flashing green Network data is being sent or received Power supply unit indicator codes AC power supply units PSUs...

Страница 17: ...oltage NOTE Ensure that both the PSUs are of the same capacity CAUTION For AC PSUs use only PSUs with the Extended Power Performance EPP label on the back D Flashing amber Indicates a problem with the PSU CAUTION When correcting a PSU mismatch replace only the PSU with the flashing indicator Swapping the PSU to make a matched pair can result in an error condition and unexpected appliance shutdown ...

Страница 18: ...ch replace only the PSU with the flashing indicator Swapping the PSU to make a matched pair can result in an error condition and unexpected appliance shutdown To change from a High Output configuration to a Low Output configuration or vice versa you must turn off the appliance CAUTION If two PSU are used they must be of the same type and have the same maximum output power CAUTION Combining AC and ...

Страница 19: ...le describes iDRAC Direct activity when configuring iDRAC Direct by using your laptop and cable Laptop Connect Table 8 iDRAC Direct LED indicator patterns iDRAC Direct LED indicator pattern Condition Solid green for two seconds Indicates that the laptop is connected Flashing green on for two seconds and off for two seconds Indicates that the laptop connected is recognized Turns off Indicates that ...

Страница 20: ... 3 Observe the VxRail Appliance serial number listed under the appliance ID as the PSNT Locating your physical Dell EMC VxRail Service Tag number Your hardware is also identified by a unique Service Tag number The Service Tag is found on the front of the appliance by pulling out the information tag Alternatively the information may be on a sticker on the chassis of the appliance This information i...

Страница 21: ... tasks and includes conceptual information emc com vxrailsupport Release Notes Product related information that includes critical information about the release emc com vxrailsupport Hardware Documents Getting started with your appliance Technical specifications emc com vxrailsupport Owner s Manual All the hardware details for your appliance along with technical specifications emc com vxrailsupport...

Страница 22: ...70 V470F appliance Table 10 Dimensions of Dell EMC VxRail P470 P470F V470 V470F appliance Appliance Xa Xb Y Za with bezel Za without bezel Zb Zc 16 x 2 5 inch hard drive 482 4 mm 434 0 mm 42 8 mm 35 0 mm 20 4 mm 731 0 mm 752 1 mm Chassis weight The Dell EMC VxRail P470 P470F V470 V470F appliance supports 16 x 2 5 inch hard drive with maximum weight of 31 4 kg 69 23 lb 3 22 Technical specifications...

Страница 23: ...ry specifications The Dell EMC VxRail P470 P470F V470 V470F appliance supports CR 2032 3 0 V lithium coin cell battery Expansion bus specifications Table 12 Expansion card riser specifications Expansion card riser PCIe slots on the riser Height Length Link Riser 1 Slot 1 half height low profile x8 Riser 1 Slot 2 half height low profile x8 Riser 1 Slot 3 half height low profile x8 Riser 2 Slot 4 fu...

Страница 24: ...front panel One USB management port iDRAC Direct on the front panel Two 9 pin USB 3 0 complaint ports on the back panel NIC ports The Dell EMC VxRail P470 P470F V470 V470F appliance supports four Network Interface Controller NIC ports on the back panel which is available in following NIC configurations Two 1 Gbps RJ45 connectors and two 10 Gbps SFP or RJ45 connectors Serial connector The serial co...

Страница 25: ... 70 8 16 32 800 X 600 60 75 85 8 16 32 1024 X 768 60 75 85 8 16 32 1152 X 864 60 75 85 8 16 32 1280 X 1024 60 75 8 16 32 1440 X 900 60 8 16 32 Environmental specifications Table 15 Temperature specifications Temperature Specifications Storage 40 C to 65 C 40 F to 149 F Continuous operation for altitude less than 950 m or 3117 ft 10 C to 35 C 50 F to 95 F with no direct sunlight on the equipment NO...

Страница 26: ...95 F to 104 F Maximum temperature is reduced by 1 C 175 m 1 F 319 ft above 950 m 3 117 ft 40 C to 45 C 104 F to 113 F Maximum temperature is reduced by 1 C 125 m 1 F 228 ft above 950 m 3 117 ft Particulate and gaseous contamination specifications The following table defines the limitations that help avoid any equipment damage or failure from particulates and gaseous contamination If the levels of ...

Страница 27: ...aminant levels measured at 50 relative humidity Standard operating temperature The standard operating temperature for altitude less than 950 meters or 3117 feet ranges from 10 C to 35 C 50 F to 95 F with no direct sunlight on the equipment Expanded operating temperature Table 23 Expanded operating temperature specifications Expanded operating temperature Specifications Continuous operation 5 C to ...

Страница 28: ...ature warnings may be reported on the LCD panel and in the System Event Log Expanded operating temperature restrictions Do not perform a cold startup below 5 C The operating temperature specified is for a maximum altitude of 3050 m 10 000 ft 145 W and Workstation CPU 160 W processors are not supported Redundant power supply units are required Non Dell qualified peripheral cards and or peripheral c...

Страница 29: ...appliance requires installation and deployment services Contact your Dell EMC account team or your reseller for installation services NOTE Do not install the appliance into rack or turn on the appliance 4 Initial setup and configuration 29 ...

Страница 30: ...ce has the following options to manage the pre operating system applications System Setup Boot Manager Dell Lifecycle Controller Preboot Execution Environment PXE NOTE Dell EMC has optimized your appliance and recommends that you do not change any of these settings System Setup By using the System Setup screen you can configure the BIOS settings iDRAC settings and device settings of your appliance...

Страница 31: ...DRAC settings utility For more information about this utility see Integrated Dell Remote Access Controller User s Guide at Dell com idracmanuals Device Settings Enables you to configure device settings System BIOS You can use the System BIOS screen to edit specific functions such as boot order appliance password setup password and enable or disable USB ports NOTE Many of the system BIOS settings h...

Страница 32: ...fies options to configure the system security settings such as appliance password setup password Trusted Platform Module TPM security It also manages the power and NMI buttons on the appliance Miscellaneous Settings Specifies options to change the appliance date time and so on Boot Settings You can use the Boot Settings screen to set the boot mode to either BIOS or UEFI It also enables you to spec...

Страница 33: ...nables or disables UEFI Boot options The Boot options include IPv4 PXE and IPv6 PXE This option is set to IPv4 by default NOTE This option is enabled only if the boot mode is UEFI Choosing the appliance boot mode NOTE VxRail appliances require the boot mode to be set to BIOS System Setup enables you to specify one of the following boot modes for installing your operating system BIOS boot mode the ...

Страница 34: ...ned as follows Option Description PXE Device n n 1 to 4 Enables or disables the device When enabled a UEFI boot option is created for the device PXE Device n Settings n 1 to 4 Enables you to control the configuration of the PXE device UEFI iSCSI Settings You can use the iSCSI Settings screen to modify iSCSI device settings The iSCSI Settings option is available only in the UEFI boot mode BIOS does...

Страница 35: ...eed of applications by performing encryption and decryption by using the Advanced Encryption Standard Instruction Set AES NI This option is set to Enabled by default System Password Sets the appliance password This option is set to Enabled by default and is read only if the password jumper is not installed in the appliance Setup Password Sets the setup password This option is read only if the pass...

Страница 36: ...bled by default Secure Boot Policy When Secure Boot policy is set to Standard the BIOS uses the appliance manufacturer s key and certificates to authenticate pre boot images When Secure Boot policy is set to Custom the BIOS uses the user defined key and certificates Secure Boot policy is set to Standard by default Secure Boot Policy Summary Specifies the list of certificates and hashes that secure...

Страница 37: ...rompts you to reenter the appliance password 5 Reenter the appliance password and click OK 6 In the Setup Password field type your setup password and press Enter or Tab A message prompts you to reenter the setup password 7 Reenter the setup password and click OK 8 Press Esc to return to the System BIOS screen Press Esc again A message prompts you to save the changes NOTE Password protection does n...

Страница 38: ...valid Password Number of unsuccessful password attempts x System Halted Must power down Even after you turn off and restart the appliance the error message is displayed until the correct password is typed The following options are exceptions If System Password is not set to Enabled and is not locked through the Password Status option you can assign a appliance password For more information see the...

Страница 39: ...creen to view all the memory settings and enable or disable specific memory functions such as memory testing and node interleaving Viewing Memory Settings To view the Memory Settings screen perform the following steps 1 Turn on or restart your appliance 2 Press F2 immediately after you see the following message F2 System Setup NOTE If your operating system begins to load before you press F2 wait f...

Страница 40: ...pports NUMA asymmetric memory configurations This option is set to Disabled by default Snoop Mode Specifies the Snoop Mode options The Snoop Mode options available are Home Snoop Early Snoop and Cluster on Die This option is set to Early Snoop by default This field is available only when the Node Interleaving is set to Disabled Processor Settings You can use the Processor Settings screen to view t...

Страница 41: ...y default Logical Processor Idling Enables you to improve the energy efficiency of a appliance It uses the operating system core parking algorithm and parks some of the logical processors in the appliance which in turn allows the corresponding processor cores to transition into a lower power idle state This option can only be enabled if the operating system supports it It is set to Disabled by def...

Страница 42: ...g All Ports Off disables all USB ports The USB keyboard and mouse operate during boot process in certain operating systems After the boot process is complete the USB keyboard and mouse do not work if the ports are disabled NOTE Selecting Only Back Ports On and All Ports Off disables the USB management port and also restricts access to iDRAC features Internal USB Port Enables or disables the intern...

Страница 43: ...ed in the specified slot Slots must be disabled only when the installed peripheral card prevents booting into the operating system or causes delays in appliance startup If the slot is disabled both the Option ROM and UEFI drivers are disabled Serial Communication You can use the Serial Communication screen to view the properties of the serial communication port Viewing Serial Communication To view...

Страница 44: ...15200 by default Remote Terminal Type Sets the remote console terminal type This option is set to VT 100 VT 220 by default Redirection After Boot Enables or disables the BIOS console redirection when the operating system is loaded This option is set to Enabled by default System Profile Settings You can use the System Profile Settings screen to enable specific appliance performance settings such as...

Страница 45: ... Sets the memory patrol scrub frequency This option is set to Standard by default Memory Refresh Rate Sets the memory refresh rate to either 1x or 2x This option is set to 1x by default Uncore Frequency Enables you to select the Processor Uncore Frequency option Dynamic mode enables the processor to optimize power resources across the cores and uncore during runtime The optimization of the uncore ...

Страница 46: ...bles the F1 F2 prompt on error This option is set to Enabled by default The F1 F2 prompt also includes keyboard errors Load Legacy Video Option ROM Enables you to determine whether the system BIOS loads the legacy video INT 10H option ROM from the video controller Selecting Enabled in the operating system does not support UEFI video output standards This field is available only for UEFI boot mode ...

Страница 47: ... by logging into iDRAC NOTE To access iDRAC connect the network cable to the Ethernet connector 1 on the system board Ensure that you change the default user name and password after setting up the iDRAC IP address iDRAC Settings utility The iDRAC settings utility is an interface to set up and configure the iDRAC parameters by using UEFI You can enable or disable various iDRAC parameters by using t...

Страница 48: ...d recommends that you do not change any of these settings Embedded systems management The Dell Lifecycle Controller provides advanced embedded systems management throughout the lifecycle of the appliance The Dell Lifecycle Controller can be started during the boot sequence and can function independently of the operating system NOTE Certain platform configurations may not support the full set of fe...

Страница 49: ...rogram System Utilities Enables you to launch System Utilities menu such as System Diagnostics and UEFI shell One shot BIOS boot menu One shot BIOS boot menu enables you to select a boot device to boot from System Utilities System Utilities contains the following utilities that can be launched Launch Diagnostics BIOS Update File Explorer Reboot System PXE boot You can use the Preboot Execution Env...

Страница 50: ...tructions section Steps 1 Turn off the appliance including any attached peripherals 2 Disconnect the appliance from the electrical outlet and disconnect the peripherals 3 If installed remove the front bezel 4 If applicable remove the appliance from the rack For more information see the Rack Installation placemat at Emc com vxrailsupport 5 Remove the appliance cover After working inside your applia...

Страница 51: ...zel can also be locked for additional security Removing the front bezel Prerequisites Follow the safety guidelines listed in the Safety instructions section Steps 1 Locate and remove the bezel key NOTE The bezel key is attached to the back of the bezel 2 Unlock the bezel by using the key 3 Slide the release latch up and pull the left end of the bezel 4 Unhook the right end and remove the bezel Fig...

Страница 52: ...appliance 4 Lock the bezel by using the key Figure 13 Installing the front bezel 1 front bezel 2 bezel lock Appliance cover The appliance cover protects the components inside the appliance and helps in maintaining air flow inside the appliance Removing the appliance cover activates the intrusion switch which aids in maintaining appliance security Removing the appliance cover Prerequisites 1 Follow...

Страница 53: ...the appliance cover disengage from the slots on the chassis NOTE The position of the latch may vary depending on the configuration of your appliance 3 Hold the cover on both sides and lift the cover away from the appliance Figure 14 Removing the appliance cover 1 latch release lock 2 latch 3 appliance cover Next steps 1 Install the appliance cover Installing the appliance cover Prerequisites 1 Fol...

Страница 54: ...pletely engaged with the tabs on the chassis 3 Rotate the latch release lock clockwise to the locked position Figure 15 Installing the appliance cover 1 latch release lock 2 latch 3 appliance cover Next steps 1 If removed install the front bezel 2 Reconnect the peripherals and connect the appliance to the electrical outlet 3 Turn on the appliance including any attached peripherals Inside the appli...

Страница 55: ...The cooling shroud aerodynamically directs the airflow across the entire appliance The airflow passes through all the critical parts of the appliance where the vacuum pulls air across the entire surface area of the heat sink thus allowing increased cooling Removing the cooling shroud Prerequisites CAUTION Never operate your appliance with the cooling shroud removed The appliance may get overheated...

Страница 56: ...in the After working inside your appliance section Installing the cooling shroud Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working inside your appliance section 3 If applicable route the cables inside the appliance along the chassis wall and secure the cables by using the cable securing bracket Steps 1 Align t...

Страница 57: ...ting frequency can be 1866 MT s 2133 MT s or 2400 MT s depending on the following factors DIMM type RDIMM or LRDIMM Number of DIMMs populated per channel System profile selected for example Performance Optimized Custom or Dense Configuration Optimized Maximum supported DIMM frequency of the processors Your appliance contains 24 memory sockets split into two sets of 12 sockets one set per processor...

Страница 58: ...5 and B9 Slots B2 B6 and B10 Slots B3 B7 and B11 Slots B4 B8 and B12 The following table shows the memory populations and operating frequencies for the supported configurations Table 25 Memory population DIMM Type DIMMs Populated Channel Voltage Operating Frequency in MT s Maximum DIMM Rank Channel RDIMM 1 1 2 V 2400 2133 1866 Dual rank or single rank 2 2400 2133 1866 Dual rank or single rank 3 18...

Страница 59: ... green release tabs Mixing of more than two memory module capacities in a appliance is not supported When mixing memory modules with different capacities populate the sockets with memory modules with highest capacity first For example if you want to mix 16 GB and 32 GB memory modules populate 32 GB memory modules in the sockets with white release tabs and 16 GB memory modules in the sockets with b...

Страница 60: ...port memory sparing Memory mirroring Memory mirroring offers the strongest memory module reliability mode compared to all other modes providing improved uncorrectable multi bit failure protection In a mirrored configuration the total available system memory is one half of the total installed physical memory Half of the installed memory is used to mirror the active memory modules In the event of an...

Страница 61: ...3 MT s A1 A2 A3 A4 A5 A6 A7 A8 A9 A10 A11 A12 B1 B2 B3 B4 B5 B6 1024 64 16 4R x4 2133 MT s A1 A2 A3 A4 A5 A6 A7 A8 A9 A10 A11 A12 B1 B2 B3 B4 B5 B6 1536 64 24 4R x4 1866 MT s 4R x4 2133 MT s A1 A2 A3 A4 A5 A6 A7 A8 A9 A10 A11 A12 B1 B2 B3 B4 B5 B6 B7 B8 B9 B10 B11 B12 Removing memory modules Prerequisites CAUTION Many repairs may only be done by a certified service technician You should only perfo...

Страница 62: ... 2 To release the memory module from the socket simultaneously press the ejectors on both ends of the memory module socket 3 Lift and remove the memory module from the appliance Figure 20 Removing the memory module 1 memory module 2 memory module socket 3 memory module socket ejector 2 Next steps 1 Install the memory module NOTE If you are removing the memory module permanently install a memory mo...

Страница 63: ...cket 3 Align the edge connector of the memory module with the alignment key of the memory module socket and insert the memory module in the socket CAUTION Do not apply pressure at the center of the memory module apply pressure at both ends of the memory module evenly NOTE The memory module socket has an alignment key that enables you to install the memory module in the socket in only one orientati...

Страница 64: ...removal and insertion CAUTION Do not turn off or reboot your appliance while the hard drive is being formatted Doing so can cause a hard drive failure NOTE Use only hard drives that have been tested and approved for use with the hard drive backplane NOTE Drive replacements must be initiated in VxRail Manager When you format a hard drive allow enough time for the formatting to be completed High cap...

Страница 65: ...e hard drive blank into the hard drive slot until the release button clicks into place Figure 23 Installing a 2 5 inch hard drive blank 1 hard drive blank Next steps If removed install the front bezel Removing a hot swappable hard drive or solid state drive Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working ins...

Страница 66: ...ackplane CAUTION When installing a hard drive ensure that the adjacent drives are fully installed Inserting a hard drive carrier and attempting to lock its handle next to a partially installed carrier can damage the partially installed carrier s shield spring and make it unusable CAUTION To prevent data loss ensure that your operating system supports hot swap drive installation See the documentati...

Страница 67: ... optional front bezel Figure 25 Installing a hot swappable hard drive 1 release button 2 hard drive or SSD carrier 3 hard drive or SSD carrier handle Removing a hard drive or a solid state drive from a hard drive carrier Prerequisites 1 Keep the Phillips 1 screwdriver ready 2 Remove the hot swappable hard drive carrier from the appliance Steps 1 Remove the screws from the slide rails on the hard d...

Страница 68: ...hot swappable hard drive carrier Steps 1 Insert the hot swappable hard drive into the hard drive carrier with the connector end of the hard drive toward the back 2 Align the screw holes on the hard drive with the set of screw holes on the hard drive carrier When aligned correctly the back of the hard drive is flush with the back of the hard drive carrier 3 Attach the screws to secure the hard driv...

Страница 69: ...amples of write intensive applications Following are the examples of write intensive applications System Center Agents System Center Configuration Manager CCMExec exe System Center Operations Manager MonitoringHost exe Write intensive Agents Databases Disk management utilities third party disk defragmentation or partitioning tools Additional roles outside of the appliance s intended use web server...

Страница 70: ...d SATA connector 5 on the system board 2 Press the SATADOM with your thumbs until it is fully seated 3 Reconnect all the cables Next steps 1 Reconnect the peripherals and connect the appliance to the electrical outlet 2 Turn on the appliance including any attached peripherals Cooling fans Your appliance supports seven hot swappable cooling fans NOTE In the event of a problem with a particular fan ...

Страница 71: ... section 2 Follow the procedure listed in the Before working inside your appliance section Steps Hold the fan and lift it out of the appliance Next steps Figure 29 Removing a cooling fan 1 cooling fan 7 2 connector on the system board 7 Installing a cooling fan Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working...

Страница 72: ...tem Event Log SEL event is logged if an expansion card riser is unsupported or missing It does not prevent your appliance from turning on and no BIOS POST message or F1 F2 pause is displayed Expansion card installation guidelines Your appliance supports PCI Express Generation 3 expansion cards Table 28 Guidelines for appliance supporting three PCIe expansion cards Riser PCIe Slot Processor Connect...

Страница 73: ...rom expansion card riser 2 or 3 Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working inside your appliance section 3 When removing a card from riser 3 ensure that the PCIe holder latch is closed Steps 1 Disconnect any cables connected to the expansion card 2 Lift the expansion card latch out of the guide slot 3 H...

Страница 74: ...Safety instructions section 2 Follow the procedure listed in the Before working inside your appliance section Steps 1 Unpack the expansion card and prepare it for installation For instructions see the documentation accompanying the card 2 Lift the expansion card latch and remove the filler bracket 3 Holding the card by its edges position the card so that the connector on the expansion card aligns ...

Страница 75: ...scribed in the documentation for the card Removing an expansion card from the expansion card riser 1 Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working inside your appliance section 3 Disconnect any cables connected to the expansion card 4 Remove the expansion card riser NOTE The expansion card riser 1 can be u...

Страница 76: ...ansion card from expansion card riser 1 1 tab A 2 expansion card riser 1 cage 3 expansion card connector 4 tab B 5 latch 6 expansion card Next steps 1 Install the expansion card 2 Install the expansion card riser 3 Follow the procedure listed in the After working inside your appliance section Installing an expansion card into the expansion card riser 1 Prerequisites 1 Follow the safety guidelines ...

Страница 77: ...riser 1 cage 3 expansion card connector 4 tab B 5 latch 6 expansion card Next steps 1 Install the expansion card riser 2 If applicable connect any cables to the expansion card 3 Follow the procedure listed in the After working inside your appliance section 4 Install any device drivers required for the card as described in the documentation for the card Removing the riser 1 blank Prerequisites 1 Fo...

Страница 78: ...ion card risers 2 Follow the procedure listed in the After working inside your appliance section Installing the riser 1 blank Prerequisites Steps To install the riser 1 blank align the blank with the slot on the chassis and insert it into the chassis until it clicks into place 78 Installing and removing components ...

Страница 79: ...ction 3 If installed remove any expansion card installed on risers 2 and 3 NOTE The expansion card riser 1 can be used only when both the processors are installed Steps 1 Holding the slots on the expansion card riser lift the riser from the riser connector on the system board 2 To remove expansion card risers 2 and 3 hold the edges of the expansion card riser and lift the riser from the riser conn...

Страница 80: ...card riser 1 3 riser guide back right 4 riser guide back left 5 expansion card riser 1 connector 6 riser guide front Figure 38 Identifying connectors on the expansion card riser 1 1 expansion card slot 1 2 expansion card slot 2 3 expansion card slot 3 80 Installing and removing components ...

Страница 81: ...r for GPU cards 2 expansion card riser 2 3 riser guide back 4 expansion card riser 2 connector 5 riser guide front Figure 40 Identifying connectors on the expansion card riser 2 1 expansion card slot 4 2 expansion card slot 5 Installing and removing components 81 ...

Страница 82: ...2 power connector for GPU cards 3 expansion card riser 3 4 riser guide back 5 expansion card riser 3 connector Figure 42 Identifying connectors on the expansion card riser 3 default 1 expansion card slot 6 2 expansion card slot 7 3 power connector for GPU cards 82 Installing and removing components ...

Страница 83: ... Installing expansion card risers Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working inside your appliance section 3 If removed install the expansion card s into the expansion card riser 1 Steps 1 Align the expansion card riser with the connectors and the riser guides on the system board 2 Lower the expansion c...

Страница 84: ...the expansion card riser 1 1 expansion card riser 1 cage 2 expansion card riser 1 3 riser guide back right 4 riser guide back left 5 expansion card riser 1 connector 6 riser guide front 84 Installing and removing components ...

Страница 85: ...45 Installing the expansion card riser 2 1 power connector for GPU cards 2 expansion card riser 2 3 riser guide back 4 expansion card riser 2 connector 5 riser guide front Installing and removing components 85 ...

Страница 86: ... that both the processors are installed The processor must be of 135 W or less The processor must use a GPU kit low profile heat sink Due to the high power consumption of GPUs the ambient inlet temperature is restricted to 30 C to ensure adequate cooling when one or more GPU cards are installed Ensure that the GPU enablement kit is available The GPU enablement kit includes Low profile heat sinks P...

Страница 87: ...cable from the GPU card 5 If you are removing the card permanently install a metal filler bracket over the empty slot opening and close the expansion card locking tabs NOTE You must install a filler bracket over an empty expansion card slot to maintain Federal Communications Commission FCC certification of the appliance The brackets also keep dust and dirt out of the appliance and aid in proper co...

Страница 88: ...ace the remaining filler brackets with the brackets from the GPU kit 7 Align the GPU card connector with the slot on the riser 8 Insert the GPU card into the riser slot until it is fully seated 9 Locate the GPU power connectors on the cable and plug them to the six pin and eight pin connectors on the GPU card NOTE Ensure that the GPU card is installed correctly into the GPU card lock 10 Press down...

Страница 89: ...ard solution The IDSDM card offers the following feature Dual card operation Maintains a mirrored configuration by using SD cards in both the slots and provides redundancy NOTE The IDSDM on the VxRail appliance is pre configured for appliance bare metal recovery Do not change any of the settings Removing an internal SD Card Prerequisites 1 Follow the safety guidelines listed in the Safety instruct...

Страница 90: ... up insert the contact pin end of the card into the slot NOTE The slot is keyed to ensure correct insertion of the card 2 To lock the card into place press it into the card slot Next steps Follow the procedure listed in the After working inside your appliancesection Removing the internal dual SD module Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow ...

Страница 91: ...card is online B Flashing green Indicates rebuild or activity C Flashing amber Indicates card mismatch or that the card has failed D Amber Indicates that the card is offline has failed or is write protected E Not lit Indicates that the card is missing or is booting Next steps 1 Install the IDSDM 2 If removed install the SD cards 3 Follow the procedure listed in the After working inside your applia...

Страница 92: ... with its corresponding slot before removal Steps 1 Locate the internal dual SD module IDSDM connector on the system board To locate the IDSDM connector see the System board connectors section 2 Align the IDSDM with the connector on the system board 3 Push the IDSDM until it is firmly seated on the system board Figure 50 Installing the optional internal dual SD module 1 IDSDM 2 pull tab 3 IDSDM co...

Страница 93: ... integrated storage controller card Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working inside your appliance section 3 Remove the cooling shroud 4 Keep the Phillips 2 screwdriver ready Steps 1 Loosen the screws that secure the integrated storage controller cable to the integrated storage controller card connect...

Страница 94: ...ler card Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working inside your appliance section 3 Remove the cooling shroud 4 Keep the Phillips 2 screwdriver ready Steps 1 Align the end of the integrated storage controller card with the controller card connector on the system board 2 Lower the connector side of the i...

Страница 95: ... integrated storage controller card holder Next steps 1 Install the cooling shroud 2 Follow the procedure listed in the After working inside your appliance section Network daughter card The Network daughter card NDC is a small removable mezzanine card The NDC provides you with the flexibility of choosing different network connectivity options for example 2 x 10GbE and 2 x 1GbE Removing the network...

Страница 96: ...ack panel 5 Lift the NDC out of the appliance Figure 53 Removing the NDC 1 captive screw socket 2 2 connector on the system board 3 captive screw 2 4 touch point 2 5 NDC 6 back panel slots for Ethernet connectors Installing the network daughter card Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working inside your...

Страница 97: ...board 5 Install the expansion card riser 3 Figure 54 Installing the NDC 1 captive screw socket 2 2 connector on the system board 3 captive screw 2 4 touch point 2 5 NDC 6 back panel slots for Ethernet connectors Next steps Follow the procedure listed in the After working inside your appliance section Processors and heat sinks Use the following procedures when Removing and installing a heat sink In...

Страница 98: ...3 Follow the procedure listed in the After working inside your appliance section Removing a processor Prerequisites NOTE This is a Field Replaceable Unit FRU Removal and installation procedures should be performed only by Dell certified service technicians NOTE To ensure proper appliance cooling you must install a processor blank in any empty processor socket 1 Follow the safety guidelines listed ...

Страница 99: ...et and leave the open first socket release lever up NOTE If you are permanently removing the processor you must install a socket protective cap in the vacant socket to protect the socket pins and keep the socket free of dust NOTE After removing the processor place it in an anti static container for reuse return or temporary storage Do not touch the bottom of the processor Touch only the side edges...

Страница 100: ... inside your appliance section Installing a processor Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working inside your appliance section 3 Keep the Phillips 2 screwdriver ready 4 Remove the cooling shroud NOTE If applicable close the expansion card latch on the cooling shroud to release the full length card 5 If ...

Страница 101: ... from under the tab Lift the lever 90 degrees upward 6 Hold the tab near the lock symbol on the processor shield and lift it up and out of the way CAUTION Positioning the processor incorrectly can permanently damage the system board or the processor Be careful not to bend the pins in the socket CAUTION While removing or reinstalling the processor wipe your hands of any contaminants Contaminants on...

Страница 102: ...riser 3 If disconnected reconnect the cables to the expansion card s 4 Follow the procedure listed in the After working inside your appliance 5 While booting press F2 to enter System Setup and verify that the processor information matches the new appliance configuration 6 Run the system diagnostics to verify that the new processor operates correctly Installing a heat sink Prerequisites 1 Follow th...

Страница 103: ...r you use it Figure 58 Applying thermal grease on the top of the processor 1 processor 2 thermal grease 3 thermal grease syringe 3 Place the heat sink onto the processor 4 Tighten one of the four screws to secure the heat sink to the system board 5 Repeat the procedure for the remaining two screws Next steps 1 Follow the procedure listed in the After working inside your appliance section 2 While b...

Страница 104: ...he PSU in the sleep state returns to an active output state If having both PSUs active is more efficient than having one PSU in the sleep state the active PSU can also activate the sleeping PSU The default PSU settings are as follows If the load on the active PSU is more than 50 percent then the redundant PSU is switched to the active state If the load on the active PSU falls below 20 percent then...

Страница 105: ... fully seated and the release latch snaps into place 2 If applicable relatch the cable management arm For information about the cable management arm see the rack documentation of your appliance 3 Connect the power cable to the PSU and plug the cable into a power outlet CAUTION When connecting the power cable secure the cable with the strap NOTE When installing hot swapping or hot adding a new PSU ...

Страница 106: ...our warranty Read and follow all safety instructions that came with the product CAUTION The system needs one power supply for normal operation On power redundant appliances remove and replace only one power supply at a time in a appliance that is powered on NOTE You may have to unlatch and lift the optional cable management arm if it interferes with power supply removal For information about the c...

Страница 107: ... your appliance section 3 If installed remove the PSU blank 4 Verify that both the PSUs are of the same type and have the same maximum output power NOTE The maximum output power shown in watts is listed on the PSU label Steps 1 Slide the PSU into the chassis until the PSU is fully seated and the release latch snaps into place NOTE If you have unlatched the cable management arm relatch it For infor...

Страница 108: ...e recommended by the manufacturer For more information see the safety information that shipped with your appliance 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working inside your appliance section 3 Remove the cooling shroud Steps 1 Locate the battery socket For more information see the Jumpers and connectors section CAUTION ...

Страница 109: ...ing shroud 2 Follow the procedure listed in the After working inside your appliance section 3 While booting press F2 to enter System Setup and ensure the battery is operating properly 4 Enter the correct time and date in the System Setup Time and Date fields 5 Exit System Setup Hard drive backplane Depending on the configuration your appliance supports one of the following 16 hard drive appliance ...

Страница 110: ... the cooling fan assembly 5 Remove all hard drives Steps 1 Disconnect the SAS SATA data signal and power cable s from the backplane 2 Press the release tabs and lift the backplane upward and slide it toward the back of the chassis NOTE To prevent damage to the control panel flex cable unlatch the blocking tab on the connector before removing the flex cable Do not bend the flex cable at the connect...

Страница 111: ...Cabling diagram 3 5 inch x12 SAS SATA backplane option 2 1 hard drive backplane 2 system board 3 backplane signal connector 0 4 backplane signal connector 1 5 hard drive mid plane 6 integrated storage controller card 7 backplane signal connector 2 Next steps 1 Install the hard drive backplane 2 Follow the procedure listed in the After working inside your appliance section Installing and removing c...

Страница 112: ...e hard drive backplane 2 Lower the hard drive backplane until the release tabs snap into place 3 Connect the SAS SATA SSD data signal and power cable s to the backplane Figure 67 Installing the 2 5 inch x16 SAS backplane 1 hard drive backplane assembly 2 backplane signal cable 3 backplane power cable 4 release tab 2 5 SAS cable 2 6 mini SAS connector 2 Next steps 1 Replace the cooling fan assembly...

Страница 113: ... 3 Keep the Phillips 2 screwdriver handy Steps 1 Using a Phillips 2 screwdriver remove the screw s securing the control panel to the chassis CAUTION Do not use excessive force when removing the control panel as it can damage the connectors 2 From inside the appliance push the control panel out of the chassis 3 Remove all the cables connecting the control panel to the chassis Installing and removin...

Страница 114: ... connector cable 4 USB connector cable 5 screw 2 6 vFlash media connector cable 4 Locate and press the tabs on the information tag 5 Push the information tag out of the slot to remove it from the control panel NOTE Retain the information tag for replacement in the new control panel 114 Installing and removing components ...

Страница 115: ...side your appliance section 3 Keep the 2 Phillips screwdriver ready Steps 1 Replace the blank information tag in the new control panel with the information tag retained from the old control panel NOTE Information tag lists appliance information such as Service Tag NIC and MAC address 2 To install the information tag push the information tag into the control panel slot 3 Connect all the applicable ...

Страница 116: ...g the control panel 2 5 inch hard drive appliance 1 control panel 2 control panel board 3 control panel connector cable 4 USB connector cable 5 screw 2 6 vFlash media connector cable 116 Installing and removing components ...

Страница 117: ... create and safely store this recovery key If you replace this system board you must supply the recovery key when you restart your appliance or program before you can access the encrypted data on your hard drives CAUTION Do not attempt to remove the TPM plug in module from the system board Once the TPM plug in module is installed it is cryptographically bound to that specific system board Any atte...

Страница 118: ...button while removing the system board from the chassis CAUTION Do not lift the system board by holding a memory module processor or other components 2 Hold the system board holder lift the blue release pin lift the system board and then slide it toward the front of the chassis Sliding the system board toward the front of the chassis disengages the connectors from the back of the chassis slots 3 L...

Страница 119: ...uct documentation or as directed by the online or telephone service and support team Damage due to servicing that is not authorized by Dell is not covered by your warranty Read and follow the safety instructions that are shipped with your product Steps 1 Unpack the new system board assembly CAUTION Do not lift the system board by holding a memory module processor or other components CAUTION Take c...

Страница 120: ...atform Module section NOTE The TPM plug in module is attached to the system board and cannot be removed A replacement TPM plug in module will be provided for all system board replacements where a TPM plug in module was installed 2 Replace the following a Cable retention bracket b PCIe card holder c Integrated storage controller card d Internal dual SD module e All expansion card risers f Heat sink...

Страница 121: ...ce Tag Settings 4 Enter the Service Tag NOTE You can enter the Service Tag only when the Service Tag field is empty Ensure that you enter the correct Service Tag After the Service Tag is entered it cannot be updated or changed 5 Click Ok 6 Import your new or existing iDRAC Enterprise license For more information see the Integrated Dell Remote Access Controller User s Guide at Dell com idracmanuals...

Страница 122: ...ion procedures must be performed only by Dell EMC certified service technicians Installing the Trusted Platform Module Prerequisites 1 Follow the safety guidelines listed in the Safety instructions section 2 Follow the procedure listed in the Before working inside your appliance section Steps 1 Locate the TPM connector on the system board NOTE To locate the TPM connector on the system board see th...

Страница 123: ...Security Settings 3 From the TPM Security option select On with Pre boot Measurements 4 From the TPM Command option select Activate 5 Save the settings 6 Restart your appliance 7 Enter System Setup again 8 On the System Setup Main Menu screen click System BIOS System Security Settings 9 From the Intel TXT option select On Installing and removing components 123 ...

Страница 124: ...ns to provide extra information about the failed device s View status messages that inform you if tests are completed successfully View error messages that inform you of problems encountered during testing NOTE Dell EMC has optimized your appliance and recommends that you do not change any of these settings Running the Embedded System Diagnostics from Boot Manager Prerequisites Run the Embedded Sy...

Страница 125: ...ted devices Results Displays the results of all tests that are run Appliancehealth Provides the current overview of the appliance performance Event log Displays a time stamped log of the results of all tests run on the appliance This is displayed if at least one event description is recorded Using system diagnostics 125 ...

Страница 126: ...ystem board jumpers and connectors Disabling a forgotten password System board jumper settings For information about resetting the password jumper to disable a password see the Disabling a forgotten password section Table 31 System board jumper settings Jumper Setting Description PWRD_EN default The password feature is enabled pins 4 6 The password feature is disabled pins 2 4 iDRAC local access i...

Страница 127: ... signal connector 1 2 J_PS2 PSU 2 power connector 3 J_BP_SIG0 Backplane signal connector 0 4 J_SATA_CD SATADOM connector 5 J_BP0 Backplane power connector 6 J_TBU SATADOM power connector 7 J_PS1 PSU 2 power connector 8 J_IDSDM Internal dual SD module connector 9 J_NDC Network daughter card connector 10 J_USB USB port 11 J_VIDEO_REAR Video connector Jumpers and connectors 127 ...

Страница 128: ...connector 27 CPU2 Processor socket 2 28 J_FAN1U_7 Cooling fan connector 29 B1 B5 B9 B2 B6 B10 Memory module sockets 30 J_BP3 Hard drive backplane power connector 31 J_FAN1U_6 Cooling fan connector 32 J_BP_SIG2 Backplane signal connector 2 33 J_FAN1U_5 Cooling fan connector 34 J_BATT_SIG Battery signal connector 35 J_FAN1U_4 Cooling fan connector 36 A1 A5 A9 A2 A6 A10 B3 B7 B11 B4 B8 B12 Memory mod...

Страница 129: ... assign a new appliancem and or setup password move the jumper back to pins 4 and 6 NOTE If you assign a new appliance and or setup password with the jumper on pins 2 and 4 the appliance disables the new passwords the next time it boots 5 Reconnect the system board jumper to its electrical outlet and turn on the appliance including any attached peripherals 6 Turn off the appliance including any at...

Страница 130: ...roubleshooting a damaged appliance Troubleshooting the appliance battery Troubleshooting power supply units Troubleshooting cooling problems Troubleshooting cooling fans Troubleshooting memory Troubleshooting an SD card Troubleshooting a hard drive or SSD Troubleshooting a storage controller Troubleshooting expansion cards Troubleshooting processors Troubleshooting appliance startup failure If you...

Страница 131: ...t USB 3 0 4 Check if USB 3 0 is enabled in System Setup If enabled disable it and see if the issue is resolved 5 In iDRAC Settings Utility ensure that USB Management Port Mode is configured as Automatic or Standard OS Use 6 If the problem is not resolved replace the keyboard and or mouse with a known working keyboard or mouse If the problem is not resolved proceed to step 7 to troubleshoot other U...

Страница 132: ...eshooting iDRAC Direct Laptop connection For information about USB laptop connection and appliance configuration see the Integrated Dell Remote Access Controller User s Guide at Dell com idracmanuals Steps 1 Ensure that your laptop is connected to the front USB Management Port identified by icon with a USB Type A A cable 2 On the iDRAC Settings Utility screen ensure that USB Management Port Mode i...

Страница 133: ... NICs and switches on the network are set to the same data transmission speed and duplex For more information see the documentation for each network device 8 Ensure that all network cables are of the proper type and do not exceed the maximum length Next steps If the problem persists see the Getting help section Troubleshooting a wet appliance Steps 1 Turn off the appliance and attached peripherals...

Страница 134: ...E If the appliance is turned off for long periods of time for weeks or months the NVRAM may lose the appliance configuration information This situation is caused by a defective battery NOTE Some software may cause the appliance time to speed up or slow down If the appliance seems to operate normally except for the time set in System Setup the problem may be caused by a software rather than by a de...

Страница 135: ...at both the PSUs are of the same type and wattage You may have to upgrade to a higher wattage PSU 5 Ensure that you use only PSUs with the Extended Power Performance EPP label on the back 6 Reseat the PSU NOTE After installing a PSU allow several seconds for the appliance to recognize the PSU and determine if it is working properly If the problem persists see the Getting help section Troubleshooti...

Страница 136: ... on the appliance and attached peripherals and note the messages on the screen If an error message is displayed indicating a fault with a specific memory module go to step 12 4 Enter System Setup and check the memory setting Make any changes to the memory settings if needed If the memory settings match the installed memory but the problem still persists go to step 12 5 Turn off the appliance and a...

Страница 137: ...ls 7 Enter System Setup and ensure that the Internal SD Card Port and Internal SD Card Redundancy modes are set to the needed modes Verify that the correct SD slot is set as Primary SD Card 8 Check if the SD card is functioning properly 9 If the Internal SD Card Redundancy option is set to Enabled at the time of the SD card failure the appliance prompts you to perform a rebuild NOTE The rebuild is...

Страница 138: ...ver c Reinstall one of the expansion cards d Install the appliance cover e Run the appropriate diagnostic test See the Using system diagnostics section If the problem persists see the Getting help section Troubleshooting expansion cards Prerequisites NOTE When troubleshooting an expansion card you also have to see the documentation for your operating system and the expansion card Steps 1 Run the a...

Страница 139: ...e appliance and attached peripherals and disconnect the appliance from the electrical outlet 3 Remove the appliance cover 4 Ensure that the processor and heat sink are properly installed 5 Install the appliance cover 6 Run the appropriate diagnostic test See the Using system diagnostics section 7 If the problem persists see the Getting help section Troubleshooting your appliance 139 ...

Страница 140: ...tion Download the SolVe Desktop Procedure Generator Browse the Dell EMC VxRail Series community and support information Link your support account for access to resources from within VxRail Manager To register for online support 1 Point your Web browser to emc com vxrailsupport or support emc com 2 Click Register here 3 Fill in the required information Support will send you a confirmation email typ...

Отзывы:

Нет отзывов