HPE Integrity NonStop NS2100 Скачать руководство пользователя страница 97 | Manualshive

Страница: 97 / 128

background image

Figure 32 Example of a Fault-Tolerant LAN Configuration

DHCP, TFTP, and DNS Window-Based Services

DHCP, TFTP, and DNS Windows based services are required for NS2100 systems. As of J06.07,
these services can reside either on a pair of System Consoles or a pair of CLuster I/O Modules
(CLIMs). By default Hewlett Packard Enterprise ships these services on:

•

NonStop system consoles for AC-powered systems

•

CLIMs for DC-powered systems

You can move these services from the NonStop system consoles to CLIMs or from CLIMs to the
system consoles. Procedures for moving these services are located in the Service Procedures
collection of NTL. For details, see:

•

Changing the DHCP, DNS, or BOOTP Server from System Consoles to CLIMs

•

Changing the DHCP, DNS, or BOOTP Server from CLIMs to System Consoles

•

You cannot have these services divided between a CLIM and a system console. This mixed
configuration is not supported.

CAUTION:

You must have only two sources of these services in the same dedicated service

LAN. If these services are installed on any other sources, they must be disabled. To determine
the location of these services, see

Locating and Troubleshooting DHCP, TFTP and DNS Services

on the NonStop Dedicated Service LAN

.

Dedicated Service LAN

97

«
...
95
96
97
98
99
...
»

Содержание Integrity NonStop NS2100

Страница 1: ...HPE Integrity NonStop NS2100 Planning Guide Part Number 697513 004R Published November 2015 Edition J06 14 and subsequent J series RVUs ...

Страница 2: ...sion use or copying Consistent with FAR 12 211 and 12 212 Commercial Computer Software Computer Software Documentation and Technical Data for Commercial Items are licensed to the U S Government under vendor s standard commercial license Export of the information contained in this publication may require authorization from the U S Department of Commerce Links to third party websites take you outsid...

Страница 3: ...380 G6 Telco CLIM Five Ethernet Copper Ports 22 DL380p Gen8 Telco CLIM Option 1 Five Ethernet Copper Ports 22 DL380p Gen8 Telco CLIM Option 2 Three Ethernet Copper and Two Ethernet Optical Ports 23 CLIM Cable Management Ethernet Patch Panel 23 SAS Disk Enclosure 24 Maintenance Switch 24 System Console 24 UPS Optional 25 UPS for a Single Phase Power Configuration Optional 25 UPS for a Three Phase P...

Страница 4: ...ower Failure Support Works 62 Considerations for Ride Through Time Configuration 63 Considerations for Site UPS Configurations 64 AC Power Fail States 64 Dimensions and Weights 65 Plan View of the Modular Cabinets 65 Service Clearances for the Modular Cabinets 65 Unit Sizes 65 36U Intelligent Rack Modular Cabinet Physical Specifications 66 42U Modular Cabinet Physical Specifications 66 Enclosure D...

Страница 5: ...closure and Disk Storage Considerations 84 Ethernet to Networks 84 IP CLIM Ethernet Interfaces 84 Telco CLIM Ethernet Interfaces 86 VIO Enclosure Ethernet Ports 87 5 Hardware Configuration in NS2100 Cabinets 88 Maximum Number of Modular Components NS2100 System 88 IP and Telco CLIM Coexistence Limits 88 Typical NS2100 Configurations 89 6 Support and other resources 93 Accessing Hewlett Packard Ent...

Страница 6: ...113 SAS Disk Enclosures With a Rack Mounted UPS 114 Non Supported UPS Configurations 115 NonStop System With a Data Center UPS Single Power Rail 116 NonStop System With Data Center UPS Both Power Rails 117 NonStop System With Rack Mounted UPS and Data Center UPS in Parallel 119 NonStop System With Two Rack Mounted UPS in Parallel 121 NonStop System with Cascading Rack Mounted UPS and Data Center U...

Страница 7: ...orage CLIMs Four M8381 25 SAS Disk Enclosure Configuration 79 24 Two DL380p Gen8 Storage CLIMs Two M8381 25 SAS Disk Enclosure Configuration 80 25 Two DL380p Gen8 Storage CLIMs Four M8381 25 SAS Disk Enclosure Configuration 81 26 Four DL380p Gen8 Storage CLIMs Four M8381 25 SAS Disk Enclosure Configuration 82 27 Four DL380p Gen8 Storage CLIMs Eight M8381 25 SAS Disk Enclosure Configuration 83 28 E...

Страница 8: ...ion in 697513 004R Updated Hewlett Packard Enterprise references New and Changed Information in 697513 004 The DL380p Gen8 IP Telco and Storage CLIMs are now supported for NS2100 systems The following topics have been added or modified NS2100 System Overview page 13 CLuster I O Modules CLIMs page 16 CLIM Connection Group Module Slot Port Numbering page 33 Uninterruptible Power Supply UPS page 40 E...

Страница 9: ... Document Organization Contents Chapters This chapter provides an overview of the NS2100 commercial system Chapter 1 NS2100 System Overview page 13 This chapter outlines topics to consider when planning or upgrading the installation site for the NS2100 system Chapter 2 Site Preparation Guidelines for NS2100 Systems page 38 This chapter provides the installation specifications for a fully populated...

Страница 10: ...file name Computer Type Computer type letters indicate C and Open System Services OSS keywords commands and reserved words Type these items exactly as shown Items not enclosed in brackets are required For example Use the cextdecs h header file Text displayed by the computer For example Last Logon 14 May 2006 08 02 23 A listing of computer code For example if listen sock 1 0 perror Listen Error exi...

Страница 11: ...xample M address new value 0 1 2 3 4 5 6 7 8 9 An ellipsis immediately following a single syntax item indicates that you can repeat that syntax item any number of times For example s char Punctuation Parentheses commas semicolons and other symbols not previously described must be typed as shown For example error NEXTFILENAME file name LISTOPENS SU process name su name Quotation marks around a symb...

Страница 12: ...lank line This spacing distinguishes items in a continuation line from items in a vertical list of selections For example ALTER OUT file spec LINE attribute spec Publishing History Publication Date Product Version Part Number August 2012 N A 697513 001 November 2012 N A 697513 002 December 2012 N A 697513 003 February 2013 N A 697513 004 November 2015 N A 697513 004R 12 ...

Страница 13: ...e CLIM pair 100 Maximum SAS disk drives per Storage CLIM pair 2 required one each for X and Y fabrics Maximum VIO enclosures 4 embedded Ethernet ports one port is reserved for OSM Maximum embedded Ethernet connectivity per VIO enclosure 4 optional expanded Ethernet ports copper optical Maximum expanded Ethernet connectivity per VIO enclosure optional Supported Enterprise Storage System ESS support...

Страница 14: ...S2100 system The applications and purpose of any NS2100 system determine the number and combinations of hardware within a modular cabinet Standard Hardware for an NS2100 system includes Blade Element rx2800 i2 page 15 Versatile I O VIO Enclosure page 15 Storage CLuster I O Module CLIM page 17 SAS Disk Enclosure page 24 14 NS2100 System Overview ...

Страница 15: ...x2800 i2 Server User Service Guide at http www hpe com support Integrity_NonStop_rx2800_i2Server_Manuals An NS2100 system supports up to four blade elements configured in pairs Because modular hardware provides flexibility in how hardware is distributed in a rack up to four blade elements can be installed in a single footprint To reduce ambiguity in identifying proper cable connections to the blad...

Страница 16: ...ster I O Protocols CIP subsystem For more information about the CIP subsystem see the Cluster I O Protocols CIP Configuration and Management Manual Two models of base servers are used for CLIMs You can determine a CLIM s model by looking at the label on the back of the unit behind the cable arm This label refers to the number as a PID but it is not the PID of the CLIM It is the Number on Label in ...

Страница 17: ... a SAS Host Bus Adapter HBA supporting SAS disk drives solid state drives and SAS tape devices A Fibre Channel FC interface for ESS and FC tape devices via a customer ordered FC HBA A Storage CLIM can have 0 2 or 4 FC interfaces in an NS2100 system Connections to FCDMs are not supported DL380 G6 and DL380p Gen8 CLIMs can coexist in the same NS2100 series system and you can have G6 and Gen8 CLIM pa...

Страница 18: ...hows the Storage CLIM HBA slots For more information about Storage CLIMs see Storage CLIM Devices page 74 DL380p Gen8 Storage CLIM The DL380p Gen8 Storage CLIM contains 3 PCIe HBA slots with these characteristics Provides Configuration Storage CLIM HBA Slot ServerNet fabric connections via a PCIe 4x adapter Part of base configuration 1 Two 6 Gbps SAS ports NOTE Fibre Channel HBA is not part of bas...

Страница 19: ...rts page 19 DL380 G6 IP CLIM Option 2 Three Ethernet Copper and Two Ethernet Optical Ports page 20 DL380p Gen8 IP CLIM Option 1 Five Ethernet Copper Ports page 20 DL380p Gen8 IP CLIM Option 2 Three Ethernet Copper and Two Ethernet Optical Ports page 21 These illustrations show the Ethernet interfaces and ServerNet fabric connections on the DL380 G6 and DL380p Gen8 IP CLIM with the IP CLIM option 1...

Страница 20: ...PCIe 4x adapter Slot 1 1 port 1GbE optical NIC Slot 2 and Slot 3 Not used Slot 4 and Slot 5 DL380p Gen8 IP CLIM Option 1 Five Ethernet Copper Ports Provides IP CLIM Slot One ServerNet PCIe interface card which provides the ServerNet fabric connections Slot 1 2 port 1GbE copper NIC Slot 2 Not used Slots 3 4 5 6 20 NS2100 System Overview ...

Страница 21: ...mation about coexistence limits for IP and Telco CLIMs see IP and Telco CLIM Coexistence Limits page 88 The Telco CLIM connects to the VIO enclosure and utilizes the Message Transfer Part Level 3 User Adaptation layer M3UA protocol and functions as a ServerNet Ethernet adapter with one of these Telco CLIM configurations DL380 G6 Telco CLIM Five Ethernet Copper Ports page 22 DL380p Gen8 Telco CLIM ...

Страница 22: ...o CLIM Five Ethernet Copper Ports Provides Telco CLIM Slot ServerNet fabric connections via a PCIe 4x adapter Slot 1 2 port 1GbE copper NIC Slot 2 Not used Slots 3 4 5 DL380p Gen8 Telco CLIM Option 1 Five Ethernet Copper Ports Provides Telco CLIM Slot One ServerNet PCIe interface card which provides the ServerNet fabric connections Slot 1 2 port 1GbE copper NIC Slot 2 Not used Slots 3 4 5 6 22 NS2...

Страница 23: ...ernet patch panel has 24 slots is 1U high and should be the topmost unit to the rear of the rack Each Ethernet patch panel can handle cables for up to five CLIMs It has no power connection Each patch panel has 6 panes labeled A B C D E and F Each pane has 4 RJ 45 ports and each port is labeled 1 2 3 or 4 The RJ 45 ports in Panel A have port names A1 A2 A3 and A4 The factory default configuration d...

Страница 24: ...o the maintenance switch One connection from the ME ENET port on each of the two VIO enclosures One connection from slot 6B port A on each of the two VIO enclosures for the OSM Service Connection and OSM Notification Director optional if a dedicated service LAN is implemented using CLIMs One connection to the iLO port on a CLIM One connection to the iLO port on a blade element One connection to an...

Страница 25: ...it the modular cabinet at either the top or bottom rear corners of the cabinet depending on what is ordered for the site power feed the large output receptacle is unused For the UPS power and environmental requirements see System Installation Specifications for NS2100 Systems page 44 For planning installation and emergency power off EPO instructions see the HPE UPS R5000 User Guide and the HPE UPS...

Страница 26: ...connection types see your Hewlett Packard Enterprise service provider NOTE The Fibre Channel SAN switch power cords might not be compatible with the modular cabinet PDU Contact your Hewlett Packard Enterprise service provider to order replacement power cords for the SAN switch that are compatible with the modular cabinet PDU Cables and switches vary depending on whether the connection is direct sw...

Страница 27: ...devices ask your Hewlett Packard Enterprise service provider to refer to the NonStop Storage Overview Preparation for Other Hardware This guide provides the specifications only for the NS2100 system modular cabinets and enclosures identified earlier in this section For site preparation specifications for other Hewlett Packard Enterprise hardware that will be installed at the site with the NS2100 s...

Страница 28: ...t module Slot or Bay or Position A connector to which a cable can be attached and which transmits and receives data Port A notation method used by hardware and software in NonStop systems for organizing and identifying the location of certain hardware components Group Module Slot GMS Group Module Slot Bay GMSB Group Module Slot Port GMSP In an NS2100 system OSM uses this term to hierarchically dif...

Страница 29: ... module represents either the blade element or the processor In an NS2100 system all blade elements are module 1 Example module 1 any blade element 100 103 relates to processors 0 3 Example module 102 processor 2 In the OSM Low Level Link 100 through 103 relates to processors 0 through 3 Example module 103 processor 3 Slot In OSM Service Connection displays 1 represents the ServerNet PCI adapter c...

Страница 30: ... Y 101 1 401 1 3 4 power supplies physical power supplies 1 and 2 102 1 402 2 103 1 403 3 32 37 fans physical fans 1 through 6 In OSM the term Blade Complex is used for the group GMS Numbering Displayed in the OSM Low Level Link Slot Module Group Processor ID 1 100 400 0 1 101 400 1 1 102 400 2 1 103 400 3 In OSM the term Blade Complex is used for the group The form of the GMS numbering for a blad...

Страница 31: ... X Fabric Not supported 1 1 3 2 100 Not supported 2 2 1 and 3 for 2 Storage CLIMs 1 4 for 4 Storage CLIMs Storage CLIM 3 3 1 2 IP CLIM 4 4 1 2 Telco CLIM Not supported 5 5 C and D 10 100 1000 Mbps Ethernet ports optical 6a 6 A B 10 100 Mbps Ethernet ports copper 6b 1 6 C D 10 100 1000 Mbps C D 10 100 1000 Mbps Ethernet ports optical 7a 7 A B 10 100 Mbps Ethernet ports copper 7b 7 C D 10 100 1000 M...

Страница 32: ...1 Port A in slot 6b is reserved for OSM Figure 3 VIO Enclosure Slot Locations NS2100 System 32 NS2100 System Overview ...

Страница 33: ... 4 Storage CLIMs 3 Storage CLIM 2 100 1 2 4 IP CLIM 4 Telco CLIM 1 and 3 for 2 Storage CLIMs 1 4 for 4 Storage CLIMs 3 Storage CLIM 3 100 1 2 4 IP CLIM 4 Telco CLIM The illustration below shows the slot and connector locations from the VIO modules to two DL380 G6 Storage CLIMs Figure 4 DL380 G6 Storage CLIM Connections to VIO Enclosures Component Location and Identification in an NS2100 System 33 ...

Страница 34: ...nd connector locations from the VIO modules to two DL380 G6 IP or Telco CLIMs NOTE The Telco CLIM connections are the same as the IP CLIM connections Figure 5 DL380 G6 IP or Telco CLIM Connections to VIO Enclosures 34 NS2100 System Overview ...

Страница 35: ...low shows the slot and connector locations from the VIO modules to two DL380p Gen8 Storage CLIMs Figure 6 DL380p Gen8 Storage CLIM Connections to VIO Enclosures Component Location and Identification in an NS2100 System 35 ...

Страница 36: ...n as the systems records an Installation Document Packet This packet can include Tech Memo for the Factory Installed Hardware Configuration page 36 Configuration Forms for the CLIMs and ServerNet Adapters page 37 Tech Memo for the Factory Installed Hardware Configuration Each new NS2100 system includes a document that describes The cabinet included with the system Each hardware enclosure installed...

Страница 37: ...ons to the Fibre Channel HBA interfaces on a Storage CLIM provide the Fibre Channel functionality in the system To add Fibre Channel and Ethernet configuration forms to your Installation Document Packet ask your Hewlett Packard Enterprise service provider to provide the necessary forms from the Versatile I O Manual or the Cluster I O Installation and Configuration Manual for IP or Telco CLIM relat...

Страница 38: ... that have these batteries also have internal EPO hardware for connection to a site EPO switch or relay In an emergency activating the EPO switch or relay removes power from all electrical equipment in the computer room except that used for lighting and fire related sensors and alarms EPO Requirement for NS2100 Systems NS2100 systems without an optional UPS such as an HPE R5000 UPS installed in th...

Страница 39: ...tage conditions such as sags or brownouts Wide and rapid variations in input voltage levels Wide and rapid variations in input power frequency Electrical storms Large inductive sources such as motors and welders Faults in the distribution system wiring such as loose connections Computer systems can be protected from the sources of many of these electrical disturbances by using A dedicated power di...

Страница 40: ... rack that would also need a UPS or UPS ERM combination installed Additionally lifting equipment might be required to lift heavy enclosures to their new location For information and specifications on the UPS and ERM that is supported for a single phase power configuration see Chapter 3 page 44 and the HPE UPS R5000 User Guide at http www hpe com support UPS_3_Phase_Manuals For information and spec...

Страница 41: ...er continuing to run can cause rapid heat buildup and excessive temperatures within the hardware Excessive internal temperatures can result in full or partial system shutdown Ensure that the site s cooling system remains fully operational when the server is running Because each modular cabinet houses a unique combination of enclosures use the Heat Dissipation Specifications and Worksheet page 69 t...

Страница 42: ...move each cabinet from its shipping pallet and to safely move it to the installation site WARNING A fully populated cabinet is unstable when moving down the unloading ramp from its shipping pallet Arrange for enough personnel to stabilize each cabinet during removal from the pallet and to prevent the cabinet from falling A falling cabinet can cause serious or fatal personal injury Ensure sufficien...

Страница 43: ... your site layout plans can also include provisions for Channels or fixtures used for routing data cables and power cables Access to air conditioning ducts filters lighting and electrical power hardware Communications cables patch panels and switch equipment Power conditioning equipment Storage area or cabinets for supplies media and spare parts Operational Space 43 ...

Страница 44: ...g Configurations page 57 Uninterruptible Power Supply UPS page 58 Power Distribution Units PDUs Two PDU cores provide power for the rack They mount at the lowest possible U location in the rack Both PDUs are mounted in the same U location one mounted to the rear mounting rail and one mounted to the front mounting rail There are two types of PDUs available for an NS2100 system Intelligent PDUs iPDU...

Страница 45: ...ions Without UPS page 48 Modular PDU Connections With Single Phase UPS page 49 Modular PDU Connections With Three Phase UPS page 50 Figure 8 Intelligent PDU Connections Without UPS Power Distribution for NS2100 Systems 45 ...

Страница 46: ...Figure 9 Intelligent PDU Connections With Single Phase UPS 46 System Installation Specifications for NS2100 Systems ...

Страница 47: ...ations of modular PDU connections show single phase modular PDU cores with four outlets In three phase installations the modular PDU cores have six outlets L1 through L6 Also 36U racks with modular PDUs have only three extension bars on each side Power Distribution for NS2100 Systems 47 ...

Страница 48: ...Figure 11 Modular PDU Connections Without UPS 48 System Installation Specifications for NS2100 Systems ...

Страница 49: ...Figure 12 Modular PDU Connections With Single Phase UPS Power Distribution for NS2100 Systems 49 ...

Страница 50: ... cabinets are ordered from Hewlett Packard Enterprise and how the AC power feeds are routed at the site NS2100 system cabinets can be ordered with the AC power cords for the PDU installed either Top Power and I O cables are routed from above the modular cabinet Bottom Power and I O cables are routed from below the modular cabinet 50 System Installation Specifications for NS2100 Systems ...

Страница 51: ...ed Without UPS page 53 AC Power Feeds With Single Phase UPS Example of Top AC Power Feed With Single Phase UPS page 54 Example of Bottom AC Power Feed With Single Phase UPS page 55 AC Power Feeds With Three Phase UPS Example of Top AC Power Feed with Three Phase UPS page 56 Example of Bottom AC Power Feed With Three Phase UPS page 57 Power Distribution for NS2100 Systems 51 ...

Страница 52: ...Figure 14 Example of Bottom AC Power Feed Without UPS 52 System Installation Specifications for NS2100 Systems ...

Страница 53: ...Figure 15 Example of Top AC Power Feed Without UPS Power Distribution for NS2100 Systems 53 ...

Страница 54: ...Figure 16 Example of Top AC Power Feed With Single Phase UPS 54 System Installation Specifications for NS2100 Systems ...

Страница 55: ...Figure 17 Example of Bottom AC Power Feed With Single Phase UPS Power Distribution for NS2100 Systems 55 ...

Страница 56: ...Figure 18 Example of Top AC Power Feed with Three Phase UPS 56 System Installation Specifications for NS2100 Systems ...

Страница 57: ...s especially for larger systems can cause unbalanced loading and might violate applicable electrical codes Connecting the two power plugs from an enclosure to the same load segment causes failure of the hardware if that load segment fails PDU Strapping Configurations PDUs are available in four static strapping configurations that are factory installed in a modular cabinet The specific PDU strappin...

Страница 58: ...he single phase power specifications for the power components used in international installations Table 5 page 59 contains the single phase power specifications for the power components used in international installations CAUTION Be sure the hardware configuration and resultant power loads of each cabinet within the system do not exceed the capacity of the branch circuit according to applicable el...

Страница 59: ... PDU 1 phase iPDU 1 phase R5000 1 phase UPS 32 A 32 A 4500 W Output Load 200 240 V 200 240 V 220 240 V Input Voltage IEC309 332P6 IEC309 332P6 IEC309 332P6 Input Connector 32 A 32 A 32 A N A N A 220 240 V Output Voltage 4x C19 6 x C19 1 x IEC309 332R6 Output Connectors 28 x C13 20 x C13 4 x C19 4 x C13 UPS outputs are connected to the compatible PDU inputs Notes Table 5 International Three Phase P...

Страница 60: ... Distribution for NS2100 Systems page 44 Factory installed enclosures are connected to the PDUs for a balanced load among the load segments CAUTION If you are installing NS2100 system enclosures in a rack balance the current load among the available load segments Using only one of the available load segments especially for larger systems can cause unbalanced loading and might violate applicable el...

Страница 61: ...2 M8381 25 SAS disk enclosure no disks NA 9 5 NA SAS disk drive 10k rpm NA 7 4 NA SAS disk drive 15k rpm 1 5 A 5 volts 5 84 5 7 NA Solid state drive 200 GB 1 0 A 12 volts 115 105 1 Rack mounted system console NSCR210 or NSCR212 2 28 28 1 Rack mounted keyboard and monitor 4 20 20 1 Maintenance switch Ethernet 2 1 One of the plugs for an enclosure must be connected to one of the left side extension ...

Страница 62: ...shutdown of I O operations and processors This shutdown does not include stopping or powering off the system nor does it stop TMF or other applications Customers are encouraged to execute scripts to shut down database activity before the processors are shut down You must perform these actions in the OSM Service Connection Perform the Configure a Power Source as UPS action to configure the power ra...

Страница 63: ...dling power failures To set the ride through time for a Hewlett Packard Enterprise supported UPS from the manufacturing default setting to an appropriate value for your system your service provider can refer to the Setting the Ride Through Time and Configuring for Maximized Runtime procedure in the NS2100 Hardware Installation Manual To set ride through time using SCF see the SCF Reference Manual ...

Страница 64: ...te UPS is used With a site UPS instead of a rack mounted UPS the customer must perform manual system shutdown if the backup generators cannot be started It is also possible to have a rack mounted UPS in addition to a site UPS Since the site UPS can supply a whole computer room or part of that room including required cooling from the perspective of OSM site UPS power can supply the group 100 AC pow...

Страница 65: ...Rack Modular Cabinet Physical Specifications page 66 42U Modular Cabinet Physical Specifications page 66 Enclosure Dimensions page 66 Modular Cabinet and Enclosure Weights With Worksheet page 67 Plan View of the Modular Cabinets Service Clearances for the Modular Cabinets Aisles 6 feet 182 9 centimeters Front 3 feet 91 4 centimeters Rear 3 feet 91 4 centimeters Unit Sizes Height U Enclosure Type 2...

Страница 66: ...pping palletized Cabinet and Enclosure Weights With Worksheet page 67 42U Modular Cabinet Physical Specifications Weight Depth Width Height Item cm in cm in cm in Depends on the 130 02 51 19 59 78 23 54 200 66 79 00 Modular cabinet enclosures 121 0 47 6 59 06 23 3 199 9 78 7 Rack installed See Modular 147 00 57 87 90 35 43 218 00 85 82 Shipping palletized Cabinet and Enclosure Weights With Workshe...

Страница 67: ...keyboard and display 74 4 29 3 43 7 17 2 12 7 5 0 R5000 UPS for single phase power 71 9 28 3 43 7 17 2 12 7 5 0 R5000 ERM for single phase power 36 5 14 4 66 26 26 1 10 3 R12000 3 UPS for three phase power 66 26 43 8 17 2 13 1 5 1 R12000 3 ERM for three phase power Modular Cabinet and Enclosure Weights With Worksheet The total weight of each modular cabinet is the sum the weights of the cabinet pl...

Страница 68: ...isk enclosure no disks 0 5 1 SAS disk drive 0 5 1 Solid state drive 2 3 5 CLIM patch panel 2 3 5 Maintenance switch Ethernet 12 7 38 rack mount system console keyboard and display 57 126 R5000 UPS single phase 73 160 R5500 XR UPS single phase 139 2 with batteries 307 with batteries R12000 3 UPS three phase 59 8 without batteries 135 without batteries 77 170 ERM for three phase power AF434A 63 139 ...

Страница 69: ...nformation about the Intelligent rack your Hewlett Packard Enterprise service provider can consult the HPE Intelligent Rack Family User Guide NOTE For instructions on grounding the rack ask your Hewlett Packard Enterprise service provider to refer to the instructions in the HPE Intelligent Rack Family Options Installation Guide Environmental Specifications This subsection provides information abou...

Страница 70: ...Operating Temperature Humidity and Altitude Maximum Rate of Change per Hour Recommended Range 1 Operating Range 1 Specification 50 to 95 F 10 to 35 C Temperature rack mounted system console and maintenance switch 18 F 10 C Repetitive 68 to 77 F 20 to 25 C 36 F 20 C Nonrepetitive 50 to 95 F 10 to 35 C Temperature CLIMs SAS disk enclosure blade elements 1 8 F 1 C Repetitive 5 4 F 3 C Nonrepetitive 6...

Страница 71: ...are not fully populated such as a Fibre Channel disk module with fewer disk drives AC current calculations assume that one PDU delivers all power In normal operation the power is split equally between the two PDUs in the cabinet However calculate the power load to assume delivery from only one PDU to allow the system to continue to operate if one of the two AC power sources or PDUs fails Example o...

Страница 72: ...sures 1536 921 450 270 52 116 4 2 DL380 G6 Storage CLIM 392 358 115 1 line 105 11 8 26 1 1 Rack mount system console keyboard and monitor 96 96 28 1 line 28 5 5 12 1 1 Rack mount keyboard and monitor 137 137 20 1 line 20 4 6 10 2 2 Maintenance switch 151 333 42 1 Modular cabinet with Intelligent rack 18 2 40 1 1 Pair of iPDU cores 1 9 1 20 NA 8 iPDU extension bar 13373 8647 3909 2515 462 1015 Tota...

Страница 73: ... application LAN equipment Length Restrictions for Cables Maximum allowable lengths of cables connecting to components outside the modular cabinet are Product ID Maximum Length Connectors Fiber Type Connection M8900nnn 1 250 m LC LC MMF VIO enclosure FC HBA interfaces on Storage CLIM to ESS M8900nnn 250 m LC LC MMF VIO enclosure FC HBA interfaces on Storage CLIM to FC switch 1 nnn indicates the le...

Страница 74: ...th a SAS tape drive connected to the system you can use the BACKUP and RESTORE utilities to save data to and restore data from tape Fibre Channel Ports to ESS ESS can be connected directly to the two customer ordered HBA fibre channel FC ports on a Storage CLIM FC ports are only supported on the NS2100 commercial system Fibre Channel Ports to Tape Devices Fibre Channel tape devices can be connecte...

Страница 75: ...ut the CIP subsystem see the Cluster I O Protocols CIP Configuration and Management Manual This illustration shows the locations of the hardware in the SAS disk enclosure as well as the I O modules on the rear of the enclosure for connecting to the Storage CLIM Storage CLIM Devices 75 ...

Страница 76: ...ration Configuration Restrictions for Storage CLIMs The maximum number of logical unit numbers LUNs for each CLIM including SAS disks ESS and tapes is 512 Each primary backup mirror and mirror backup path is counted in this maximum SAS disk enclosures connected to DL380 G6 and DL380p Gen8 CLIMs cannot be daisy chained Use only the supported configurations as described below Configurations for Stor...

Страница 77: ...s In this case SYSTEM DSMSCM AUDIT and OSS are configured as mirrored SAS disk volumes Backup and Mirror CLIM Primary and Mirror Backup CLIM Disk Volume Name 100 2 3 3 100 2 3 1 SYSTEM 100 2 3 3 100 2 3 1 DSMSCM 100 2 3 3 100 2 3 1 AUDIT 100 2 3 3 100 2 3 1 OSS 1 For an illustration of the factory default slot locations for a SAS disk enclosure see Factory Default Disk Volume Locations for SAS Dis...

Страница 78: ...00 2 3 1 100 2 3 3 100 2 3 3 100 2 3 1 SYSTEM 2 2 202 102 100 2 3 1 100 2 3 3 100 2 3 3 100 2 3 1 DSMSCM 3 3 203 103 100 2 3 1 100 2 3 3 100 2 3 3 100 2 3 1 AUDIT 4 4 204 104 100 2 3 1 100 2 3 3 100 2 3 3 100 2 3 1 OSS 1 1 If you have ordered OSS you need a 4 pair disk configuration For an illustration of the factory default slot locations for a SAS disk enclosure see Factory Default Disk Volume L...

Страница 79: ...01 101 100 2 3 2 100 2 3 4 100 2 3 3 100 2 3 1 SYSTEM 2 2 202 102 100 2 3 2 100 2 3 4 100 2 3 3 100 2 3 1 DSMSCM 3 3 203 103 100 2 3 2 100 2 3 4 100 2 3 3 100 2 3 1 AUDIT 4 4 204 104 100 2 3 2 100 2 3 4 100 2 3 3 100 2 3 1 OSS For an illustration of the factory default slot locations for a SAS disk enclosure see Factory Default Disk Volume Locations for SAS Disk Devices page 76 DL380p Gen8 Storage...

Страница 80: ...Storage CLIMs and two M8381 25 SAS disk enclosures In this case SYSTEM DSMSCM AUDIT and OSS are configured as mirrored SAS disk volumes Mirror Disk Location in Mirror SAS Enclosure Primary Disk Bay in Primary SAS Enclosure Mirror LUN Primay LUN Mirror Backup CLIM Mirror CLIM Backup CLIM Primary CLIM Disk Volume Name 1 1 201 101 100 2 5 3 1 100 2 5 3 3 100 2 5 3 3 100 2 5 3 1 SYSTEM 2 2 202 102 100...

Страница 81: ...age CLIMs and four M8381 25 SAS disk enclosures In this case SYSTEM DSMSCM AUDIT and OSS are configured as mirrored SAS disk volumes Mirror Disk Location in Mirror SAS Enclosure Primary Disk Bay in Primary SAS Enclosure Mirror LUN Primay LUN Mirror Backup CLIM Mirror CLIM Backup CLIM Primary CLIM Disk Volume Name 1 1 201 101 100 2 5 3 1 100 2 5 3 3 100 2 5 3 3 100 2 5 3 1 SYSTEM 2 2 202 102 100 2 ...

Страница 82: ...Backup CLIM Primary CLIM Disk Volume Name 1 1 101 101 100 2 5 3 3 100 2 5 4 3 100 2 5 4 1 100 2 5 3 1 SYSTEM 2 2 102 102 100 2 5 3 3 100 2 5 4 3 100 2 5 4 1 100 2 5 3 1 DSMSCM 3 3 103 103 100 2 5 3 3 100 2 5 4 3 100 2 5 4 1 100 2 5 3 1 AUDIT 4 4 104 104 100 2 5 3 3 100 2 5 4 3 100 2 5 4 1 100 2 5 3 1 OSS Four DL380p Gen8 Storage CLIMs Eight M8381 25 SAS Disk Enclosures This illustration shows exam...

Страница 83: ...T and OSS are configured as mirrored SAS disk volumes Mirror Disk Location in Mirror SAS Enclosure Primary Disk Bay in Primary SAS Enclosure Mirror LUN Primay LUN Mirror Backup CLIM Mirror CLIM Backup CLIM Primary CLIM Disk Volume Name 1 1 101 101 100 2 5 3 3 100 2 5 4 3 100 2 5 4 1 100 2 5 3 1 SYSTEM 2 2 102 102 100 2 5 3 3 100 2 5 4 3 100 2 5 4 1 100 2 5 3 1 DSMSCM 3 3 103 103 100 2 5 3 3 100 2 ...

Страница 84: ...page 86 VIO Enclosure Ethernet Ports page 87 The IP CLIM Telco CLIM or the Ethernet ports on a VIO enclosure provide Ethernet connectivity between NS2100 commercial systems and Ethernet LANs The Ethernet port is an end node on the ServerNet and uses either fiber optic or copper cable for connectivity to user application LANs as well as for the dedicated service LAN These are the front views of eac...

Страница 85: ...This illustration shows the Ethernet interfaces and ServerNet fabric connections on DL380 G6 and DL380p Gen8 IP CLIMs with the IP CLIM option 1 and option 2 configurations IP CLIM Ethernet Interfaces 85 ...

Страница 86: ... using the CIP subsystem see the Cluster I O Protocols CIP Configuration and Management Manual Telco CLIM Ethernet Interfaces These illustration shows the Ethernet interfaces and ServerNet fabric connections on a DL380 G6 and DL380p Gen8 Telco CLIM 86 System Configuration Guidelines for NS2100 Systems ...

Страница 87: ...t Manual VIO Enclosure Ethernet Ports For more information on the VIO Enclosure s Ethernet ports see VIO Enclosure Group Module Slot Numbering page 31 For illustrations and details about connecting to the Ethernet ports on the VIO enclosure ask your Hewlett Packard Enterprise service provider to refer to the Versatile I O Manual VIO Enclosure Ethernet Ports 87 ...

Страница 88: ... and are provided only as an example not as exact values NS2100 system Enclosure or Component 1 4 processor 2 processor 4 2 Blade element 2 2 System console 2 2 VIO enclosure 4 4 Storage CLIM 2 2 IP CLIM 2 2 Telco CLIM 1 1 CLIM patch panel 8 4 SAS disk enclosure 2 2 Maintenance switch 1 1 HPE R5000 UPS for single phase 1 1 HPE R12000 3 UPS for three phase 2 2 Extended runtime module ERM for single...

Страница 89: ...CLIM Coexistence Limits 0 2 2 0 Typical NS2100 Configurations Figure 28 Example 42U Configuration Without UPS and ERM Typical NS2100 Configurations 89 ...

Страница 90: ...Figure 29 Example 42U Configurations With Possible UPS ERM Combinations 90 Hardware Configuration in NS2100 Cabinets ...

Страница 91: ...Figure 30 Example 36U Configuration Without UPS and ERM Typical NS2100 Configurations 91 ...

Страница 92: ...31 Example 36U Configurations With Possible UPS ERM Combinations A second cabinet is required when space for optional components exceeds the capacity of the cabinet 92 Hardware Configuration in NS2100 Cabinets ...

Страница 93: ...updates through the product interface Review your product documentation to identify the recommended software update method To download product updates go to either of the following HP Support Center Hewlett Packard Enterprise Get connected with updates from HP page www hpe com support e updates Software Depot website www hpe com support softwaredepot To view and update your entitlements and to lin...

Страница 94: ...pair can be accomplished by CSR For more information about CSR contact your local service provider or go to the CSR website www hpe com support selfrepair Remote support Remote support is available with supported devices as part of your warranty Care Pack Service or contractual support agreement It provides intelligent event diagnosis and automatic secure submission of hardware event notifications...

Страница 95: ...s a Windows Server approved by Hewlett Packard Enterprise to run maintenance and diagnostic software for NS2100 systems Through the system console you can Monitor system operations between and perform maintenance operations on systems using the HPE NonStop Open System Management OSM interface Install and use other console software for managing NonStop systems such as HPE Systems Insight Manager SI...

Страница 96: ...CLIMs the primary and backup CLIMs are defined based on the disk path configuration NOTE For more information about CLIM to CLIM failover see the Cluster I O Protocols CIP Configuration and Management Manual If CLIMs are used to configure the maintenance LAN connect the CLIM that configures ZTCP0 to one maintenance switch and connect the other CLIM that configures ZTCP1 to the second maintenance s...

Страница 97: ...e system consoles Procedures for moving these services are located in the Service Procedures collection of NTL For details see Changing the DHCP DNS or BOOTP Server from System Consoles to CLIMs Changing the DHCP DNS or BOOTP Server from CLIMs to System Consoles You cannot have these services divided between a CLIM and a system console This mixed configuration is not supported CAUTION You must hav...

Страница 98: ...al switches 192 168 36 12 192 168 36 20 N A Maintenance switch ProCurve More than 10 switches 192 168 42 11 N A iPDU in rack 1 front mounting rail 192 168 42 12 N A iPDU in rack 1 rear mounting rail 192 168 42 21 N A iPDU in rack 2 front mounting rail 192 168 42 22 N A iPDU in rack 2 rear mounting rail 192 168 42 31 N A iPDU in rack 3 front mounting rail 192 168 42 32 N A iPDU in rack 3 rear mount...

Страница 99: ...es SWAN Concentrator Restrictions NOTE SWAN and SWAN 2 concentrators are only supported on the NS2100 commercial system SWAN SWAN 2 concentrators can be connected to an IP CLIM or the 10 100 Ethernet ports on a VIO enclosure with these restrictions Isolate any ServerNet wide area networks SWANs on the system The system must be equipped with at least two LANs one LAN for SWAN SWAN 2 concentrators a...

Страница 100: ...rt 1 of the VIO enclosure located in group 100 module 2 IP Configuration TCP IP Stack GMS for IP CLIM Location in VIO Enclosure IP 192 168 36 10 ZTCP0 100 2 4 1 Subnet hFFFFFF00 Hostname osmlanx IP 192 168 36 11 ZTCP1 100 3 4 1 Subnet hFFFFFF00 Hostname osmlany Dedicated Service LAN Links With Telco CLIMs You can implement up system service LAN connectivity using Telco CLIMs if the system has at l...

Страница 101: ...rvice Connection see Configuring Additional TCP IP Processes for OSM Connectivity in the OSM Migration and Configuration Guide System Consoles for NS2100 Systems NOTE Because Hewlett Packard Enterprise requires two sources of HSS files for NS2100 systems you must have two system consoles primary and backup configured on the dedicated service LAN If you do not have a second system console available...

Страница 102: ... preconfigured DHCP configuration of the backup system console before you add it to the LAN Change the preconfigured IP address of the backup system console before you add it to the LAN CAUTION Networks with more than one path between any two systems can cause loops that result in message duplication and broadcast storms that can bring down the network If a second connection is used refer to the d...

Страница 103: ...8 100 M8900125 410 1 125 1 M8900200 656 1 200 1 M8900250 820 1 250 1 M8920 3 10 3 MTP MTP MMF M8920 5 16 5 M8920 10 33 10 M8920 30 98 30 M8920 50 164 50 customer supplied RJ 45 RJ 45 CAT 6 UTP ETH1 port on storage CLIM with encryption to customer supplied switch M8926 02 2 0 6 RJ 45 CAT 5e or CAT 6 Ethernet M8926 04 4 1 2 M8926 05 5 1 5 M8926 06 6 1 8 M8926 08 8 2 5 M8926 10 10 3 M8926 12 12 3 7 M...

Страница 104: ...088 MMF DL380p Gen8 Storage CLIM to M8381 25 copper 2 SAS disk enclosure M8900nnn 1 Maximum Length Transfer Rate LC LC MMF OM2 Storage CLIM FC HBA interface to ESS 300 m 3 2 Gbps 150 m 4 Gbps 50 m 8 Gbps Customer supplied Maximum Length Transfer Rate LC LC MMF OM3 500 m 2 Gbps 380 m 4 Gbps 150 m 8 Gbps M8900nnn 1 Maximum Length Transfer Rate LC LC MMF OM2 Storage CLIM FC HBA interface to FC tape 3...

Страница 105: ...een the modular enclosures in the system Hewlett Packard Enterprise recommends placing all cabinets adjacent to each other and bolting them together with cable length between each of the enclosures as short as possible Cable Length Restrictions 105 ...

Страница 106: ...632 using Insight Remote Support Advanced OSM Low Level Link T0633 Provides down system support Provides support to configure CLIMs before they are operational in a system Provides CLIM software updates Provides the following console based components OSM Console Tools T0634 OSM System Inventory Tool Terminal Emulator File Converter OSM Certificate Tool NonStop Maintenance LAN DHCP DNS Configuratio...

Страница 107: ...System Down OSM Low Level Link 107 ...

Страница 108: ...f the automatic system load is not successful additional paths for loading are available in the boot task Using one load path the system load task attempts to use another path and keeps trying until all possible paths have been used or the system load is successful These 16 paths are available for loading and are listed in the order of their use by the system load task ServerNet Fabric Destination...

Страница 109: ...tion files and automatic generation of the names of the modular resources Preconfigured default resource names are Description Example Naming Convention 1 Type of Object Twentieth ESS disk drive in the system ESS20 ESS number ESS disk drive 2 Twentieth SAS disk volume in the system SAS20 SASnumber SAS disk enclosure SAS CG disk enclosure First modular tape drive in the system TAPE01 TAPE number Mo...

Страница 110: ... 2 concentrators are only supported on the NS2100 commercial system On new NonStop systems only one of each of these processes and names is configured TCP6SAM ZTC0 Telserv ZTCN0 Listener LSN0 No TFTP or WANBOOT process is configured for new NonStop systems NOTE Naming conventions or configurations for the dedicated service LAN TCP IP are the same as the TCP IP conventions used with G series and H ...

Страница 111: ...re but these configurations are supported on all NonStop platforms and can be used with single phase and three phase UPS IMPORTANT You must change the ride through time for a Hewlett Packard Enterprise supported UPS from the manufacturing default setting to an appropriate value for your system During installation of an NS2100 system or HPE UPS your service provider can refer to the Setting the Rid...

Страница 112: ...ns Define Site Infrastructure White Paper IMPORTANT With this configuration you can guarantee that the data center never loses power Figure 33 shows an example of a NonStop system in a fault tolerant data center which has two simultaneously active power distribution paths with multiple backup UPS and engine generator systems Figure 33 NonStop System With a Fault Tolerant Data Center 112 UPS and Da...

Страница 113: ... beginning of the configured ride through time period OSM monitors if AC power is restored before the ride through period ends If AC Power is restored before the ride through period ends the ride through countdown terminates and OSM does not take further steps to prepare for an outage If AC Power is not restored before the ride through periods ends OSM broadcasts a PFAIL_SHOUT command to all proce...

Страница 114: ...35 SAS Disk Enclosures With a Rack Mounted UPS When the utility power fails the NonStop system powers off without an OSM initiated controlled shutdown of the I O operations and processors Only the products in the rack with the rack mounted UPS remain powered on All completed disk write transactions data are written to the disk drive media or the disk drive write cache The rack mounted UPS provides...

Страница 115: ...em do not use any of these non supported UPS configurations They might result in data loss NonStop System With a Data Center UPS Single Power Rail page 116 NonStop System With Data Center UPS Both Power Rails page 117 NonStop System With Rack Mounted UPS and Data Center UPS in Parallel page 119 NonStop System With Two Rack Mounted UPS in Parallel page 121 NonStop System with Cascading Rack Mounted...

Страница 116: ...the controlled shutdown of the I O operations and processors If the utility power is not restored before the data center UPS shuts down any data in the NonStop system disk drive write cache that has not been transferred to the disk drive media is lost To prevent data loss during a utility power failure you must manually disable the Write Cache Enable WCE option on all the disk drive volumes For in...

Страница 117: ...Define Site Infrastructure White Paper IMPORTANT If this configuration is used there is no guarantee that your data center will never lose power Figure 37 shows an example of a non supported configuration in a NonStop system with the left and right PDUs connected to the data center UPS In this configuration OSM does not manage or monitor the data center UPS Figure 37 NonStop System With Data Cente...

Страница 118: ...that has not been transferred to the disk drive media is lost To prevent data loss during a utility power failure you must manually disable the Write Cache Enable WCE option on all the disk drive volumes For information on how to disable the WCE see the SCF Reference Manual for the Storage Subsystem G06 28 H06 05 J06 03 When the utility power is restored you can enable the WCE During a utility pow...

Страница 119: ...ata Center UPS in Parallel When the utility power fails OSM detects a UPS AC Input not Present event from the rack mounted UPS OSM does not recognize the data center UPS OSM does not detect that the data center UPS is running on battery and the UPS battery runtime OSM does not initiate the controlled shutdown of the I O operations and processors The rack mounted UPS shuts down before the data cent...

Страница 120: ...information on how to disable the WCE see the SCF Reference Manual for the Storage Subsystem G06 28 H06 05 J06 03 When the utility power is restored you can enable the WCE During the utility power failure the system can continue to run until the data center UPS runs out of power or until it shuts down 120 UPS and Data Center Power Configurations ...

Страница 121: ...Parallel OSM has the capability to monitor both UPSs but it does not have the logic to initiate the controlled shutdown of the I O operations and processors when utility power fails in this configuration If the utility power is not restored before both rack mounted UPSs shut down any data in the NonStop system disk drive write cache that has not been transferred to the disk drive media is lost If ...

Страница 122: ... the other A typical scenario where this behavior occurs is the failure of the smaller downstream UPS to recognize a stable input from its upstream source In the event of an upstream UPS failure or output disturbance the downstream UPS switches the load to battery Once the upstream UPS regains full function the downstream UPS should recognize a stable input and switch to pass through mode but this...

Страница 123: ...power from the upstream UPS Factors can include the other types of loads which are driven by the upstream UPS Some non linear loads such as lighting or larger motors are more likely to distort the upstream UPS output than other electronic equipment The occurrence of these problems is unpredictable and has affected NonStop customers There is currently no known method to analytically predict the occ...

Страница 124: ...pport ProLiantServers Warranties HPE Enterprise Servers www hpe com support EnterpriseServers Warranties HPE Storage Products www hpe com support Storage Warranties HPE Networking Products www hpe com support Networking Warranties Regulatory information Belarus Kazakhstan Russia marking Manufacturer and Local Representative Information Manufacturer information Hewlett Packard Enterprise 3000 Hanov...

Страница 125: ...ion 2010 is indicated by 0 2011 by 1 2012 by 2 2013 by 3 and so forth YYWW where YY indicates the year using a base year of 2000 for example 0238 02 for 2002 and 38 for the week of September 9 Turkey RoHS material content declaration Türkiye Cumhuriyeti EEE Yönetmeliğine Uygundur Ukraine RoHS material content declaration Обладнання відповідає вимогам Технічного регламенту щодо обмеження використан...

Страница 126: ...s IP CLIM Ethernet 84 maintenance switch 24 SAS disk enclosure 74 tape SAS 74 Console configuration 101 contacting Hewlett Packard Enterprise 93 cooling assessment 41 customer self repair 94 D Default disk drive locations SAS disk enclosures 76 default startup characteristics 108 dimensions enclosures 66 modular cabinet 65 service clearances 65 Disk drives default disk drive locations SAS disk enc...

Страница 127: ...ion units PDUs 38 50 power feed top or bottom 38 50 power input 50 power quality 39 power receptacles PDU 57 Power fail importance of changing ride through factory default setting 63 monitoring 62 power fail states 64 processor interconnect cabling 74 processor ID 15 R R12000 3 UPS 25 R5000 UPS for single phase 25 rack 28 rack offset 28 29 raised flooring 41 receiving and unpacking space 42 recept...

Страница 128: ...64 HPE R0500 for single phase 25 HPE R12000 3 25 40 HPE R5000 40 importance of changing ride through factory default setting 63 user supplied rack mounted 40 user supplied site 41 V VIO Enclosure Ethernet ports 87 VIO enclosure configuration considerations 84 description 15 disk storage considerations 84 Fibre Channel tape device connection 74 GMS numbering 31 W warranty information 124 HPE Enterp...

Отзывы:

Нет отзывов

Похожие инструкции для Integrity NonStop NS2100

Бренд: IBM Страницы: 64

BladeCenter JS20

Бренд: IBM Страницы: 132

Бренд: IBM Страницы: 194

Bull Escala E5-700

Бренд: IBM Страницы: 116

Бренд: Belkin Страницы: 2

376227-B21 - ProLiant InfiniBand 4x Fabric Copper Switch

Бренд: HP Страницы: 169

DIGI CONNECT ES

Бренд: Digi Страницы: 23

Бренд: Inventec Страницы: 129

Бренд: F5 Страницы: 182

Бренд: Planet Страницы: 72

Бренд: Gigabyte Страницы: 152

Бренд: QSSC Страницы: 98

Бренд: QSSC Страницы: 99

Бренд: Xerox Страницы: 2

NAS TS-877XU-RP-3600-8G-US

Бренд: QNAP Страницы: 12

Бренд: QNAP Страницы: 15

Бренд: Inspur Страницы: 2

326m - eServer - 7969

Бренд: IBM Страницы: 82

Бренды по названию

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Популярные бренды

Загрузить еще бренды