IBM totalstorage 326 Скачать руководство пользователя страница 97 | Manualshive

Страница: 97 / 240

background image

Chapter 8. Troubleshooting

This chapter provides basic troubleshooting information to help you resolve some
common problems that might occur with the Model 326 components. These
components are:

v

IBM 5187 Network Attached Storage Model 6RZ (engine) (see “IBM 5187
Network Attached Storage Model 6RZ”)

v

IBM Ethernet and Fibre Channel network adapters (see “Adapter troubleshooting
and diagnostics” on page 96)

v

IBM 3534 Fibre Channel Hub Model 1RU (hub) (see “IBM 3534 Fibre Channel
Hub Model 1RU” on page 111)

v

IBM 5191 RAID Storage Controller Model 0RU (storage controller) (see “IBM
5191 RAID Storage Controller Model 0RU (storage controller)” on page 113)

v

IBM 5192 Storage Unit Model 0RU (storage unit) (see “IBM 5192 Storage Unit
Model 0RU (storage unit)” on page 118)

If you cannot locate and correct the problem using the information in this section,
refer to “Appendix B. Getting help, service, and information” on page 129 for more
information.

For the latest troubleshooting guidance, symptom fixes, and tips, go to the IBM
support Web site at:

www.ibm.com/storage/support/nas

This site contains additional information, gathered from field experience, not
available when this document was developed.

IBM 5187 Network Attached Storage Model 6RZ

This section gives troubleshooting information for the IBM 5187 Network Attached
Storage Model 6RZ (engine).

Note:

The information in this section must be applied to both engines in the Model
326. As an example, when the text reads, “The engine has light-emitting
diodes (LEDs) to help you identify problems,” this means that each engine in
the Model 326 has LEDs which require your attention.

As another example, the information contained in “Engine troubleshooting
charts” on page 89 applies to each of the two engines.

Engine diagnostic tools overview

The following tools are available to help you identify and resolve hardware-related
problems:

Note:

If you need to remove the engines for inspection, do so one at a time:
remove an engine, inspect it, and put it back; then remove the other engine,
inspect it, and put it back.

v

POST beep codes, error messages, and error logs

The power-on self-test (POST) generates beep codes and messages to indicate
successful test completion or the detection of a problem.

© Copyright IBM Corp. 2002

85

«
...
95
96
97
98
99
...
»

Содержание totalstorage 326

Страница 1: ...IBM TotalStorage Network Attached Storage 300 Model 326 User s Reference Release 2 5 GA27 4276 02...

Страница 2: ...form for reader s comments is provided at the back of this publication If the form has been removed you may address your comments to International Business Machines Corporation Design Information Deve...

Страница 3: ...BM Advanced Appliance Configuration Utility 13 Initial network adapter selection and connection to the IAACU 14 IAACU Agent 15 IAACU Console 15 Universal Manageability Services 21 System requirements...

Страница 4: ...rage 53 IBM Director 53 Dependencies 54 Hardware requirements 54 Director extensions 55 Naming conventions 55 Web based access 55 Disaster recovery 56 Software distribution 56 Real time diagnostics 57...

Страница 5: ...oubleshooting the ServeRAID 4Lx 103 Troubleshooting the SCSI HVD 3570 adapter 107 Testing the Fibre Channel host adapter with FAStT MSJ 108 Testing the Integrated System Management Processor 109 Testi...

Страница 6: ...the serial port while the hub is on 158 Running diagnostics from a Telnet session on the Ethernet 158 Diagnostic tests during POST 158 Diagnostic commands 159 Diagnostic command descriptions 160 Error...

Страница 7: ...Figures 1 File share dependencies 47 2 Diagnostics panel LEDs 88 3 Boot block jumper location 93 4 Battery removal 95 5 Battery replacement 95 Copyright IBM Corp 2002 vii...

Страница 8: ...viii Model 326 User s Reference...

Страница 9: ...adapter troubleshooting chart 108 18 HUB front panel LED status indicators 111 19 Hub POST tests 112 20 Hub offline and online tests 113 21 Storage controller troubleshooting 113 22 Storage unit troub...

Страница 10: ...x Model 326 User s Reference...

Страница 11: ...fety Information on the Documentation CD that came with the appliance Each notice is numbered for easy reference to the corresponding notices in the Safety Information The following terms used within...

Страница 12: ...that were not available at the time this book was produced Note that the User s Reference is provided in softcopy only Related publications The following publications contain additional information a...

Страница 13: ...configuring storage size v Twice the maximum storage size v More options in configuring Ethernet connections v More options for tape backup The Model 326 is a two node appliance server and features v...

Страница 14: ...Universal Manageability Server Extensions Provides system management support based on industry standards in conjunction with the IBM Director console application as well as other management software I...

Страница 15: ...me drive letter on each node v All disks shared between the two cluster nodes must have the same drive letter v All shared storage must be defined as NTFS and be on primary partitions v Compression ca...

Страница 16: ...t static addresses 2 Complete the steps in Setting the date and time on page 27 and Setting up the network on page 27 Step 2 Define shared storage and setup partitions The Model 326 comes with preconf...

Страница 17: ...p 4 Cluster administration At this point you can add users file shares and complete other configuration tasks to improve operations of the Model 326 in a cluster environment 1 Add users see Creating u...

Страница 18: ...uster The top node in the Model 326 is considered the first node and the bottom node is considered the joining node Notes 1 If you are not the system administrator contact that person for the applicab...

Страница 19: ...Cluster Cluster name IP address Subnet mask First node Computer name example IBM5195 23H1234 IP address Subnet mask Gateway Preferred DNS WINS server optional Joining node Computer name IP address Sub...

Страница 20: ...8 Model 326 User s Reference...

Страница 21: ...s Client v IBM Advanced Appliance Configuration Utility IAACU v Universal Manageability Services v Windows 2000 for Network Attached Storage This chapter describes these tools in general and then in d...

Страница 22: ...ailed inventory information about hardware OS and so on using Universal Manageability Services v RAID configuration through Storage Manager Create RAID arrays and LUNs Add additional RAID or storage e...

Страница 23: ...rvices on the appliance enabling you to perform advanced systems management tasks See IBM Advanced Appliance Configuration Utility on page 13 for more information Universal Manageability Services Univ...

Страница 24: ...lowing 1 Click Start Programs Terminal Services Terminal Services Client 2 In the Server field select the computer name of the appropriate Model 326 If that Model 326 is not listed enter the IP addres...

Страница 25: ...that you not change the default computer name of your NAS appliance to avoid the chance of propagating misidentification through the system Also The IBM Advanced Appliance Configuration Utility depen...

Страница 26: ...owever the IAACU will automatically discover connected appliances and their network settings Initial network adapter selection and connection to the IAACU Unlike the limited number of network adapter...

Страница 27: ...such as IP addresses DNS and gateway server addresses subnet masks and host names v Group discovered appliances into function specific Families Appliances are added to a Family based on the appliance...

Страница 28: ...pliances v Each discovered appliance also appears in one of the following sections of the tree view In a Family If the discovered appliance fits the requirements of a Family it will automatically appe...

Страница 29: ...ntains the following items v All Appliances Every discovered appliance is listed in the tree view under All Appliances v Families The Families group in the Tree View Pane shows all Families that have...

Страница 30: ...s Any discovered appliance that has the same IP address as a previously discovered appliance will be listed in the Conflicting Network Addresses group Creating a Family To create a Family 1 Select Cre...

Страница 31: ...ve an appliance from a family and then rescan the network to add it to an appropriate Family that appears higher in the Tree View pane To remove an appliance right click the appliance and then select...

Страница 32: ...nt the appliance moved to 2 Select Move Up in List to move the selected Family up in the list of families Repeat steps 1 and 2 until the Family that you want to add the appliance to appears above the...

Страница 33: ...support for UM Services Upward Integration Modules These modules enable systems management professionals who use any supported systems management platform including Tivoli Enterprise CA Unicenter TNG...

Страница 34: ...number located in the lower right corner of the bezel on the front of the appliance If you have changed the computer name from the predefined value use that name instead A user log in window appears 2...

Страница 35: ...pliance in the IAACU Console Tree View Pane When you select the appliance from the tree view information about the selected appliance appears in the Information Pane 2 Click the Start Web Based Manage...

Страница 36: ...et client specify the IP address or host name of the Model 326 then log in using an ID and password defined on the Model 326 with administrative authority From the command line you can issue DOS like...

Страница 37: ...configuration This condition is most appropriate when using Windows Terminal Services for operation of the Model 326 If you are using this method proceed with Initial setup and configuration on page 2...

Страница 38: ...rosoft Windows 2000 for Network Attached Storage is automatically selected on the Appliance tab In the right pane Windows 2000 for Network Attached Storage starts 3 Again you are prompted to authentic...

Страница 39: ...appears allowing you to change the password Note the warning on the page that any information that you enter can be viewed by others on the network To prevent others from seeing your information set u...

Страница 40: ...nterfaces installed You must modify the adapter by completing the IP task to modify IP configurations and then choosing one or more of the following tasks as appropriate v DNS to modify DNS configurat...

Страница 41: ...storage use the IBM FAStT Storage Manager Storage Manager With Storage Manager you can configure and manage the DASD mounted in the IBM 5191 RAID Storage Controller Model 0RU storage controller and I...

Страница 42: ...an existing Ethernet network using Ethernet cables A separate stand alone diagnostic network can be created by connecting the SM client computer DHCP computer and all storage subsystem controllers to...

Страница 43: ...iscovers host agent managed storage subsystems if the hosts that provide network management connections to the storage subsystems respond to the broadcast The software discovers direct managed storage...

Страница 44: ...e them use the Subsystem Management window Refer to the renaming storage subsystems topic in the Subsystem Management online help The help topic provides detailed instructions for renaming storage sub...

Страница 45: ...es and you will be asked whether you want to restart you computer Again do not restart your computer at this point Leave this message in the foreground until the array initialization completes 4 Once...

Страница 46: ...ion The format of the command and its options are assign letter l or mount path convert You can use several commands to convert disks The format and options for each of the commands are convert mbr co...

Страница 47: ...ure 4 Check all the boxes to write a Disk Signature to all disks that will be accessed by the Cluster Server all disks in the view 5 On the unformatted drive a Right click and select Create Partition...

Страница 48: ...mpression and select Finish 6 Format all other drives but do not enable compression Use all space available for each drive for each logical drive assigned by the operating system Assign drive letter H...

Страница 49: ...details for installing and initially configuring MSCS on the Model 326 Administrative concepts and procedures are provided in the online help and at the following Web sites v www microsoft com windows...

Страница 50: ...a connection perform the following steps on each node 1 Right click My Network Places then click Properties 2 Select a Local Area Connection When you perform this step the connection that uses the IBM...

Страница 51: ...xample you would type ping 192 168 1 12 and ping 192 168 2 12 for the first node and you would type ping 192 168 1 13 and ping 192 168 2 13 for the joining node You can do this from any machine that i...

Страница 52: ...button and then click the Next button On the next window clear the Show this screen at startup check box and click Finish Cluster setup At this step you have completed the cluster installation steps...

Страница 53: ...nd both cluster nodes are running It is recommended that you review the Cluster Administration Guide located in the IBM NAS Admin in the Cluster Tools folder before continuing with the following steps...

Страница 54: ...lly owned by the restarted node failback to that node when the cluster service detects that the node is operational and provided that the defined failover policy allows this to occur If you have not d...

Страница 55: ...S Support on page 72 has more information on Services for UNIX and NFS Support for NFS is provided in the Model 326 by a preloaded and preconfigured software component Microsoft Services for UNIX The...

Страница 56: ...d all of the UNIX users who will be accessing and storing files on the Model 326 through an NFS share For each user you need to know the Windows user name the UNIX user name the primary group and the...

Страница 57: ...maps and then click Set Primary b Define group mappings as follows 1 Click Show group maps 2 Select the Windows domain name the domain to which you joined the Model 326 earlier in this chapter from t...

Страница 58: ...S server in the NIS server field 4 Click Show Windows Users to display all of the Windows user names in the Windows domain you selected 5 Click Show UNIX Users to display all of the UNIX user names in...

Страница 59: ...page 73 for details Figure 1 illustrates the file share dependencies Descriptions of the diagram components follow the figure Physical disk The base resource in which to store user data It is not dep...

Страница 60: ...ddress resource a Right click Disk Group 2 and select New Resource b Enter an IP address name for example ipaddr2 and change the resource type to IP Address c Select Run this resource in a separate Re...

Страница 61: ...d node click Cluster Administration located in IBM NAS Admin in the Cluster Tools folder If prompted for a cluster name enter the name of the cluster and then click Open Make sure that all resources a...

Страница 62: ...synchronization between the two nodes in the cluster In the event of a power loss to both nodes or a hardware failure that corrupts the Quorum data the cluster service might not start leading to the f...

Страница 63: ...to the backup date There are impacts to performing this operation that include loss of data You should perform this operation only when it is absolutely necessary Before you add software You have now...

Страница 64: ...52 Model 326 User s Reference...

Страница 65: ...remote management functions include v Sophisticated discovery of network components v Scheduled asset hardware and software inventories with persistent storage of data v Proactive problem notificatio...

Страница 66: ...ctor Consoles that can connect into the Management Server Dependencies The IBM Director 3 1 Agent the version included in this release must be managed by an IBM Director 3 1 Management Server If your...

Страница 67: ...ance preinstallation process1 The Director system name does not have to be the same as the computer name The Director system name is displayed on the IBM Director Console to identify the NAS Appliance...

Страница 68: ...name is not restored and directory is where the saved data resides IBM Director Management Server cannot be running when this command is issued twgreset This command resets the Director Server system...

Страница 69: ...ome results might require that you take specific action For details on correcting a failed device consult the documentation that comes with the NAS appliance You can also run all tests by selecting Al...

Страница 70: ...Web UI is an IBM Director Management Server enhancement made specifically for managed networks containing IBM NAS appliances Install NAS Web UI on the IBM Director Management Server and all IBM Direc...

Страница 71: ...e files in a previous persistent image rather than the original data itself When selecting the files for the NT Backup operation you must select the specific folders in the persistent image If you sel...

Страница 72: ...ge virtual drive letter instead of the original drive letter For example if you selected drive C for backup a persistent image was created on the next available drive letter in the system and that dri...

Страница 73: ...at uses for each volume an area of pre allocated storage the PSM cache file that keeps only those data blocks which have been written since the time you made a persistent image of the volume Persisten...

Страница 74: ...ld 90 percent full Cache size 15 percent of the total volume capacity Note You cannot change the cache size for a volume while there are persistent images on that volume the Cache size combo box will...

Страница 75: ...ention value there are other higher and lower values which can be selected v Delete an existing persistent image v Modify properties of an existing persistent image including read only or read write a...

Страница 76: ...nd restore capability it is a two step process In contrast the method supported by PSM allows you to restore the system drive from a single image without having to go through the entire recovery proce...

Страница 77: ...n its diskette drive type a fixboot exe and answer the prompts Note When you run fixboot exe on the diskette the diskette remains bootable unless you reformat it if you later erase files on the disket...

Страница 78: ...x0044 For PCI slot 4 0x0045 For PCI slot 5 Restoring the system drive using the PSM recovery diskette To restore the system drive from a backup image created through the PSM Disaster Recovery panel as...

Страница 79: ...then click OK on the Delete Persistent Image panel that appears If the restore was unsuccessful then you must use the Recovery CD as described in Chapter 9 Using the Recovery and Supplementary CDs on...

Страница 80: ...that you set in the Global Settings panel For example if the maximum number of persistent images is 10 and you enter numbers in other fields that add up to greater than 10 only 10 persistent images w...

Страница 81: ...cache file usage below the automatic deletion threshold then it will continue to select and delete persistent images until the cache file usage is reduced below the automatic deletion threshold For ea...

Страница 82: ...6 to become fully operational after a restart During mapping PSM makes the loaded persistent images accessible through the file system by mounting each of them as a virtual volume underneath the persi...

Страница 83: ...orage Manager link on the IBM NAS Admin console on the Model 326 desktop or by starting the Windows 2000 for Network Attached Storage user interface and then selecting Disks then Persistent Storage Ma...

Страница 84: ...containing persistent images the volume will not be defragmented If you select the volume and click the Defragment button the Disk Defragmenter will run on the volume and then indicate that the volume...

Страница 85: ...machine and possibly modify their format for use by the User Name Mapping function as described in Preparing local copies of passwd and group Preparing local copies of passwd and group If you will be...

Страница 86: ...If the NAS is a single node product the server runs on the NAS For a clustered NAS User Name Mapping clustering is recommended so User Name Mapping can run on both nodes and failover as needed When y...

Страница 87: ...of access as a special nobody user This is known as anonymous access and you can enable or disable on a per share basis This anonymous user will have very limited access to resources on the NAS it ha...

Страница 88: ...76 Model 326 User s Reference...

Страница 89: ...ay the NVRAM parameters of adapters note that you cannot change the parameters v Monitor alarms and indications of the adapters The primary purpose of FAStT MSJ in the Model 326 is to obtain diagnosti...

Страница 90: ...ctor the RSA enables more flexible management through a Web browser interface To use either adapter and for more information see Using the ISMP and RSA on page 80 Table 6 on page 79 provides a summary...

Страница 91: ...es Controlled remote power on off using the OS No Yes Remote POST including all POST message ids No Yes Remote access to engine vital product data VPD and serial number No Yes Multiple login IDs No Ye...

Страница 92: ...at you just installed on the back panel in step 2 4 Connect the second ISMP interconnect cable to the RJ 11 socket on the RSA 5 Connect the two ISMP interconnect cables with a single Category 5 Ethern...

Страница 93: ...e or complete failure the other adapters in the team continue to share the network transmission load although total throughput is decreased Load balancing is only supported for adapter teams consistin...

Страница 94: ...he adapter under Network Components and select one of the adapters that will be part of the teaming 7 Right click the adapter select Add to Team then select Create New Team 8 Select the type of team t...

Страница 95: ...D storage controller into a rack c Attach fibre channel cables and power cables d Power down the node see Powering off and powering on the Model 326 on page 49 Make sure that you note which node you p...

Страница 96: ...ce partitions are mirrored using two 18 GB hard drives to provide increased reliability and failover capability This RAID option has a stripe size of 8K Memory notes The following sections contain inf...

Страница 97: ...at www ibm com storage support nas This site contains additional information gathered from field experience not available when this document was developed IBM 5187 Network Attached Storage Model 6RZ T...

Страница 98: ...e Testing the Fibre Channel host adapter with FAStT MSJ on page 108 v Troubleshooting charts These charts list problem symptoms along with suggested steps to correct the problems See Engine troublesho...

Страница 99: ...D comes on press Ctrl Alt Delete Watch the screen for any POST errors Check the System Event Error Log for any listed problems If the system powers up with no errors a Power switch assembly b System b...

Страница 100: ...e Model 326 engine to shut down Figure 2 shows the LEDs on the diagnostics panel on the system board You must remove the top cover to view the LEDs See Light path diagnostics for information on identi...

Страница 101: ...ed System Management Processor detected an error Remind button You can use the remind button to place the front panel system error light into a remind mode By pressing the button you acknowledge the f...

Страница 102: ...drive CD ROM drive is not recognized 1 Run Configuration Setup enable primary IDE channel 2 Check cables and jumpers 3 Check for correct device driver 4 System board 5 Run CD ROM diagnostics 6 CD ROM...

Страница 103: ...t encounter A general procedure for troubleshooting power problems is as follows 1 Power off the system and disconnect the AC cord s Attention Note the special considerations when powering off and pow...

Страница 104: ...eck connections to power subsystem 2 Replace power supply 3 Replace power backplane System under recommended X current level non critical system drawing less current than recommended on voltage X 1 Se...

Страница 105: ...Typing Y will copy the corrupted BIOS into the secondary page 8 At the prompt to save the current code on a diskette select N 9 At the prompt select your language 0 7 and press Enter to accept your ch...

Страница 106: ...ame manufacturer The battery contains lithium and can explode if not properly used handled or disposed of Do not v Throw or immerse into water v Heat to more than 100 C 212 F v Repair or disassemble I...

Страница 107: ...Wait approximately 20 seconds after you plug the power cord of the engine into an electrical outlet for the Power Control button to become active 6 Turn on the appliance 7 Start the Configuration Setu...

Страница 108: ...s section provides troubleshooting information for problems that might occur with the 10 100 Mbps integrated Ethernet adapter Network connection problems If the Ethernet adapter cannot connect to the...

Страница 109: ...Transmit Receive Activity light is not On Check the following Note The Ethernet Transmit Receive Activity LED is On only when data is sent to or by this Ethernet adapter 1 Ensure that you have loaded...

Страница 110: ...them is good ACT LNK Off Check the following v Adapter not sending or receiving data v Adapter or switch not receiving power v Cable connection between adapter and switch is faulty v Drivers not conf...

Страница 111: ...both ends Testing the Ethernet adapters with Intel PROSet II Each Model 326 engine comes with Intel PROSet II Use PROSet to view the following v Adapter parameters such as MAC and IP addresses v Netw...

Страница 112: ...se the Identify Adapter push button in INTEL PROSet II to control blinking 2 Ensure that the cable is installed correctly The network cable must be securely attached at all connections If the cable is...

Страница 113: ...em is faulty Green The adapter and switch are receiving power The cable connection between them is good A 100 Mbps link has been established Amber The adapter and switch are receiving power The cable...

Страница 114: ...ot 5 Check all cables PRO 1000 XT Server adapter is unable to connect at 1000 Mbps instead it connects at 100 Mbps Copper based connections only 1 Ensure that the cable is the correct type 2 Try anoth...

Страница 115: ...ators v ACT LNK Green on The adapter is connected to a valid link partner Green flashing Data activity is detected Off No link is detected Yellow flashing There is an identity problem Use the Identify...

Страница 116: ...r on self test can take up to 59 Second s test Failed Controller is not responding properly Run Diagnostics Error Code XXXX YY The sample BIOS screen below shows configuration status and error informa...

Страница 117: ...of identified channel c Check for proper backplane jumper configuration d Check for proper cabling configuration in systems that use DASD status cables Reconnect all cables that you disconnected at th...

Страница 118: ...nly when indicated to do so in the POST ISPR error procedures XXX in Table 16 is used as a placeholder and can be any letter or number in an actual error message Table 16 ServeRAID 4Lx problems and ac...

Страница 119: ...system You can obtain a copy from the ServerGuide Diskette Factory or download the image from the IBM Web site To back up the ServeRAID configuration 1 From the Main Menu select Advanced Functions 2 S...

Страница 120: ...e host adapter 2 Restart the engine 3 If the engine restarts successfully check the bus terminations and cable connections Also one of the devices on the bus might be defective Testing the Fibre Chann...

Страница 121: ...tic functions refer to the FAStT MSJ online help Testing the Integrated System Management Processor 1 Insert the ISMP Utility CD ROM into the CD ROM drive and restart the Model 326 engine If the engin...

Страница 122: ...s the main menu appears containing the following selections v Hardware Status and Information v Configuration Settings v Update System Management firmware 3 Use the up and down arrow keys to select Ha...

Страница 123: ...and problems are displayed with a yellow port indicator The color and blink speed of each port s LED as described in Table 18 indicates the status of each port Table 18 HUB front panel LED status indi...

Страница 124: ...ard SRAMs CMI Conn test Checks the CMI bus between ASICs CAM test Checks the CAM Port loopback test Checks all of the hub hardware to ensure the frames are transmitted looped back and received After t...

Страница 125: ...amTest cmiTest cmemRetentionTest portLoopbackTest portRegTest spinSilk sramRetentionTest IBM 5191 RAID Storage Controller Model 0RU storage controller This section contains information to help you sol...

Страница 126: ...panel General system error Indicates that a Fault LED somewhere on the storage controller has turned on Check for amber LEDs on CRUs Amber LED is on and green LED off Power supply CRU Power switch is...

Страница 127: ...ftware to enable the cache 2 Replace the RAID controller 3 Replace the battery Host loop Host managed hub or switch is off or has failed 1 Check if host managed hub or switch is on 2 Replace attached...

Страница 128: ...y malfunctions that delay interrupt or prevent successful I O activity between the hosts and the hard disk drives This section explains how to replace a failed drive Attention Failure to replace the d...

Страница 129: ...de it completely out of the 5191 RAID Storage Controller f If you are replacing the drive ensure that the filler piece remains in place for use with the new drive 5 Install the new drive CRU a Gently...

Страница 130: ...192 Storage Unit Model 0RU storage unit Use Table 22 on page 119 to find solutions to problems that have definite symptoms Refer to your system management software documentation for additional informa...

Страница 131: ...e action needed if system is properly configured ESM board failure If the ESM board Fault LED is lit replace the ESM board No incoming signal detected 1 Reattach the GBIC and Fibre Channel FC cables 2...

Страница 132: ...ing Drive CRUs Drive rebuild or identity is in process No corrective action needed One or more green LEDs off Power supply CRUs Power cord unplugged or switches turned off Make sure the cord is plugge...

Страница 133: ...and replace the failed CRU Midplane failure Have the midplane replaced service technician only Unable to access drives Drives and FC loop Incorrect ID settings 1 Ensure that the FC optical cables are...

Страница 134: ...122 Model 326 User s Reference...

Страница 135: ...you have not met the requirements for using the PSM recovery method or if the PSM recovery fails then you must use the Recovery CD Set as described in this chapter Using the Recovery Enablement Diske...

Страница 136: ...er recovery CDs into the CD ROM drive When the preload image is restored the Model 326 restarts automatically You may now remove the last inserted CD Recovery CD 4 from the CD ROM drive 10 If you have...

Страница 137: ...e file system and change the volume label to Maintenance f Click Finish to close the wizard The partition is then formatted When formatting is complete the status of the partition should appear as Hea...

Страница 138: ...you might be prompted to insert the Windows Powered CD ROM If so insert the Supplementary CD and specify path x i386 where x is the drive letter assigned to the CD ROM drive W2KSP2 Windows Powered Se...

Страница 139: ...Tokyo 106 Japan The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law INTERNATIONAL BUSINESS MACHINES CORPORATION PROV...

Страница 140: ...l LANDesk MMX Pentium Pentium II Xeon and Pentium III Xeon are trademarks or registered trademarks of Intel Corporation in the United States other countries or both Java and all Java based trademarks...

Страница 141: ...overage During the IBM hardware product warranty period you may call the IBM Support Center 1 800 426 7378 in the U S for hardware product assistance covered under the terms of the IBM hardware warran...

Страница 142: ...ched storage appliance comes with documentation that contains troubleshooting procedures and explanations of error messages The documentation that comes with your appliance also contains information a...

Страница 143: ...running support for 90 days after installation This service provides assistance for v Setting up your network attached storage appliance v Limited configuration assistance Please have the following in...

Страница 144: ...132 Model 326 User s Reference...

Страница 145: ...ice beyond the warranty period Warranty upgrades in the U S include v On site service to premium on site service If your warranty provides for on site service you can upgrade to premium on site servic...

Страница 146: ...134 Model 326 User s Reference...

Страница 147: ...ingle problem might cause several error messages When this occurs work to correct the cause of the first error message After you correct the cause of the first error message the other error messages u...

Страница 148: ...long and one short beep POST encountered an error on a video adapter If you are using the integrated video controller call for service If you are using an optional video adapter replace the failing v...

Страница 149: ...ondary DMA register failed System board 2 1 2 Primary DMA register failed System board 2 1 3 Primary interrupt mask register failed System board 2 1 4 Secondary interrupt mask register failed System b...

Страница 150: ...1 DIMM 2 Battery 3 3 2 Critical SMBUS error occurred 1 Disconnect the server power cord from outlet wait 30 seconds and retry 2 System board 3 DIMMs 4 DASD backplane 5 Power supply 6 Power supply bac...

Страница 151: ...eting POST The Power On Status is disabled 1 Run Configuration Setup set the Start Options Power On Status to enable 2 Check speaker connections 3 System board No AC power Power supply AC LED is off 1...

Страница 152: ...essor error System board 111 Channel check error 1 Failing ISA Adapter 2 DIMM 3 System board 114 Adapter read only memory error 1 Failing Adapter 2 Run Diagnostics 129 Internal cache error 1 Processor...

Страница 153: ...tem board 189 An attempt was made to access the appliance with invalid passwords Run Configuration Setup enter the administrator password 201 Memory test error If the appliance does not have the lates...

Страница 154: ...Setup 3 System board 11XX System board serial port 1 or 2 error 1 Disconnect external cable on serial port 2 Run Configuration Setup 3 System board 0001200 Machine check architecture error 1 Processo...

Страница 155: ...rd 4 Processor PCI board 1762 Hard disk drive configuration error 1 Run Configuration Setup 2 Hard disk cables 3 Hard disk adapter 4 Hard disk drive 5 SCSI backplane 6 System board 178X Hard disk driv...

Страница 156: ...p 2 Failing adapter 3 System board 00180300 No more memory above 1 MB for PCI adapter 1 Run Configuration Setup 2 Failing adapter 3 System board 00180400 No more memory below 1 MB for PCI adapter 1 Mo...

Страница 157: ...In event of a POST error check the System Event Error Log as it may indicate the most recent errors commonly associated with typical hardware failures It may not detect all hardware failures but many...

Страница 158: ...sult Test Specific String where Function Name The name of the function being tested when the error occurred This corresponds to the function code fff given in the previous list Result Can be one of th...

Страница 159: ...ress F1 from within a help screen to obtain online documentation from which you can select different categories To exit Help and return to where you left off press Esc b If the Model 326 engine stops...

Страница 160: ...cleared Diagnostic error message tables Table 28 describes the error messages that might appear when you run the diagnostic programs Important If diagnostic error messages that are not listed in Table...

Страница 161: ...ce test System board 035 XXX 099 No adapters were found If the adapter is installed recheck the connection 035 XXX S99 Failed RAID test on PCI slot S Note Check the System Error Log before replacing a...

Страница 162: ...anel and system board J39 2 Operator information panel 3 System board 166 201 003 System Management failed I2C Bus Error s ISMP indicates I2C errors on bus 3 Potential FRUs power backplane system boar...

Страница 163: ...ssembly 180 XXX 005 Failed SCSI backplane LED test 1 SCSI backplane 2 SCSI backplane cable 3 System board 180 XXX 006 Memory Board LED test Suspected part 1 Memory 2 Processor PCI board 3 System board...

Страница 164: ...ive number refers to the RAID logical array Hard disk drive 5 217 XXX 005 Failed BIOS Fixed Disk test Note If RAID is configured the hard disk drive number refers to the RAID logical array Hard disk d...

Страница 165: ...N Failed Ethernet test on adapter in PCI slot N 1 Adapter in PCI slot N 2 System board 415 XXX 000 Failed modem test Suspected part 1 Cable 2 Modem Note Ensure that the modem is present and attached t...

Страница 166: ...154 Model 326 User s Reference...

Страница 167: ...inning a test or procedure Isolating a system fault Various loopback paths are built into the hub hardware for diagnostic purposes A loopback path test within the hub verifies the proper internal Fibr...

Страница 168: ...and restarts 15 Connect the cable back to the first fibre hub 16 Press Enter on the terminal screen 17 On the first hub type including the quotes qlpartner 10 00 00 60 69 30 18 01 that is the partner...

Страница 169: ...Hub User s Guide or the 2109 Model Sxx User s Guide Running diagnostics on the hub There are three methods to access the hub for running diagnostics All methods involve the use of Telnet commands and...

Страница 170: ...that can access the hub Ethernet port You need to get an administrator level username and password from the system administrator as well as the hub IP address or name Perform the following steps 1 Go...

Страница 171: ...descriptions of the commands Hub offline switchDisable Memory test ramTest Port register test portRegTest Central memory test centralMemoryTest CMI conn test cmiTest CAM test camTest Port loopback te...

Страница 172: ...can be correctly sent from any ASIC to any ASIC It also tests that the checksum check is OK crossPortTest Verifies the intended functional operation of the hub The crossPortTest command sends frames...

Страница 173: ...connected it aborts the test The test determines which port is connected to which port by transmitting frames As such if any pair of ports are not properly connected for various reasons improperly se...

Страница 174: ...ed and is not reported as failing Therefore it is important to make sure that testing occurs on all the ports that are intended This can be done by observing the screen messages from the crossPortTest...

Страница 175: ...or view an error log ramTest Checks CPU RAM memory This test validates proper memory function setGbicMode Forces crossPortTest or spinSilk to limit its testing to only those ports whose GBICs or imbe...

Страница 176: ...t on the same hub and the test fails Using operating mode 0 when running spinSilk is preferred If you do not include the nMillions parameter the number of frames for the test to execute in millions of...

Страница 177: ...wrap test The tests should be run again after swapping cables and GBICs to determine cause It is unlikely that the system board is at fault as most system board failures cause a POST failure Diagnosti...

Страница 178: ...t period ASIC failure 1 DIAG CMERRPTN Err 102B centralMemoryTest Error detected at the wrong port ASIC failure 1 DIAG CMERRTYPE Err 102A centralMemoryTest Port got the wrong CMEM error type ASIC failu...

Страница 179: ...NIL Err 2031 cmiTest ASIC failed to get a CMI error interrupt ASIC failure 1 DIAG INTNOTCLR Err 102C centralMemoryTest The interrupt bit could not be cleared ASIC failure 1 DIAG LCMEM Err 1027 central...

Страница 180: ...that POST be executed Informational only None required DIAG REGERR Err 0B15 0415 portRegTest sramRetentionTest Data read from ASIC register or ASIC SRAM did not match data previously written into same...

Страница 181: ...3 TEMP 5_FAILED LOG_CRITICAL FANS 1_FAILED LOG_WARNING FANS 2_FAILED LOG_ERROR FANS 3_FAILED LOG_CRITICAL FANS 4_FAILED LOG_CRITICAL FANS 5_FAILED LOG_CRITICAL FANS 6_FAILED LOG_CRITICAL POWER 1_FAIL...

Страница 182: ...170 Model 326 User s Reference...

Страница 183: ...ration Settings menu in Fast UTIL select Host Adapter Settings The default settings for the FAStT Host Adapter are listed in Table 33 and described in the following paragraphs Table 33 Host adapter se...

Страница 184: ...4 Advanced adapter settings Setting Options Default Execution Throttle 1 256 256 Fast Command Posting Enabled or Disabled Enabled 4 GByte Addressing Enabled or Disabled Disabled LUNs per Target 0 8 16...

Страница 185: ...mber of times the software retries a command to a port returning port down status The default is 30 retries Drivers Load RISC Code When this setting is enabled the host adapter uses the RISC firmware...

Страница 186: ...e Number Enabled or Disabled Disabled Read Transfer Ready Enabled or Disabled Disabled Response Timer 0 255 0 Interrupt Delay Timer 0 255 0 Extended Control Block Enables all other extended firmware s...

Страница 187: ...ting is reserved The default is Disabled Response Timer Contains the value in 100 microsecond increments used by a timer to limit the time waiting accumulating multiple responses For example if this f...

Страница 188: ...loop or a loopback connector CAUTION Performing this test will disrupt data if tested in a FC loop Select Host Adapter Use this setting to select a specific FAStT Host Adapter if you have multiple FA...

Страница 189: ...14 18 2 GB SLIM HARD DISK DRIVE 37L0311 POWER SUPPLY WITH MOUNTING 270 WF 38P7644 FRONT BEZEL 36L8645 12 7 MM DISKETTE DRIVE 06P5263 24X CDROM 06P5931 FRAME ASSEMBLY 25P2127 SYSTEM BOARD 33L3325 512 M...

Страница 190: ...umber System part 38P8294 M T 5191 2RU RAID CNTRL FINAL ASSEMBLY 37L0198 DASD BEZEL FILLER ASM 38P7638 FRONT BEZEL 5191 0RU 19K1164 POWER SUPPLY ASM 350 W 09N7285 BLOWER ASM 19K1115 FC CONTROLLER 37L0...

Страница 191: ...2 3534 1RU Hub CRU number System part 35L1801 M T 3534 1RU FC HUB FINAL ASSEMBLY 19P0005 RACK SLIDES 34L2767 RACK MOUNT BRACKETS 34L2723 SWITCH SECURING EARS Appendix G Customer Replaceable Unit CRU l...

Страница 192: ...180 Model 326 User s Reference...

Страница 193: ...60 SCSI controller FC1 One port IBM FAStT Host adapter Fibre Channel FC2 Two port IBM FAStT Host adapter Fibre Channel Table 43 One adapter configuration Configuration PCI Slot 1 32 bit 33 MHz PCI Slo...

Страница 194: ...64 bit 66 MHz RSA Quad FC2 RSA Quad FC2 RSA Quad FC1 RSA Quad FC1 RSA Ethernet FC2 RSA Ethernet FC2 RSA Ethernet FC1 RSA Ethernet FC1 RSA SCSI SE FC2 RSA SCSI SE FC2 RSA SCSI SE FC1 RSA SCSI SE FC1 RS...

Страница 195: ...hernet PRO 1000 FC2 Ethernet Gigabit FC1 Ethernet Gigabit FC1 Ethernet PRO 1000 FC1 Ethernet PRO 1000 FC1 Ethernet SCSI LVD SE FC2 Ethernet SCSI LVD SE FC2 Ethernet SCSI HVD FC2 Ethernet SCSI HVD FC2...

Страница 196: ...C1 ServeRAID Gigabit FC1 PRO 1000 ServeRAID FC1 ServeRAID PRO 1000 FC1 Gigabit FC2 FC1 Gigabit FC1 FC2 PRO 1000 FC2 FC1 PRO 1000 FC1 FC2 Gigabit FC1 FC1 Gigabit FC1 FC1 PRO 1000 FC1 FC1 PRO 1000 FC1 F...

Страница 197: ...2 RSA Gigabit PRO 1000 FC2 RSA PRO 1000 Gigabit FC2 RSA PRO 1000 PRO 1000 FC2 RSA PRO 1000 PRO 1000 FC2 RSA Gigabit Gigabit FC1 RSA Gigabit Gigabit FC1 RSA Gigabit PRO 1000 FC1 RSA PRO 1000 Gigabit FC...

Страница 198: ...Gigabit FC2 Quad ServeRAID FC2 PRO 1000 ServeRAID Quad PRO 1000 FC2 Quad SCSI LVD SE ServeRAID FC1 SCSI LVD SE ServeRAID Quad FC1 Quad ServeRAID FC2 FC1 ServeRAID Quad FC1 FC2 Quad ServeRAID FC1 FC1 S...

Страница 199: ...hernet SCSI HVD PRO 1000 FC1 Ethernet SCSI LVD SE ServeRAID FC2 Ethernet SCSI LVD SE ServeRAID FC2 Ethernet SCSI HVD ServeRAID FC2 Ethernet SCSI HVD ServeRAID FC2 Ethernet SCSI LVD SE ServeRAID FC1 Et...

Страница 200: ...ServeRAID FC2 ServeRAID PRO 1000 Gigabit FC2 PRO 1000 PRO 1000 ServeRAID FC2 ServeRAID PRO 1000 PRO 1000 FC2 Gigabit Gigabit ServeRAID FC1 ServeRAID Gigabit Gigabit FC1 Gigabit PRO 1000 ServeRAID FC1...

Страница 201: ...000 FC1 RSA SCSI SE Quad PRO 1000 FC1 RSA Quad Gigabit SCSI LVD SE FC2 RSA SCSI LVD SE Quad Gigabit FC2 RSA Quad PRO 1000 SCSI LVD SE FC2 RSA SCSI LVD SE Quad PRO 1000 FC2 RSA Quad PRO 1000 SCSI HVD F...

Страница 202: ...CSI LVD SE ServeRAID FC1 RSA SCSI LVD SE ServeRAID Quad FC1 RSA Quad SCSI LVD SE FC1 FC1 RSA SCSI LVD SE Quad FC1 FC1 RSA Quad SCSI HVD FC1 FC1 RSA SCSI HVD Quad FC1 FC1 RSA Quad ServeRAID FC2 FC1 RSA...

Страница 203: ...t PRO 1000 SCSI LVD SE FC2 RSA SCSI LVD SE Ethernet PRO 1000 FC2 RSA Ethernet PRO 1000 SCSI HVD FC2 RSA SCSI HVD Ethernet PRO 1000 FC2 RSA Ethernet Gigabit SCSI LVD SE FC1 RSA SCSI LVD SE Ethernet Gig...

Страница 204: ...I SE Gigabit ServeRAID FC2 RSA ServeRAID SCSI SE Gigabit FC2 RSA SCSI SE PRO 1000 ServeRAID FC2 RSA ServeRAID SCSI SE PRO 1000 FC2 RSA SCSI SE Gigabit ServeRAID FC1 RSA ServeRAID SCSI SE Gigabit FC1 R...

Страница 205: ...t FC1 FC2 RSA PRO 1000 PRO 1000 FC2 FC1 RSA PRO 1000 PRO 1000 FC1 FC2 RSA Gigabit Gigabit FC1 FC1 RSA Gigabit Gigabit FC1 FC1 RSA Gigabit PRO 1000 FC1 FC1 RSA PRO 1000 Gigabit FC1 FC1 RSA PRO 1000 PRO...

Страница 206: ...bit PRO 1000 FC1 SCSI SE Quad PRO 1000 Gigabit FC1 Quad SCSI SE PRO 1000 PRO 1000 FC1 SCSI SE Quad PRO 1000 PRO 1000 FC1 Quad SCSI SE Gigabit ServeRAID FC2 SCSI SE ServeRAID Quad Gigabit FC2 Quad SCSI...

Страница 207: ...1000 SCSI LVD SE ServeRAID FC1 SCSI LVD SE ServeRAID Quad PRO 1000 FC1 Quad PRO 1000 SCSI HVD ServeRAID FC1 SCSI HVD ServeRAID Quad PRO 1000 FC1 Quad Gigabit SCSI LVD SE FC1 FC1 SCSI LVD SE Quad Gigab...

Страница 208: ...et SCSI SE Ethernet FC1 FC1 Ethernet Ethernet Gigabit Gigabit FC2 Ethernet Ethernet Gigabit Gigabit FC2 Ethernet Ethernet Gigabit PRO 1000 FC2 Ethernet Ethernet PRO 1000 Gigabit FC2 Ethernet Ethernet...

Страница 209: ...Ethernet Ethernet SCSI HVD ServeRAID FC1 Ethernet SCSI HVD Ethernet ServeRAID FC1 Ethernet Ethernet SCSI LVD SE FC1 FC1 Ethernet SCSI LVD SE Ethernet FC1 FC1 Ethernet Ethernet SCSI HVD FC1 FC1 Etherne...

Страница 210: ...it Gigabit SCSI HVD FC1 Ethernet SCSI HVD Gigabit Gigabit FC1 Ethernet Gigabit PRO 1000 SCSI LVD SE FC1 Ethernet SCSI LVD SE PRO 1000 Gigabit FC1 Ethernet Gigabit PRO 1000 SCSI HVD FC1 Ethernet SCSI H...

Страница 211: ...RAID FC1 Ethernet SCSI HVD ServeRAID PRO 1000 FC1 Ethernet Gigabit SCSI LVD SE FC1 FC1 Ethernet SCSI LVD SE Gigabit FC1 FC1 Ethernet Gigabit SCSI HVD FC1 FC1 Ethernet SCSI HVD Gigabit FC1 FC1 Ethernet...

Страница 212: ...eRAID Gigabit Gigabit FC2 Gigabit PRO 1000 SCSI LVD SE ServeRAID FC2 SCSI LVD SE ServeRAID PRO 1000 Gigabit FC2 Gigabit PRO 1000 SCSI HVD ServeRAID FC2 SCSI HVD ServeRAID PRO 1000 Gigabit FC2 PRO 1000...

Страница 213: ...E PRO 1000 PRO 1000 FC1 FC1 PRO 1000 PRO 1000 SCSI HVD FC1 FC1 SCSI HVD PRO 1000 PRO 1000 FC1 FC1 Gigabit SCSI LVD SE ServeRAID FC1 FC1 SCSI LVD SE ServeRAID Gigabit FC1 FC1 Gigabit SCSI HVD ServeRAID...

Страница 214: ...202 Model 326 User s Reference...

Страница 215: ...Ethernet standard that supports a transmission rate of 10 Mbps using RG 58 A U and RG 58 C U coaxial cable and BNC connectors 10BASE2 is sometimes called thin Ethernet or thinnet 10BASE5 The IEEE 802...

Страница 216: ...rnate adapter In a personal computer that is used on a LAN and that supports installation of two network adapters the adapter that uses alternate not standard or default mapping between adapter shared...

Страница 217: ...ond for example one baud equals one half dot cycle per second in Morse code one bit per second in a train of binary signals and one 3 bit value per second in a train of signals each of which can assum...

Страница 218: ...r Distributed Data Interface Challenge Handshake Authorization Protocol CHAP A password protection protocol that describes how to authenticate incoming data calls The password is encrypted over the ac...

Страница 219: ...cally to perform their task others operate periodically data port Ethernet ports used for storage traffic and configuration purposes DASD queue A queue that resides on a direct access storage device D...

Страница 220: ...Industry Standard Architecture ELAN See emulated LAN electromagnetic interference A disturbance in the transmission of data on a network resulting from the magnetism created by a current of electrici...

Страница 221: ...side a CP processor Extended configuration services keeps a local cache of transmission group locations Extended configuration services do not handle activation and deactivation See configuration serv...

Страница 222: ...s its content without power but must be erased in fixed blocks rather than single bytes floating virtual connection FVC The ability to resume a virtual connection on a port other than the port connect...

Страница 223: ...pertext documents I IBM Disk Operating System DOS A disk operating system based on MS DOS that operates with all IBM compatible personal computers IETF See Internet Engineering Task Force iLUN iSCSI c...

Страница 224: ...seminates configuration data LAN multicast Sending of a transmission frame that is intended to be accepted by a group of selected data stations on the same local area network LAN Segment Number The id...

Страница 225: ...See low smoke zero halogen M macro An instruction that causes the execution of a predefined sequence of instructions in the same source language main storage Program addressable storage from which in...

Страница 226: ...that allows any host in a network to mount another host s file directories After a file directory is mounted it appears to reside on the local host network information services NIS A set of UNIX netw...

Страница 227: ...ISA or EISA slot while high speed PCI controllers plug into a PCI slot Persistent Storage Manager PSM Columbia Data Products software that creates multiple point in time persistent True Image data vi...

Страница 228: ...l Simple Network Management Protocol SNMP In the Internet suite of protocols a network management protocol that is used to monitor routers and attached networks SNMP is an application layer protocol I...

Страница 229: ...of LAN switching bridging routing ATM switching and other switched services synchronous data transfer A physical transfer of data to or from a device that has a predictable time relationship with the...

Страница 230: ...definitely or can be ended at will The three states of a virtual connection are up down or suspended virtual local area network VLAN A logical association of switch ports based upon a set of rules or...

Страница 231: ...X Xmodem A public domain asynchronous data link control DLC protocol that provides packet numbering and checksum error control for the transfer of binary files Glossary of terms and abbreviations 219...

Страница 232: ...220 Model 326 User s Reference...

Страница 233: ...rties 41 installation steps cluster configuration 40 clustering continued installation steps continued joining a node to a domain 40 networking setup 37 shared storage setup 29 powering off and poweri...

Страница 234: ...92 Storage Unit Model 0RU storage unit troubleshooting 118 IBM Advanced Appliance Configuration Utility IAACU 11 13 25 IBM Advanced Appliance Configuration Utility agent 2 IBM Director dependencies 54...

Страница 235: ...3 P partnering setting up on the 3534 managed Fibre hubs 155 Persistent Images creating and preserving images of drives 61 disaster recovery 64 granting user access to persistent image files 68 PSM no...

Страница 236: ...ector Agent 2 IBM Director Agent and Universal Manageability Server Extensions 1 IBM FAStT MSJ 1 IBM FAStT Storage Manager for Windows 2000 Version 2 Intel PROSet II 1 2 Microsoft Cluster Service 1 2...

Страница 237: ...Mbps integrated Ethernet adapter 97 SCSI HVD 3570 adapter 107 ServeRAID 4Lx 106 tutorial NAS Setup Navigator 3 U UM Services launching 22 23 starting 22 system requirements 21 using 21 Universal Mana...

Страница 238: ...226 Model 326 User s Reference...

Страница 239: ......

Страница 240: ...Printed in the United States of America on recycled paper containing 10 recovered post consumer fiber GA27 4276 02...

Отзывы:

Нет отзывов

Похожие инструкции для totalstorage 326

Бренд: Nayar Systems Страницы: 37

Бренд: IBM Страницы: 104

System Storage TS3100

Бренд: IBM Страницы: 375

Бренд: Watchguard Страницы: 39

Бренд: ?omtime Страницы: 62

inLab Speedcure 9494800

Бренд: Dentsply Sirona Страницы: 91

Бренд: H3C Страницы: 12

Бренд: ZALMAN Страницы: 4

Бренд: Lucent Technologies Страницы: 20

Бренд: Seattle Computer Products Страницы: 31

Бренд: Valcom Страницы: 4

Бренд: Marani Страницы: 39

EK-FC750 GTX Series

Бренд: ekwb Страницы: 2

Бренд: Xantech Страницы: 16

Бренд: FiberHome Страницы: 2

Powereta iQP Series

Бренд: TDK Страницы: 2

WAFER-EHL Series

Бренд: IEI Technology Страницы: 142

Бренд: RadioSPECTRAL Страницы: 2

Бренды по названию

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Популярные бренды

Загрузить еще бренды