Sun Microsystems StorEdge T3+ Service Manual Download Page 166

Page: 166 / 240

10-2

Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001

10.1.1

Preparing the Arrays

1. Decide which unit is the master controller and which is the alternate master.

2. Back up the data on both arrays.

Caution –

Make sure you back up data on both units before proceeding! You need to

re-create the volume(s) on the alternate master after cabling the units together.

3. Ensure that the data path between the host and both arrays has been quiesced.

There must not be any I/O activity.

4. Start a Telnet session with both arrays.

a. On the host, use the

telnet

command with the array name (or IP address) to

connect to the array.

b. Log in to the array by typing

root

and your password at the prompts.

The array prompt is displayed.

5. Verify that firmware levels for all array firmware are the same on the master unit

and alternate master unit.

On both arrays:

a. Type

ver

to display the controller firmware level.

For example:

In this example, the controller firmware level is listed as

Release

1.14

# telnet

array_name

Trying 129.150.47.101...

Connected to 129.150.47.101.

Escape character is ’^]’.

pSOSystem (129.150.47.101)

:/:<1> ver

T300 Release 1.14 2000/08/01 10:43:22 (129.150.47.135)

Summary of Contents for StorEdge T3+

Page 1: ...nc 901 San Antonio Road Palo Alto CA 94303 4900 U S A 650 960 1300 Send comments about this document to docfeedback sun com Sun StorEdge T3 and T3 Array Field Service Manual Part No 816 0779 10 September 2001 Revision A ...

Page 2: ...tems Inc 901 San Antonio Road Palo Alto CA 94303 4900 Etats Unis Tous droits réservés Ce produit ou document est distribué avec des licences qui en restreignent l utilisation la copie la distribution et la décompilation Aucune partie de ce produit ou document ne peut être reproduite sous aucune forme par quelque moyen que ce soit sans l autorisation préalable et écrite de Sun et de ses bailleurs d...

Page 3: ...ts for a Class A digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if it is not installed and used in accordance with the instruction manual it may cause harmful interference to ...

Page 4: ...e equipment off and on the user is encouraged to try to correct the interference by one or more of the following measures Reorient or relocate the receiving antenna Increase the separation between the equipment and receiver Connect the equipment into an outlet on a circuit different from that to which the receiver is connected Consult the dealer or an experienced radio television technician for he...

Page 5: ...Regulatory Compliance Statements v ...

Page 6: ...un StorEdge T3 and T3 Array Field Service Manual September 2001 BSMI Class A Notice The following statement is applicable to products shipped to Taiwan and marked as Class A on the product compliance label ...

Page 7: ...ble for regulatory compliance of a modified Sun product Placement of a Sun Product Caution Do not block or cover the openings of your Sun product Never place a Sun product near a radiator or heat register Failure to follow these guidelines can cause overheating and affect the reliability of your Sun product Caution The workplace dependent noise level defined in DIN 45 635 Part 1000 must be 70Db A ...

Page 8: ...icher Vorschriften Auf dieser Seite werden Sicherheitsrichtlinien beschrieben die bei der Installation von Sun Produkten zu beachten sind Sicherheitsvorkehrungen Treffen Sie zu Ihrem eigenen Schutz die folgenden Sicherheitsvorkehrungen wenn Sie Ihr Gerät installieren Beachten Sie alle auf den Geräten angebrachten Warnhinweise und Anweisungen Vergewissern Sie sich daß Spannung und Frequenz Ihrer St...

Page 9: ...duzieren schließen Sie das Kabel nur an eine fachgerecht verlegte geerdete Steckdose an Die folgende Warnung gilt nur für Geräte mit Wartezustand Netzschalter Achtung Die Ein Aus Schalter dieses Geräts schalten nur auf Wartezustand Stand By Modus Um die Stromzufuhr zum Gerät vollständig zu unterbrechen müssen Sie die Netzkabel aus der Steckdose ziehen Alle Netzkabel müssen ausgesteckt sein um die ...

Page 10: ...ée et leur contact peut provoquer des blessures corporelles Attention présence de tensions dangereuses Pour éviter les risques d électrocution et de danger pour la santé physique veuillez suivre les instructions MARCHE votre système est sous tension courant alternatif Un des symboles suivants sera peut être utilisé en fonction du type d interrupteur de votre système ARRET votre système est hors te...

Page 11: ...que Panasonic modèle HHR200SCP Il existe un risque d explosion si cette batterie est manipulée de façon erronée ou mal mise en place Ne remplacez cette batterie que par une batterie Sun Microsystems du même type Ne la démontez pas et n essayez pas de la recharger hors du système Ne faites pas brûler la batterie mais mettez la au rebut conformément aux réglementations locales en vigueur Couvercle A...

Page 12: ...e la normativa SELV El estado de la seguridad de las conexiones de entrada salida cumple los requisitos de la normativa SELV Conexión del cable de alimentación eléctrica Precaución Los productos Sun están diseñados para trabajar en una red eléctrica monofásica con toma de tierra Para reducir el riesgo de descarga eléctrica no conecte los productos Sun a otro tipo de sistema de alimentación eléctri...

Page 13: ...ón puede ocasionar daños personales o perjudicar el funcionamiento del equipo Aviso de cumplimiento con requisitos de láser Los productos Sun que utilizan la tecnología de láser cumplen con los requisitos de láser de Clase 1 Precaución El manejo de los controles los ajustes o la ejecución de procedimientos distintos a los aquí especificados pueden exponer al usuario a radiaciones peligrosas GOST R...

Page 14: ...xiv Sun StorEdge T3 and T3 Array Field Service Manual September 2001 ...

Page 15: ...3 Sun StorEdge Component Manager 1 4 1 4 Sun StorEdge StorTools Software 1 4 1 5 Static Electricity Precautions 1 5 2 Connecting to the Sun StorEdge T3 and T3 Array 2 1 2 1 Establishing a Serial Port Connection 2 1 2 2 Establishing a Telnet Session 2 3 2 3 Establishing an FTP Session 2 5 2 4 Using tftpboot to Boot a Single Array or a Partner Group Remotely 2 6 2 5 Configuring a Server for Remote B...

Page 16: ... Verifying Hub Connectivity 3 11 3 6 Checking Array Boot Status 3 11 3 7 Telnet Connection Status Checks 3 14 3 7 1 Determining Failover 3 14 3 7 2 Verifying the Firmware Level and Configuration 3 15 3 7 3 Checking FRU Status 3 18 3 7 4 Testing the Array With StorTools 3 19 3 8 Identifying Miscabled Partner Groups 3 19 3 9 Identifying Data Channel Failures 3 23 4 Controller Card Assembly 4 1 4 1 C...

Page 17: ...ing Disk Drive Firmware 5 13 5 5 Clearing Corrupted Disk Labels 5 15 6 Interconnect Card Assemblies 6 1 6 1 Interconnect Card LEDs 6 2 6 2 Removing and Replacing an Interconnect Card 6 3 6 3 Upgrading Interconnect Card Firmware 6 5 7 Power and Cooling Unit Assemblies 7 1 7 1 Power and Cooling Unit 7 1 7 2 Power and Cooling Unit LEDs 7 2 7 2 1 Power and Cooling Unit LEDs 7 3 7 3 Removing and Replac...

Page 18: ...rformance Against Baseline Data 8 12 8 3 3 StorTools Message Monitoring 8 13 8 3 4 Component Manager Status Indicator 8 13 8 3 5 Manual Examination of the syslog File 8 13 8 3 6 Example syslog Error Messages 8 14 8 3 7 Using CLI Diagnostic Commands 8 15 8 3 8 Using the ofdg Diagnostic Utility 8 16 8 4 Repair Procedures 8 21 8 4 1 Interconnect Card Replacement Procedure 8 21 8 4 2 RAID Controller R...

Page 19: ...stablishing a New IP Address 10 17 10 2 3 Establishing a Network Connection 10 17 10 2 4 Defining and Mounting Volumes 10 18 10 3 Changing the Port ID on the Array 10 23 A Illustrated Parts Breakdown A 1 A 1 Sun StorEdge T3 Array A 2 A 2 Sun StorEdge T3 Array Assemblies A 3 A 3 Door Assembly A 4 A 4 Interconnect Card Assembly A 5 A 5 Power Supply and Cooling Unit A 6 A 6 Controller Card A 7 A 7 Dr...

Page 20: ...1 Message Syntax C 1 C 2 Reset Log Types C 3 C 3 Boot Messages C 4 D Sun StorEdge T3 Array System Commands D 1 D 1 Commands List D 1 D 2 FRU Identifiers D 3 E FC AL Loop Identifiers E 1 F Sun StorEdge T3 Array Configuration Worksheets F 1 F 1 Worksheets F 1 F 2 System Information Worksheets F 2 Glossary Glossary 1 ...

Page 21: ...roller Card LEDs 4 3 FIGURE 4 3 Removing the Controller Card 4 4 FIGURE 5 1 Disk Drive LEDs Viewed Through Front Cover 5 6 FIGURE 5 2 Removing the Front Panel 5 8 FIGURE 5 3 Disk Drive Numbering 5 8 FIGURE 5 4 Releasing the Latch Handle 5 9 FIGURE 5 5 Removing a Disk Drive 5 10 FIGURE 6 1 Interconnect Card LEDs 6 2 FIGURE 6 2 Removing the Interconnect Card 6 4 FIGURE 7 1 Power Cords Connected to t...

Page 22: ...er and MAC Address on Pull out Tab 9 3 FIGURE 9 3 Removing the Chassis 9 4 FIGURE 9 4 Serial Number and MAC Address on Pull out Tab 9 6 FIGURE 10 1 Connecting the Interconnect Cables 10 6 FIGURE 10 2 Fully Cabled Partner Group 10 7 FIGURE 10 3 Location of Pull Out Tab With MAC Address 10 8 FIGURE 10 4 Interconnect Cable Location 10 16 FIGURE A 1 Sun StorEdge T3 Array Front View A 2 FIGURE A 2 Sun ...

Page 23: ...ontroller Card LED Descriptions 4 3 TABLE 4 4 Channel Active LED Descriptions 4 11 TABLE 5 1 Drive Status Messages 5 2 TABLE 5 2 Disk Drive LED Descriptions 5 6 TABLE 6 1 Interconnect Card LED Descriptions 6 2 TABLE 7 1 Power and Cooling Unit LED Descriptions 7 3 TABLE A 1 Sun StorEdge T3 Array Assemblies A 3 TABLE A 2 Door Assembly A 4 TABLE A 3 Interconnect Card Assembly A 5 TABLE A 4 Power Supp...

Page 24: ...LE C 2 FRU Identifers C 2 TABLE C 3 Reset Log Types C 3 TABLE C 4 Default System Files and Directories C 3 TABLE C 5 Boot Message Acronyms C 4 TABLE C 6 Firmware Status Boot Messages C 6 TABLE D 1 Commands Listed in Alphabetical Order D 2 TABLE D 2 FRU Identifiers D 3 TABLE E 1 Assigned Loop Identifier E 1 TABLE F 1 Sun StorEdge T3 and T3 array Information Worksheet F 2 ...

Page 25: ...lure remove and replace component s effectively reconfigure the module and system and place the product back into the customer s network Before You Read This Book Make sure you have prepared by reviewing the Sun StorEdge T3 and T3 Array Installation Operation and Service Manual Sun StorEdge T3 and T3 Array Administrator s Guide and Sun StorEdge T3 and T3 Array Release Notes Work with the site syst...

Page 26: ...e Chapter 7 describes how to replace the power and cooling unit and monitor the UPS Chapter 8 describes how to diagnose and correct back end FC AL drive loop problems with the Sun StorEdge T3 and T3 array Chapter 9 describes how to replace the chassis backplane assembly Chapter 10 describes how to reconfigure the Sun StorEdge T3 array into partner groups and single controller units Appendix A cont...

Page 27: ...ation on basic UNIX commands and procedures such as booting the devices For more information outside of this document see the following AnswerBook2 online documentation for the Solaris software environment Other software documentation that you received with your system ...

Page 28: ...l AaBbCc123 What you type when contrasted with on screen computer output su Password AaBbCc123 Book titles new words or terms words to be emphasized glossary terms Read Chapter 6 in the User s Guide These are called class options The user must be superuser to do this Command line variable replace with a real name or value To delete a file type rm filename TABLE P 2 Shell Prompts Shell Prompt C she...

Page 29: ...tion Guide 806 7979 Latest array updates Sun StorEdge T3 and T3 Array Release Notes 816 1983 Administration Sun StorEdge T3 and T3 Array Administrator s Guide 816 0776 Disk drive specifications 18 Gbyte 10K rpm Disk Drive Specifications 806 1493 36 Gbyte 10K rpm Disk Drive Specifications 806 6383 73 Gbyte 10K rpm Disk Drive Specifications 806 4800 Component Manager installation Sun StorEdge Compon...

Page 30: ...e Web You can browse the documentation archive at http www sun com products n solutions hardware docs Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions You can email your comments to Sun at docfeedback sun com Please include the part number 816 0779 10 of your document in the subject line of your email ...

Page 31: ... and T3 array can be structured to a maximum of two different RAID volumes or logical unit numbers LUNs This means that each array can store information from two completely different applications or sources but both sources uniquely transmit their data delivery and retrieval through the same host adapter The Sun StorEdge T3 and T3 array partner group consists of two independent controller RAID uni...

Page 32: ...is log See Section 2 6 Setting Up Remote Logging on page 2 10 to set up this service 1 2 2 Host Generated Message A syslog daemon in the host hardware writes system error message logs to var adm messages The data host sees a array as one or two logical volumes A host generated message indicates that the host cannot communicate with the array through the Fibre Channel Arbitrated Loop FC AL channel ...

Page 33: ...1 1 Levels of Message Notification Message Level Description Error Indicates a critical system or storage network event or failure requiring immediate intervention or attention Warning Indicates a possible system or storage network event or failure requiring eventual intervention Notice Indicates a system event that could be a normal periodic notification a system fault operator keyboard commands ...

Page 34: ...w to use the GUI to administer Sun StorEdge T3 and T3 arrays The Sun StorEdge Component Manager software communicates with the array via an Ethernet connection It must be installed configured and initialized on the management host The management host does not have to be the application host directly connected to the array The software recognizes the unit through the Ethernet address and monitors i...

Page 35: ... to Section 3 7 4 Testing the Array With StorTools on page 3 19 and the Sun StorEdge StorTools User s Guide for information identifying data channel failures 1 5 Static Electricity Precautions Follow these procedures to prevent damaging the FRUs Remove plastic vinyl and foam from the work area Before handling a FRU discharge any static electric charge by touching a ground surface Wear an antistati...

Page 36: ...1 6 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 ...

Page 37: ...g Up Remote Logging on page 2 10 2 1 Establishing a Serial Port Connection The serial port is a direct connection to the array from any serial port on any host or system Individual commands can be run to query and repair the unit from this interface using the command line interface CLI The serial port connection provides the following advantages over the Telnet connection Boot messages are display...

Page 38: ... 02 Diagnostic Kit The T3 array uses the serial cable with RJ 11 connectors and the T3 array uses the serial cable with RJ 45 connectors The serial port on the array is on the controller card backplane FIGURE 2 1 Serial Port Location 2 On the host system open a terminal window type tip the baud rate and the serial port designation For example mymachine tip 9600 dev ttya connected Password Invalid ...

Page 39: ...ailable through the CLI are accessible For more information on serial connections see Section 2 6 Setting Up Remote Logging on page 2 10 Section 3 6 Checking Array Boot Status on page 3 11 2 2 Establishing a Telnet Session The Telnet session is a direct network link to the array unit through the command line interface CLI You can execute individual commands to query and repair the unit from this i...

Page 40: ...ing root and the root password at the prompts The array prompt is displayed 3 To view the available commands on the array type help at the prompt For more information on how to set up the syslog file and interpret it see Section 2 6 Setting Up Remote Logging on page 2 10 and for information on how to use the CLI commands see Sun StorEdge T3 and T3 Array Administrator s Guide mgmt host telnet T3 1 ...

Page 41: ...ple 2 Log in to the array by typing root and the supervisor password at the prompts Note Be sure to set Binary mode if transferring firmware mgmt host 15 ftp 123 123 123 2 Connected to 123 123 123 2 Escape character is 123 123 123 2 pSOSystem NUPPC 2 0 0 G ready Name 123 123 123 2 root Name 123 123 123 2 root root 331 Password required for root Password password 230 User root logged in ftp ...

Page 42: ...e server See Section 2 5 Configuring a Server for Remote Booting on page 2 9 2 Unplug the Ethernet cable connected to the alternate master Leave the Ethernet cable on the master connected 3 Get to the array EPROM as described in Section 2 1 Establishing a Serial Port Connection on page 2 1 4 Set the array boot mode to tftpboot T3 1 set bootmode tftp T3 1 set bootmode tftp bootdelay 3 sn 000596 ip ...

Page 43: ...ame bin T300 EP set bootmode tftp bootdelay 3 sn 000596 ip 123 123 123 99 netmask 255 255 255 0 gateway 0 0 0 0 tftphost 129 150 47 37 tftpfile nb113 bin hostname T3 1 spindelay 0 revision 0210 mac 00 20 f2 00 02 ba rarp on T3 1 reset Starting T3 1 Release 2 10 1999 11 24 13 05 57 123 123 123 3 Copyright C 1997 1999 Sun Microsystems Inc All Rights Reserved Found units u1 ctr tftp boot is enabled h...

Page 44: ...stem 11 Reconnect the Ethernet cable to the alternate master mgmt_host ftp 123 123 123 3 Connected to 123 123 123 3 220 123 123 123 3 pSOSystem FTP server NUPPC 2 0 0 G ready Name 123 123 123 3 root root 331 Password required for root Password 230 User root logged in ftp lcd tftpboot Local directory now tftpboot ftp bin 200 Type set to I ftp put filename bin 200 PORT command successful 150 Opening...

Page 45: ...allow users read write access 3 Copy the Sun StorEdge T3 disk tray boot code into the tftpboot directory Where nbnnn bin is the current boot code file identification number For example nb101 bin 4 Verify that tftpboot nbnnn bin is readable 5 Edit the etc inetd conf file and uncomment the tftp line 6 Restart inetd boothost mkdir tftpboot boothost chmod 777 tftpboot boothost cp nbnnn bin tftpboot bo...

Page 46: ...Simple Network Management Protocol SNMP traps To enable SNMP notification edit the etc syslog conf and the etc hosts files on the array to configure system message logging Because files cannot be edited on the array ftp the files to a host to make the edits and then ftp the files back to the array Refer to the Sun StorEdge T3 and T3 Array Administrator s Guide for instructions on setting up remote...

Page 47: ...ivity Tests on page 3 8 Section 3 6 Checking Array Boot Status on page 3 11 Section 3 7 Telnet Connection Status Checks on page 3 14 Section 3 8 Identifying Miscabled Partner Groups on page 3 19 Section 3 9 Identifying Data Channel Failures on page 3 23 3 1 Diagnostic Information Sources TABLE 3 1 summarizes the diagnostic tools available to you TABLE 3 1 Diagnostic Functions and Tools Function To...

Page 48: ...e System admin domain configuration CM CLI E CLI S System admin domain monitoring CM CLI E CLI S SRS SNMP CA syslog CA Version level check CM CLI E CLI S LUN configuration CM CLI E CLI S FRU failure monitoring LED CM CLI E CLI S SRS SNMP CA syslog CA Performance monitoring CM CLI E CLI S SNMP CA syslog CA Firmware download CLI E Syslog access mgmt host CLI E CLI S syslog CA and StorTools M with 2n...

Page 49: ...ols M The StorTools application runs on a management host as described in Sun StorEdge StorTools User s Guide Version 4 1 syslog Sun StorEdge T3 and T3 array syslog file syslog CA Sun StorEdge T3 and T3 array syslog with customer written application SRS Sun Remote Service 3 2 Troubleshooting Flow Charts The following three charts illustrate typical diagnostic procedures ...

Page 50: ...n the var adm messages file Identify the failing array by decoding the messages In the failing array are any errors indicated in the array syslog file Decode errors and replace failed component in the array Run StorTools appl Does it pass YES NO Connect loopback plug to HBA and re run test Does it pass Check Intermittent Loop GBIC MIA and fiber cable Does problem persist NO Check GBIC MIA and fibe...

Page 51: ...the etc hosts file NO YES Verify that etc nsswitch conf file has ethers and hosts entries before NOTFOUND return NO DONE YES Correct the files and restart rarpd as follows ps eaf grep rarpd Kill the PID and restart with usr sbin in rarpd a Can you access the array NO Hook up a console serial cable to the array and verify the netmask and IP address with the YES YES Procedure A DONE YES Is the ENET ...

Page 52: ... ethernet cable and ping the array s YES NO IP conflict Contact your site network administrator to resolve the conflict Replace network cable with a known good cable Can you access the array DONE YES Change RAID controller board Set up IP address NO IP address Any response Note Ensure that the host and the array are on the same subnet ...

Page 53: ...on to the array unit See Section 1 2 2 Host Generated Message on page 1 2 for more information about host generated messages 4 Messages generated by the Sun StorEdge Component Manager software indicating a problem See Section 1 3 Sun StorEdge Component Manager on page 1 4 for more information about Component Manager 3 3 2 Troubleshooting Checks 1 The connection between the host and the Sun StorEdg...

Page 54: ...s identified by the SUN T3 0100 label 3 5 StorTools Connectivity Tests Use StorTools to verify the physical connection between the host and the array and to determine the primary and alternate paths 3 5 1 Primary Path Verification by the Host To determine a Sun StorEdge T3 array s primary and alternate paths from the host console do the following format Searching for disks done c1t1d0 configured w...

Page 55: ...mber 50020f2300000172 they point to the same volume The following step determines whether selection 2 is the primary or alternate path to the logical volume format e Searching for disks done AVAILABLE DISK SELECTIONS 0 c0t2d0 drive type unknown sbus 1f 0 SUNW fas e 8800000 sd 2 0 1 c0t3d0 SUN2 1G cyl 2733 alt 2 hd 19 sec 80 sbus 1f 0 SUNW fas e 8800000 sd 3 0 2 c1t1d0 SUN T3 0100 cyl 34145 alt 2 h...

Page 56: ...finitions inquiry show vendor product and revision scsi independent SCSI mode selects volname set 8 character volume name cmd execute cmd then return0 quit format scsi SCSI MENU disk select a disk type select define a disk type partition select define a partition table current describe the current disk format format and analyze the disk repair repair a defective sector label write label to the dis...

Page 57: ...orTools A5x00 FRU Isolation tool filtr in manual mode and the disk tray FRU Isolation tool sedr in verbose mode as described in the Sun StorEdge StorTools User Guide Note Running the StorTools application affects performance 3 6 Checking Array Boot Status 1 Establish a serial connection with the array as described in Section 2 1 Establishing a Serial Port Connection on page 2 1 Inquiry 00 00 03 12...

Page 58: ...s not responding or if the master has failed over to the alternate master in the boot messages tip 9600 dev ttyb Connected T3 EP Release 2 10 1999 11 24 13 05 27 IP Address of tray Copyright c 1997 1999 Sun Microsystems Inc All Rights Reserved Found units u1 ctr1 u2 ctr auto boot is enabled hit the RETURN key within 3 seconds to cancel Default master is 1 Default alternate master is 2 Initializing...

Page 59: ...ensure that they are correct A message such as the following might appear after you log in It is possible that the serial cable is connected to the alternate master unit instead of the master unit To determine if this is true enter fru myuid If you are connected the master u1 is returned If you are connected to the alternate u2 is returned If you are connected the alternate stop the tip session re...

Page 60: ...name or IP address to connect to the array 2 Log in to the array by typing root and the supervisor password at the prompts 3 To determine which unit is the master or alternate master unit enter sys stat The following example shows a partner group in a normal state In a failover state unit 2 assumes the role of master controller and unit 1 is disabled as shown in the following example mngt_host tel...

Page 61: ... firmware See Section 5 4 Upgrading Disk Drive Firmware on page 5 13 Interconnect card firmware See Section 6 3 Upgrading Interconnect Card Firmware on page 6 5 The firmware upgrade procedures must be done through the Ethernet connection The latest firmware versions are located on the SunSolveSM web site http sunsolve sun com Firmware file naming restrictions are as follows The name consists of a ...

Page 62: ...e sure the latest firmware versions are installed and that the array configuration information indicates that the unit is ready for operation Check the firmware versions and array information in a telnet session with the array 1 On the host use the telnet command with the array name or IP address to connect to the array For example 2 Log in to the array by typing root and the supervisor password a...

Page 63: ...C 1997 2000 Sun Microsystems Inc All Rights Reserved 7 fru list ID TYPE VENDOR MODEL REVISION SERIAL u1ctr controller card SUN 0082f f0 0210 000596 u1d1 disk drive SEAGATE ST118202FSUN EA29 LKG88867 u1d2 disk drive SEAGATE ST118202FSUN EA29 LKG89225 u1d3 disk drive SEAGATE ST118202FSUN EA29 LKG88938 u1d4 disk drive SEAGATE ST118202FSUN EA29 LKG89528 u1d5 disk drive SEAGATE ST118202FSUN EA29 LKG898...

Page 64: ...a disk ready ready 34 v0 u2d1 ready enabled data disk ready ready 31 v1 u2d2 ready enabled data disk ready ready 31 v1 u2d3 ready enabled data disk ready ready 30 v1 u2d4 ready enabled data disk ready ready 26 v1 u2d5 ready enabled data disk ready ready 34 v1 u2d6 ready enabled data disk ready ready 26 v1 u2d7 ready enabled data disk ready ready 28 v1 u2d8 ready enabled data disk ready ready 32 v1...

Page 65: ...nd performs disk inquiries Note Since lbf is not supported on PCI FC 100 host board adapters initcheck performs disk inquiries only on those systems Consult your StorTools documentation for information on how to perform StorTools diagnostic tests Note The StorTools diagnostic package expects the software and firmware files to be at certain minimum revision levels to run the tools Always use the Ch...

Page 66: ...the bottom unit will take over the values of the master top unit If the partner group has been cabled together incorrectly the following procedure can help determine if the top unit is acting as the master controller 1 Determine the MAC address of the top unit The MAC address is located on a pull out tab at the front of the unit to the left of the first disk drive FIGURE 3 4 FIGURE 3 4 MAC Address...

Page 67: ...as shown d Determine if the RARP daemon is running by typing If the RARP daemon is running proceed to Step 3 If the RARP daemon is not running continue to Step e e Start the RARP daemon in the Solaris environment by typing 3 Ensure that there is an Ethernet connection to the 10BASE T port of the top unit 4 Press the power switch on the power and cooling units on both arrays to remove AC power FIGU...

Page 68: ...itch conf file is properly configured on the RARP server In the Solaris environment use the snoop command to verify that the array is attempting to establish RARP communication with the Solaris server MAC address is incorrect In the Solaris environment use the snoop command to specify the MAC address of the array and to determine if any RARP packets are transmitted If you observe no transmissions ...

Page 69: ...adapter MIA attached to the array Errors in the host data channel are outside of the scope of the Sun StorEdge T3 and T3 array To determine failures in the data path use host based application diagnostics such as the StorTools product for the Solaris operating environment Refer to the documentation of the selected diagnostics tool for information on identifying data channel failures ...

Page 70: ...3 24 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 ...

Page 71: ...1 Controller Card LEDs The controller card LEDs for a Sun StorEdge T3 array differ from that of a Sun StorEdge T3 array The controller LEDs of both array models are described in the following sections Sun StorEdge T3 Array Controller LEDs The Sun StorEdge T3 array controller card has a channel active LED for the host interface port a controller status online LED and a reset switch TABLE 4 1 lists ...

Page 72: ...Port enabled and idle Blinking green Port enabled and active TABLE 4 2 Controller Status LED Descriptions Sun StorEdge T3 array Controller Status LED green or amber Description Off Controller not installed not recognized Green Controller OK Amber Controller boot shutdown or firmware download in progress Blinking amber Controller failure OK to replace controller Note Verify a controller card failur...

Page 73: ...isabled Green Port enabled and idle Blinking green Port enabled and active Ethernet Active LED green Off Link invalid Green Link valid and idle Blinking green Link valid and active 10 100 BASE T Active LED green Off Port disabled 10 Mbps rate Green Port enabled and idle 100 Mbps rate Blinking green Port enabled and active Controller Status LED green or amber Off Controller not installed not recogn...

Page 74: ...ally shut down and power off To replace the controller card 1 Observe static electricity precautions See Section 1 5 Static Electricity Precautions on page 1 5 2 Ensure that the controller card is showing failure status 3 Remove the Ethernet cable from the 10BASE T connector 4 Remove the fiber optic cable and MIA from the FC AL connector 5 Unlock the controller card by pushing in on the latch hand...

Page 75: ...r User s Guide for instructions Note In a partner group configuration the controller fails over to the alternate master when there is a controller card failure in a master unit After the controller board is replaced the partner group performs a reset command to return to the original failover configuration of master and alternate master 4 3 Upgrading Controller Firmware The controller firmware can...

Page 76: ...le for instructions specific to that release 4 Power cycle the array to reset it a Type b Press the power button on each power and cooling unit to remove AC power c Press the power buttons again to return AC power to the array Caution Power cycling a Sun StorEdge T3 and T3 array causes an interruption in array operation 4 3 1 2 Controller EPROM Firmware The EPROM firmware is stored in the FLASH me...

Page 77: ... supervisor password for the Sun StorEdge T3 and T3 array prior to attempting this procedure To upgrade the EPROM firmware 1 Use ftp to transfer the firmware to the storage systems directory using binary mode See Section 2 3 Establishing an FTP Session on page 2 5 2 Establish a Telnet connection to the array See Section 2 2 Establishing a Telnet Session on page 2 3 3 Install the firmware using the...

Page 78: ...idge chip and the console serial port It prints T3B when the initialization is done Then it waits about 1 5 seconds to allow the user to select one of the two copies of level 2 code to boot The user can type 1 or 2 but there is no echo for the character typed If the user makes no selection level 2 code does the selection automatically In the automatic selection the level 1 code verifies the level ...

Page 79: ...ent updated one to boot The user can override the automatic selection by typing 1 or 2 within 1 5 seconds after T3B is displayed on the console If the command fails in the middle of update it will be an invalid level 2 code and level 1 code will not select the invalid level 2 code for booting If a bad level 2 code is programmed into ROM successfully then the user can manually select which copy to ...

Page 80: ...through tftp must have specific header information with a structure such as listed below The file content must be the binary image to be loaded into ROM or RAM It cannot be an elf file a hex file or a srecord file typedef struct ep_header_struct init code_size code size init code_cksum code checksum init code_start code start init code_base code base init code_signature code signature init code_re...

Page 81: ... to this location code_base The starting location for download For example the level 2 code downloads the level 3 code from ROM into RAM starting at this location However notice that when the starting location is 0x20000 the image in the file is loaded to 0x20040 in RAM The first 0x40 bytes are occupied by the header information That is to say that the code_base includes the space occupied by the ...

Page 82: ...he tftp host See Section 2 5 Configuring a Server for Remote Booting on page 2 9 hdr_counter For the file to be downloaded to ROM by the ep command to RAM through tftp this field should be 1 But after the code is programmed into ROM the ep command will change this field automatically This field is used to identify which of two copies of level 2 code or level 3 code is newer The smaller the value i...

Page 83: ...nection when the system prompts to press a key within three seconds 7 Install the firmware using the ep netload1 command 8 Set the bootmode to automatic 9 Power cycle the array to reset it a Type b Press the power button on each power and cooling unit to remove AC power c Press the power buttons again to return AC power to the array T3B EP set bootmode tftp T3B EP set tftphost xxx xxx xxx xxx T3B ...

Page 84: ... enterprise configuration this procedure downloads level 2 firmware to both the master unit and alternate master unit at one time To upgrade the Level 3 controller firmware perform the following steps 1 Use the ftp binary mode to transfer the firmware to the storage systems directory See Section 2 3 Establishing an FTP Session on page 2 5 2 In a telnet session with the array set the bootmode to au...

Page 85: ...process a controller detects a level 3 firmware version on the system disk different than the level 3 image loaded in flash the controller will reflash its local level 3 image and reset This can appear as two sequential boot cycles This process is expected behavior ...

Page 86: ...4 16 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 ...

Page 87: ...5 1 Monitoring Drive Status The following sections describe commands for monitoring the status of the drives Disk status can be checked by using a variety of CLI commands This section discusses how to monitor the following Section 5 1 1 Checking Drive Status Codes on page 5 2 Section 5 1 2 Checking the Hot Spare on page 5 3 Section 5 1 3 Checking Data Parity on page 5 4 Section 5 1 4 Checking Driv...

Page 88: ...conditions The following table lists numeric drive status codes 40 vol stat v0 u1d1 u1d2 u1d3 u1d4 u1d5 u1d6 u1d7 u1d8 u1d9 mounted 0 0 0 0 0 0 0 0 0 v1 u2d1 u2d2 u2d3 u2d4 u2d5 u2d6 u2d7 u2d8 u2d9 mounted 0 0 0 0 0 0 0 0 0 TABLE 5 1 Drive Status Messages Value Description 0 Drive mounted 2 Drive present 3 Drive is spun up 4 Drive is disabled 5 Drive has been replaced 7 Invalid system area on driv...

Page 89: ...he status of the hot spare drive All drives should show a status of 0 See TABLE 5 1 for definitions of drive status codes 41 vol list volume capacity raid data standby v0 125 2 GB 5 u1d1 8 u1d9 v1 125 2 GB 5 u2d1 8 u2d9 42 vol stat v0 u1d1 u1d2 u1d3 u1d4 u1d5 u1d6 u1d7 u1d8 u1d9 mounted 0 0 0 0 0 0 0 0 0 v1 u2d1 u2d2 u2d3 u2d4 u2d5 u2d6 u2d7 u2d8 u2d9 mounted 0 0 0 0 0 0 0 0 0 ...

Page 90: ...rm a parity check of the drives You can also use the fix and rate options Where fix recalculates and rewrites the parity block if a mismatch is detected rate specifies the speed with 1 slowest and 8 fastest Note The vol command is not re entrant Other vol commands cannot run on the array or partner group until the vol verify operation has completed Note It is a good practice to run vol verify befo...

Page 91: ... v0 u2d1 ready enabled data disk ready ready 25 v1 u2d2 ready enabled data disk ready ready 21 v1 u2d3 ready enabled data disk ready ready 26 v1 u2d4 ready enabled data disk ready ready 25 v1 u2d5 ready enabled data disk ready ready 23 v1 u2d6 ready enabled data disk ready ready 22 v1 u2d7 ready enabled data disk ready ready 29 v1 u2d8 ready enabled data disk ready ready 28 v1 u2d9 ready enabled d...

Page 92: ...Disk Drive LEDs LEDs at the top of each disk drive indicate drive activity and status These LEDs appear in the front cover on the unit TABLE 5 2 lists the possible drive LED states and a description for each state FIGURE 5 1 Disk Drive LEDs Viewed Through Front Cover TABLE 5 2 Disk Drive LED Descriptions Drive Activity Green Drive Status Amber Descriptions Off Off Drive not installed not recognize...

Page 93: ...up and reenables a replaced disk drive then automatically reconstructs the data from the parity or hot spare disk drives The disk drive spinup takes about 30 seconds Reconstruction of the data on the disk drive can take up to one hour depending on system activity Note For the array to automatically reconstruct drive data the array must remain powered on while a disk is replaced To prevent automati...

Page 94: ... Static Electricity Precautions on page 1 5 2 Remove the front panel by pressing in on the side latches and pulling the cover forward See FIGURE 5 2 FIGURE 5 2 Removing the Front Panel 3 Locate the disk drive that needs to be replaced Disk drives are numbered from 1 to 9 starting on the left side of the array FIGURE 5 3 Disk Drive Numbering Latch Latch Disk 1 Disk 9 ...

Page 95: ... 2 5 cm Wait 30 seconds and then pull the drive out completely This gives the disk drive time to spin down 6 Remove the disk drive from the array See FIGURE 5 5 Push in the latch handle on the removed disk drive to protect it from damage Caution Any disk drive that is removed must be replaced within 30 minutes or the Sun StorEdge T3 and T3 array and all attached arrays will automatically shut down...

Page 96: ...il it is seated with the centerplane connector Use a coin or small screwdriver to press in and lock the latch handle 9 Replace the front panel Note Replace the front panel for the array to meet FCC compliance requirements 10 Type fru list undn to verify the firmware revision of the new disk drive where un is the unit u number n dn is the drive d number n See Section 5 4 Upgrading Disk Drive Firmwa...

Page 97: ...connect to the array 2 Log in to the array by typing root and the supervisor password at the prompts 3 On the array type 4 Start a second Telnet session with the array to check rebuild progress 5 Check the rebuild progress Use the information in the PERCENT column and the TIME column which shows the elapsed time for estimating when the volume will complete reconstruction Note If all power is remov...

Page 98: ...sk ready ready 34 v0 u2d1 ready enabled data disk ready ready 31 v1 u2d2 ready enabled data disk ready ready 31 v1 u2d3 ready enabled data disk ready ready 30 v1 u2d4 ready enabled data disk ready ready 26 v1 u2d5 ready enabled data disk ready ready 34 v1 u2d6 ready enabled data disk ready ready 26 v1 u2d7 ready enabled data disk ready ready 28 v1 u2d8 ready enabled data disk ready ready 32 v1 u2d...

Page 99: ...mponent Manger is actively polling problems might occur during the firmware download Disable the polling utility within Component Manager during this procedure to avoid problems No unnecessary command line program interaction with the array is performed during the disk drive firmware download Note The disk firmware download takes approximately 20 minutes for 9 drives Do not attempt to interrupt th...

Page 100: ...ry refresh operations in progress Allow a battery refresh in progress to complete before proceeding with the firmware download 6 Unmount the array volume s from the host to ensure there is no host I O activity 7 Unmount internal array volume s 8 Install the firmware using the disk download command The filename is the file name of the disk drive firmware image that was transferred by FTP to the arr...

Page 101: ...timal condition 12 Remount the volume s on the array 5 5 Clearing Corrupted Disk Labels This procedure describes how to recover from corruption of disk labels on all nine disks of a master unit Caution This procedure is equivalent to executing the newfs command on the Sun StorEdge T3 local disk It will destroy all disk data This procedure uses a private command intended for Sun internal use only I...

Page 102: ...onfigure the tftpboot server so the Sun StorEdge T3 and T3 array can be tftp booted See Section 2 5 Configuring a Server for Remote Booting on page 2 9 2 Establish a serial port connection to the array See Section 2 1 Establishing a Serial Port Connection on page 2 1 3 Ensure that the tftpfile and tftphost values are properly set Where host_IP_address is the IP address of the host and where nbxxx ...

Page 103: ...mand Answer Yes to the Clear internal disk label question The system boots and displays the u1 Configuration local data display set bootmode auto bootdelay 3 sn 000596 ip 123 123 123 7 netmask 255 255 255 0 gateway 0 0 0 0 tftphost 123 123 123 6 tftpfile nb113 bin hostname T3 1 vendor SUN model 0082f f0 revision 0210 logto loglevel 3 rarp on mac 00 20 f2 00 02 ba set bootmode tftp boot c Clear int...

Page 104: ... process 9 Set bootmode back to auto 10 Install the autoboot firmware onto the disk drives with the boot i command Where xxx is the current boot code identification number that was set in Step 3 For example nb101 bin There is also a SunSolve patch that uploads all files to the array 11 Use ftp to restore the files in the etc web and webgui directories from http sunsolve sun com 12 Reset the Sun St...

Page 105: ...tor and replace the interconnect card and upgrade firmware The chapter contains the following sections Section 6 1 Interconnect Card LEDs on page 6 2 Section 6 2 Removing and Replacing an Interconnect Card on page 6 3 Section 6 3 Upgrading Interconnect Card Firmware on page 6 5 ...

Page 106: ...onnect card Refer to Section 3 7 3 Checking FRU Status on page 3 18 or the Sun StorEdge Component Manager User s Guide for instructions TABLE 6 1 Interconnect Card LED Descriptions Interconnect Card Status LED Green or Amber Description Off Interconnect card not installed not recognized Green solid Interconnect card OK Cable OK if present Green slow blink Interconnect card OK possible communicatio...

Page 107: ...tion or loss of data To prevent interruption of the data host system operation during interconnect card replacement ensure that In a single controller unit configuration remove only the failed interconnect card Leave the second interconnect card intact in the array In a partner group remove the interconnect cable only from the failed interconnect card Leave the interconnect cable attached to the w...

Page 108: ...ill automatically shut down and power off 6 Insert the new interconnect card making sure that the card sits on the frame 7 Lock the new interconnect card in place by pushing in the latch handle Use a coin or small screwdriver to press in and secure the latch handle 8 Reconnect the interconnect cable to the interconnect card 9 Verify that the LEDs on the interconnect card show that the interconnect...

Page 109: ...com The firmware must be resident on the host for this operation The Sun StorEdge T3 and T3 arrays must have a supervisor password prior to attempting this procedure To upgrade the firmware 1 Use ftp to transfer the firmware to the storage system s directory using binary mode See Section 2 3 Establishing an FTP Session on page 2 5 2 Establish a Telnet connection to the array See Section 2 2 Establ...

Page 110: ...6 6 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 Note It is not necessary to reboot the array for the interconnect card firmware to become effective ...

Page 111: ... is used to power all remaining circuits and disk drives is activated when AC or battery power is present and the power switch is on Each power and cooling unit has a power switch in the rear upper center of the unit Turning off the power on a power and cooling unit affects only that power and cooling unit Therefore to power off all primary power to the unit both power switches on both power and c...

Page 112: ...p There are no serviceable parts inside this unit Note The batteries in the power and cooling units recharge after powering on the array If the batteries are less than fully charged fru stat output displays batteries in a fault condition and write behind cache is disabled until the batteries are charged Note that the system can take several hours to determine the health of the batteries after the ...

Page 113: ... TABLE 7 1 Power and Cooling Unit LED Descriptions AC LED Green or Amber PS LED Green or Amber Description Off Off Power is off No AC input Amber Off Power is off Power switch turned off AC power is available Green Off Occurs when array is shut down PCU disabled AC power is available Green Green Normal operating state PCU receiving AC power Power switch is turned on AC power is available Amber Amb...

Page 114: ...ed only when a replacement power and cooling unit is available to be inserted Caution Replace only one power and cooling unit at a time to prevent system interruption Green Amber Indicates one or more of following Over temperature condition PCU disabled DC power not available PCU disabled Both fans fault PCU disabled Battery on refresh cycle Green Blinking green Battery not ready charging Green Bl...

Page 115: ...5 Unlock the power and cooling unit by using a coin or small screwdriver to push in and release the two latch handles FIGURE 7 3 6 Pull the power and cooling unit out of the array Put one index finger through each of the latch handles With your thumbs on the top of the chassis for support pry the power and cooling unit out of its connectors with an upward rotation Once it is out approximately 1 in...

Page 116: ...ower and cooling unit The battery provides backup in case of a complete AC power failure and sustains power to the array long enough to flush cache data to the drives When a Sun StorEdge T3 and T3 array is first powered up write behind caching is disabled cache runs in write through mode for a short time The write behind caching is disabled during cold boots even if AC power has not been removed f...

Page 117: ...y 2 Log in to the array by typing root and the supervisor password at the prompts 3 Use the id read command to display battery life related information Unit number n 1 or 2 power cooling unit number n 1 or 2 mngt_host telnet array name Trying 123 123 123 101 Connected to 123 123 123 101 Escape character is pSOSystem 123 123 123 101 51 id read unpcun Revision 0000 Manufacture Week 00421999 Battery ...

Page 118: ...lth of the battery During the refresh if a problem is detected with the battery future refresh operations are suspended until the problem is fixed When refresh is suspended battery write behind caching is turned off automatically as a safety precaution Note During the discharge period of a refresh cycle approximately 12 minutes write behind cache is turned off 53 refresh s PCU1 PCU2 U1 Completed R...

Page 119: ...hat a battery refresh cycle begin on January 15 2001 at 11 p m the entry in the etc schd conf file Note that the next refresh start time is always calculated from the start time of the previous refresh cycle If a user manually starts a refresh cycle then the next refresh depends on the starting time of the manually activated refresh cycle Note If a controller failover occurs the scheduler daemon s...

Page 120: ...ry 1 Remove the PCU from the array See Removing and Replacing a Power and Cooling Unit on page 4 Caution Any power and cooling unit that is removed must be replaced within 30 minutes or the Sun StorEdge T3 and T3 array and all attached arrays automatically shut down and power off 2 Turn the PCU over such that the bottom of the unit is facing up as shown in FIGURE 7 4 FIGURE 7 4 Turning the PCU ups...

Page 121: ...he PCU When removing the bottom panel do not attempt to remove it completely as the battery is still connected to the unit FIGURE 7 5 Removing the Screws from the PCU Bottom Panel 4 Slide the bottom panel off the unit slightly enough to expose the battery connector as shown in FIGURE 7 6 and FIGURE 7 7 ...

Page 122: ...7 12 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 FIGURE 7 6 Lifting the PCU Bottom Panel and Battery Slightly Away from the Unit ...

Page 123: ...URE 7 7 The Battery Connector Details Inside the PCU 5 Remove the battery connector by pulling on if firmly straight out from the connector inside the PCU 6 Lift the bottom panel with the battery away from the unit and set it aside as shown in FIGURE 7 8 ...

Page 124: ... the way into the PCU battery connector There is no indication such as a mechanical click that indicates that it is fully inserted 2 Seat the battery pack in the PCU such that the bottom panel is flush with the edges of the PCU See FIGURE 7 5 3 Replace the four Phillips screws and secure the bottom panel to the PCU 4 Replace the PCU in the array and prepare the PCU for return to service as describ...

Page 125: ...tat performance data CLI status commands StorTools StorTools message monitoring Component Manager the Sun StorEdge T3 array syslog and the FC AL connected host messages file Data from these sources is used to determine the most likely failed FRU within the Sun StorEdge T3 array system 8 1 Overview The procedures in this chapter assume that the person servicing the equipment has been trained on the...

Page 126: ...ng RAID controllers causes a LUN controller path failover This failover might require some kind of manual procedure by the customer to continue running and it might affect the overall system performance See Section 8 4 2 RAID Controller Replacement Procedure on page 8 22 4 Isolate replace and verify the FC AL disk drives Perform the this step only if steps 2 and 3 fail to resolve the problem To ru...

Page 127: ...n Loop 1 Path 0 Interconnect card Loop 2 Path 1 Interconnect card Nonsplit loop Normal Non split configuration drives u1d4 9 and u2d4 9 are logically configured to loop 1 path 0 Interconnect card Loop 1 Path 0 Alternate u2 Nonsplit loop Normal Nonsplit configuration drives u1d1 3 and u2d1 3 are logically configured to loop 2 path 1 Interconnect card Loop 2 Path 1 Loop cables Mirrored cache data al...

Page 128: ...oop 1 path 0 and loop 2 path 1 The normal configuration information can be determined by using the following CLI commands and interpreting the results fru stat see Section 8 2 1 The fru stat Command on page 8 5 vol mode see Section 8 2 2 The vol mode Command on page 8 6 port listmap see Section 8 2 3 The port listmap Command on page 8 6 loop stat see Section 8 2 4 The loop stat Command on page 8 6...

Page 129: ...eady 31 v0 u1d7 ready enabled data disk ready ready 35 v0 u1d8 ready enabled data disk ready ready 32 v0 u1d9 ready enabled data disk ready ready 37 v0 u2d1 ready enabled data disk ready ready 33 v1 u2d2 ready enabled data disk ready ready 33 v1 u2d3 ready enabled data disk ready ready 31 v1 u2d4 ready enabled data disk ready ready 31 v1 u2d5 ready enabled data disk ready ready 27 v1 u2d6 ready en...

Page 130: ...ent loop configuration with regard to the electrical connections between the loop cards A loop configuration other than the example below might indicate loop problems Note The symbol represents the presence of the isp2100 chip CODE EXAMPLE 8 2 vol mode Command Normal Ouputs 2 vol mode volume mounted cache mirror v0 yes writebehind on v1 yes writebehind on CODE EXAMPLE 8 3 port listmap Command Norm...

Page 131: ...urns the current disk path logical configuration A path status other than what is displayed below might indicate loop problems Note The Telnet session always runs the command through the master controller Although it is possible to connect directly to the alternate controller it is not supported CODE EXAMPLE 8 5 disk pathstat Command Normal Ouput 5 disk pathstat u1d1 9 DISK PPATH APATH CPATH PATH_...

Page 132: ...ange to the preferred path 8 2 6 The disk linkstat Command The disk linkstat command returns whether a device port link status register can be accessed by a controller in its current configuration If the link status register cannot be accessed this may indicate a path problem to those disk s ports u1d9 0 U 1 U PPATH PPATH PATH pass 6 disk pathstat u2d1 9 DISK PPATH APATH CPATH PATH_POLICY FAIL_POL...

Page 133: ...sk linkstat Command Normal Ouput 9 disk linkstat u1d1 9 path 0 DISK LINKFAIL LOSSSYNC LOSSSIG PROTOERR INVTXWORD INVCRC u1d1 1 10 0 0 77 0 u1d2 1 1 0 0 20 0 u1d3 2 24 0 0 112 0 u1d4 1 10 0 0 78 0 u1d5 1 1 0 0 20 0 u1d6 1 7 0 0 90 0 u1d7 1 11 0 0 76 0 u1d8 1 2 0 0 20 0 u1d9 1 16 0 0 45 0 CODE EXAMPLE 8 7 disk linkstat Command Normal Ouput alternate 28 disk linkstat u1d1 9 path 0 DISK LINKFAIL LOSSS...

Page 134: ...m Indicators The following symptoms indicate possible FC AL loop problems 1 The first indication observed by a customer might be performance degradation in the suspect Sun StorEdge T3 array See Section 8 3 2 Checking Performance Against Baseline Data on page 8 12 for more detail 2 A second indication might be StorTools message monitoring from a host that is receiving remote array syslog messages S...

Page 135: ... 4 Component Manager Status Indicator on page 8 13 and Section 8 3 6 Example syslog Error Messages on page 8 14 for more details 4 A fourth indication of a problem may be a warning or error log entry in the local Sun StorEdge T3 array syslog file Examine this file by using CLI commands via a Telnet or Tip connection This file can also be transferred via ftp to another host for examination and arch...

Page 136: ...0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 c3t1d0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 c4t2d1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 c5t1d1 54 0 28 5 0 4 7 0 0 0 0 7 0 0 8 3 0 60 c5t1d0 normal u1ctr I O 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 c3t1d1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 c4t2d0 53 3 26 1 2 2 6 4 0 0 1 6 0 0 19 7 0 59 c6t2d1 normal u2ctr I O 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 c6t2d0 CODE EXAMPLE 8 9 ...

Page 137: ...y changes its state if there has been a change of status for a FRU in a partner group Unless a FRU has been marked as failed missing or disabled by the array firmware no red highlighted FRU appears in the GUI display Most back end loop problems do not change FRU status The example failure illustrated in Section 8 3 3 does not change the normal status displayed by the GUI If the array marks a FRU a...

Page 138: ... Mar 07 18 33 22 ISR1 1 W u1d4 SVD_PATH_FAILOVER path_id 0 CODE EXAMPLE 8 11 Drive Loop Problem Example Error Messages Sep 27 18 36 53 T3A ROOT 1 W u1ctr Hardware Reset 1000 occurred Sep 27 18 48 46 T3A ISR1 1 W SCSI Disk Error Occurred path 0x1 port 0x1 lun 0x0 Sep 28 06 52 23 T3A CFGT 1 W u2ctr Disabled Sep 28 06 53 49 T3A LPCT 1 E u2ctr Not present Sep 28 06 53 49 T3A TMRT 1 E u2ctr Missing sys...

Page 139: ...re The port listmap command would show a normal status for this failure The loop stat command would show a normal status for this failure The disk pathstat command would show a normal status for this failure The disk linkstat command would show the following error conditions for this failure When the disk linkstat command is run from the master controller it is unable to access any of the link reg...

Page 140: ...test Option on page 8 18 for additional details fast_find does a fast Go No Go test of the selected enclosure and loop It also runs a simplified loop fault isolation diagnostic See Section 8 3 8 3 The ofdg fast_find Option on page 8 19 for additional details find does an extensive Go No Go test If loop failures are detected it automatically initiates the full loop fault isolation diagnostic This i...

Page 141: ... either a Go or No Go status If there is a Go status this indicates that the ofdg test did not detect any problems with the configuration and that there is no need for further tests If there is a No Go status proceed to the next step 3 Perform an ofdg fast_find operation The loop is given a Go or No Go status with progress indications If a failure is reported on the first or nearest enclosure then...

Page 142: ...backplane should be suspected See Section 9 2 Replacing the Chassis Backplane Assembly on page 9 2 for details 8 3 8 1 The health_check Option The health_check option provides a fast Go No Go Loop test for all the loops in the Sun StorEdge T3 array The health_check option calls fast_test multiple times one time for each loop 8 3 8 2 The ofdg fast_test Option The fast_test option provides a fast Go...

Page 143: ...wn to a disk port that is detect and isolate down to a bad disk port while find will try using Type 1 and Type 2 algorithms The fast_find option assumes that the probability of loop failures caused by either a bad interconnect cable or loop card is much higher than the probability of loop failures caused by a bad disk port Therefore fast_find should be used before find to first weed out bad interc...

Page 144: ...interconnect cable between u1l1 and u2l1 causes ofdg to fail on all interconnect cards In certain cases where interconnect cables have problems ofdg has proven ineffective in isolating the root cause of the failure In some cases ofdg health_check operations indicate that all interconnect cards fail the test If you observe these kind of results replace both back end interconnect cables before repla...

Page 145: ...ming that the other card is working of course Data accessibility is maintained during the replacement and testing of a single interconnect card with no change in the host configuration For the example of a suspected loop 1 path 0 problem perform the following steps 1 From the CLI disable the u1l1 interconnect card 2 When the u1l1 LED is flashing amber remove and replace the interconnect card from ...

Page 146: ...the CLI disable the u1 RAID controller card This causes a controller failure over to the other controller The Telnet session fails and Component Manager reports a loss of polling as the alternate controller becomes the master VERITAS if used redirects the host I O through the remaining path for the failed controller s volumes 2 When the u1 LED flashes amber remove and replace the u1 controller car...

Page 147: ... also requires that Component Manager halt all polling to the Sun StorEdge T3 array Because HTTP polling by Component Manager is blocked during the course of this test Component Manager may report rejected requests or other problems To administer and monitor the test connect a serial maintenance cable and open a Tip session to the Sun StorEdge T3 and T3 array The following steps describe how to te...

Page 148: ...rom the array MIAs 7 Disable Component Manager polling to the target Sun StorEdge T3 array Consult your Component Manager documentation for details 8 Establish a serial connection and Tip session to the Master RAID controller of the problem array See Section 2 1 Establishing a Serial Port Connection on page 2 1 9 Execute the set command and note the current values of logto and loglevel You will ne...

Page 149: ... 12 Examine the output in detail to identify the failed FRU For comparison a test run that found no errors is shown in CODE EXAMPLE 8 13 This test might take 8 minutes to complete CODE EXAMPLE 8 13 ofdg Sample Output No Errors 5 set logto 1 6 set loglevel 4 7 ofdg find u1l1 WARNING Volume data will be offline while OFDG is running Continue N y 8 ofdg find u1l1 WARNING Volume data will be offline w...

Page 150: ...8 50 LPCT 1 N u1d3 Bypassed on loop 1 May 26 19 18 50 LPCT 1 N u1d4 Bypassed on loop 1 May 26 19 18 50 LPCT 1 N u1d5 Bypassed on loop 1 May 26 19 18 50 LPCT 1 N u1d6 Bypassed on loop 1 May 26 19 18 50 LPCT 1 N u1d7 Bypassed on loop 1 May 26 19 18 50 LPCT 1 N u1d8 Bypassed on loop 1 May 26 19 18 50 LPCT 1 N u1d9 Bypassed on loop 1 May 26 19 19 11 LPCT 1 N u1ctr ISP not ready on loop 1 May 26 19 19 ...

Page 151: ...PASS May 26 19 20 13 ONDG 1 N ONDG Completed 9 fru s u1d1 9 DISK STATUS STATE ROLE PORT1 PORT2 TEMP VOLUME u1d1 ready enabled data disk ready ready 44 v0 u1d2 ready enabled data disk ready ready 45 v0 u1d3 ready enabled data disk ready ready 37 v0 u1d4 ready enabled data disk ready ready 35 v0 u1d5 ready enabled data disk ready ready 38 v0 u1d6 ready enabled data disk ready ready 39 v0 u1d7 ready ...

Page 152: ...p 11 and Step 12 Once the test completes examine and compare the two outputs to insure that the fault has been corrected a If the problem is resolved proceed with Step 18 through Step 17 b If the problem is not resolved proceed with Step 18 through Step 17 and then replace the backplane chassis See Section 8 4 4 Chassis Replacement Procedure on page 8 29 and Section 9 2 Replacing the Chassis Backp...

Page 153: ... replacement of the chassis backplane assembly A replacement part must be on site before beginning this procedure Before starting the customer must off load all the data that is contained in the Sun StorEdge T3 array The array must then be removed from host operation The procedure for replacing a backplane is described in Section 9 2 Replacing the Chassis Backplane Assembly on page 9 2 Once the ba...

Page 154: ...8 30 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 ...

Page 155: ... replaced together because they are factory aligned Problems with the backplane most likely occur because of an electrical short or a bent or broken pin connector These problems first appear as a failure of another FRU component such as an interconnect failure or drive failure If replacing the FRU that appears to be failed does not correct the problem then examine the backplane connector that the ...

Page 156: ...e volumes 2 From the data hosts quiesce all I O going to all volume s in that disk array and associated partner group Notify all applications to stop accessing any affected volumes by unmounting the volume s or stopping the application if necessary Verify that all drive activity has stopped The drive activity LEDs become solid green indicating that the drives are idle 3 If any volume manager softw...

Page 157: ...un StorEdge T3 and T3 array system serial number and MAC address Locate the pull out tab at the left side of the array next to the first disk drive as shown in FIGURE 9 2 This tab contains the array serial number and media access control MAC address The serial number is located on the top left portion of the pull out tab and begins with the part number 595 xxxx Record this information to transcrib...

Page 158: ...ernet cables Note If the array is part of a partner group note down the placement of the host FC AL connections and loop cables You need this information in Step 12 8 Remove the chassis if it is mounted in a cabinet a Remove the two screws at the back of the chassis that secure it to the side rails in the cabinet b Slide the chassis out of the cabinet FIGURE 9 3 FIGURE 9 3 Removing the Chassis ...

Page 159: ...e s b Pull the FRU straight out c Lock the FRU back into place in the new chassis by pushing in and securing the latch handle s with a coin or small screwdriver Caution Maintain disk positions or data could be lost d Remove and replace the controller card See Section 4 2 Removing and Replacing a Controller Card on page 4 4 for instructions e Remove and replace the interconnect cards See Section 6 ...

Page 160: ...at the host FC AL cables are recabled to the same Sun StorEdge T3 and T3 array FC AL connections that they were removed from as you noted down in Step 7 Also ensure that loop cables are properly recabled 13 Add the T3 system serial number and the MAC address to the new chassis Locate the pull out tab at the left side of the array next to the first disk drive Use a fine tipped permanent marker to w...

Page 161: ...is example 192 129 122 111 is the IP address assigned previously 17 Verify that the etc nsswitch conf file on the RARP server references the local system files To ensure that the Solaris software environment uses the changes made to the etc ethers and etc hosts files edit the host and ethers entries in the etc nsswitch conf file so that the files parameter appears before the NOTFOUND return statem...

Page 162: ...hich all LEDs should be solid green indicating that the unit is receiving power and there is no drive activity Note The batteries in the power and cooling units recharge after powering on the unit While the batteries are recharging write behind cache is disabled Note If the green power and cooling unit LEDs on connected units do not light press the power switches on those units 23 Use either the C...

Page 163: ... volume s device path also need to be changed Refer to each application s documentation for instructions 25 Execute a format command on the data host to verify that the Sun StorEdge T3 and T3 array devices are seen The Sun StorEdge T3 and T3 array volumes are now usable by the data host and can be mounted or re enabled with the appropriate volume manager software datahost drvconfig disks devlinks ...

Page 164: ...9 10 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 ...

Page 165: ...er Group Caution This procedure destroys data Back up all your data before beginning this procedure This section describes how to reconfigure two existing single controller units that contain data to form a partner group redundant controller units You will need two interconnect cables to connect the units See Appendix A for a part number and illustration of the interconnect cable This procedure in...

Page 166: ... with both arrays a On the host use the telnet command with the array name or IP address to connect to the array b Log in to the array by typing root and your password at the prompts The array prompt is displayed 5 Verify that firmware levels for all array firmware are the same on the master unit and alternate master unit On both arrays a Type ver to display the controller firmware level For examp...

Page 167: ... 5 or in Chapter 5 of the Sun StorEdge T3 and T3 Array Installation Operation and Service Manual 2 fru list ID TYPE VENDOR MODEL REVISION SERIAL u1ctr controller card SUN 0082f f0 0210 000596 u1d1 disk drive SEAGATE ST118202FSUN EA29 LKG88867 u1d2 disk drive SEAGATE ST118202FSUN EA29 LKG89225 u1d3 disk drive SEAGATE ST118202FSUN EA29 LKG88938 u1d4 disk drive SEAGATE ST118202FSUN EA29 LKG89528 u1d5...

Page 168: ... Guide for more detailed information on setting block size Caution The set z command resets the IP address of the units to 0 0 0 0 You will to reassign the IP address to the master unit after you cable the partner group together but before powering on as described in the next section 7 Power off both units a Type b Press the power button once on each power and cooling unit to turn the switch off 1...

Page 169: ...on in the cabinet refer to the rackmount installation instructions in the Sun StorEdge T3 and T3 Array Installation Operation and Service Manual If the units are cabled to the hosts and power sources such that they cannot be placed in close proximity rearrange the cabling so that the units can be placed together 2 Make sure that the 10BASE T cables are connected to a network with the same manageme...

Page 170: ...you connect the cables to the correct interconnect card connectors exactly as shown in the figure This cable connection determines the master and alternate master relationship Tighten the retaining screws The remaining connectors are reserved for expansion units FIGURE 10 1 Connecting the Interconnect Cables Master controller unit Alternate master controller unit ...

Page 171: ...lishing a New IP Address The JumpStart feature automatically downloads a newly assigned IP address to the array To enable this feature you must edit your host file on a RARP server before powering on the array After you power on the IP address is automatically assigned Before you begin make sure you have the following MAC address The MAC address is located in the pullout tab at the front of the ar...

Page 172: ...network IP address for the array 1 On a host connected to the same subnet as the array edit the etc ethers file by adding the MAC address and array name For example In this example 8 0 20 7d 93 7e is the MAC address array name is the name of the array you are installing 2 Edit the etc hosts file with the IP address and array name For example In this example 192 129 122 111 is the assigned IP addre...

Page 173: ...by pressing the power button on each power and cooling unit All power and cooling unit LEDs on both units turn green indicating that power has been restored The IP address automatically downloads to the master controller unit after you power on Note In some cases the array times out before receiving the RARP request through an Ethernet switch If this time out happens the array cannot receive the a...

Page 174: ...s to connect to the master unit Note The Telnet session verifies that your network connection is good If you cannot connect through the Telnet session you might have miscabled the partner group See Section 3 8 Identifying Miscabled Partner Groups on page 3 19 to determine if this is the problem If the partner group is cabled correctly then the IP address might not be assigned correctly If you susp...

Page 175: ...LKG95302 u2d1 disk drive SEAGATE ST118202FSUN EA29 LKG63405 u2d2 disk drive SEAGATE ST118202FSUN EA29 LKH57340 u2d3 disk drive SEAGATE ST118202FSUN EA29 LKD20515 u2d4 disk drive SEAGATE ST118202FSUN EA29 LKG89040 u2d5 disk drive SEAGATE ST118202FSUN EA29 LKG89845 u2d6 disk drive SEAGATE ST118202FSUN EA29 LKG82866 u2d7 disk drive SEAGATE ST118202FSUN EA29 LKG95090 u2d8 disk drive SEAGATE ST118202FS...

Page 176: ...y 40 v0 u1d8 ready enabled data disk ready ready 36 v0 u1d9 ready enabled data disk ready ready 29 v0 u2d1 ready enabled unassigned ready ready 38 u2d2 ready enabled unassigned ready ready 40 u2d3 ready enabled unassigned ready ready 40 u2d4 ready enabled unassigned ready ready 34 u2d5 ready enabled unassigned ready ready 39 u2d6 ready enabled unassigned ready ready 38 u2d7 ready enabled unassigne...

Page 177: ...For example v1 is the volume name u2d1 8 indicates the location of the volume unit 2 disk drives 1 through 8 raid 5 is RAID level 5 standby u2d9 is the location of the hot spare unit 2 drive 9 4 Check the status of the volumes to ensure that you created the volume correctly The status of all drives must be 0 For example 3 vol add volume name data undn n raid n standby und9 4 vol add v1 data u2d1 8...

Page 178: ...mand probes for new devices Refer to the luxadm 1M man page for more information on this command a Make sure there is a dev es directory on the host system If not type The dev es directory is necessary for running the luxadm command b On the host system type luxadm insert Note If the luxadm utility is not available execute a reconfiguration reboot boot r to ensure that the host recognizes the new ...

Page 179: ...ion on page 10 17 Section 10 2 4 Defining and Mounting Volumes on page 10 18 10 2 1 Preparing the Arrays 1 Back up all data on the partner group Caution Make sure you back up data before proceeding 2 Ensure that the data path between the host and the partner group has been quiesced There must not be any I O activity 3 Start a Telnet session with the master unit a On the host use the telnet command...

Page 180: ... 4 Interconnect Cable Location At this point you can physically move the arrays apart If you are moving the arrays to different locations remove the other cables Replace all cables except the interconnect cable when the arrays are at their permanent locations Note Do not power on the arrays until you complete the instructions in Section 10 2 2 Establishing a New IP Address on page 10 17 5 shutdown...

Page 181: ... recognize the host 1 On the host use the telnet command with the array name or IP address to connect to the array Note The Telnet session verifies that your network connection is good If you cannot connect through the Telnet session you might have miscabled the partner group See Section 3 8 Identifying Miscabled Partner Groups on page 3 19 to determine if this is the problem If the partner group ...

Page 182: ...e former master unit continues to display volumes formerly available in the partner group on the alternate master unit These phantom volumes do not exist but continue to display from the command line In the example that follows v1 is a phantom volume on a standalone array that was previously connected in a partner group Note This situation occurs only on the former master unit The former alternate...

Page 183: ...0210 003636 u1d1 disk drive SEAGATE ST136403FSUN D44A LT067917 u1d2 disk drive SEAGATE ST136403FSUN D44A LT128949 u1d3 disk drive SEAGATE ST136403FSUN D44A LT182205 u1d4 disk drive SEAGATE ST136403FSUN D44A LT133265 u1d5 disk drive SEAGATE ST136403FSUN D44A LT152632 u1d6 disk drive SEAGATE ST136403FSUN D44A LT183848 u1d7 disk drive SEAGATE ST136403FSUN D44A LT187470 u1d8 disk drive SEAGATE ST13640...

Page 184: ...n its reserved system area To correct this situation and ensure that the array is ready for operation 1 Install the latest firmware patch on the array This patch is available on the SunSolve web site http sunsolve sun com 6 fru stat CTLR STATUS STATE ROLE PARTNER TEMP u1ctr ready enabled master 34 5 DISK STATUS STATE ROLE PORT1 PORT2 TEMP VOLUME u1d1 ready enabled data disk ready ready 33 v0 u1d2 ...

Page 185: ...unted 0 0 0 0 0 0 0 0 0 9 fru list ID TYPE VENDOR MODEL REVISION SERIAL u1ctr controller card SCI SJ 375 0084 01 0210 003636 u1d1 disk drive SEAGATE ST136403FSUN D44A LT067917 u1d2 disk drive SEAGATE ST136403FSUN D44A LT128949 u1d3 disk drive SEAGATE ST136403FSUN D44A LT182205 u1d4 disk drive SEAGATE ST136403FSUN D44A LT133265 u1d5 disk drive SEAGATE ST136403FSUN D44A LT152632 u1d6 disk drive SEAG...

Page 186: ...disk ready ready 29 v0 u1d3 ready enabled data disk ready ready 30 v0 u1d4 ready enabled data disk ready ready 28 v0 u1d5 ready enabled data disk ready ready 28 v0 u1d6 ready enabled data disk ready ready 36 v0 u1d7 ready enabled data disk ready ready 27 v0 u1d8 ready enabled data disk ready ready 27 v0 u1d9 ready enabled data disk ready ready 34 v0 LOOP STATUS STATE MODE CABLE1 CABLE2 TEMP u1l1 r...

Page 187: ...performing a system reboot Note Sun StorEdge T3 arrays that are factory configured in cabinets with hubs have unique port ID values assigned This procedure applies only to standalone partner groups that are being added to an existing hub configuration To change the port ID on a Sun StorEdge T3 array 1 Connect to the array in a telnet session See Section 2 2 Establishing a Telnet Session on page 2 ...

Page 188: ...10 24 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 ...

Page 189: ...er Section A 1 Sun StorEdge T3 Array on page A 2 Section A 2 Sun StorEdge T3 Array Assemblies on page A 3 Section A 3 Door Assembly on page A 4 Section A 4 Interconnect Card Assembly on page A 5 Section A 5 Power Supply and Cooling Unit on page A 6 Section A 6 Controller Card on page A 7 Section A 7 Drive Assembly on page A 8 Section A 8 Cable and Interconnect Assemblies on page A 9 ...

Page 190: ...A 2 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 A 1 Sun StorEdge T3 Array FIGURE A 1 Sun StorEdge T3 Array Front View ...

Page 191: ...art Number Description 1 F540 4306 Door assembly 2 F370 3990 Empty chassis backplane assembly 3 F300 1454 Power supply and cooling unit 4 F375 0084 T3 controller card shown 4 F501 5710 T3 controller card 5 F375 0085 Interconnect card assembly 6 F540 4287 Drive assembly 18 GB not shown in this view 7 F540 4367 Drive assembly 36 GB not shown in this view 12765 3 4 5 6 2 1 7 ...

Page 192: ...tember 2001 A 3 Door Assembly FIGURE A 3 Door Assembly TABLE A 2 Door Assembly Item Part Number Description 1 F540 4306 Door assembly 2 F370 3990 Empty chassis backplane assembly 3 F540 4287 Drive assembly 18 GB 4 F540 4367 Drive assembly 36 GB 12749 2 1 3 4 ...

Page 193: ...nnect Card Assembly TABLE A 3 Interconnect Card Assembly Item Part Number Description 1 F375 0085 Interconnect card assembly 2 F370 3990 Empty chassis backplane assembly 3 F300 1454 Power supply and cooling unit 4 F375 0084 T3 controller card shown 4 F501 5710 T3 controller card 12767 3 4 1 2 ...

Page 194: ... A 5 Power Supply TABLE A 4 Power Supply Item Part Number Description 1 F300 1454 Power supply and cooling unit 2 F375 0085 Interconnect card assembly 3 F370 3990 Empty chassis backplane assembly 4 F375 0084 T3 controller card shown 4 F501 5710 T3 controller card F370 3956 Battery pack NIMH 12768 13276 3 4 1 2 ...

Page 195: ...ntroller Card TABLE A 5 Controller Card Item Part Number Description 1 F375 0084 T3 controller card 2 F501 5710 T3 controller card 3 F375 0085 Interconnect card assembly 4 F370 3990 Empty chassis backplane assembly 5 F300 1454 Power supply and cooling unit 3 4 5 12766 13273 1 2 ...

Page 196: ...Manual September 2001 A 7 Drive Assembly FIGURE A 7 Drive Assembly TABLE A 6 Drive Assembly Item Part Number Description 1 F540 4287 Drive assembly 18 GB 2 F540 4367 Drive assembly 36 GB 3 F370 3990 Empty chassis backplane assembly 1 3 13564 13275 2 ...

Page 197: ...Appendix A Illustrated Parts Breakdown A 9 A 8 Cable and Interconnect Assemblies FIGURE A 8 Cables and Interconnects 13271 1 2 3 4 5 6 7 ...

Page 198: ...ription 1 F530 2842 Interconnect cable short 2 F530 2843 Interconnect cable long 3 F180 1918 Locking power cord 4 F537 1034 Fiber optic cable Sun StorEdge T3 array LC SFF to SC 5 1 1 Found in F370 4119 02 Diagnostic Cable Kit Shielded Ethernet cable category 5 6 F537 1020 Fiber optic cable Sun StorEdge T3 array 7 F370 3989 MIA adapter ...

Page 199: ...B 1 Boot Defaults Specify boot defaults with the set command When run without any parameters the set command displays the current values See the Sun StorEdge T3 and T3 Array Administrator s Guide for information on using the set command TABLE B 1 Default Settings set List Parameter Default Variables bootmode auto auto tftp none bootdelay 3 Number of seconds sn Number Serial number ip n n n n Unit ...

Page 200: ...EP revision EP writes this value logto 1 filename where 1 Forces logging to serial console Directs logging daemon to direct logging as specified in the etc syslog conf file loglevel 3 0 1 2 3 4 where 0 No logging at all 1 Error messages only 2 Warning and higher messages 3 Notice and higher messages 4 All message levels including info rarp on on off mac n n n n n n Controller MAC address Set by fi...

Page 201: ...tandby disk The volume is configured as follows vol add v0 data u1d1 9 RAID 5 vol init v0 sysarea vol init v0 data rate 16 recon_rate medium high medium low Reconstruction rate memsize 32 Set by controller read only In MBytes cache memsize 256 Set by controller read only In MBytes TABLE B 3 Volume Defaults Parameter Default Variables init rate n 16 1 16 1 is lowest 16 is highest verify rate n 1 1 ...

Page 202: ...nb113 bin Controller firmware RR Sum 23020 5000 lplc_05 01 Interconnect card FW RR Sum 63295 21 BITMAP SYS Contains a map of used and free blocks ep2_10 bin Controller EPROM flash RR Sum 3221 1023 FLIST SYS Contains the file descriptors cmdlog Log of all commands executed on the system adm Legacy directory formerly used for syslog files webgui Contains old browser based admin files etc hosts Defau...

Page 203: ...n C 2 Reset Log Types on page C 3 Section C 3 Boot Messages on page C 4 Interpreting Boot Messages on page 4 Examples of Boot Messages on page 7 C 1 Message Syntax Error message syntax consists of the following two components Section C 1 1 Message Types on page C 2 Section C 1 2 FRU Identifiers on page C 2 The following sub sections describe these components and list possible error and warning mes...

Page 204: ...r Indicates a critical system event requiring immediate user intervention or attention For example an over temperature condition or a detected FRU being removed Warning Indicates a possible event requiring eventual user intervention For example a FRU being disabled and recovery procedure executed Notice Indicates a system event that might be a side effect of other events or may be a normal conditi...

Page 205: ...x5000 Takeover 5 pSOSFail 0x6000 pSOS fatal error 6 SysFail 0x7000 System error TABLE C 4 Default System Files and Directories Files and Directories Description adm Empty directory etc hosts Default hosts with comments on format of file etc schd conf Battery Refresh File Contents BAT_CYC 7 etc syslog conf System Logging Configuration File web elemprop htm Component Manager Req d File web encmap ht...

Page 206: ...es of Boot Messages on page C 7 Section C 3 2 1 Sun StorEdge T3 Array Workgroup Configuration on page C 7 Section C 3 2 2 Sun StorEdge T3 Array Enterprise Configuration on page C 9 Section C 3 2 3 Sun StorEdge T3 Array Workgroup Configuration on page C 11 Section C 3 2 4 Sun StorEdge T3 Array Enterprise Configuration on page C 13 Section C 3 2 5 Sun StorEdge T3 Array Enterprise Configuration as se...

Page 207: ...ng FC AL Ports and Reporting Firmware Status Compare two sections of boot messages one from the master controller and one from the alternate master controller Initializing loop 1 ISP2200 firmware status 3 Detected 19 FC AL ports on loop 1 Initializing loop 2 ISP2200 firmware status 3 Detected 19 FC AL ports on loop 2 and Initializing loop 1 ISP2200 firmware status 3 Detected 20 FC AL ports on loop...

Page 208: ... be reported through a serial port console during a T3 boot cycle If the firmware status given in either of these boot messages is not 3 a drive or other component in the array could be faulty The number of devices found is important when trying to determine the failing device For example if only half of the devices are found a loop card or loop cable could be faulty The following message is gener...

Page 209: ...g Select IDs u1 1 Loop A Configured as 1 Loop B Configured as 1 Disable CT Bypass LRC Initializing System Drivers Initializing XPT Component Initializing QLCF Component Initializing loop 1 ISP2100 firmware status 3 Detected 10 FC AL ports on loop 1 Initializing loop 2 ISP2100 firmware status 3 Detected 10 FC AL ports on loop 2 Initializing SVD Services Found 9 disks in the system Found 9 disks in ...

Page 210: ... Addr Toggle Test begin Cache Mem Addr Toggle Test complete Passed 256 MBytes Cache Memory Detected Testing CPU DRAM Passed Testing ISP2100 Passed Testing Cache memory Passed Testing XOR Memory Passed Initializing system DB structure Initializing configuration Initializing port configuration Initializing loop 2 to accept SCSI commands Mounting root volume Checking local file system Initializing ne...

Page 211: ...s u1 1 u2 2 Loop A Configured as 12 Loop B Configured as 12 Disable CT Bypass LRC Initializing System Drivers Initializing XPT Component Initializing QLCF Component Initializing loop 1 ISP2100 firmware status 3 Detected 19 FC AL ports on loop 1 Initializing loop 2 ISP2100 firmware status 3 Detected 19 FC AL ports on loop 2 Initializing SVD Services Found 18 disks in the system Found 9 disks in U1 ...

Page 212: ...cache memory Cache Mem Addr Toggle Test begin Cache Mem Addr Toggle Test complete Passed 256 MBytes Cache Memory Detected Testing CPU DRAM Passed Testing ISP2100 Passed Testing Cache memory Passed Testing XOR Memory Passed Initializing system DB structure Initializing configuration Initializing port configuration Initializing loop 2 to accept SCSI commands Mounting root volume Checking local file ...

Page 213: ...e 2 00 2001 03 26 16 33 52 129 150 28 81 Copyright C 1997 2001 Sun Microsystems Inc All Rights Reserved Found units u1 ctr auto boot is enabled hit the RETURN key within 3 seconds to cancel Starting T3B Release 2 00 2001 04 02 15 21 29 129 150 28 81 Copyright C 1997 2001 Sun Microsystems Inc All Rights Reserved Initializing software Found units u1 ctr Default master is u1 Starting Heartbeats Assig...

Page 214: ...ected destructive tests OK Testing data cache memory Passed Initializing Cache Memory Initializing system DB structure Initializing configuration Initializing port configuration Initializing loop 2 to accept SCSI commands Mounting root volume Checking local file system Initializing network routes Read PGR data Done Starting Syslog Daemon System has 1 active controller s Initializing TFTP Starting ...

Page 215: ...Starting T3B Release 2 00 2001 04 02 15 21 29 129 150 28 80 Copyright C 1997 2001 Sun Microsystems Inc All Rights Reserved Initializing software Found units u1 ctr u2 ctr Default master is u1 Default alternate master is u2 Master coming up Starting Heartbeats Assigning Select IDs u1 1 u2 2 Initializing system drivers Initializing XPT component Initializing QLCF component Initializing loop 1 ISP220...

Page 216: ...izing port configuration Initializing loop 2 to accept SCSI commands Mounting root volume Checking local file system Initializing network routes Read PGR data Done Starting Syslog Daemon Waiting for 1 slave controller s to come up u1 Configuring local data u2 Initializing drives System has 1 active controller s Initializing TFTP Starting ftpd Starting telnetd Starting timed Starting pshd Starting ...

Page 217: ...key within 3 seconds to cancel Starting T3B Release 2 00 2001 04 02 15 21 29 129 150 28 80 Copyright C 1997 2001 Sun Microsystems Inc All Rights Reserved Initializing software Found units u1 ctr u2 ctr Default master is u1 Default alternate master is u2 Waiting for Master to come up Starting Heartbeats Initializing system drivers Initializing XPT component Initializing QLCF component Initializing ...

Page 218: ...esting XOR functions and datapaths Passed Cold Boot detected destructive tests OK Testing data cache memory Passed Initializing Cache Memory Initializing loop 2 to accept SCSI commands Starting Syslog Daemon Waiting for configuration data from master Initializing host port u2p1 ISP2200 firmware status 7 Host port u2p1 TARGET_ID 0xffff ALPA 0x5 Starting psh Login ...

Page 219: ...ands List To view the available command line interface CLI commands on the array type help at the prompt To display command syntax use the command name help command For example for information on the reset command type 184 help arp cat cd cmp cp date echo head help ls mkdir mv ping pwd rm rmdir tail touch boot disable disk enable fru id logger lpc more passwd port proc reset set shutdown sync sys ...

Page 220: ...in FRUs ep Program the flash EPROM fru Display the FRU information help Display reference manual pages id Display FRU identification summary logger Generate messages to the syslog in the unit dump the reset log and display system crash information lpc Get interconnect card property port Configure the interface port proc Displays status of outstanding vol processes refresh Start stop battery refres...

Page 221: ...oling unit l for interconnect card d for disk drive and the FRU number n TABLE D 2 lists the possible FRU variables as they appear in this appendix TABLE D 2 FRU Identifiers FRU Identifier Unit number Controller card uencidctr encid unit number 1 2 Power and cooling unit uencidpcu 1 2 encid unit number 1 2 n pcu number 1 2 Interconnect card uencidl 1 2 encid unit number 1 2 n interconnect card num...

Page 222: ...D 4 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 ...

Page 223: ...witch hex Setting dec AL_PA hex Switch hex Setting dec AL_PA hex Switch hex Setting dec EF 00 2 9F 2C 44 4B 58 88 E8 01 1 9E 2D 45 4A 59 89 E4 02 2 9D 2E 46 49 5A 90 E2 03 3 9B 2F 47 47 5B 91 E1 04 4 98 30 48 46 5C 92 E0 05 5 97 31 49 45 5D 93 DC 06 6 90 32 50 43 5E 94 DA 07 7 8F 33 51 3C 5F 95 D9 08 8 88 34 52 3A 60 96 D6 09 9 84 35 53 39 61 97 D5 0A 10 82 36 54 36 62 98 D4 0B 11 81 37 55 35 63 9...

Page 224: ... B9 1B 27 69 47 71 1E 73 115 B6 1C 28 67 48 72 1D 74 116 B5 1D 29 66 49 73 1B 75 117 B4 1E 30 65 4A 74 18 76 118 B3 1F 31 63 4B 75 17 77 119 B2 20 32 5C 4C 76 10 78 120 B1 21 33 5A 4D 77 0F 79 121 AE 22 34 59 4E 78 08 7A 122 AD 23 35 56 4F 79 04 7B 123 AC 24 36 55 50 80 02 7C 124 AB 25 37 54 51 81 01 7D 125 AA 26 38 53 52 82 A9 27 39 52 53 83 00 7E 126 A7 28 40 51 54 84 7F 127 A6 29 41 4E 55 85 A5...

Page 225: ... and TFTP connections from the application management and TFTP host system s The application management and TFTP host can all be resident on the same server Supervisor access is required for all hosts during troubleshooting Host types are defined as the following Application host The application host utilizes the FC AL connection as a data path to and from the Sun StorEdge T3 and T3 array Manageme...

Page 226: ...es of this blank form and complete it for each Sun StorEdge T3 and T3 array TABLE F 1 Sun StorEdge T3 and T3 array Information Worksheet Management Host Application Host TFTP Host Host ID Host name Host IP address Gateway IP address Sun StorEdge T3 IP address Sun StorEdge T3 array name TFTP host address OS patch revision level VERITAS DMP release Primary application Sun StorTools release Component...

Page 227: ...n StorEdge T3 Array Configuration Worksheets F 3 Legend Required Field Optional Field Not Applicable TABLE F 1 Sun StorEdge T3 and T3 array Information Worksheet Continued Management Host Application Host TFTP Host ...

Page 228: ...F 4 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 ...

Page 229: ...nate pathing requires special software to perform this function auto cache mode The default cache mode for the Sun StorEdge T3 array In a fully redundant configuration cache is set to write behind mode In a nonredundant configuration cache is set to write through Read caching is always performed auto disable The Sun StorEdge T3 array default that automatically disables a disk drive that has failed...

Page 230: ...without a controller card It must be connected to a Sun StorEdge T3 array to be operational erasable programmable read only memory EPROM Memory stored on the controller card useful for stable storage for long periods without electricity while still allowing reprogramming F Fibre Channel Arbitrated Loop FC AL A 100 MB sec serial channel which allows connection of multiple devices disk drives and co...

Page 231: ...output operations per second IOPS A performance measurement of the transaction rate interconnect cable An FC AL cable with a unique switched loop architecture that is used to interconnect multiple Sun StorEdge T3 arrays Sometimes referred to as a loop cable interconnect card A array component that contains the interface circuitry and two connectors for interconnecting multiple Sun StorEdge T3 arra...

Page 232: ... that enables the controller to rebuild data after a drive failure partner group A pair of interconnected controller units Expansion units interconnected to the pair of controller units can also be part of the partner group power and cooling unit A FRU component in the Sun StorEdge T3 array The unit contains a power supply cooling fans and an integrated UPS battery A Sun StorEdge T3 array contains...

Page 233: ...om access memory DRAM that can run at higher clock speeds than conventional DRAM system area Located on the disk drive label the space that contains configuration data boot firmware and file system information U uninterruptable power source UPS A component within the power and cooling unit The UPS supplies power from a battery in the case of an AC power failure unit interconnect card UIC See Inter...

Page 234: ...T3 and T3 Array Field Service Manual September 2001 W write caching Data used to build up stripes of data eliminating the read modify write overhead Write caching improves performance for applications that are writing to disk ...

Page 235: ...C 3 auto boot 2 3 B back end loop see loop problems batteries 7 6 etc schd conf file 7 9 checking 7 7 id read command 7 7 maintenance 7 8 not fully charged 7 7 refresh cycle 7 8 refresh s command 7 8 removing and replacing 7 10 service life 7 9 blocksize B 2 boot auto 2 3 commands 2 3 defaults B 1 how to 3 12 i option 2 8 mode 2 6 tftp 2 6 tftp server 2 9 boot i command 5 18 bootcode file 5 18 boo...

Page 236: ...sk pathstat command 8 7 disk tray see Sun StorEdge T3 disk tray disk tray settings 10 1 door assembly A 4 dot commands 8 1 E ep download command 4 7 EPROM 2 3 4 6 error message type C 2 Error severity level 1 3 error code 0X2202 5 15 error messages see messages Exception reset log type C 3 F fail over determining 3 14 FAIL_POLICY 8 8 failed FRU status 8 1 FC AL loop identifiers E 1 FC AL loop prob...

Page 237: ...oblems 8 1 baseline data 8 12 Component Manager indicators 8 13 diagnosis 8 2 8 10 error messages 8 14 indicators 8 10 normal status 8 2 Product Watch messages 8 13 repair procedures 8 2 8 21 syslog file 8 13 lpc command 6 5 LUNs 1 1 M mac B 2 MAC addresses location 3 20 9 3 9 6 memsize B 3 messages syntax 1 3 C 1 types C 2 midplane 9 1 etc ethers file 9 7 etc hosts 9 7 etc nsswitch conf 9 7 disk ...

Page 238: ...n 3 20 9 3 9 6 set bootmode command 5 17 5 18 set command B 1 set tftpfile command 5 16 set tftphost command 5 16 setting the IP address 10 8 shell prompts xxviii shutdown command 9 2 Simple Network Management Protocol 2 10 sn B 1 SNMP 2 10 static electricity 1 5 status codes 5 2 StorTools 1 4 Sun Documentation Online xxx Sun StorEdge T3 disk tray boot defaults B 1 cable assemblies A 9 commands 2 ...

Page 239: ... B 3 verify volume fails on u1d1 5 15 verifying firmware level 3 17 vol command adding a volume 10 13 checking data parity 5 4 initializing volumes 10 14 mounting volume 10 14 rebuilding a replaced FRU 5 11 verify subcommand 5 4 vol disable command 8 27 vol list command 5 3 vol mode command 8 6 vol mount command 5 15 vol recon command 5 11 8 28 vol stat command 5 2 vol unmount command 5 14 vol ver...

Page 240: ...Index 12 Sun StorEdge T3 and T3 Array Field Service Manual September 2001 ...

Search results

Summary of Contents for StorEdge T3+

Reviews:

Related manuals for StorEdge T3+

Brands by name

Popular brands

Sun Microsystems StorEdge T3+, Service Manual

Search results

Summary of Contents for StorEdge T3+

Reviews:

Related manuals for StorEdge T3+

Brands by name

Popular brands