H3C S12500G-AF Series Troubleshooting Manual Download Page 2

Page: 2 / 86

Contents

Introduction ···································································································· 1

General guidelines ············································································································································· 1

Collecting log and operating information ············································································································ 1

Collecting common log messages ············································································································· 2

Collecting diagnostic log messages ··········································································································· 4

Collecting operating statistics····················································································································· 5

Contacting technical support ······························································································································ 9

Removing deployment errors ······································································· 10

Dealing with password loss ·········································································· 16

Dealing with console login password loss ········································································································ 16

Telnetting to the device to change the console login password ······························································· 16

Using BootWare menus to change the console login password ······························································ 17

Dealing with Telnet password loss ··················································································································· 21

Troubleshooting configuration loss ······························································ 23

Startup configuration file failure························································································································ 23

Symptom ·················································································································································· 23

Solution ···················································································································································· 23

Related commands ·········································································································································· 24

Troubleshooting hardware ··········································································· 25

MPU reboot failure ··········································································································································· 25

Troubleshooting flowchart ························································································································ 25

Newly installed standby MPU boot failure ········································································································ 26

Troubleshooting flowchart ························································································································ 26

Service module reboot failure ·························································································································· 27

Troubleshooting flowchart ························································································································ 27

Newly installed service module boot failure ····································································································· 28

Troubleshooting flowchart ························································································································ 29

Operating power module failure ······················································································································· 30

Troubleshooting flowchart ························································································································ 31

Newly installed power module failure ··············································································································· 33

Troubleshooting flowchart ························································································································ 33

Fan tray failure ················································································································································· 34

Troubleshooting flowchart ························································································································ 35

Troubleshooting system management ························································· 37

High CPU usage on a module·························································································································· 37

Troubleshooting flowchart ························································································································ 37

Summary of Contents for S12500G-AF Series

Page 1: ...ved No part of this manual may be reproduced or transmitted in any form or by any means without prior written consent of New H3C Technologies Co Ltd Except for the trademarks of New H3C Technologies C...

Page 2: ...on 23 Related commands 24 Troubleshooting hardware 25 MPU reboot failure 25 Symptom 25 Troubleshooting flowchart 25 Solution 25 Newly installed standby MPU boot failure 26 Symptom 26 Troubleshooting f...

Page 3: ...Symptom 49 Troubleshooting flowchart 50 Solution 50 Failure to support digital diagnosis on a transceiver module 50 Symptom 50 Troubleshooting flowchart 51 Solution 51 Error frames for example CRC err...

Page 4: ...owchart 70 Solution 71 Related commands 71 Troubleshooting MDC 72 Service module assignment failure 72 Symptom 72 Troubleshooting flowchart 72 Solution 72 Interface assignment failure 74 Symptom 74 Tr...

Page 5: ...ed during the troubleshooting process To ensure safety wear an ESD wrist strap when you replace or maintain a hardware component If hardware replacement is required use the release notes to verify the...

Page 6: ...y of the flash memory on the active MPU in standalone mode or global active MPU in IRF mode Save log messages to the log file on the default MDC Admin Sysname logfile save The contents in the log file...

Page 7: ...ot1 flash logfile Directory of slot1 flash logfile 0 rw 21863 Apr 27 2020 16 00 37 logfile1 log 3710740 KB total 3002308 KB free In IRF mode display the log file on each standby MPU Sysname dir chassi...

Page 8: ...DC Sysname system view Sysname switchto mdc mdc2 Copyright c 2004 2020 New H3C Technologies Co Ltd All rights reserved Without the owner s prior written consent no decompiling or reverse engineering s...

Page 9: ...ame dir flash mdc Directory of flash mdc 0 drw Apr 27 2020 14 56 50 mdc2 1 drw Apr 27 2020 16 48 04 mdc3 Sysname dir flash diagfile Directory of flash diagfile 0 rw 349 Apr 27 2020 16 21 38 diagfile1...

Page 10: ...r gz Diagnostic information is outputting to flash diag_H3C_20200523 151204 tar gz Please wait Save successfully Sysname dir flash Directory of flash 9 rw 236011 May 23 2020 14 56 45 diag_H3C_20200523...

Page 11: ...07 Extended BootWare Version 302 CPLD 1 Version 002 CPLD 2 Version 002 CPLD 3 Version 002 CPLD 4 Version 002 PowChip Version NONE PLL Version None Release Version H3C S12516G AF 7595 Patch Version Non...

Page 12: ...ion 007 PowChip Version NONE PLL Version None PCIE 1 Version 001 PCIE 2 Version 001 PCIE 3 Version 001 PCIE 4 Version 001 Release Version H3C S12516G AF 7595 Patch Version None Reboot Cause UserReboot...

Page 13: ...t H3C Support When you contact an authorized H3C support representative be prepared to provide the following information Information described in General guidelines Product serial numbers This informa...

Page 14: ...supplies to provide power redundancy The power supplies are operating correctly The display power command shows that their state is Normal Are the LEDs all displaying correct statuses Visually check t...

Page 15: ...operating in half duplex mode display interface brief OK Not OK Not related If there is a port operating in half duplex mode identify whether the two ends are consistent in configuration Is flow contr...

Page 16: ...trunk ports between two devices are assigned to the same VLANs For example if you assign a trunk port to all VLANs also assign its peer port to all VLANs Are the peer ports set to the same link type...

Page 17: ...play stp tc display stp history OK Not OK Not related Examine the following items in the command output for TC attacks Incoming and outgoing TC TCN BPDU statistics Historical port role calculation inf...

Page 18: ...rred and the number continues to increase collect the error information for further analysis Are there severe route flappings display ip routing table statistics OK Not OK Not related Examine the stat...

Page 19: ...for network route errors CPU security Are there packet attacks on the CPU debug rxtx softcar show OK Not OK Not related Execute the debug rxtx softcar show command in probe view to view packet rate li...

Page 20: ...termine the user line you are using Sysname display users Idx Line Idle Time Pid Type 1 AUX 1 1 00 00 36 Jun 14 16 35 09 543 16 VTY 0 00 00 00 Jun 14 17 02 03 566 TEL Following are more details VTY 0...

Page 21: ...change the console login password depends on whether password recovery capability is enabled If password recovery capability is enabled you can use the Skip Authentication for Console Login option to...

Page 22: ...Ver A BootWare Validating Press Ctrl B to access EXTENDED BOOTWARE MENU 3 Press Ctrl B within 3 seconds after the Press Ctrl B to access EXTENDED BOOTWARE MENU prompt message appears The extended Boot...

Page 23: ...s Ctrl V to start heavy memory test 6 After the device starts up configure a new console login password You can also configure a different login authentication mode Sysname system view Sysname line au...

Page 24: ...D Version 2 0 PCB Version1 Ver A PCB Version2 Ver A BootWare Validating Press Ctrl B to access EXTENDED BOOTWARE MENU 3 Press Ctrl B within 3 seconds after the Press Ctrl B to access EXTENDED BOOTWARE...

Page 25: ...reboot with the factory defaults Enter your choice 0 8 0 System is Starting Press Ctrl D Into xmodem mode Press Ctrl T to start memory test Booting Normal Extend Bootware Press Ctrl V to start heavy m...

Page 26: ...authentication password simple abc123 Sysname line vty0 63 return 3 Save the running configuration to enable the configuration to survive a reboot Sysname save The current configuration will be writte...

Page 27: ...all MPUs use the same type of storage medium as the default storage medium In this section the flash memory is used on each MPU If a partitioned USB disk is used make sure the configuration file is tr...

Page 28: ...on file uses the same name as the corrupt main startup configuration file Sysname startup saved configuration config cfg 3 Reboot the device 4 If the issue persists contact H3C Support Related command...

Page 29: ...Troubleshooting ports MPU reboot failure Symptom An MPU fails to reboot Troubleshooting flowchart Figure 1 Troubleshooting MPU reboot failure Solution To resolve the issue 1 Verify that the system sof...

Page 30: ...running correctly Reboot the MPU and immediately press CTRL T to examine the memory If a memory fault is detected replace the MPU 3 Verify that no error is reported during the BootWare loading process...

Page 31: ...ot Troubleshooting flowchart Figure 3 Troubleshooting service module reboot failure Solution To resolve the issue 1 Verify that the system software image is available and that the image is the same si...

Page 32: ...tartup mdb 10 drw Apr 22 2020 11 11 54 versionInfo 3710740 KB total 2882156 KB free 2 Install another service module into the slot If the new service module boots successfully no failure occurs on the...

Page 33: ...flash S12500G CMW710 SYSTEM E7595 bin Main startup software images flash S12500G CMW710 BOOT E7595 bin flash S12500G CMW710 SYSTEM E7595 bin Backup startup software images None Sysname dir Directory o...

Page 34: ...service module in another slot make sure the connectors of the service module are not damaged Before installing another service module in the slot make sure the connectors of the slot are not damaged...

Page 35: ...Power W FanDirection 1 Absent 2 Absent 3 Absent 4 Absent 5 Absent 6 Absent 7 Absent 8 Absent 9 Absent 10 Absent 11 Normal AC 24 5 54 9 1345 5 12 Absent 13 Absent 14 Absent 15 Absent 16 Absent The powe...

Page 36: ...replace the power module 3 Verify that the power module is operating correctly a Verify that the power cord is connected to the power module securely H3C display power Input Power 2364 0 W PowerID Sta...

Page 37: ...te of the power module H3C display power Input Power 2364 0 W PowerID State Mode Current A Voltage V Power W FanDirection 1 Absent 2 Absent 3 Absent 4 Absent 5 Absent 6 Absent 7 Absent 8 Absent 9 Abse...

Page 38: ...le is installed securely Then execute the display power command to verify that the power module has changed to Normal state b Remove and install the power module into an empty power module slot Then e...

Page 39: ...your hand at the air outlet to feel if air is being expelled out of the air outlet If no air is being expelled out of the air outlet the fan tray is faulty Execute the debug sysm fan fan id get speed...

Page 40: ...ctories display alarm Displays alarm information display boot loader Displays current configuration files and system software images display environment Displays temperature information display fan Di...

Page 41: ...at has a high CPU usage For example H3C probe display process cpu slot 1 CPU utilization in 5 secs 2 4 1 min 2 5 5 mins 2 4 JID 5Sec 1Min 5Min Name 1 0 0 0 0 0 0 scmd 2 0 0 0 0 0 0 kthreadd 3 0 0 0 0...

Page 42: ...fff8045f418 schedule_timeout 0x98 0xe0 ffffffff8030d084 ep_poll 0x4b4 0x5e0 ffffffffc01e7640 drv_mac_async_ipc_process 0x70 0x100 system ffffffffc3f4d344 thread_boot 0x84 0xa0 system ffffffff80260730...

Page 43: ...Collect the information displayed in the previous steps and operating statistics to contact H3C Support High memory usage on a module Symptom The memory usage on a module is over 60 for more than 30...

Page 44: ...0 21 1 0 0 IPFS_CacheHash_cachep More Each value line shows the memory information for a slab The Number field shows the number of objects memory blocks allocated to the module The Active field shows...

Page 45: ..._MAP_AddRec 0x160 0x2a0 system age 4264142 4264175 4264209 pid 288 cpus 9 1 drv_evi_localmac_init 0x160 0x650 system age 4651896 pid 128 cpus 0 1 DRV_QINQ_Init 0x278 0x890 system age 4650270 pid 128 c...

Page 46: ...e 3 Check whether the air filters are clean If they are not clean them 4 Use the temperature limit command to adjust the temperature alarm thresholds for the module 5 Use the display environment comma...

Page 47: ...ry usage statistics display process cpu Displays the CPU usage statistics for jobs This command is available in probe view display system internal kernel memory pool Displays memory block usage statis...

Page 48: ...44 Troubleshooting ports This section provides troubleshooting information for common port problems 10 Gigabit SFP fiber port fails to come up Symptom A 10 Gigabit SFP fiber port cannot come up...

Page 49: ...match use the speed command and the duplex command to set the speed and duplex mode for the port No Yes No Yes No Yes Yes No No Yes Yes No No Yes Yes No No Yes Yes No A 10 GE SFP fiber port fails to...

Page 50: ...he display transceiver alarm interface command to examine the alarms present on the transceiver module The device displays None if no error occurs The device displays alarms if the transceiver module...

Page 51: ...transceiver module The device displays None if no error occurs The device displays alarms if the transceiver module fails or the type of the transceiver module does not match the port type b Use an op...

Page 52: ...shooting flowchart Figure 13 Troubleshooting link up failure on a port Solution To resolve the issue 1 Verify that the local and peer ports are operating correctly Use a QSFP28 cable to connect the lo...

Page 53: ...stance as the peer transceiver module d If the transceiver module or cable is not operating correctly replace it with a new H3C transceiver module or cable that matches the fiber port For more informa...

Page 54: ...information Send the bar code of the transceiver module to H3C Support to identify the vendor of the transceiver module b If you determine that the transceiver module vendor is not H3C replace it with...

Page 55: ...er module supports digital diagnosis a Use the display transceiver interface command to display transceiver module information b Determine whether the value of the Digital Diagnostic Monitoring field...

Page 56: ...digital diagnosis parameters for the transceiver module b If the optical power of the transceiver module is not within the correct range replace the transceiver module with a transceiver module of th...

Page 57: ...se the speed command and the duplex command to set the speed and duplex mode for the port 4 Verify that the port and the link medium are operating correctly a Plug the link medium into another port th...

Page 58: ...command resets the values of each statistical field to 0 so that you can view the statistics changes more clearly b Determine whether the ports at both ends are always up and use the display interface...

Page 59: ...disable STP on the port if it is directly connected to a terminal f If the port is assigned to an aggregation group use the display link aggregation summary command to verify that the status of the po...

Page 60: ...g a Use the display interface brief command to verify that the port configurations are correct The port configurations include the duplex mode speed port type and VLAN configurations of the ports at b...

Page 61: ...smission medium including network cables optical fibers and transceiver modules c Examine the port If the port is a copper port directly connect the port to a PC If the port is a fiber port replace th...

Page 62: ...58 Troubleshooting IRF This section provides troubleshooting information for common IRF issues IRF fabric setup failure Symptom A chassis cannot be added to an IRF fabric...

Page 63: ...gs same across member devices IRF setup failure Resolved Resolved Resolved Resolved No No No No Yes Yes Yes Same chassis model Replace with a chassis that is the same model as existing IRF member chas...

Page 64: ...l other member ID requirements if any For information about the member ID requirements see IRF configuration in H3C S12500G AF Switch Series Virtual Technologies Configuration Guide for the software v...

Page 65: ...me settings as other IRF member chassis for features that require configuration consistency across the IRF fabric For example all member chassis must have the same settings for the ecmp mode enhanced...

Page 66: ...events e Execute the display version command to identify the uptime of MPUs and interface modules that have IRF links f Compare the uptime of MPUs and interface modules to determine whether a member c...

Page 67: ...Correct the connections No Yes No Yes BFD MAD VLAN unique in a multi IRF fabrics network No No Yes Yes BFD MAD ports always up No No Yes Yes No No Yes Yes All BFD MAD ports up No No Yes Yes BFD MAD IP...

Page 68: ...4 Verify that the BFD MAD VLAN and physical ports in the VLAN are configured correctly a Execute the display vlan command to verify the following items The BFD VLAN contains all physical ports used fo...

Page 69: ...e the device or use BFD MAD for detection Intermediate device supports extended LACPDUs for MAD Resolved Each member has a link to the intermediate device Correct the connections Resolved Dynamic aggr...

Page 70: ...rify that the IRF domain IDs of the two IRF fabrics are unique CAUTION he IRF member devices send extended LACPDUs with TLVs that convey the domain ID and the active ID of the IRF fabric To avoid spli...

Page 71: ...configuration display transceiver diagnosis Displays the present measured values of the digital diagnosis parameters for transceiver modules display trapbuffer Displays trap buffer information and bu...

Page 72: ...n To resolve the issue 1 Delete the unsupported rule and apply the packet filter or QoS policy again If the rule is indispensable and cannot be deleted go to step 2 2 If the issue persists collect dev...

Page 73: ...insufficient If the ACLs are to be applied globally check remaining resource usage on all cards Sysname display qos acl resource Interfaces XGE2 1 0 1 to XGE2 1 0 21 XGE2 1 0 22 XGE2 1 0 23 to XGE2 1...

Page 74: ...he reason might be that the ACL conflicts with a specific algorithm in the ASIC chip In this case go to step 4 3 Apply the packet filter or QoS policy again 4 If the issue persists collect device info...

Page 75: ...rity as shown in Table 3 Table 3 Rules for selecting a higher priority behavior from conflicting behaviors Conflicting behaviors Higher priority behavior redirect filter permit redirect redirect filte...

Page 76: ...module can belong to only one MDC Before you assign a service module to a non default MDC you must remove the existing assignment of the service module To resolve the issue 1 Display the CPU disk spac...

Page 77: ...rom the default MDC Sysname mdc Admin Sysname mdc 1 Admin undo location chassis 1 slot 3 The configuration associated with the specified slot of MDC will be lost Continue Y N y 4 Verify that the servi...

Page 78: ...to an MDC assign all interfaces on the service module to the MDC by using a single allocate command To reclaim a service module from the default MDC only the undo location command is required You do...

Page 79: ...3 0 32 Ten GigabitEthernet1 3 0 33 Ten GigabitEthernet1 3 0 34 Ten GigabitEthernet1 3 0 35 Ten GigabitEthernet1 3 0 36 Ten GigabitEthernet1 3 0 37 Ten GigabitEthernet1 3 0 38 Ten GigabitEthernet1 3 0...

Page 80: ...Ethernet1 3 0 6 Ten GigabitEthernet1 3 0 7 Ten GigabitEthernet1 3 0 8 Ten GigabitEthernet1 3 0 9 Ten GigabitEthernet1 3 0 10 Ten GigabitEthernet1 3 0 11 Ten GigabitEthernet1 3 0 12 Ten GigabitEthernet...

Page 81: ...lists the commands that you might use for troubleshooting MDC Command Description allocate interface Assigns physical interfaces to an MDC display diagnostic information Displays operating statistics...

Page 82: ...erify that the DR member devices use the same DR system MAC address a Execute the display drni system command to identify the DR system MAC addresses of the DR member devices DR system setup failure D...

Page 83: ...IPP information b If an IPP is not configured use the intra portal port command to configure an available aggregate interface as the IPP 5 Verify that the IPP is up a Execute the display interface com...

Page 84: ...physical member ports for a reboot event a Execute the display version command to identify the uptime of the card b If the card has rebooted resolve the issue as described in Service module reboot fa...

Page 85: ...erbose command to identify the state of the DR system b If the DR system has split resolve the issue as described in DR system split 3 Verify that the DR member devices have configuration consistency...

Page 86: ...ni consistency Displays information about the configuration consistency check done by DRNI display drni system Displays the DR system settings display drni verbose Displays detailed information about...

Search results

Summary of Contents for S12500G-AF Series

Reviews:

Related manuals for S12500G-AF Series

Brands by name

Popular brands

H3C S12500G-AF Series, Troubleshooting Manual

Search results

Summary of Contents for S12500G-AF Series

Reviews:

Related manuals for S12500G-AF Series

Brands by name

Popular brands