Troubleshooting Guide
Page 3
... 1-14 Troubleshooting FCoE Issues 2-1 Data Center Bridging 2-1 FIP 2-7 CNA 2-9 PFC 2-11 Registers and Counters 2-15 Troubleshooting Layer 2 Switching Issues 3-1 MAC Address Table 3-1 Spanning Tree Protocol 3-3 Multicast 3-5 VLANs 3-6 Registers and Counters 3-10 Troubleshooting QoS Issues 4-1 Policy Maps...PFC 4-8 Registers and Counters 4-10 Troubleshooting SAN Switching Issues 5-1 Overview 5-1 NPV 5-2 Zoning 5-7 SAN Port Channels 5-13 FC Services 5-16 Cisco Fabric Services 5-31 VSANs 5-40 Registers and Counters 5-48 Cisco Nexus 5000 Series Troubleshooting Guide iii Send document comments to...
... 1-14 Troubleshooting FCoE Issues 2-1 Data Center Bridging 2-1 FIP 2-7 CNA 2-9 PFC 2-11 Registers and Counters 2-15 Troubleshooting Layer 2 Switching Issues 3-1 MAC Address Table 3-1 Spanning Tree Protocol 3-3 Multicast 3-5 VLANs 3-6 Registers and Counters 3-10 Troubleshooting QoS Issues 4-1 Policy Maps...PFC 4-8 Registers and Counters 4-10 Troubleshooting SAN Switching Issues 5-1 Overview 5-1 NPV 5-2 Zoning 5-7 SAN Port Channels 5-13 FC Services 5-16 Cisco Fabric Services 5-31 VSANs 5-40 Registers and Counters 5-48 Cisco Nexus 5000 Series Troubleshooting Guide iii Send document comments to...
Troubleshooting Guide
Page 4
Contents Send document comments to nexus5k-docfeedback@cisco.com. Troubleshooting Security Issues 6-1 Roles 6-1 AAA 6-4 Troubleshooting System Management Issues 7-1 SNMP 7-1 Logging 7-3 Traps 7-4 DNS 7-4 Troubleshooting Virtual Port Channel Issues 8-1 Improper Configurations 8-1 Troubleshooting Config-Sync Issues 9-1 Commit Failure 9-1 Import Failure 9-3 Merge Failure 9-5 Switch-profile Deletion Failure 9-6 Verify Failure 9-8 Cisco Nexus 5000 Series Troubleshooting Guide iv OL-25300-01
Contents Send document comments to nexus5k-docfeedback@cisco.com. Troubleshooting Security Issues 6-1 Roles 6-1 AAA 6-4 Troubleshooting System Management Issues 7-1 SNMP 7-1 Logging 7-3 Traps 7-4 DNS 7-4 Troubleshooting Virtual Port Channel Issues 8-1 Improper Configurations 8-1 Troubleshooting Config-Sync Issues 9-1 Commit Failure 9-1 Import Failure 9-3 Merge Failure 9-5 Switch-profile Deletion Failure 9-6 Verify Failure 9-8 Cisco Nexus 5000 Series Troubleshooting Guide iv OL-25300-01
Troubleshooting Guide
Page 5
... how to identify and resolve problems that can occur with Layer 2 switching in the Cisco Nexus 5000 Series switch. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide v Organization This reference is for problems that can occur with FCoE in the Cisco Nexus 5000 Series switch. Troubleshooting Layer 2 Switching Issues Describes how to identify and resolve problems that may occur...
... how to identify and resolve problems that can occur with Layer 2 switching in the Cisco Nexus 5000 Series switch. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide v Organization This reference is for problems that can occur with FCoE in the Cisco Nexus 5000 Series switch. Troubleshooting Layer 2 Switching Issues Describes how to identify and resolve problems that may occur...
Troubleshooting Guide
Page 6
... vertical bars. Optional alternative keywords are in angle brackets. [ ] Default responses to material not covered in the manual. Cisco Nexus 5000 Series Troubleshooting Guide vi OL-25300-01 This document uses the following information will include the quotation marks. Do not ...System Management Issues Description Describes how to identify and resolve problems that can occur with system management and the Cisco Nexus 5000 Series switch. Tip Means the following conventions: Note Means reader take note. Describes how to identify and resolve problems that...
... vertical bars. Optional alternative keywords are in angle brackets. [ ] Default responses to material not covered in the manual. Cisco Nexus 5000 Series Troubleshooting Guide vi OL-25300-01 This document uses the following information will include the quotation marks. Do not ...System Management Issues Description Describes how to identify and resolve problems that can occur with system management and the Cisco Nexus 5000 Series switch. Tip Means the following conventions: Note Means reader take note. Describes how to identify and resolve problems that...
Troubleshooting Guide
Page 7
... following are related Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender documents: Release Notes Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Release Notes Cisco Nexus 5000 Series Switch Release Notes Configuration Guides Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 5.0(2)N1(1) Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 4.2(1)N1(1) and Release 4.2(1)N2(1) Cisco Nexus 5000 Series NX...
... following are related Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender documents: Release Notes Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Release Notes Cisco Nexus 5000 Series Switch Release Notes Configuration Guides Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 5.0(2)N1(1) Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 4.2(1)N1(1) and Release 4.2(1)N2(1) Cisco Nexus 5000 Series NX...
Troubleshooting Guide
Page 8
Preface Regulatory Compliance and Safety Information for the Cisco Nexus 5000 Series Switches and Cisco Nexus 2000 Series Fabric Extenders Licensing Guide Cisco NX-OS Licensing Guide Command References Cisco Nexus 5000 Series Command Reference Technical References Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender MIBs Reference Error and System Messages Cisco NX-OS System Messages Reference Troubleshooting Guide Cisco Nexus 5000 Troubleshooting Guide Cisco Nexus 5000 Series Troubleshooting Guide viii OL-25300-01
Preface Regulatory Compliance and Safety Information for the Cisco Nexus 5000 Series Switches and Cisco Nexus 2000 Series Fabric Extenders Licensing Guide Cisco NX-OS Licensing Guide Command References Cisco Nexus 5000 Series Command Reference Technical References Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender MIBs Reference Error and System Messages Cisco NX-OS System Messages Reference Troubleshooting Guide Cisco Nexus 5000 Troubleshooting Guide Cisco Nexus 5000 Series Troubleshooting Guide viii OL-25300-01
Troubleshooting Guide
Page 9
...specific symptoms. Identify all potential problems that may occur when configuring and using the Cisco Nexus 5000 Series switch. To identify the possible problems, you determine the cause of the switch. switch# show system reset-reason commands to display the reason for the crash. Send... document comments to nexus5k-docfeedback@cisco.com. 1 C H A P T E R Troubleshooting Overview This chapter introduces the basic concepts, methodology, ...
...specific symptoms. Identify all potential problems that may occur when configuring and using the Cisco Nexus 5000 Series switch. To identify the possible problems, you determine the cause of the switch. switch# show system reset-reason commands to display the reason for the crash. Send... document comments to nexus5k-docfeedback@cisco.com. 1 C H A P T E R Troubleshooting Overview This chapter introduces the basic concepts, methodology, ...
Troubleshooting Guide
Page 10
...Troubleshooting Basics Chapter 1 Troubleshooting Overview Send document comments to display the processes and if a core was recorded. Cisco Nexus 5000 Series Troubleshooting Guide 1-2 OL-25300-01 switch#show logging command, review the events that crashed. (Usually the module number is down (Error disabled. You ...2010 Nov 6 08:00:51 TTPSW-5020SF1 %$ VDC-1 %$ %ETHPORT-2-IF_DOWN_ERROR_DISABLED: Interface Ethernet103/1/1 is 1 for a Nexus 5000 switch.) switch#show cores command to obtain an analysis of the file. • Obtain the timestamp of the crash with BPDU Guard enabled.
...Troubleshooting Basics Chapter 1 Troubleshooting Overview Send document comments to display the processes and if a core was recorded. Cisco Nexus 5000 Series Troubleshooting Guide 1-2 OL-25300-01 switch#show logging command, review the events that crashed. (Usually the module number is down (Error disabled. You ...2010 Nov 6 08:00:51 TTPSW-5020SF1 %$ VDC-1 %$ %ETHPORT-2-IF_DOWN_ERROR_DISABLED: Interface Ethernet103/1/1 is 1 for a Nexus 5000 switch.) switch#show cores command to obtain an analysis of the file. • Obtain the timestamp of the crash with BPDU Guard enabled.
Troubleshooting Guide
Page 11
... Troubleshooting Guide 1-3 Best Practices Best practices are the recommended steps you should take to ensure the proper operation of your switch. • Maintain a consistent Cisco NX-OS release across all your Cisco Nexus 5000 switches. • Refer to the release notes for your configuration and detect possible problems before they become critical. Chapter 1 Troubleshooting Overview...
... Troubleshooting Guide 1-3 Best Practices Best practices are the recommended steps you should take to ensure the proper operation of your switch. • Maintain a consistent Cisco NX-OS release across all your Cisco Nexus 5000 switches. • Refer to the release notes for your configuration and detect possible problems before they become critical. Chapter 1 Troubleshooting Overview...
Troubleshooting Guide
Page 12
...lines that match include Include lines that chapter. NX-OS Tips Displaying what you can display required data from the configuration switch# show logging | egrep Egrep grep Grep head Stream Editor last Display last lines less Stream Editor no need to back... out to troubleshoot your specific problem. The following chapters in that match Cisco Nexus 5000 Series Troubleshooting Guide 1-4 OL-25300-01 switch(config)# show run switch(config)# show interface brief Pipe command switch# show running-config interface version 4.0(1a)N2(1) interface vfc29 no shutdown bind...
...lines that match include Include lines that chapter. NX-OS Tips Displaying what you can display required data from the configuration switch# show logging | egrep Egrep grep Grep head Stream Editor last Display last lines less Stream Editor no need to back... out to troubleshoot your specific problem. The following chapters in that match Cisco Nexus 5000 Series Troubleshooting Guide 1-4 OL-25300-01 switch(config)# show run switch(config)# show interface brief Pipe command switch# show running-config interface version 4.0(1a)N2(1) interface vfc29 no shutdown bind...
Troubleshooting Guide
Page 13
...NX-OS allows you to redirect outputs to files and flash areas in the switch. Using the pipe command to only display required keyword switch# show tech-support details command to nexus5k-docfeedback@cisco.com. bootflash: core: debug: ftp: licenses log: modflash: nvram: ...mode fex-fabric switchport mode fex-fabric switchport speed 1000 switchport mode SD no system default switchport shutdown Copy command switch# copy ? OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-5 Chapter 1 Troubleshooting Overview Fabric Manager Tools and CLI Commands Send document comments to ...
...NX-OS allows you to redirect outputs to files and flash areas in the switch. Using the pipe command to only display required keyword switch# show tech-support details command to nexus5k-docfeedback@cisco.com. bootflash: core: debug: ftp: licenses log: modflash: nvram: ...mode fex-fabric switchport mode fex-fabric switchport speed 1000 switchport mode SD no system default switchport shutdown Copy command switch# copy ? OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-5 Chapter 1 Troubleshooting Overview Fabric Manager Tools and CLI Commands Send document comments to ...
Troubleshooting Guide
Page 14
... when comparing strings -x Print only lines where the match is a whole line WORD Search for the expression switch# show cli list | include debug | include interface Narrowing scope of a keyword. switch(config-if)# show logging Cisco Nexus 5000 Series Troubleshooting Guide 1-6 OL-25300-01 In the following examples, the logging command and the Device Manager...
... when comparing strings -x Print only lines where the match is a whole line WORD Search for the expression switch# show cli list | include debug | include interface Narrowing scope of a keyword. switch(config-if)# show logging Cisco Nexus 5000 Series Troubleshooting Guide 1-6 OL-25300-01 In the following examples, the logging command and the Device Manager...
Troubleshooting Guide
Page 15
... logflash: disabled Logging logfile: enabled Name - SPAN is a command-line version of Wireshark that are transient to the switch are destined to, or originate from, the Nexus 5000 control plane. This tool is a feature whereby frames that captures and decodes packets. You can be seen via ...this tool. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-7 Ethanalyzer Ethanalyzer is a tool that collects frames that are copied to node traffic can be seen with this...
... logflash: disabled Logging logfile: enabled Name - SPAN is a command-line version of Wireshark that are transient to the switch are destined to, or originate from, the Nexus 5000 control plane. This tool is a feature whereby frames that captures and decodes packets. You can be seen via ...this tool. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-7 Ethanalyzer Ethanalyzer is a tool that collects frames that are copied to node traffic can be seen with this...
Troubleshooting Guide
Page 16
... 32768/00:04:c1:0f:6e:c0 Cost = 57 Port = 0x801d [snip] The following example is a well-known name for switch domain controller. ethanalyzer local sniff-interface brief Captures packets sent or received by the supervisor and provides detailed protocol information. ethanalyzer local sniff-...STP Conf. Root = 32769/00:0d:ec:6b:cd:41 Cost = 0 Port = 0x8093 [snip] Cisco Nexus 5000 Series Troubleshooting Guide 1-8 OL-25300-01 The FCID is for Cisco NX-OS. Command Description ethanalyzer local sniff-interface Captures packets sent or received by the supervisor and provides a...
... 32768/00:04:c1:0f:6e:c0 Cost = 57 Port = 0x801d [snip] The following example is a well-known name for switch domain controller. ethanalyzer local sniff-interface brief Captures packets sent or received by the supervisor and provides detailed protocol information. ethanalyzer local sniff-...STP Conf. Root = 32769/00:0d:ec:6b:cd:41 Cost = 0 Port = 0x8093 [snip] Cisco Nexus 5000 Series Troubleshooting Guide 1-8 OL-25300-01 The FCID is for Cisco NX-OS. Command Description ethanalyzer local sniff-interface Captures packets sent or received by the supervisor and provides a...
Troubleshooting Guide
Page 17
With VLANs or VSANs, all supported interfaces in a SPAN session. The Cisco Nexus 5000 Series switch supports Ethernet, virtual Ethernet, Fibre Channel, virtual Fibre Channel, port channels, SAN port channels, VLANs, and VSANs as SPAN sources. SPAN ... delta from previous captured frame: 1218591692.631969000 seconds] [Time delta from which traffic can be a Cisco SwitchProbe, a Fibre Channel Analyzer, or other Remote Monitoring (RMON) probes. Note For the Cisco Nexus 5548 Switch, Fibre Channel ports cannot be configured as ingress source ports in the specified VLAN or VSAN are included...
With VLANs or VSANs, all supported interfaces in a SPAN session. The Cisco Nexus 5000 Series switch supports Ethernet, virtual Ethernet, Fibre Channel, virtual Fibre Channel, port channels, SAN port channels, VLANs, and VSANs as SPAN sources. SPAN ... delta from previous captured frame: 1218591692.631969000 seconds] [Time delta from which traffic can be a Cisco SwitchProbe, a Fibre Channel Analyzer, or other Remote Monitoring (RMON) probes. Note For the Cisco Nexus 5548 Switch, Fibre Channel ports cannot be configured as ingress source ports in the specified VLAN or VSAN are included...
Troubleshooting Guide
Page 18
...VLAN or VSAN SPAN sources, all physical ports in the source VLAN or VSAN are included as source ports. • The Cisco Nexus 5010 switch supports a maximum of traffic from the source ports, VLANs, or VSANs. Port channel and SAN port channel interfaces can be configured...ports in the group. Fabric Manager Tools and CLI Commands Chapter 1 Troubleshooting Overview Send document comments to the Cisco Nexus 5020 Switch and the Cisco Nexus 5548 switch. The switch supports any number of Destination Ports Each local SPAN session must have a destination port (also called a monitored...
...VLAN or VSAN SPAN sources, all physical ports in the source VLAN or VSAN are included as source ports. • The Cisco Nexus 5010 switch supports a maximum of traffic from the source ports, VLANs, or VSANs. Port channel and SAN port channel interfaces can be configured...ports in the group. Fabric Manager Tools and CLI Commands Chapter 1 Troubleshooting Overview Send document comments to the Cisco Nexus 5020 Switch and the Cisco Nexus 5548 switch. The switch supports any number of Destination Ports Each local SPAN session must have a destination port (also called a monitored...
Troubleshooting Guide
Page 19
...the SPAN session is active. • Is excluded from the source list and is up DESCRIPTION OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-11 If a destination port is configured as egress source • VLAN or port ...switch(config)# interface fc3/2 switch(config-if)# switchport mode sd switch(config-if)# switchport speed 1000 switch(config-if)# no shut switch(config-if)# exit switch(config)# monitor session 1 switch(config-monitor)# source interface fc3/1 tx switch(config-monitor)# source interface fc3/1 rx switch(config-monitor)# destination interface fc3/2 DS-PAA Nexus...
...the SPAN session is active. • Is excluded from the source list and is up DESCRIPTION OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-11 If a destination port is configured as egress source • VLAN or port ...switch(config)# interface fc3/2 switch(config-if)# switchport mode sd switch(config-if)# switchport speed 1000 switch(config-if)# no shut switch(config-if)# exit switch(config)# monitor session 1 switch(config-monitor)# source interface fc3/1 tx switch(config-monitor)# source interface fc3/1 rx switch(config-monitor)# destination interface fc3/2 DS-PAA Nexus...
Troubleshooting Guide
Page 20
...both : fc3/1 source VLANs : rx : source VSANs : rx : destination ports : fc3/2 Suspending the SPAN Session Example: switch(config)# monitor session 1 suspend switch(config)# show debug command to screen via console, Telnet, or SSH. There are many different options to select when turning on...-Line Debugging Available debugs depend on debugs. You must have administrator privileges to nexus5k-docfeedback@cisco.com. Determine the destination of the debug file. 1-12 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Debugs can only be run debugs. Fabric Manager ...
...both : fc3/1 source VLANs : rx : source VSANs : rx : destination ports : fc3/2 Suspending the SPAN Session Example: switch(config)# monitor session 1 suspend switch(config)# show debug command to screen via console, Telnet, or SSH. There are many different options to select when turning on...-Line Debugging Available debugs depend on debugs. You must have administrator privileges to nexus5k-docfeedback@cisco.com. Determine the destination of the debug file. 1-12 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Debugs can only be run debugs. Fabric Manager ...
Troubleshooting Guide
Page 21
..., SSH, or console application that can be cleared and overwritten when the next debug logfile is created. The following commands: switch# clear debug-logfile CiscoLive_debugs switch# undebug all If you enter the VRF, if none is specified then the default is used. CDP is used with the... to read and understand, but some are CDP enabled entry Show CDP entries in Default Format OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-13 Cisco Discover Protocol Cisco Discover Protocol (CDP) version 2 is applied to the physical Ethernet interface and only works when enabled at...
..., SSH, or console application that can be cleared and overwritten when the next debug logfile is created. The following commands: switch# clear debug-logfile CiscoLive_debugs switch# undebug all If you enter the VRF, if none is specified then the default is used. CDP is used with the... to read and understand, but some are CDP enabled entry Show CDP entries in Default Format OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-13 Cisco Discover Protocol Cisco Discover Protocol (CDP) version 2 is applied to the physical Ethernet interface and only works when enabled at...
Troubleshooting Guide
Page 22
...timeout the login sessions. Device ID:TM-6506-1 System Name: Interface address(es): IPv4 Address: 11.1.1.1 Platform: cisco WS-C6506, Capabilities: Router Switch IGMP Filtering Interface: Ethernet1/4, Port ID (outgoing port): TenGigabitEthernet1/2 port connections Holdtime: 133 sec ? However, in... the converged network, even though the LAN connectivity is signaled using logical link status TLVs defined in DCBX and VIC protocols. 1-14 Cisco Nexus...
...timeout the login sessions. Device ID:TM-6506-1 System Name: Interface address(es): IPv4 Address: 11.1.1.1 Platform: cisco WS-C6506, Capabilities: Router Switch IGMP Filtering Interface: Ethernet1/4, Port ID (outgoing port): TenGigabitEthernet1/2 port connections Holdtime: 133 sec ? However, in... the converged network, even though the LAN connectivity is signaled using logical link status TLVs defined in DCBX and VIC protocols. 1-14 Cisco Nexus...