Troubleshooting Guide
Page 1
Cisco Nexus 5000 Series Troubleshooting Guide December 15, 2011 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 527-0883 Text Part Number: OL-25300-01 Send document comments to nexus5k-docfeedback@cisco.com.
Cisco Nexus 5000 Series Troubleshooting Guide December 15, 2011 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 527-0883 Text Part Number: OL-25300-01 Send document comments to nexus5k-docfeedback@cisco.com.
Troubleshooting Guide
Page 2
... Registrar, Aironet, AllTouch, AsyncOS, Bringing the Meeting To You, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, CCVP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, Cisco Lumin, Cisco Nexus, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Collaboration Without Limitation, Continuum, EtherFast, EtherSwitch, Event Center, Explorer, Follow Me Browsing, GainMaker, iLYNX, IOS, iPhone, IronPort...
... Registrar, Aironet, AllTouch, AsyncOS, Bringing the Meeting To You, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, CCVP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, Cisco Lumin, Cisco Nexus, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Collaboration Without Limitation, Continuum, EtherFast, EtherSwitch, Event Center, Explorer, Follow Me Browsing, GainMaker, iLYNX, IOS, iPhone, IronPort...
Troubleshooting Guide
Page 3
... 1-14 Troubleshooting FCoE Issues 2-1 Data Center Bridging 2-1 FIP 2-7 CNA 2-9 PFC 2-11 Registers and Counters 2-15 Troubleshooting Layer 2 Switching Issues 3-1 MAC Address Table 3-1 Spanning Tree Protocol 3-3 Multicast 3-5 VLANs 3-6 Registers and Counters 3-10 Troubleshooting QoS Issues 4-1 Policy Maps...PFC 4-8 Registers and Counters 4-10 Troubleshooting SAN Switching Issues 5-1 Overview 5-1 NPV 5-2 Zoning 5-7 SAN Port Channels 5-13 FC Services 5-16 Cisco Fabric Services 5-31 VSANs 5-40 Registers and Counters 5-48 Cisco Nexus 5000 Series Troubleshooting Guide iii Send document comments to...
... 1-14 Troubleshooting FCoE Issues 2-1 Data Center Bridging 2-1 FIP 2-7 CNA 2-9 PFC 2-11 Registers and Counters 2-15 Troubleshooting Layer 2 Switching Issues 3-1 MAC Address Table 3-1 Spanning Tree Protocol 3-3 Multicast 3-5 VLANs 3-6 Registers and Counters 3-10 Troubleshooting QoS Issues 4-1 Policy Maps...PFC 4-8 Registers and Counters 4-10 Troubleshooting SAN Switching Issues 5-1 Overview 5-1 NPV 5-2 Zoning 5-7 SAN Port Channels 5-13 FC Services 5-16 Cisco Fabric Services 5-31 VSANs 5-40 Registers and Counters 5-48 Cisco Nexus 5000 Series Troubleshooting Guide iii Send document comments to...
Troubleshooting Guide
Page 4
Contents Send document comments to nexus5k-docfeedback@cisco.com. Troubleshooting Security Issues 6-1 Roles 6-1 AAA 6-4 Troubleshooting System Management Issues 7-1 SNMP 7-1 Logging 7-3 Traps 7-4 DNS 7-4 Troubleshooting Virtual Port Channel Issues 8-1 Improper Configurations 8-1 Troubleshooting Config-Sync Issues 9-1 Commit Failure 9-1 Import Failure 9-3 Merge Failure 9-5 Switch-profile Deletion Failure 9-6 Verify Failure 9-8 Cisco Nexus 5000 Series Troubleshooting Guide iv OL-25300-01
Contents Send document comments to nexus5k-docfeedback@cisco.com. Troubleshooting Security Issues 6-1 Roles 6-1 AAA 6-4 Troubleshooting System Management Issues 7-1 SNMP 7-1 Logging 7-3 Traps 7-4 DNS 7-4 Troubleshooting Virtual Port Channel Issues 8-1 Improper Configurations 8-1 Troubleshooting Config-Sync Issues 9-1 Commit Failure 9-1 Import Failure 9-3 Merge Failure 9-5 Switch-profile Deletion Failure 9-6 Verify Failure 9-8 Cisco Nexus 5000 Series Troubleshooting Guide iv OL-25300-01
Troubleshooting Guide
Page 5
... is for problems that may occur when configuring and using the Cisco Nexus 5000 Series switch. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide v Troubleshooting Layer 2 Switching Issues Describes how to identify and resolve problems that can occur with Layer 2 switching in the Cisco Nexus 5000 Series switch. Preface This preface describes the audience, organization, and conventions of the...
... is for problems that may occur when configuring and using the Cisco Nexus 5000 Series switch. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide v Troubleshooting Layer 2 Switching Issues Describes how to identify and resolve problems that can occur with Layer 2 switching in the Cisco Nexus 5000 Series switch. Preface This preface describes the audience, organization, and conventions of the...
Troubleshooting Guide
Page 6
...Issues Troubleshooting System Management Issues Description Describes how to identify and resolve problems that can occur with security in the Cisco Nexus 5000 Series switch. Elements in square brackets are grouped in italics. Tip Means the following conventions: Note Means reader take note. ...Describes how to identify and resolve problems that can occur with system management and the Cisco Nexus 5000 Series switch. Optional alternative keywords are optional. Notes contain helpful suggestions or references to system prompts are in brackets and separated...
...Issues Troubleshooting System Management Issues Description Describes how to identify and resolve problems that can occur with security in the Cisco Nexus 5000 Series switch. Elements in square brackets are grouped in italics. Tip Means the following conventions: Note Means reader take note. ...Describes how to identify and resolve problems that can occur with system management and the Cisco Nexus 5000 Series switch. Optional alternative keywords are optional. Notes contain helpful suggestions or references to system prompts are in brackets and separated...
Troubleshooting Guide
Page 7
... following are related Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender documents: Release Notes Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Release Notes Cisco Nexus 5000 Series Switch Release Notes Configuration Guides Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 5.0(2)N1(1) Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 4.2(1)N1(1) and Release 4.2(1)N2(1) Cisco Nexus 5000 Series NX...
... following are related Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender documents: Release Notes Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Release Notes Cisco Nexus 5000 Series Switch Release Notes Configuration Guides Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 5.0(2)N1(1) Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 4.2(1)N1(1) and Release 4.2(1)N2(1) Cisco Nexus 5000 Series NX...
Troubleshooting Guide
Page 8
Preface Regulatory Compliance and Safety Information for the Cisco Nexus 5000 Series Switches and Cisco Nexus 2000 Series Fabric Extenders Licensing Guide Cisco NX-OS Licensing Guide Command References Cisco Nexus 5000 Series Command Reference Technical References Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender MIBs Reference Error and System Messages Cisco NX-OS System Messages Reference Troubleshooting Guide Cisco Nexus 5000 Troubleshooting Guide Cisco Nexus 5000 Series Troubleshooting Guide viii OL-25300-01
Preface Regulatory Compliance and Safety Information for the Cisco Nexus 5000 Series Switches and Cisco Nexus 2000 Series Fabric Extenders Licensing Guide Cisco NX-OS Licensing Guide Command References Cisco Nexus 5000 Series Command Reference Technical References Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender MIBs Reference Error and System Messages Cisco NX-OS System Messages Reference Troubleshooting Guide Cisco Nexus 5000 Troubleshooting Guide Cisco Nexus 5000 Series Troubleshooting Guide viii OL-25300-01
Troubleshooting Guide
Page 9
... 1 Step 2 Step 3 Gather information that defines the specific symptoms. Identify all potential problems that may occur when configuring and using the Cisco Nexus 5000 Series switch. Send document comments to nexus5k-docfeedback@cisco.com. 1 C H A P T E R Troubleshooting Overview This chapter introduces the basic concepts, methodology, and general troubleshooting guidelines for problems that could be from the...
... 1 Step 2 Step 3 Gather information that defines the specific symptoms. Identify all potential problems that may occur when configuring and using the Cisco Nexus 5000 Series switch. Send document comments to nexus5k-docfeedback@cisco.com. 1 C H A P T E R Troubleshooting Overview This chapter introduces the basic concepts, methodology, and general troubleshooting guidelines for problems that could be from the...
Troubleshooting Guide
Page 10
...• Use the copy core://module-id/PID ftp: command to export the file and contact the TAC to determine if a core file was created. Cisco Nexus 5000 Series Troubleshooting Guide 1-2 OL-25300-01 Service: clis hap reset Version: 4.2(1)N2(1) 2) At 841383 usecs after Sat Nov 6 14:56:25 2010...N2(1) • Use the show cores command to obtain an analysis of the file. • Obtain the timestamp of the show cores command for a Nexus 5000 switch.) switch#show processes log details Service: clis Description: CLI Server Started at Sat Nov 6 14:59:10 2010 (882984 us) Stopped at Sat Nov 6 ...
...• Use the copy core://module-id/PID ftp: command to export the file and contact the TAC to determine if a core file was created. Cisco Nexus 5000 Series Troubleshooting Guide 1-2 OL-25300-01 Service: clis hap reset Version: 4.2(1)N2(1) 2) At 841383 usecs after Sat Nov 6 14:56:25 2010...N2(1) • Use the show cores command to obtain an analysis of the file. • Obtain the timestamp of the show cores command for a Nexus 5000 switch.) switch#show processes log details Service: clis Description: CLI Server Started at Sat Nov 6 14:59:10 2010 (882984 us) Stopped at Sat Nov 6 ...
Troubleshooting Guide
Page 11
... Best practices are the recommended steps you should take to ensure the proper operation of your switch. • Maintain a consistent Cisco NX-OS release across all your Cisco Nexus 5000 switches. • Refer to the release notes for your Cisco SAN-OS release for the latest features, limitations, and caveats. • Enable system message logging. •...
... Best practices are the recommended steps you should take to ensure the proper operation of your switch. • Maintain a consistent Cisco NX-OS release across all your Cisco Nexus 5000 switches. • Refer to the release notes for your Cisco SAN-OS release for the latest features, limitations, and caveats. • Enable system message logging. •...
Troubleshooting Guide
Page 12
... chapter. switch(config)# show run switch(config)# show interface brief Pipe command switch# show running...Displaying within the configuration mode, so there is required from the configuration switch# show logging | egrep Egrep grep Grep head Stream Editor last ..., you may describe additional tools and commands specific to nexus5k-docfeedback@cisco.com. Fabric Manager Tools and CLI Commands Chapter 1 Troubleshooting Overview...symptoms and possible problems covered in this guide may use to the switch prompt. Fabric Manager Tools and CLI Commands This section highlights the...
... chapter. switch(config)# show run switch(config)# show interface brief Pipe command switch# show running...Displaying within the configuration mode, so there is required from the configuration switch# show logging | egrep Egrep grep Grep head Stream Editor last ..., you may describe additional tools and commands specific to nexus5k-docfeedback@cisco.com. Fabric Manager Tools and CLI Commands Chapter 1 Troubleshooting Overview...symptoms and possible problems covered in this guide may use to the switch prompt. Fabric Manager Tools and CLI Commands This section highlights the...
Troubleshooting Guide
Page 13
OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-5 Chapter 1 Troubleshooting Overview Fabric Manager Tools and CLI Commands Send document comments to a file and then gzip the file. switch# show tech-support aaa > bootflash:ciscolive09 switch# dir 103557265 12451 49152 20058112 20193280 76930262 ...-OS allows you to redirect outputs to files and flash areas in the switch. Using the pipe command to only display required keyword switch# show tech-support details command to nexus5k-docfeedback@cisco.com. bootflash: core: debug: ftp: licenses log: modflash: nvram: ...
OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-5 Chapter 1 Troubleshooting Overview Fabric Manager Tools and CLI Commands Send document comments to a file and then gzip the file. switch# show tech-support aaa > bootflash:ciscolive09 switch# dir 103557265 12451 49152 20058112 20193280 76930262 ...-OS allows you to redirect outputs to files and flash areas in the switch. Using the pipe command to only display required keyword switch# show tech-support details command to nexus5k-docfeedback@cisco.com. bootflash: core: debug: ftp: licenses log: modflash: nvram: ...
Troubleshooting Guide
Page 14
... destination filesystem sftp: Select destination filesystem startup-config Copy from the device using the procedure in the copy command section. switch(config-if)# show logging Cisco Nexus 5000 Series Troubleshooting Guide 1-6 OL-25300-01 switch# copy volatile:show_tech_out.gz ? The file is stored on bootflash://filename provided that there is a whole line WORD Search...
... destination filesystem sftp: Select destination filesystem startup-config Copy from the device using the procedure in the copy command section. switch(config-if)# show logging Cisco Nexus 5000 Series Troubleshooting Guide 1-6 OL-25300-01 switch# copy volatile:show_tech_out.gz ? The file is stored on bootflash://filename provided that there is a whole line WORD Search...
Troubleshooting Guide
Page 15
...packets. You can be seen via this tool. This tool is a Cisco NX-OS protocol analyzer tool based on the Wireshark open source code. Node to switch or switch to switch traffic can use Ethanalyzer to troubleshoot your network and analyze the control-plane ... Severity Levels in the Device Manager Ethanalyzer and SPAN Ethanalyzer is a feature whereby frames that are copied to nexus5k-docfeedback@cisco.com. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-7 Chapter 1 Troubleshooting Overview Fabric Manager Tools and CLI Commands Send document comments to a second ...
...packets. You can be seen via this tool. This tool is a Cisco NX-OS protocol analyzer tool based on the Wireshark open source code. Node to switch or switch to switch traffic can use Ethanalyzer to troubleshoot your network and analyze the control-plane ... Severity Levels in the Device Manager Ethanalyzer and SPAN Ethanalyzer is a feature whereby frames that are copied to nexus5k-docfeedback@cisco.com. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-7 Chapter 1 Troubleshooting Overview Fabric Manager Tools and CLI Commands Send document comments to a second ...
Troubleshooting Guide
Page 16
...or received by the supervisor and provides detailed protocol information. ethanalyzer local sniff-interface decode-internal Decodes the internal frame header for switch domain controller. ethanalyzer local sniff-interface read Opens the captured data file and analyzes it. The FCID is for viewing the ...c2:00:00:00 0x0 0x0 STP RST. Root = 32769/00:0d:ec:6b:cd:41 Cost = 0 Port = 0x8093 [snip] Cisco Nexus 5000 Series Troubleshooting Guide 1-8 OL-25300-01 Command Description ethanalyzer local sniff-interface Captures packets sent or received by the supervisor and provides a summary...
...or received by the supervisor and provides detailed protocol information. ethanalyzer local sniff-interface decode-internal Decodes the internal frame header for switch domain controller. ethanalyzer local sniff-interface read Opens the captured data file and analyzes it. The FCID is for viewing the ...c2:00:00:00 0x0 0x0 STP RST. Root = 32769/00:0d:ec:6b:cd:41 Cost = 0 Port = 0x8093 [snip] Cisco Nexus 5000 Series Troubleshooting Guide 1-8 OL-25300-01 Command Description ethanalyzer local sniff-interface Captures packets sent or received by the supervisor and provides a summary...
Troubleshooting Guide
Page 17
...Fibre Channel Analyzer, or other Remote Monitoring (RMON) probes. The Cisco Nexus 5000 Series switch supports Ethernet, virtual Ethernet, Fibre Channel, virtual Fibre Channel, port channels, SAN port channels, VLANs, and VSANs as SPAN sources. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-9 With VLANs or VSANs, all supported ... this source port is copied to the SPAN destination port. • Egress source (Tx)-Traffic exiting the switch through this source port is copied to nexus5k-docfeedback@cisco.com. 2008-08-13 01:37:23.220253 00:0d:ec:6b:cd:40 -> fc:fc:fc:ff:ff:...
...Fibre Channel Analyzer, or other Remote Monitoring (RMON) probes. The Cisco Nexus 5000 Series switch supports Ethernet, virtual Ethernet, Fibre Channel, virtual Fibre Channel, port channels, SAN port channels, VLANs, and VSANs as SPAN sources. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-9 With VLANs or VSANs, all supported ... this source port is copied to the SPAN destination port. • Egress source (Tx)-Traffic exiting the switch through this source port is copied to nexus5k-docfeedback@cisco.com. 2008-08-13 01:37:23.220253 00:0d:ec:6b:cd:40 -> fc:fc:fc:ff:ff:...
Troubleshooting Guide
Page 18
... source port can be monitored in the group. The rx/tx option is a switched interface that you monitor for VLAN or VSAN SPAN sessions. • Beginning with a direction (ingress, egress, or both) to the Cisco Nexus 5020 Switch and the Cisco Nexus 5548 switch. Fabric Manager Tools and CLI Commands Chapter 1 Troubleshooting Overview Send document comments to the...
... source port can be monitored in the group. The rx/tx option is a switched interface that you monitor for VLAN or VSAN SPAN sessions. • Beginning with a direction (ingress, egress, or both) to the Cisco Nexus 5020 Switch and the Cisco Nexus 5548 switch. Fabric Manager Tools and CLI Commands Chapter 1 Troubleshooting Overview Send document comments to the...
Troubleshooting Guide
Page 19
...is up only if the destination port is up DESCRIPTION OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-11 Monitor Caveats Limitations of Nexus 5000 SPAN CoS values are in down state (hardware resource unavailable). ...switch(config)# interface fc3/2 switch(config-if)# switchport mode sd switch(config-if)# switchport speed 1000 switch(config-if)# no shut switch(config-if)# exit switch(config)# monitor session 1 switch(config-monitor)# source interface fc3/1 tx switch(config-monitor)# source interface fc3/1 rx switch(config-monitor)# destination interface fc3/2 DS-PAA Nexus 5020...
...is up only if the destination port is up DESCRIPTION OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-11 Monitor Caveats Limitations of Nexus 5000 SPAN CoS values are in down state (hardware resource unavailable). ...switch(config)# interface fc3/2 switch(config-if)# switchport mode sd switch(config-if)# switchport speed 1000 switch(config-if)# no shut switch(config-if)# exit switch(config)# monitor session 1 switch(config-monitor)# source interface fc3/1 tx switch(config-monitor)# source interface fc3/1 rx switch(config-monitor)# destination interface fc3/2 DS-PAA Nexus 5020...
Troubleshooting Guide
Page 20
... different options to select when turning on features enabled in switch memory. • Capture to direct to run from the CLI. Determine the destination of the debug file. 1-12 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Debugs can only ... tx : fc3/1 both : fc3/1 source VLANs : rx : source VSANs : rx : destination ports : fc3/2 Debugging Command-Line Debugging Available debugs depend on debugs. switch# show monitor session 1 session 1 type : local state : up source intf : rx : fc3/1 tx : fc3/1 both : fc3/1 source VLANs : rx : source...
... different options to select when turning on features enabled in switch memory. • Capture to direct to run from the CLI. Determine the destination of the debug file. 1-12 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Debugs can only ... tx : fc3/1 both : fc3/1 source VLANs : rx : source VSANs : rx : destination ports : fc3/2 Debugging Command-Line Debugging Available debugs depend on debugs. switch# show monitor session 1 session 1 type : local state : up source intf : rx : fc3/1 tx : fc3/1 both : fc3/1 source VLANs : rx : source...