Troubleshooting Guide
Page 1
Send document comments to nexus5k-docfeedback@cisco.com. Cisco Nexus 5000 Series Troubleshooting Guide December 15, 2011 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 527-0883 Text Part Number: OL-25300-01
Send document comments to nexus5k-docfeedback@cisco.com. Cisco Nexus 5000 Series Troubleshooting Guide December 15, 2011 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 527-0883 Text Part Number: OL-25300-01
Troubleshooting Guide
Page 2
... Registrar, Aironet, AllTouch, AsyncOS, Bringing the Meeting To You, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, CCVP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, Cisco Lumin, Cisco Nexus, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Collaboration Without Limitation, Continuum, EtherFast, EtherSwitch, Event Center, Explorer, Follow Me Browsing, GainMaker, iLYNX, IOS, iPhone, IronPort...
... Registrar, Aironet, AllTouch, AsyncOS, Bringing the Meeting To You, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, CCVP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, Cisco Lumin, Cisco Nexus, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Collaboration Without Limitation, Continuum, EtherFast, EtherSwitch, Event Center, Explorer, Follow Me Browsing, GainMaker, iLYNX, IOS, iPhone, IronPort...
Troubleshooting Guide
Page 3
... Address Table 3-1 Spanning Tree Protocol 3-3 Multicast 3-5 VLANs 3-6 Registers and Counters 3-10 Troubleshooting QoS Issues 4-1 Policy Maps 4-1 Improper Configurations 4-2 PFC 4-8 Registers and Counters 4-10 Troubleshooting SAN Switching Issues 5-1 Overview 5-1 NPV 5-2 Zoning 5-7 SAN Port Channels 5-13 FC Services 5-16 Cisco Fabric Services 5-31 VSANs 5-40 Registers and Counters 5-48 Cisco Nexus 5000 Series Troubleshooting Guide iii
... Address Table 3-1 Spanning Tree Protocol 3-3 Multicast 3-5 VLANs 3-6 Registers and Counters 3-10 Troubleshooting QoS Issues 4-1 Policy Maps 4-1 Improper Configurations 4-2 PFC 4-8 Registers and Counters 4-10 Troubleshooting SAN Switching Issues 5-1 Overview 5-1 NPV 5-2 Zoning 5-7 SAN Port Channels 5-13 FC Services 5-16 Cisco Fabric Services 5-31 VSANs 5-40 Registers and Counters 5-48 Cisco Nexus 5000 Series Troubleshooting Guide iii
Troubleshooting Guide
Page 4
Contents Send document comments to nexus5k-docfeedback@cisco.com. Troubleshooting Security Issues 6-1 Roles 6-1 AAA 6-4 Troubleshooting System Management Issues 7-1 SNMP 7-1 Logging 7-3 Traps 7-4 DNS 7-4 Troubleshooting Virtual Port Channel Issues 8-1 Improper Configurations 8-1 Troubleshooting Config-Sync Issues 9-1 Commit Failure 9-1 Import Failure 9-3 Merge Failure 9-5 Switch-profile Deletion Failure 9-6 Verify Failure 9-8 Cisco Nexus 5000 Series Troubleshooting Guide iv OL-25300-01
Contents Send document comments to nexus5k-docfeedback@cisco.com. Troubleshooting Security Issues 6-1 Roles 6-1 AAA 6-4 Troubleshooting System Management Issues 7-1 SNMP 7-1 Logging 7-3 Traps 7-4 DNS 7-4 Troubleshooting Virtual Port Channel Issues 8-1 Improper Configurations 8-1 Troubleshooting Config-Sync Issues 9-1 Commit Failure 9-1 Import Failure 9-3 Merge Failure 9-5 Switch-profile Deletion Failure 9-6 Verify Failure 9-8 Cisco Nexus 5000 Series Troubleshooting Guide iv OL-25300-01
Troubleshooting Guide
Page 5
... Describes how to identify and resolve problems that can occur with SAN switching and the Cisco Nexus 5000 Series switch. Troubleshooting Layer 2 Switching Issues Describes how to identify and resolve problems that can occur with Layer 2 switching in the Cisco Nexus 5000 Series switch. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide v Preface This preface describes the audience, organization, and...
... Describes how to identify and resolve problems that can occur with SAN switching and the Cisco Nexus 5000 Series switch. Troubleshooting Layer 2 Switching Issues Describes how to identify and resolve problems that can occur with Layer 2 switching in the Cisco Nexus 5000 Series switch. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide v Preface This preface describes the audience, organization, and...
Troubleshooting Guide
Page 6
...and information that can occur with security in the Cisco Nexus 5000 Series switch. Elements in square brackets are in boldface. Screen examples use quotation marks around the string or the string will help you must enter is in boldface screen font. Cisco Nexus 5000 Series Troubleshooting Guide vi OL-25300-01 ... following conventions: Note Means reader take note. In this situation, you might do something that can occur with system management and the Cisco Nexus 5000 Series switch. Describes how to material not covered in equipment damage or loss of characters.
...and information that can occur with security in the Cisco Nexus 5000 Series switch. Elements in square brackets are in boldface. Screen examples use quotation marks around the string or the string will help you must enter is in boldface screen font. Cisco Nexus 5000 Series Troubleshooting Guide vi OL-25300-01 ... following conventions: Note Means reader take note. In this situation, you might do something that can occur with system management and the Cisco Nexus 5000 Series switch. Describes how to material not covered in equipment damage or loss of characters.
Troubleshooting Guide
Page 7
... following are related Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender documents: Release Notes Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Release Notes Cisco Nexus 5000 Series Switch Release Notes Configuration Guides Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 5.0(2)N1(1) Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 4.2(1)N1(1) and Release 4.2(1)N2(1) Cisco Nexus 5000 Series NX...
... following are related Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender documents: Release Notes Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Release Notes Cisco Nexus 5000 Series Switch Release Notes Configuration Guides Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 5.0(2)N1(1) Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 4.2(1)N1(1) and Release 4.2(1)N2(1) Cisco Nexus 5000 Series NX...
Troubleshooting Guide
Page 8
Preface Regulatory Compliance and Safety Information for the Cisco Nexus 5000 Series Switches and Cisco Nexus 2000 Series Fabric Extenders Licensing Guide Cisco NX-OS Licensing Guide Command References Cisco Nexus 5000 Series Command Reference Technical References Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender MIBs Reference Error and System Messages Cisco NX-OS System Messages Reference Troubleshooting Guide Cisco Nexus 5000 Troubleshooting Guide Cisco Nexus 5000 Series Troubleshooting Guide viii OL-25300-01
Preface Regulatory Compliance and Safety Information for the Cisco Nexus 5000 Series Switches and Cisco Nexus 2000 Series Fabric Extenders Licensing Guide Cisco NX-OS Licensing Guide Command References Cisco Nexus 5000 Series Command Reference Technical References Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender MIBs Reference Error and System Messages Cisco NX-OS System Messages Reference Troubleshooting Guide Cisco Nexus 5000 Troubleshooting Guide Cisco Nexus 5000 Series Troubleshooting Guide viii OL-25300-01
Troubleshooting Guide
Page 9
... is usually recorded with a core file on the switch and includes the reason for the crash, such as a failed process. switch# show system reset-reason commands to HA policy of Reset OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-1 The following can help you...2 Step 3 Gather information that defines the specific symptoms. Identify all potential problems that may occur when configuring and using the Cisco Nexus 5000 Series switch. This chapter includes the following sections: • Troubleshooting Basics • Fabric Manager Tools and CLI Commands • Failover ...
... is usually recorded with a core file on the switch and includes the reason for the crash, such as a failed process. switch# show system reset-reason commands to HA policy of Reset OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-1 The following can help you...2 Step 3 Gather information that defines the specific symptoms. Identify all potential problems that may occur when configuring and using the Cisco Nexus 5000 Series switch. This chapter includes the following sections: • Troubleshooting Basics • Fabric Manager Tools and CLI Commands • Failover ...
Troubleshooting Guide
Page 10
... 1 for the process that happened just before the crash. With the show process log Process PID clis 4023 clis 4155 Normal-exit ----------- switch# show logging [snip] 2010 Nov 6 08:00:50 TTPSW-5020SF1 %$ VDC-1 %$ %STP-2-BLOCK_BPDUGUARD: Received BPDU on port Ethernet103/1/1 ...• Use the copy core://module-id/PID ftp: command to export the file and contact the TAC to nexus5k-docfeedback@cisco.com. Cisco Nexus 5000 Series Troubleshooting Guide 1-2 OL-25300-01 Troubleshooting Basics Chapter 1 Troubleshooting Overview Send document comments to obtain an analysis of ...
... 1 for the process that happened just before the crash. With the show process log Process PID clis 4023 clis 4155 Normal-exit ----------- switch# show logging [snip] 2010 Nov 6 08:00:50 TTPSW-5020SF1 %$ VDC-1 %$ %STP-2-BLOCK_BPDUGUARD: Received BPDU on port Ethernet103/1/1 ...• Use the copy core://module-id/PID ftp: command to export the file and contact the TAC to nexus5k-docfeedback@cisco.com. Cisco Nexus 5000 Series Troubleshooting Guide 1-2 OL-25300-01 Troubleshooting Basics Chapter 1 Troubleshooting Overview Send document comments to obtain an analysis of ...
Troubleshooting Guide
Page 11
...practices are the recommended steps you should take to ensure the proper operation of your switch. • Maintain a consistent Cisco NX-OS release across all your Cisco Nexus 5000 switches. • Refer to the release notes for your configuration and detect possible problems before... Network Link Fabric Extender Port Analyzer Adapter Reconfigure Fabric Request State Change Notification Cisco FCoE MUX ASIC Fibre Channel Protocol Fabric Shortest Path First OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-3 Chapter 1 Troubleshooting Overview Troubleshooting Basics Send document ...
...practices are the recommended steps you should take to ensure the proper operation of your switch. • Maintain a consistent Cisco NX-OS release across all your Cisco Nexus 5000 switches. • Refer to the release notes for your configuration and detect possible problems before... Network Link Fabric Extender Port Analyzer Adapter Reconfigure Fabric Request State Change Notification Cisco FCoE MUX ASIC Fibre Channel Protocol Fabric Shortest Path First OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-3 Chapter 1 Troubleshooting Overview Troubleshooting Basics Send document ...
Troubleshooting Guide
Page 12
... can display required data from the configuration switch# show running-config interface version 4.0(1a)N2(1) interface vfc29 no shutdown bind interface Ethernet1/29 interface fc2/3 no need to back out to nexus5k-docfeedback@cisco.com. Fabric Manager Tools and CLI Commands...Chapter 1 Troubleshooting Overview Send document comments to the switch prompt. The following chapters in that match Cisco Nexus 5000 Series Troubleshooting Guide 1-4 OL-25300-01 switch(config)# show run switch(config)# show interface brief Pipe command switch# show logging | egrep Egrep grep Grep head ...
... can display required data from the configuration switch# show running-config interface version 4.0(1a)N2(1) interface vfc29 no shutdown bind interface Ethernet1/29 interface fc2/3 no need to back out to nexus5k-docfeedback@cisco.com. Fabric Manager Tools and CLI Commands...Chapter 1 Troubleshooting Overview Send document comments to the switch prompt. The following chapters in that match Cisco Nexus 5000 Series Troubleshooting Guide 1-4 OL-25300-01 switch(config)# show run switch(config)# show interface brief Pipe command switch# show logging | egrep Egrep grep Grep head ...
Troubleshooting Guide
Page 13
...Select source filesystem Select source filesystem Redirecting output NX-OS allows you to redirect outputs to nexus5k-docfeedback@cisco.com. switch# show tech-support aaa > bootflash:ciscolive09 switch# dir 103557265 12451 49152 20058112 20193280 76930262 103557265 4096 Apr 01 17:39:22 2009 Apr 10...output of the show tech-support details command Use the tac-pac filename command to a file and then gzip the file. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-5 bootflash: core: debug: ftp: licenses log: modflash: nvram: running-config scp: sftp: startup-config system: ...
...Select source filesystem Select source filesystem Redirecting output NX-OS allows you to redirect outputs to nexus5k-docfeedback@cisco.com. switch# show tech-support aaa > bootflash:ciscolive09 switch# dir 103557265 12451 49152 20058112 20193280 76930262 103557265 4096 Apr 01 17:39:22 2009 Apr 10...output of the show tech-support details command Use the tac-pac filename command to a file and then gzip the file. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-5 bootflash: core: debug: ftp: licenses log: modflash: nvram: running-config scp: sftp: startup-config system: ...
Troubleshooting Guide
Page 14
... commands like grep and include to startup configuration system: Select destination filesystem tftp: Select destination filesystem volatile: Select destination filesystem NX-OS command listing switch# show logging Cisco Nexus 5000 Series Troubleshooting Guide 1-6 OL-25300-01 In the following examples, the logging command and the Device Manager display severity information: Viewing Severity Information...
... commands like grep and include to startup configuration system: Select destination filesystem tftp: Select destination filesystem volatile: Select destination filesystem NX-OS command listing switch# show logging Cisco Nexus 5000 Series Troubleshooting Guide 1-6 OL-25300-01 In the following examples, the logging command and the Device Manager display severity information: Viewing Severity Information...
Troubleshooting Guide
Page 15
...of Wireshark that captures and decodes packets. ciscolive09: Severity - This tool is a Cisco NX-OS protocol analyzer tool based on the Wireshark open source code. Node to switch or switch to switch traffic can be seen via this tool. You can be seen with this method.... that are transient to the switch are destined to a second port for analysis. Chapter 1 Troubleshooting Overview Fabric Manager Tools and CLI Commands Send document comments to troubleshoot your network and analyze the control-plane traffic. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-7 ...
...of Wireshark that captures and decodes packets. ciscolive09: Severity - This tool is a Cisco NX-OS protocol analyzer tool based on the Wireshark open source code. Node to switch or switch to switch traffic can be seen via this tool. You can be seen with this method.... that are transient to the switch are destined to a second port for analysis. Chapter 1 Troubleshooting Overview Fabric Manager Tools and CLI Commands Send document comments to troubleshoot your network and analyze the control-plane traffic. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-7 ...
Troubleshooting Guide
Page 16
... to analyze the data using Wireshark instead of protocol information. Note Do not use this option if you press Ctrl-C. Examples switch# ethanalyzer local sniff-interface No matches in current mode, matching in the command captures output until you plan to capture. ethanalyzer...-filter Filters the types of packets to display. Root = 32769/00:0d:ec:6b:cd:41 Cost = 0 Port = 0x8093 [snip] Cisco Nexus 5000 Series Troubleshooting Guide 1-8 OL-25300-01 Fabric Manager Tools and CLI Commands Chapter 1 Troubleshooting Overview Send document comments to a file. ethanalyzer ...
... to analyze the data using Wireshark instead of protocol information. Note Do not use this option if you press Ctrl-C. Examples switch# ethanalyzer local sniff-interface No matches in current mode, matching in the command captures output until you plan to capture. ethanalyzer...-filter Filters the types of packets to display. Root = 32769/00:0d:ec:6b:cd:41 Cost = 0 Port = 0x8093 [snip] Cisco Nexus 5000 Series Troubleshooting Guide 1-8 OL-25300-01 Fabric Manager Tools and CLI Commands Chapter 1 Troubleshooting Overview Send document comments to a file. ethanalyzer ...
Troubleshooting Guide
Page 17
...the ingress direction, the egress direction, or both directions for analysis by a network analyzer. Note For the Cisco Nexus 5548 Switch, Fibre Channel ports cannot be a Cisco SwitchProbe, a Fibre Channel Analyzer, or other Remote Monitoring (RMON) probes. Chapter 1 Troubleshooting Overview Fabric Manager ... to the SPAN destination port. • Egress source (Tx)-Traffic exiting the switch through this source port is marked: False] [Protocols in a SPAN session. The Cisco Nexus 5000 Series switch supports Ethernet, virtual Ethernet, Fibre Channel, virtual Fibre Channel, port channels, SAN...
...the ingress direction, the egress direction, or both directions for analysis by a network analyzer. Note For the Cisco Nexus 5548 Switch, Fibre Channel ports cannot be a Cisco SwitchProbe, a Fibre Channel Analyzer, or other Remote Monitoring (RMON) probes. Chapter 1 Troubleshooting Overview Fabric Manager ... to the SPAN destination port. • Egress source (Tx)-Traffic exiting the switch through this source port is marked: False] [Protocols in a SPAN session. The Cisco Nexus 5000 Series switch supports Ethernet, virtual Ethernet, Fibre Channel, virtual Fibre Channel, port channels, SAN...
Troubleshooting Guide
Page 18
... • For VLAN or VSAN SPAN sources, all physical ports in the source VLAN or VSAN are included as source ports. • The Cisco Nexus 5010 switch supports a maximum of traffic from the source ports, VLANs, or VSANs. Source Ports A source port, also called a monitoring port) that receives...a copy of two egress SPAN source ports. Port channel and SAN port channel interfaces can be configured as SPAN destinations. The Cisco Nexus 5000 Series switch supports Ethernet and Fibre Channel interfaces as ingress or egress source ports. • Source ports can be ingress and applies to ...
... • For VLAN or VSAN SPAN sources, all physical ports in the source VLAN or VSAN are included as source ports. • The Cisco Nexus 5010 switch supports a maximum of traffic from the source ports, VLANs, or VSANs. Source Ports A source port, also called a monitoring port) that receives...a copy of two egress SPAN source ports. Port channel and SAN port channel interfaces can be configured as SPAN destinations. The Cisco Nexus 5000 Series switch supports Ethernet and Fibre Channel interfaces as ingress or egress source ports. • Source ports can be ingress and applies to ...
Troubleshooting Guide
Page 19
... interface fc3/1 tx switch(config-monitor)# source interface fc3/1 rx switch(config-monitor)# destination interface fc3/2 DS-PAA Nexus 5020 FC3/2 FC3/1 199999 Verifying the SPAN Session Example: switch# show monitor session SESSION STATE REASON 1 up The session is up only if the destination port is up DESCRIPTION OL-25300-01 Cisco Nexus 5000 Series Troubleshooting...
... interface fc3/1 tx switch(config-monitor)# source interface fc3/1 rx switch(config-monitor)# destination interface fc3/2 DS-PAA Nexus 5020 FC3/2 FC3/1 199999 Verifying the SPAN Session Example: switch# show monitor session SESSION STATE REASON 1 up The session is up only if the destination port is up DESCRIPTION OL-25300-01 Cisco Nexus 5000 Series Troubleshooting...
Troubleshooting Guide
Page 20
...to select when turning on features enabled in switch memory. • Capture to direct to see name of the output: • Logfile-Data file in NX-OS. Determine the destination of the debug file. 1-12 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Debug ...Logging Set the log file as CiscoLive_debugs, using the debug logfile command. switch# show monitor session 1 session 1 type : local state : up source intf : rx ...
...to select when turning on features enabled in switch memory. • Capture to direct to see name of the output: • Logfile-Data file in NX-OS. Determine the destination of the debug file. 1-12 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Debug ...Logging Set the log file as CiscoLive_debugs, using the debug logfile command. switch# show monitor session 1 session 1 type : local state : up source intf : rx ...