Troubleshooting Guide
Page 3
... 1-4 Failover 1-14 Troubleshooting FCoE Issues 2-1 Data Center Bridging 2-1 FIP 2-7 CNA 2-9 PFC 2-11 Registers and Counters 2-15 Troubleshooting Layer 2 Switching Issues 3-1 MAC Address Table 3-1 Spanning Tree Protocol 3-3 Multicast 3-5 VLANs 3-6 Registers and Counters 3-10 Troubleshooting QoS Issues 4-1 Policy ...PFC 4-8 Registers and Counters 4-10 Troubleshooting SAN Switching Issues 5-1 Overview 5-1 NPV 5-2 Zoning 5-7 SAN Port Channels 5-13 FC Services 5-16 Cisco Fabric Services 5-31 VSANs 5-40 Registers and Counters 5-48 Cisco Nexus 5000 Series Troubleshooting Guide iii Send document comments...
... 1-4 Failover 1-14 Troubleshooting FCoE Issues 2-1 Data Center Bridging 2-1 FIP 2-7 CNA 2-9 PFC 2-11 Registers and Counters 2-15 Troubleshooting Layer 2 Switching Issues 3-1 MAC Address Table 3-1 Spanning Tree Protocol 3-3 Multicast 3-5 VLANs 3-6 Registers and Counters 3-10 Troubleshooting QoS Issues 4-1 Policy ...PFC 4-8 Registers and Counters 4-10 Troubleshooting SAN Switching Issues 5-1 Overview 5-1 NPV 5-2 Zoning 5-7 SAN Port Channels 5-13 FC Services 5-16 Cisco Fabric Services 5-31 VSANs 5-40 Registers and Counters 5-48 Cisco Nexus 5000 Series Troubleshooting Guide iii Send document comments...
Troubleshooting Guide
Page 5
Troubleshooting FCoE Issues Describes how to identify and resolve problems that can occur with Layer 2 switching in the Cisco Nexus 5000 Series switch. Troubleshooting SAN Switching Issues Describes how to identify and resolve problems that can occur with FCoE in the Cisco Nexus 5000 Series switch. Troubleshooting Layer 2 Switching Issues Describes how to identify and resolve problems that may occur when configuring...
Troubleshooting FCoE Issues Describes how to identify and resolve problems that can occur with Layer 2 switching in the Cisco Nexus 5000 Series switch. Troubleshooting SAN Switching Issues Describes how to identify and resolve problems that can occur with FCoE in the Cisco Nexus 5000 Series switch. Troubleshooting Layer 2 Switching Issues Describes how to identify and resolve problems that may occur when configuring...
Troubleshooting Guide
Page 7
... Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Release Notes Cisco Nexus 5000 Series Switch Release Notes Configuration Guides Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 5.0(2)N1(1) Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 4.2(1)N1(1) and Release 4.2(1)N2(1) Cisco Nexus 5000 Series NX-OS Fibre Channel over Ethernet Configuration Guide Cisco Nexus 5000 Series NX-OS Layer 2 Switching Configuration Guide Cisco Nexus...
... Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Release Notes Cisco Nexus 5000 Series Switch Release Notes Configuration Guides Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 5.0(2)N1(1) Cisco Nexus 5000 Series Configuration Limits for Cisco NX-OS Release 4.2(1)N1(1) and Release 4.2(1)N2(1) Cisco Nexus 5000 Series NX-OS Fibre Channel over Ethernet Configuration Guide Cisco Nexus 5000 Series NX-OS Layer 2 Switching Configuration Guide Cisco Nexus...
Troubleshooting Guide
Page 11
...recommended steps you should take to ensure the proper operation of your switch. • Maintain a consistent Cisco NX-OS release across all your Cisco Nexus 5000 switches. • Refer to the release notes for your Cisco SAN-OS release for the latest features, limitations, and caveats. ...Spanning Tree Protocol Fibre Channel over Ethernet Fibre Channel Forwarder FCoE Initialization Protocol Priority Flow Control Enhanced Transmission Selection Link Layer Discovery Protocol Converged Enhanced Ethernet Virtual Network Tag No-Drop Ethernet Consolidated Network Adapter Host Bus Adapter N Port ...
...recommended steps you should take to ensure the proper operation of your switch. • Maintain a consistent Cisco NX-OS release across all your Cisco Nexus 5000 switches. • Refer to the release notes for your Cisco SAN-OS release for the latest features, limitations, and caveats. ...Spanning Tree Protocol Fibre Channel over Ethernet Fibre Channel Forwarder FCoE Initialization Protocol Priority Flow Control Enhanced Transmission Selection Link Layer Discovery Protocol Converged Enhanced Ethernet Virtual Network Tag No-Drop Ethernet Consolidated Network Adapter Host Bus Adapter N Port ...
Troubleshooting Guide
Page 22
...layer, the CNA needs to be signaled to and from the host-facing link. However, in DCBX and VIC protocols. 1-14 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Device ID:TM-6506-1 System Name: Interface address(es): IPv4 Address: 11.1.1.1 Platform: cisco WS-C6506, Capabilities: Router Switch... IGMP Filtering Interface: Ethernet1/4, Port ID (outgoing port): TenGigabitEthernet1/2 port connections Holdtime: 133 sec ? Sent on Native VLAN Duplex: full Failover FCoE Traffic When the Nexus 5000 experiences loss of...
...layer, the CNA needs to be signaled to and from the host-facing link. However, in DCBX and VIC protocols. 1-14 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Device ID:TM-6506-1 System Name: Interface address(es): IPv4 Address: 11.1.1.1 Platform: cisco WS-C6506, Capabilities: Router Switch... IGMP Filtering Interface: Ethernet1/4, Port ID (outgoing port): TenGigabitEthernet1/2 port connections Holdtime: 133 sec ? Sent on Native VLAN Duplex: full Failover FCoE Traffic When the Nexus 5000 experiences loss of...
Troubleshooting Guide
Page 43
..., learning is full. A severity 2 syslog message, STM_LIMIT_REACHED, should have been received. Send document comments to identify and resolve problems that can occur with Layer 2 switching in the Cisco Nexus 5000 Series switch. A severity 2 syslog message, STM_LOOP_DETECT, should have been received. A severity 2 syslog message, STM_LEARNING_RE_ENABLE, should be received. Possible Cause The MAC address table is enabled...
..., learning is full. A severity 2 syslog message, STM_LIMIT_REACHED, should have been received. Send document comments to identify and resolve problems that can occur with Layer 2 switching in the Cisco Nexus 5000 Series switch. A severity 2 syslog message, STM_LOOP_DETECT, should have been received. A severity 2 syslog message, STM_LEARNING_RE_ENABLE, should be received. Possible Cause The MAC address table is enabled...
Troubleshooting Guide
Page 44
...STM_LOOP_DETECT, should have been received. If this is enabled automatically. A severity 4 syslog message, STM_LEARNING_OVERLOAD, should have been received. Cisco Nexus 5000 Series Troubleshooting Guide 3-2 OL-25300-01 Alternatively, wait until some MAC entries are aged out, so that the total ... Alternatively, the outgoing interfaces may not have been enabled on any of the switch. MAC Address Table Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to bring up those interfaces. Possible Cause MAC address learning is full.
...STM_LOOP_DETECT, should have been received. If this is enabled automatically. A severity 4 syslog message, STM_LEARNING_OVERLOAD, should have been received. Cisco Nexus 5000 Series Troubleshooting Guide 3-2 OL-25300-01 Alternatively, wait until some MAC entries are aged out, so that the total ... Alternatively, the outgoing interfaces may not have been enabled on any of the switch. MAC Address Table Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to bring up those interfaces. Possible Cause MAC address learning is full.
Troubleshooting Guide
Page 45
...details of a VPC scenario. With the filter enabled, the HIFs do not send or receive any BPDUs. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-3 Spanning Tree Protocol HIFs go down with the BPDUGuard errDisable message HIFs go down accompanied with the ...there are connected to nexus5k-docfeedback@cisco.com. If they are no disputes or incorrect port states. Possible Cause The MAC address is disabled. Chapter 3 Troubleshooting Layer 2 Switching Issues Spanning Tree Protocol Send document comments to a non-host device/switch that is sending BPDUs, the HIFs...
...details of a VPC scenario. With the filter enabled, the HIFs do not send or receive any BPDUs. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-3 Spanning Tree Protocol HIFs go down with the BPDUGuard errDisable message HIFs go down accompanied with the ...there are connected to nexus5k-docfeedback@cisco.com. If they are no disputes or incorrect port states. Possible Cause The MAC address is disabled. Chapter 3 Troubleshooting Layer 2 Switching Issues Spanning Tree Protocol Send document comments to a non-host device/switch that is sending BPDUs, the HIFs...
Troubleshooting Guide
Page 46
...the details of the STP port state for the port: • show spanning-tree interface detail • show spanning-tree interface Cisco Nexus 5000 Series Troubleshooting Guide 3-4 OL-25300-01 However, the port is stuck in STP blocking state with BLK*(Type_Inc). At that they... mode. This is supposed to indicate that they have the same native VLAN. Spanning Tree Protocol Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to nexus5k-docfeedback@cisco.com. • If the source of the data frames, which are physically moving, is identified, then control ...
...the details of the STP port state for the port: • show spanning-tree interface detail • show spanning-tree interface Cisco Nexus 5000 Series Troubleshooting Guide 3-4 OL-25300-01 However, the port is stuck in STP blocking state with BLK*(Type_Inc). At that they... mode. This is supposed to indicate that they have the same native VLAN. Spanning Tree Protocol Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to nexus5k-docfeedback@cisco.com. • If the source of the data frames, which are physically moving, is identified, then control ...
Troubleshooting Guide
Page 47
... by using the show platform fwm info vlan 1001 all_macgs verbose Solution OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-5 Chapter 3 Troubleshooting Layer 2 Switching Issues Multicast Send document comments to conserve MAC address space. Alternatively, you can clear ...the MAC addresses specifically by the switch in order to nexus5k-docfeedback@cisco.com. Solution Check the native VLAN ...
... by using the show platform fwm info vlan 1001 all_macgs verbose Solution OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-5 Chapter 3 Troubleshooting Layer 2 Switching Issues Multicast Send document comments to conserve MAC address space. Alternatively, you can clear ...the MAC addresses specifically by the switch in order to nexus5k-docfeedback@cisco.com. Solution Check the native VLAN ...
Troubleshooting Guide
Page 48
...indicates that VLANs must be created. Solution Use a VLAN number that is used. Cisco Nexus 5000 Series Troubleshooting Guide 3-6 OL-25300-01 VLANs Nexus 5000 does not have the same VLANs as switch running the VTP server. Possible Cause An internal VLAN range is , 224.0.0.X) are ...not the same as for the switch running VTP server VLANs for the Nexus 5000 are not created. VLANs Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to 4047 is reserved for internal use . Possible Cause IGMP snooping...
...indicates that VLANs must be created. Solution Use a VLAN number that is used. Cisco Nexus 5000 Series Troubleshooting Guide 3-6 OL-25300-01 VLANs Nexus 5000 does not have the same VLANs as switch running the VTP server. Possible Cause An internal VLAN range is , 224.0.0.X) are ...not the same as for the switch running VTP server VLANs for the Nexus 5000 are not created. VLANs Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to 4047 is reserved for internal use . Possible Cause IGMP snooping...
Troubleshooting Guide
Page 49
... mismatch Name Type Local Value Peer Value OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-7 Possible Cause VLAN was suspended by the vPC configuration on the Nexus 5000 pair: Example: switch# sh vpc consistency-parameters global Legend: Type 1 : vPC...switch(config-if)# shut switch(config-if)# no shutdown switch(config-if)# show interface vlan 600 brief Interface Secondary VLAN(Type) Status Reason Vlan600 -- VLAN ID 1-4094 or range(s): 1-5, 10 or 2-5,7-19 Interface VLAN is down . If it come up -- Chapter 3 Troubleshooting Layer 2 Switching...
... mismatch Name Type Local Value Peer Value OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-7 Possible Cause VLAN was suspended by the vPC configuration on the Nexus 5000 pair: Example: switch# sh vpc consistency-parameters global Legend: Type 1 : vPC...switch(config-if)# shut switch(config-if)# no shutdown switch(config-if)# show interface vlan 600 brief Interface Secondary VLAN(Type) Status Reason Vlan600 -- VLAN ID 1-4094 or range(s): 1-5, 10 or 2-5,7-19 Interface VLAN is down . If it come up -- Chapter 3 Troubleshooting Layer 2 Switching...
Troubleshooting Guide
Page 50
... for VLAN). Possible Cause The VLAN was not created. Cannot create VLAN The VLAN cannot be created. Solution For the Nexus 5000, the maximum number of available VLANs. Use the show resource vlan command to determine if VLAN exists. Solution In ...an interface does not automatically create VLAN . If it does not exist, then use the vlan command to nexus5k-docfeedback@cisco.com. remainder reserved for VSAN; VLANs Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to create the VLAN. QoS 1 Network QoS (MTU) 1 Network Qos (Pause) 1 Input ...
... for VLAN). Possible Cause The VLAN was not created. Cannot create VLAN The VLAN cannot be created. Solution For the Nexus 5000, the maximum number of available VLANs. Use the show resource vlan command to determine if VLAN exists. Solution In ...an interface does not automatically create VLAN . If it does not exist, then use the vlan command to nexus5k-docfeedback@cisco.com. remainder reserved for VSAN; VLANs Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to create the VLAN. QoS 1 Network QoS (MTU) 1 Network Qos (Pause) 1 Input ...
Troubleshooting Guide
Page 51
...The private VLAN (PVLAN) cannot be created. Solution The interface-vlan feature must be enabled before configuring the SVI. Chapter 3 Troubleshooting Layer 2 Switching Issues VLANs Send document comments to determine which makes the PVLAN command available. Resource ----------- Use the show feature Feature Name Instance State... interface-vlan 1 enabled private-vlan 1 enabled udld 1 enabled vpc 1 enabled fcoe 1 disabled fex 1 enabled OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-9 Possible Cause The private-vlan feature is not enabled.
...The private VLAN (PVLAN) cannot be created. Solution The interface-vlan feature must be enabled before configuring the SVI. Chapter 3 Troubleshooting Layer 2 Switching Issues VLANs Send document comments to determine which makes the PVLAN command available. Resource ----------- Use the show feature Feature Name Instance State... interface-vlan 1 enabled private-vlan 1 enabled udld 1 enabled vpc 1 enabled fcoe 1 disabled fex 1 enabled OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-9 Possible Cause The private-vlan feature is not enabled.
Troubleshooting Guide
Page 52
...only option is associated with ethernet 1/1. Stomping a frame involves setting the FCS to nexus5k-docfeedback@cisco.com. The following example, the chip is being switched in the path for the Nexus 5000 to drop this frame. A downstream store-and-forward device, or a host, will ...interface, except for queuing drops. The example shows which Gatos and which chip your port resides. Registers and Counters Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to a known value that does not pass a CRC check. There are logical and physical causes for this...
...only option is associated with ethernet 1/1. Stomping a frame involves setting the FCS to nexus5k-docfeedback@cisco.com. The following example, the chip is being switched in the path for the Nexus 5000 to drop this frame. A downstream store-and-forward device, or a host, will ...interface, except for queuing drops. The example shows which Gatos and which chip your port resides. Registers and Counters Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to a known value that does not pass a CRC check. There are logical and physical causes for this...
Troubleshooting Guide
Page 53
...on the ingress interface. Chapter 3 Troubleshooting Layer 2 Switching Issues Registers and Counters Send document comments to the port : 0 Pkts discarded on ingress : 0 Per-priority-pause status : Rx (Inactive), Tx (Inactive) OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-11 Note The ... enabled to protect NX-OS from the cross-bar : 0 Pkts sent to nexus5k-docfeedback@cisco.com. Increments with VLAN_MASK_TO_NULL. not actually a VLAN. Example: switch# show platform fwm info gatos-errors command increments 3 times for the CPU interfaces; Increments ...
...on the ingress interface. Chapter 3 Troubleshooting Layer 2 Switching Issues Registers and Counters Send document comments to the port : 0 Pkts discarded on ingress : 0 Per-priority-pause status : Rx (Inactive), Tx (Inactive) OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-11 Note The ... enabled to protect NX-OS from the cross-bar : 0 Pkts sent to nexus5k-docfeedback@cisco.com. Increments with VLAN_MASK_TO_NULL. not actually a VLAN. Example: switch# show platform fwm info gatos-errors command increments 3 times for the CPU interfaces; Increments ...
Troubleshooting Guide
Page 54
...good frame is a frame that has a CRC error or other kind of error All counters include MAC Control frames where applicable. 3-12 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 You can be seen with the error already. The egress interface increments a Tx CRC error and...statistics: Mcast pkts received from the cross-bar : 0 MTU violation The Nexus 5000 is a cut -through to nexus5k-docfeedback@cisco.com. However, the frame cannot be dropped. Registers and Counters Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to the next device in the FCS on to...
...good frame is a frame that has a CRC error or other kind of error All counters include MAC Control frames where applicable. 3-12 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 You can be seen with the error already. The egress interface increments a Tx CRC error and...statistics: Mcast pkts received from the cross-bar : 0 MTU violation The Nexus 5000 is a cut -through to nexus5k-docfeedback@cisco.com. However, the frame cannot be dropped. Registers and Counters Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to the next device in the FCS on to...
Troubleshooting Guide
Page 55
... frames transmitted. Number of frames (good and bad frames) transmitted. Number of good unicast frames transmitted. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-13 Number of frames (good and bad frames) with transmit packet size between 1519 and 2047... Total byte count of good frames. Total byte count of packet octets (good and bad frames) transmitted. Chapter 3 Troubleshooting Layer 2 Switching Issues Registers and Counters Send document comments to 64 bytes. Number of frame length. MAC TX Statistics Counter TX_PKT_LT64 TX_PKT_64 TX_PKT_65 ...
... frames transmitted. Number of frames (good and bad frames) transmitted. Number of good unicast frames transmitted. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-13 Number of frames (good and bad frames) with transmit packet size between 1519 and 2047... Total byte count of good frames. Total byte count of packet octets (good and bad frames) transmitted. Chapter 3 Troubleshooting Layer 2 Switching Issues Registers and Counters Send document comments to 64 bytes. Number of frame length. MAC TX Statistics Counter TX_PKT_LT64 TX_PKT_64 TX_PKT_65 ...
Troubleshooting Guide
Page 56
...good unicast frames received. Number of frame length. Number of good broadcast frames received. This number is always 0. 3-14 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Number of good multicast frames received. N/A The value of this counter is the sum... regardless of frames (good and bad frames) with receive packet size greater than CFG_xg_rx_stats_max_frame_len. Registers and Counters Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to 64 bytes. Number of frames (good and bad frames) with receive packet size between 1519 and...
...good unicast frames received. Number of frame length. Number of good broadcast frames received. This number is always 0. 3-14 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Number of good multicast frames received. N/A The value of this counter is the sum... regardless of frames (good and bad frames) with receive packet size greater than CFG_xg_rx_stats_max_frame_len. Registers and Counters Chapter 3 Troubleshooting Layer 2 Switching Issues Send document comments to 64 bytes. Number of frames (good and bad frames) with receive packet size between 1519 and...
Troubleshooting Guide
Page 57
...Total byte count of good priority flow control frames received. Number of frames with the actual frame length. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-15 Note Frame length is compared with a length field check error, but no CRC error. Number...the ethertype/length field. Number of good 802.3x MAC control frames received. Chapter 3 Troubleshooting Layer 2 Switching Issues Registers and Counters Send document comments to nexus5k-docfeedback@cisco.com. This length is based on the contents of bad frames received that are less than ...
...Total byte count of good priority flow control frames received. Number of frames with the actual frame length. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 3-15 Note Frame length is compared with a length field check error, but no CRC error. Number...the ethertype/length field. Number of good 802.3x MAC control frames received. Chapter 3 Troubleshooting Layer 2 Switching Issues Registers and Counters Send document comments to nexus5k-docfeedback@cisco.com. This length is based on the contents of bad frames received that are less than ...