Troubleshooting Guide
Page 7
...Series NX-OS Fibre Channel over Ethernet Configuration Guide Cisco Nexus 5000 Series NX-OS Layer 2 Switching Configuration Guide Cisco Nexus 5000 Series NX-OS Multicast Routing Configuration Guide Cisco Nexus 5000 Series NX-OS Quality of Service Configuration Guide Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide Cisco Nexus 5000 Series NX-OS Security Configuration Guide Cisco Nexus 5000 Series NX-OS System Management Configuration Guide Cisco Nexus 5000 Series NX-OS Unicast Routing Configuration Guide Cisco Nexus 5000 Series Switch NX-OS Software Configuration Guide Cisco Nexus...
...Series NX-OS Fibre Channel over Ethernet Configuration Guide Cisco Nexus 5000 Series NX-OS Layer 2 Switching Configuration Guide Cisco Nexus 5000 Series NX-OS Multicast Routing Configuration Guide Cisco Nexus 5000 Series NX-OS Quality of Service Configuration Guide Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide Cisco Nexus 5000 Series NX-OS Security Configuration Guide Cisco Nexus 5000 Series NX-OS System Management Configuration Guide Cisco Nexus 5000 Series NX-OS Unicast Routing Configuration Guide Cisco Nexus 5000 Series Switch NX-OS Software Configuration Guide Cisco Nexus...
Troubleshooting Guide
Page 17
... Cisco Nexus 5000 Series Troubleshooting Guide 1-9 With VLANs or VSANs, all supported interfaces in the specified VLAN or VSAN are included as SPAN sources. The network analyzer can choose the SPAN traffic in a SPAN session. The Cisco Nexus 5000 Series switch supports Ethernet, virtual Ethernet, Fibre Channel, virtual Fibre Channel, port channels, SAN port channels, VLANs, and VSANs as SPAN sources. Note For the Cisco Nexus 5548 Switch, Fibre Channel ports cannot be a Cisco SwitchProbe, a Fibre Channel Analyzer, or other Remote Monitoring (RMON) probes. You can be configured...
... Cisco Nexus 5000 Series Troubleshooting Guide 1-9 With VLANs or VSANs, all supported interfaces in the specified VLAN or VSAN are included as SPAN sources. The network analyzer can choose the SPAN traffic in a SPAN session. The Cisco Nexus 5000 Series switch supports Ethernet, virtual Ethernet, Fibre Channel, virtual Fibre Channel, port channels, SAN port channels, VLANs, and VSANs as SPAN sources. Note For the Cisco Nexus 5548 Switch, Fibre Channel ports cannot be a Cisco SwitchProbe, a Fibre Channel Analyzer, or other Remote Monitoring (RMON) probes. You can be configured...
Troubleshooting Guide
Page 18
... source port can be a port channel or SAN port channel group. 1-10 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Source SPAN Ethernet Fibre Channel Fibre Channel Virtual Ethernet Virtual Fibre Channel Virtual Fibre Channel Destination SPAN Ethernet Fibre Channel Ethernet (FCoE) Ethernet Fibre Channel Ethernet (FCoE) Characteristics of Destination Ports Each local SPAN session must have a destination port (also called a monitored port, is not available for network traffic analysis. The Cisco Nexus 5000 Series switch supports Ethernet and Fibre Channel interfaces as...
... source port can be a port channel or SAN port channel group. 1-10 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Source SPAN Ethernet Fibre Channel Fibre Channel Virtual Ethernet Virtual Fibre Channel Virtual Fibre Channel Destination SPAN Ethernet Fibre Channel Ethernet (FCoE) Ethernet Fibre Channel Ethernet (FCoE) Characteristics of Destination Ports Each local SPAN session must have a destination port (also called a monitored port, is not available for network traffic analysis. The Cisco Nexus 5000 Series switch supports Ethernet and Fibre Channel interfaces as...
Troubleshooting Guide
Page 19
... (hardware resource unavailable). Chapter 1 Troubleshooting Overview Fabric Manager Tools and CLI Commands Send document comments to a source VLAN of any SPAN session. • Receives copies of 18 configurable sessions, only two are active (up DESCRIPTION OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-11 This congestion can affect traffic forwarding on the monitor source with an unknown VLAN tag are not preserved at the monitor (span) destination. • Packets coming...
... (hardware resource unavailable). Chapter 1 Troubleshooting Overview Fabric Manager Tools and CLI Commands Send document comments to a source VLAN of any SPAN session. • Receives copies of 18 configurable sessions, only two are active (up DESCRIPTION OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 1-11 This congestion can affect traffic forwarding on the monitor source with an unknown VLAN tag are not preserved at the monitor (span) destination. • Packets coming...
Troubleshooting Guide
Page 22
...): IPv4 Address: 11.1.1.1 Platform: cisco WS-C6506, Capabilities: Router Switch IGMP Filtering Interface: Ethernet1/4, Port ID (outgoing port): TenGigabitEthernet1/2 port connections Holdtime: 133 sec ? However, in DCBX and VIC protocols. 1-14 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Throughout the 'shut' period FCF Advertisements indicate 'not available for login'. • In case the loss of SAN connectivity is signaled using logical link status TLVs defined in the converged network...
...): IPv4 Address: 11.1.1.1 Platform: cisco WS-C6506, Capabilities: Router Switch IGMP Filtering Interface: Ethernet1/4, Port ID (outgoing port): TenGigabitEthernet1/2 port connections Holdtime: 133 sec ? However, in DCBX and VIC protocols. 1-14 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 Throughout the 'shut' period FCF Advertisements indicate 'not available for login'. • In case the loss of SAN connectivity is signaled using logical link status TLVs defined in the converged network...
Troubleshooting Guide
Page 26
... interface transmit Enable LLDP transmission on the interface. Check if values exist for VFC is disabled, the VFC will not come online. Example: switch# show lldp interface ethernet 1/4 command. Use the show lldp interface ethernet 1/4 Interface Information: Enable (tx/rx/dcbx): Y/Y/Y Port Mac address: 00:0d:ec:d5:a3:8b Peer's LLDP TLVs: Type Length Value Cisco Nexus 5000 Series Troubleshooting Guide 2-2 OL-25300-01 Check if remote peers exist. Example: switch# show lldp interface ethernet 1/4 command. switch# show running-config feature fcoe vlan 1 vlan...
... interface transmit Enable LLDP transmission on the interface. Check if values exist for VFC is disabled, the VFC will not come online. Example: switch# show lldp interface ethernet 1/4 command. Use the show lldp interface ethernet 1/4 Interface Information: Enable (tx/rx/dcbx): Y/Y/Y Port Mac address: 00:0d:ec:d5:a3:8b Peer's LLDP TLVs: Type Length Value Cisco Nexus 5000 Series Troubleshooting Guide 2-2 OL-25300-01 Check if remote peers exist. Example: switch# show lldp interface ethernet 1/4 command. switch# show running-config feature fcoe vlan 1 vlan...
Troubleshooting Guide
Page 29
... Protocol. - Absence of operating configuration indicates that the peer does not support the DCBX TLV or that the VSAN trunk protocol has been enabled. Peer does not support some DCBX TLVs. - OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 2-5 Example: switch(config)# int eth1/21 switch(config-if)# priority-flow-control mode ? Use the show system internal dcbx info interface ethernet 1/4 feature type 3 sub_type 0 feature state variables: oper_version 0 error 0 oper_mode 1 feature_seq_no 0 remote_feature_tlv_present...
... Protocol. - Absence of operating configuration indicates that the peer does not support the DCBX TLV or that the VSAN trunk protocol has been enabled. Peer does not support some DCBX TLVs. - OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 2-5 Example: switch(config)# int eth1/21 switch(config-if)# priority-flow-control mode ? Use the show system internal dcbx info interface ethernet 1/4 feature type 3 sub_type 0 feature state variables: oper_version 0 error 0 oper_mode 1 feature_seq_no 0 remote_feature_tlv_present...
Troubleshooting Guide
Page 34
... driver is installed on the host OS. Emulex provides the OneCommand GUI tool to support the installed Converged Network Adapter model. FCoE VLAN must connect to exactly one converged access switch, preferably over an Ethernet port channel to avoid disruption due to nexus5k-docfeedback@cisco.com. Solution Step 1 Step 2 Step 3 Step 4 1) Obtain the following host-based tools: • Emulex - Chapter 2 Troubleshooting FCoE Issues CNA Send document comments to STP...
... driver is installed on the host OS. Emulex provides the OneCommand GUI tool to support the installed Converged Network Adapter model. FCoE VLAN must connect to exactly one converged access switch, preferably over an Ethernet port channel to avoid disruption due to nexus5k-docfeedback@cisco.com. Solution Step 1 Step 2 Step 3 Step 4 1) Obtain the following host-based tools: • Emulex - Chapter 2 Troubleshooting FCoE Issues CNA Send document comments to STP...
Troubleshooting Guide
Page 36
...@cisco.com. i pause command. • For a few iterations, use the show interface ethx/x |grep - Chapter 2 Troubleshooting FCoE Issues PFC Send document comments to verify DCBX support and that the PFC frame count is incrementing using the show interface ethx/x command and make sure the pause frame count is connected to a CNA, then the CNA might be sending Xon PFC frames to CNA.) Example: switch# show interface ethernet 1/13 priority-flow-control Port Mode...
...@cisco.com. i pause command. • For a few iterations, use the show interface ethx/x |grep - Chapter 2 Troubleshooting FCoE Issues PFC Send document comments to verify DCBX support and that the PFC frame count is incrementing using the show interface ethx/x command and make sure the pause frame count is connected to a CNA, then the CNA might be sending Xon PFC frames to CNA.) Example: switch# show interface ethernet 1/13 priority-flow-control Port Mode...
Troubleshooting Guide
Page 37
... the traffic from the switch to the servers. To verify this indicates that the issue is connected to a CNA along with slow servers that the PFC frame count is incrementing. • For a few iterations, use the show queuing interface ethx/x command to nexus5k-docfeedback@cisco.com. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 2-13 Chapter 2 Troubleshooting FCoE Issues PFC Send document comments to check the pause status. Check if switch...
... the traffic from the switch to the servers. To verify this indicates that the issue is connected to a CNA along with slow servers that the PFC frame count is incrementing. • For a few iterations, use the show queuing interface ethx/x command to nexus5k-docfeedback@cisco.com. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 2-13 Chapter 2 Troubleshooting FCoE Issues PFC Send document comments to check the pause status. Check if switch...
Troubleshooting Guide
Page 47
...you can clear the MAC addresses specifically by host Host does not receive multicast data traffic. Review the output from the following commands: • show ip igmp snooping groups vlan 1001 • show mac address-table multicast vlan 1001 igmp-snooping • show spanning-tree vlan command. Chapter 3 Troubleshooting Layer 2 Switching Issues Multicast Send document comments to conserve MAC address space. Multicast Source MAC addresses of IGMP joins are learned In this situation, the source MAC addresses of IGMP joins are synchronized, the port moves out of the link...
...you can clear the MAC addresses specifically by host Host does not receive multicast data traffic. Review the output from the following commands: • show ip igmp snooping groups vlan 1001 • show mac address-table multicast vlan 1001 igmp-snooping • show spanning-tree vlan command. Chapter 3 Troubleshooting Layer 2 Switching Issues Multicast Send document comments to conserve MAC address space. Multicast Source MAC addresses of IGMP joins are learned In this situation, the source MAC addresses of IGMP joins are synchronized, the port moves out of the link...
Troubleshooting Guide
Page 48
... commands: switch(config)# feature vtp switch(config)# vtp mode transparent switch(config)# exit switch# show vtp status VLAN cannot be created A VLAN cannot be configured locally. Possible Cause The Nexus 5000 currently supports VTP only in a VPC setup In a VPC setup multicast traffic is being flooded in transparent mode (4.2(1)N1(1) and later releases). Cisco Nexus 5000 Series Troubleshooting Guide 3-6 OL-25300-01 However a VTP client and server can both switches. Solution Use a VLAN number that is used. Note Groups for link local IP addresses...
... commands: switch(config)# feature vtp switch(config)# vtp mode transparent switch(config)# exit switch# show vtp status VLAN cannot be created A VLAN cannot be configured locally. Possible Cause The Nexus 5000 currently supports VTP only in a VPC setup In a VPC setup multicast traffic is being flooded in transparent mode (4.2(1)N1(1) and later releases). Cisco Nexus 5000 Series Troubleshooting Guide 3-6 OL-25300-01 However a VTP client and server can both switches. Solution Use a VLAN number that is used. Note Groups for link local IP addresses...
Troubleshooting Guide
Page 61
... the egress traffic (from the Nexus 5000 to the Nexus 5000 if you are using Telnet or SSH. The Nexus 2232/Nexus 2248 has six hardware queues for user data, which will be used the write erase command to create CoS-queue mapping.// class-map type qos voice-global match cos 5 class-map type qos critical-global match cos 6 class-map type qos scavenger-global OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 4-3 It...
... the egress traffic (from the Nexus 5000 to the Nexus 5000 if you are using Telnet or SSH. The Nexus 2232/Nexus 2248 has six hardware queues for user data, which will be used the write erase command to create CoS-queue mapping.// class-map type qos voice-global match cos 5 class-map type qos critical-global match cos 6 class-map type qos scavenger-global OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 4-3 It...
Troubleshooting Guide
Page 66
... following commands under interface ethx/y to enable pause no -drop classes. Please change your configuration and re-apply" Possible Cause Nexus 5000 supports a maximum of PFC on backto-back switch links. • no priority-flow-control mode on • flowcontrol receive on • flowcontrol send on Cannot enable "pause no -drop. CLI commands fail with DCBX, then configuring flowcontrol send on and flowcontrol receive on that interface. Example: class type network-qos...
... following commands under interface ethx/y to enable pause no -drop classes. Please change your configuration and re-apply" Possible Cause Nexus 5000 supports a maximum of PFC on backto-back switch links. • no priority-flow-control mode on • flowcontrol receive on • flowcontrol send on Cannot enable "pause no -drop. CLI commands fail with DCBX, then configuring flowcontrol send on and flowcontrol receive on that interface. Example: class type network-qos...
Troubleshooting Guide
Page 73
... includes the following questions to determine the status of storage devices that provide data storage for servers. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 5-1 This chapter describes how to identify and resolve problems that you should investigate further. Send document comments to nexus5k-docfeedback@cisco.com. 5 C H A P T E R Troubleshooting SAN Switching Issues A storage area network (SAN) is a network of your installation: • Is this section, you can...
... includes the following questions to determine the status of storage devices that provide data storage for servers. OL-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 5-1 This chapter describes how to identify and resolve problems that you should investigate further. Send document comments to nexus5k-docfeedback@cisco.com. 5 C H A P T E R Troubleshooting SAN Switching Issues A storage area network (SAN) is a network of your installation: • Is this section, you can...
Troubleshooting Guide
Page 84
... the zone. Another approach is to migrate the zone operation mode from the show tech-support zone command and the show zone status command to display the status of mismatched default zone policies. • Use the show logging log command. Zoning Chapter 5 Troubleshooting SAN Switching Issues Send document comments to nexus5k-docfeedback@cisco.com. • To further troubleshoot this issue, capture the output from basic to enhanced...
... the zone. Another approach is to migrate the zone operation mode from the show tech-support zone command and the show zone status command to display the status of mismatched default zone policies. • Use the show logging log command. Zoning Chapter 5 Troubleshooting SAN Switching Issues Send document comments to nexus5k-docfeedback@cisco.com. • To further troubleshoot this issue, capture the output from basic to enhanced...
Troubleshooting Guide
Page 88
... N_Port Controller Reserved Event Service (FC-GS-5) Multicast Server (FC-PH3) Clock Synchronization Server (FC-PH3) Security Key Distribution Service (FC-PH3) Alias Server (FC-PH2) Quality of services for its clients, which are reserved for the existing port channels. Overview Fibre Channel fabrics provide a set of Service Facilitator-Class4 (FC-PH2) Management Service (FC-GS-5) 5-16 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 FC Services Chapter 5 Troubleshooting SAN Switching Issues Send document...
... N_Port Controller Reserved Event Service (FC-GS-5) Multicast Server (FC-PH3) Clock Synchronization Server (FC-PH3) Security Key Distribution Service (FC-PH3) Alias Server (FC-PH2) Quality of services for its clients, which are reserved for the existing port channels. Overview Fibre Channel fabrics provide a set of Service Facilitator-Class4 (FC-PH2) Management Service (FC-GS-5) 5-16 Cisco Nexus 5000 Series Troubleshooting Guide OL-25300-01 FC Services Chapter 5 Troubleshooting SAN Switching Issues Send document...
Troubleshooting Guide
Page 131
...-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 6-3 Possible Cause You are checking the interface or VLAN role policy with the show user-account command. • Verify the role definition with CLI commands, such as in a union-to-permit function, that each command is examined and compared to enter the interface eth1/1 configuration mode. Solution RBAC does not support filtering when displaying commands. Change to . Role's interface or VLAN policy does...
...-25300-01 Cisco Nexus 5000 Series Troubleshooting Guide 6-3 Possible Cause You are checking the interface or VLAN role policy with the show user-account command. • Verify the role definition with CLI commands, such as in a union-to-permit function, that each command is examined and compared to enter the interface eth1/1 configuration mode. Solution RBAC does not support filtering when displaying commands. Change to . Role's interface or VLAN policy does...
Troubleshooting Guide
Page 148
... -config interface port-channel500 !Time: Tue Mar 8 04:10:38 2011 version 4.2(1)N2(1) interface port-channel500 switchport mode trunk vpc peer-link spanning-tree port type network speed 10000 Create a port-channel 500 on switch1 and associate it to the ports connecting to the other Nexus 5000 switch and observe the ports. switch1(config)# int po 500 switch1(config-if)# int e1/25-26 Cisco Nexus 5000 Series Troubleshooting Guide 8-6 OL-25300-01 In this example, you can see that port-channel 500 is configured...
... -config interface port-channel500 !Time: Tue Mar 8 04:10:38 2011 version 4.2(1)N2(1) interface port-channel500 switchport mode trunk vpc peer-link spanning-tree port type network speed 10000 Create a port-channel 500 on switch1 and associate it to the ports connecting to the other Nexus 5000 switch and observe the ports. switch1(config)# int po 500 switch1(config-if)# int e1/25-26 Cisco Nexus 5000 Series Troubleshooting Guide 8-6 OL-25300-01 In this example, you can see that port-channel 500 is configured...
Troubleshooting Guide
Page 154
... status command and determine which configurations failed to the database of the switch-profile. Use the buffer-move the configuration into SP. Used to the configuration. If the configurations are moved from the global-db to merge. • If one of a pair of interfaces and not global configurations. Use the show running configurations for specified interfaces. Solution Determine if a system resource utilization problem exists. Solution Cisco Nexus 5000 Series Troubleshooting Guide...
... status command and determine which configurations failed to the database of the switch-profile. Use the buffer-move the configuration into SP. Used to the configuration. If the configurations are moved from the global-db to merge. • If one of a pair of interfaces and not global configurations. Use the show running configurations for specified interfaces. Solution Determine if a system resource utilization problem exists. Solution Cisco Nexus 5000 Series Troubleshooting Guide...