Troubleshooting Guide
Page 2
... any other company. (0812R) Any Internet Protocol (IP) addresses used in this document or website are not intended to mdsfeedback-doc@cisco.com THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF ...
... any other company. (0812R) Any Internet Protocol (IP) addresses used in this document or website are not intended to mdsfeedback-doc@cisco.com THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF ...
Troubleshooting Guide
Page 25
... 3.x, and tells you where they are also listed in the website mentioned above. Send documentation comments to mdsfeedback-doc@cisco.com New and Changed Information This chapter provides release-specific information for each new and changed guideline in the Cisco MDS SAN-OS Release 3.x software. Chapter 26, "Troubleshooting Fabric Manager" OL-9285-05...
... 3.x, and tells you where they are also listed in the website mentioned above. Send documentation comments to mdsfeedback-doc@cisco.com New and Changed Information This chapter provides release-specific information for each new and changed guideline in the Cisco MDS SAN-OS Release 3.x software. Chapter 26, "Troubleshooting Fabric Manager" OL-9285-05...
Troubleshooting Guide
Page 33
... could be causing the symptoms. Systematically eliminate each potential problem (from most likely to mdsfeedback-doc@cisco.com 1 C H A P T E R Troubleshooting Overview This chapter introduces the basic concepts, methodology, and general troubleshooting guidelines for problems that are specific to use a variety of multilayer directors and fabric switches. For this reason, this book for investigating...
... could be causing the symptoms. Systematically eliminate each potential problem (from most likely to mdsfeedback-doc@cisco.com 1 C H A P T E R Troubleshooting Overview This chapter introduces the basic concepts, methodology, and general troubleshooting guidelines for problems that are specific to use a variety of multilayer directors and fabric switches. For this reason, this book for investigating...
Troubleshooting Guide
Page 34
... your fabric. These questions are independent of the problem. Best Practices Chapter 1 Troubleshooting Overview Send documentation comments to mdsfeedback-doc@cisco.com Best Practices Best practices are the recommended steps you trying to solve an existing application problem (too slow, too high ... excessively long response time) or did the problem show up recently? See the "System Messages" section on an existing subsystem, then fabric-specific issues (such as FSPF, ISLs, or FCNS) do not need to the release notes for the latest features, limitations, and caveats. ...
... your fabric. These questions are independent of the problem. Best Practices Chapter 1 Troubleshooting Overview Send documentation comments to mdsfeedback-doc@cisco.com Best Practices Best practices are the recommended steps you trying to solve an existing application problem (too slow, too high ... excessively long response time) or did the problem show up recently? See the "System Messages" section on an existing subsystem, then fabric-specific issues (such as FSPF, ISLs, or FCNS) do not need to the release notes for the latest features, limitations, and caveats. ...
Troubleshooting Guide
Page 35
...; Interface status-In Fabric Manager, choose Switches > Interfaces and select the port type you may include additional tools and commands specific to -End Connectivity" section on page 1-4. Common Fabric Manager Tools Use the following general SAN troubleshooting steps: Step 1 Step...page 1-5. See the "Verifying SAN Element Registration" section on page 1-3. Verify registration to troubleshoot problems within your specific problem. OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 1-3 See the "Verifying Basic Connectivity" section on page 1-5. In...
...; Interface status-In Fabric Manager, choose Switches > Interfaces and select the port type you may include additional tools and commands specific to -End Connectivity" section on page 1-4. Common Fabric Manager Tools Use the following general SAN troubleshooting steps: Step 1 Step...page 1-5. See the "Verifying SAN Element Registration" section on page 1-3. Verify registration to troubleshoot problems within your specific problem. OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 1-3 See the "Verifying Basic Connectivity" section on page 1-5. In...
Troubleshooting Guide
Page 67
... ping the TFTP server. • The TFTP server must type the command exactly as you want the command to obtain more information about a specific command in the "Recovery from the switch(boot)# Prompt" section on the defined subnet. The switch(boot)# prompt indicates that you have a ...usable Kickstart image. OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-19 loader> net --nm= 255.255.255.0 Specify the IP address of the default gateway (rather than...
... ping the TFTP server. • The TFTP server must type the command exactly as you want the command to obtain more information about a specific command in the "Recovery from the switch(boot)# Prompt" section on the defined subnet. The switch(boot)# prompt indicates that you have a ...usable Kickstart image. OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-19 loader> net --nm= 255.255.255.0 Specify the IP address of the default gateway (rather than...
Troubleshooting Guide
Page 68
...TERM signal Sending all processes the KILL signal... done. INIT: Going single user INIT: Sending processes the TERM signal switch(boot)# 2-20 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x OL-9285-05 You must type the command exactly as you begin this prompt or to appear...255.255.0 Server: 0.0.0.0 Gateway: 0.0.0.0 Specify the IP address of the configuration files before you want the command to obtain more information about a specific command in undesired errors. loader> boot tftp://172.16.10.100/kickstart-image1 Address: 172.16.1.2 Netmask: 255.255.255.0 Server: 172....
...TERM signal Sending all processes the KILL signal... done. INIT: Going single user INIT: Sending processes the TERM signal switch(boot)# 2-20 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x OL-9285-05 You must type the command exactly as you begin this prompt or to appear...255.255.0 Server: 0.0.0.0 Gateway: 0.0.0.0 Specify the IP address of the configuration files before you want the command to obtain more information about a specific command in undesired errors. loader> boot tftp://172.16.10.100/kickstart-image1 Address: 172.16.1.2 Netmask: 255.255.255.0 Server: 172....
Troubleshooting Guide
Page 72
...Server: 172.16.10.100 Gateway: 172.16.1.1 Booting: /kick-282 console=ttyS0,9600n8nn quiet loader_ver= "2.1(2 Image verification OK Starting kernel... 2-24 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x OL-9285-05 loader> ip default-gateway 172.16.1.1 Address: 172.16.1.2 Netmask: 255.255.255.0...255.255.255.0 Server: 0.0.0.0 Gateway: 0.0.0.0 Specify the IP address of commands available at this prompt or to obtain more information about a specific command in undesired errors. Step 2 Step 3 Step 4 Specify the local IP address and the subnet mask for the switch. If you wait...
...Server: 172.16.10.100 Gateway: 172.16.1.1 Booting: /kick-282 console=ttyS0,9600n8nn quiet loader_ver= "2.1(2 Image verification OK Starting kernel... 2-24 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x OL-9285-05 loader> ip default-gateway 172.16.1.1 Address: 172.16.1.2 Netmask: 255.255.255.0...255.255.255.0 Server: 0.0.0.0 Gateway: 0.0.0.0 Specify the IP address of commands available at this prompt or to obtain more information about a specific command in undesired errors. Step 2 Step 3 Step 4 Specify the local IP address and the subnet mask for the switch. If you wait...
Troubleshooting Guide
Page 76
...0x7FFFFC5C: 0804F990 0804C416 00000003 0804E994 0x7FFFFC6C: 00000008 0804BF95 2AC451E0 2AAC24A4 .........Q.*.$.* 0x7FFFFC7C: 7FFFFD14 2AC2C581 0804E6BC 7FFFFCA8 2-28 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x OL-9285-05 S0 - Step 3 Step 4 The system output looks like...PID ntp 919 snsm 972 Normal-exit ----------- Troubleshooting Cisco SAN-OS Software System Reboots Chapter 2 Troubleshooting Installs, Upgrades, and Reboots Send documentation comments to show detailed information about a specific process that have had abnormal exits and to be ...
...0x7FFFFC5C: 0804F990 0804C416 00000003 0804E994 0x7FFFFC6C: 00000008 0804BF95 2AC451E0 2AAC24A4 .........Q.*.$.* 0x7FFFFC7C: 7FFFFD14 2AC2C581 0804E6BC 7FFFFCA8 2-28 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x OL-9285-05 S0 - Step 3 Step 4 The system output looks like...PID ntp 919 snsm 972 Normal-exit ----------- Troubleshooting Cisco SAN-OS Software System Reboots Chapter 2 Troubleshooting Installs, Upgrades, and Reboots Send documentation comments to show detailed information about a specific process that have had abnormal exits and to be ...
Troubleshooting Guide
Page 78
... to a TFTP server: system cores tftp:[//servername][/path] Step 8 This command causes the switch to enable the automatic copy of a specific core file to review your core dump. output abbreviated ... This time interval is not configurable. • The copy of core files to...See also the "Troubleshooting Supervisor Issues" section on page 4-14 or the "Troubleshooting Switching and Services Modules" section on page 4-21. 2-30 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x OL-9285-05 ESP 7FFFF830, TOP 7FFFFCD0 Enter the following conditions apply: • The core files are...
... to a TFTP server: system cores tftp:[//servername][/path] Step 8 This command causes the switch to enable the automatic copy of a specific core file to review your core dump. output abbreviated ... This time interval is not configurable. • The copy of core files to...See also the "Troubleshooting Supervisor Issues" section on page 4-14 or the "Troubleshooting Switching and Services Modules" section on page 4-21. 2-30 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x OL-9285-05 ESP 7FFFF830, TOP 7FFFFCD0 Enter the following conditions apply: • The core files are...
Troubleshooting Guide
Page 79
... Restarts An unrecoverable system restart might occur in slot 5 and slot 6 are displayed. • The show system reset-reason module 5 ----- reset reason for a specific module in slot 1 are displayed. Chapter 2 Troubleshooting Installs, Upgrades, and Reboots Troubleshooting Cisco SAN-OS Software System Reboots Send documentation comments to an unrecoverable reset, see the "Troubleshooting...
... Restarts An unrecoverable system restart might occur in slot 5 and slot 6 are displayed. • The show system reset-reason module 5 ----- reset reason for a specific module in slot 1 are displayed. Chapter 2 Troubleshooting Installs, Upgrades, and Reboots Troubleshooting Cisco SAN-OS Software System Reboots Send documentation comments to an unrecoverable reset, see the "Troubleshooting...
Troubleshooting Guide
Page 81
...cause the system to reboot. Reload the MPS-14/2 module using a SAN-OS version with operational FCIP PortChannels is a specific module. Downgrade to Cisco SAN-OS Release 2.1.2 or 2.1(1b). Switch Reboots after FCIP Reload Symptom Switch rebooted after FCIP module was reloaded, upgraded...reload module module-number command, where module-number is reloaded, upgraded, or downgraded, the supervisor module might have been reinitialized from Cisco MDS SAN-OS Release 2.0(1b) to Release 2.0(3) and following the configuration of a new FCIP link. Possible Cause Solution This ...
...cause the system to reboot. Reload the MPS-14/2 module using a SAN-OS version with operational FCIP PortChannels is a specific module. Downgrade to Cisco SAN-OS Release 2.1.2 or 2.1(1b). Switch Reboots after FCIP Reload Symptom Switch rebooted after FCIP module was reloaded, upgraded...reload module module-number command, where module-number is reloaded, upgraded, or downgraded, the supervisor module might have been reinitialized from Cisco MDS SAN-OS Release 2.0(1b) to Release 2.0(3) and following the configuration of a new FCIP link. Possible Cause Solution This ...
Troubleshooting Guide
Page 97
... can usually be doing to what it should hear the fan module to determine whether or not it is more fans in the system. The Cisco MDS 9000 Family includes the following sections: • Overview, page 4-1 • Troubleshooting Startup Issues, page 4-2 • Troubleshooting Startup Issues, page... Switching and Services Modules, page 4-21 Overview The key to success when troubleshooting the system hardware is to isolate the problem to a specific system component. This includes the power supply fans. • Fan module-The chassis fan module should operate whenever system power is on ...
... can usually be doing to what it should hear the fan module to determine whether or not it is more fans in the system. The Cisco MDS 9000 Family includes the following sections: • Overview, page 4-1 • Troubleshooting Startup Issues, page 4-2 • Troubleshooting Startup Issues, page... Switching and Services Modules, page 4-21 Overview The key to success when troubleshooting the system hardware is to isolate the problem to a specific system component. This includes the power supply fans. • Fan module-The chassis fan module should operate whenever system power is on ...
Troubleshooting Guide
Page 136
For detailed information about the installation and specifications for Generation 2 Modules Module or Switch DS-X9148 DS-X9124 DS-9304-18K9 DS-X9112 DS-X9704 DS-C9134-K9 Description 48-port 4-Gbps 24-port 4-Gbps 18-port/4-port 4-Gbps (MSM-18/4 module) 12-port 4-Gbps 4-port ...3.x 5-2 OL-9285-05 Table 5-2 Bandwidth and Port Groups for these modules, refer to mdsfeedback-doc@cisco.com Table 5-1 Generation 2 Modules and Switches (continued) Part Number DS-X9124 DS-9304-K9 Description 24-port 4-Gbps Fibre Channel switch 18-port 1/2/4-Gbps Fibre Channel switch with 4 Gigabit Ethernet ...
For detailed information about the installation and specifications for Generation 2 Modules Module or Switch DS-X9148 DS-X9124 DS-9304-18K9 DS-X9112 DS-X9704 DS-C9134-K9 Description 48-port 4-Gbps 24-port 4-Gbps 18-port/4-port 4-Gbps (MSM-18/4 module) 12-port 4-Gbps 4-port ...3.x 5-2 OL-9285-05 Table 5-2 Bandwidth and Port Groups for these modules, refer to mdsfeedback-doc@cisco.com Table 5-1 Generation 2 Modules and Switches (continued) Part Number DS-X9124 DS-9304-K9 Description 24-port 4-Gbps Fibre Channel switch 18-port 1/2/4-Gbps Fibre Channel switch with 4 Gigabit Ethernet ...
Troubleshooting Guide
Page 155
...ordering process, do not use the chassis serial number for the chassis where the module resides, not the module serial number. OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 6-7 Chapter 6 Troubleshooting Licensing Licensing Installation Issues Send documentation comments to obtain the correct chassis serial ...valid on any zeros in a license package that matches where you want to the switch for which it is issued and is specific to install a new license. Copy down the SerialNo Primary field for the chassis that you have not installed, you purchased...
...ordering process, do not use the chassis serial number for the chassis where the module resides, not the module serial number. OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 6-7 Chapter 6 Troubleshooting Licensing Licensing Installation Issues Send documentation comments to obtain the correct chassis serial ...valid on any zeros in a license package that matches where you want to the switch for which it is issued and is specific to install a new license. Copy down the SerialNo Primary field for the chassis that you have not installed, you purchased...
Troubleshooting Guide
Page 162
... Attributes> Switches > CFS. These applications can be CFS capable. Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 7-2 OL-9285-05 The results acts like a single switch fabric. As of VSANs over some specific VSANs. All switches in the fabric. If the CFS Regions feature...-enabled application, the configuration modification process begins and the application locks the fabric. • Pending database-The pending database is running Cisco SAN-OS Release 2.0(1b) or later. When you do not receive distributions and result in the topology, within the physical scope ...
... Attributes> Switches > CFS. These applications can be CFS capable. Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 7-2 OL-9285-05 The results acts like a single switch fabric. As of VSANs over some specific VSANs. All switches in the fabric. If the CFS Regions feature...-enabled application, the configuration modification process begins and the application locks the fabric. • Pending database-The pending database is running Cisco SAN-OS Release 2.0(1b) or later. When you do not receive distributions and result in the topology, within the physical scope ...
Troubleshooting Guide
Page 164
... Services Send documentation comments to mdsfeedback-doc@cisco.com Step 2 fscm Yes role Yes radius Yes fctimer No syslogd No callhome No device-alias Yes port-security ...00:00:0d:ec:06:55:c0 10.76.100.205 Total number of entries = 3 Scope :Logical [VSAN 3] Domain Switch WWN IP Address Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 7-4 OL-9285-05 An example command output for a physical scope application follows: Switch# show cfs peers...:d7:00:3c:9e 10.76.100.52 Total number of entries = 11 The Physical scope means that application to a specific VSAN.
... Services Send documentation comments to mdsfeedback-doc@cisco.com Step 2 fscm Yes role Yes radius Yes fctimer No syslogd No callhome No device-alias Yes port-security ...00:00:0d:ec:06:55:c0 10.76.100.205 Total number of entries = 3 Scope :Logical [VSAN 3] Domain Switch WWN IP Address Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 7-4 OL-9285-05 An example command output for a physical scope application follows: Switch# show cfs peers...:d7:00:3c:9e 10.76.100.52 Total number of entries = 11 The Physical scope means that application to a specific VSAN.
Troubleshooting Guide
Page 201
... two switches can be necessary to verify that you can manually change the content of the zone database on the Admin Status drop-down is specific to one of the following two approaches to resolve a zone merge failure: • Choose File > Restore from the Allowed VSAN list and ...click Apply Changes. OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 8-29 Remove the VSAN from the Edit Local Full Zone Database dialog box to overwrite the zoning configuration ...
... two switches can be necessary to verify that you can manually change the content of the zone database on the Admin Status drop-down is specific to one of the following two approaches to resolve a zone merge failure: • Choose File > Restore from the Allowed VSAN list and ...click Apply Changes. OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 8-29 Remove the VSAN from the Edit Local Full Zone Database dialog box to overwrite the zoning configuration ...
Troubleshooting Guide
Page 202
...would affect all the VSANs crossing the EISL instead of just the VSAN experiencing the isolation problem. 8-30 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x OL-9285-05 Therefore, for any allowed VSAN. zone copy ...a TE port, it . Common Problems with Port Interfaces Chapter 8 Troubleshooting Ports Send documentation comments to mdsfeedback-doc@cisco.com Troubleshooting E port Isolation Using the CLI To troubleshoot E port isolation due to zoning using the following commands:...:05:30:00:63:9e vsan is 1 Beacon is specific to one switch with the other switch's configuration.
...would affect all the VSANs crossing the EISL instead of just the VSAN experiencing the isolation problem. 8-30 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x OL-9285-05 Therefore, for any allowed VSAN. zone copy ...a TE port, it . Common Problems with Port Interfaces Chapter 8 Troubleshooting Ports Send documentation comments to mdsfeedback-doc@cisco.com Troubleshooting E port Isolation Using the CLI To troubleshoot E port isolation due to zoning using the following commands:...:05:30:00:63:9e vsan is 1 Beacon is specific to one switch with the other switch's configuration.
Troubleshooting Guide
Page 208
... access to their boot LUNs. Initial Troubleshooting Checklist Chapter 9 Troubleshooting N-Port Virtualization Send documentation comments to mdsfeedback-doc@cisco.com Initial Troubleshooting Checklist Troubleshooting an NPV problem involves gathering information about the switch configuration and connectivity of servers and ... and Restrictions • NPV core switches must support NPIV. • You cannot manually assign the server interfaces to a specific NPV core switch link. Ensure that NPIV is enabled on both sides of 16 VSANs are the same. Verify the status...
... access to their boot LUNs. Initial Troubleshooting Checklist Chapter 9 Troubleshooting N-Port Virtualization Send documentation comments to mdsfeedback-doc@cisco.com Initial Troubleshooting Checklist Troubleshooting an NPV problem involves gathering information about the switch configuration and connectivity of servers and ... and Restrictions • NPV core switches must support NPIV. • You cannot manually assign the server interfaces to a specific NPV core switch link. Ensure that NPIV is enabled on both sides of 16 VSANs are the same. Verify the status...