Troubleshooting Guide
Page 2
...ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED "AS IS" WITH ALL FAULTS. Any examples, command display output, and figures included in this...THE POSSIBILITY OF SUCH DAMAGES. The Cisco implementation of Cisco Systems, Inc. Changing the Way We Work, Live, Play, and Learn and Cisco Store are the property of California. Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x © 2009 Cisco Systems, Inc. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ...
...ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED "AS IS" WITH ALL FAULTS. Any examples, command display output, and figures included in this...THE POSSIBILITY OF SUCH DAMAGES. The Cisco implementation of Cisco Systems, Inc. Changing the Way We Work, Live, Play, and Learn and Cisco Store are the property of California. Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x © 2009 Cisco Systems, Inc. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ...
Troubleshooting Guide
Page 4
... 2-5 Verifying Cisco SAN-OS Software Installations 2-6 Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades 2-7 Software Installation Reports an Incompatibility 2-7 Diagnosing Compatibility Issues 2-7 Software Installation Ends with Error 2-9 Installing SAN-OS Software Using Fabric Manager 2-10 Installing Cisco SAN-OS Software from the CLI 2-11 Troubleshooting Cisco SAN-OS Software System Reboots ...States 2-25 Switch or Process Resets 2-26 Recoverable System Restarts 2-27 Unrecoverable System Restarts 2-31 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x iv OL-9285-05
... 2-5 Verifying Cisco SAN-OS Software Installations 2-6 Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades 2-7 Software Installation Reports an Incompatibility 2-7 Diagnosing Compatibility Issues 2-7 Software Installation Ends with Error 2-9 Installing SAN-OS Software Using Fabric Manager 2-10 Installing Cisco SAN-OS Software from the CLI 2-11 Troubleshooting Cisco SAN-OS Software System Reboots ...States 2-25 Switch or Process Resets 2-26 Recoverable System Restarts 2-27 Unrecoverable System Restarts 2-31 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x iv OL-9285-05
Troubleshooting Guide
Page 5
... 4-6 Troubleshooting the Power Supplies 4-7 Troubleshooting Fan Issues 4-8 Fan Is Not Spinning 4-8 Fan Is Spinning; Contents Send documentation comments to mdsfeedback-doc@cisco.com Recovering the Administrator Password 2-32 Miscellaneous Software Image Issues 2-32 All Ports Down Because of System Health Failure 2-33 Switch Reboots after FCIP Reload 2-33 FCIP Link Fails to... is On 4-6 Power Supply Fan Ok LED is Red 4-8 Troubleshooting a Fan Failure Using Device Manager 4-9 Troubleshooting a Fan Failure Using the CLI 4-10 OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x v
... 4-6 Troubleshooting the Power Supplies 4-7 Troubleshooting Fan Issues 4-8 Fan Is Not Spinning 4-8 Fan Is Spinning; Contents Send documentation comments to mdsfeedback-doc@cisco.com Recovering the Administrator Password 2-32 Miscellaneous Software Image Issues 2-32 All Ports Down Because of System Health Failure 2-33 Switch Reboots after FCIP Reload 2-33 FCIP Link Fails to... is On 4-6 Power Supply Fan Ok LED is Red 4-8 Troubleshooting a Fan Failure Using Device Manager 4-9 Troubleshooting a Fan Failure Using the CLI 4-10 OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x v
Troubleshooting Guide
Page 7
... Utilization in a Port Group Using the CLI 5-12 Cannot Enable a Port 5-13 Cannot Upgrade Supervisor System Image 5-13 Selecting the Correct Software Images 5-13 6 C H A P T E R Troubleshooting Licensing 6-1 License Overview 6-1 Chassis Serial Numbers 6-2 Grace Period 6-2 Initial ...Device Manager 6-10 License Listed as Missing 6-11 7 C H A P T E R Troubleshooting Cisco Fabric Services 7-1 Overview 7-1 Initial Troubleshooting Checklist 7-2 Verifying CFS Using Fabric Manager 7-3 Verifying CFS Using the CLI 7-3 OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x vii
... Utilization in a Port Group Using the CLI 5-12 Cannot Enable a Port 5-13 Cannot Upgrade Supervisor System Image 5-13 Selecting the Correct Software Images 5-13 6 C H A P T E R Troubleshooting Licensing 6-1 License Overview 6-1 Chassis Serial Numbers 6-2 Grace Period 6-2 Initial ...Device Manager 6-10 License Listed as Missing 6-11 7 C H A P T E R Troubleshooting Cisco Fabric Services 7-1 Overview 7-1 Initial Troubleshooting Checklist 7-2 Verifying CFS Using Fabric Manager 7-3 Verifying CFS Using the CLI 7-3 OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x vii
Troubleshooting Guide
Page 22
... Manager Upgrade Without Losing Map Settings 26-5 Restrictions When Using Fabric Manager Across FCIP 26-5 Running Cisco Fabric Manager with Network Multiple Interfaces 26-5 Specifying an Interface for Fabric Manager Server 26-5 Specifying ... Manager 26-6 Configuring a Proxy Server 26-6 Clearing Topology Maps 26-6 Using Fabric Manager in a Mixed Software Environment 26-7 Troubleshooting Fabric Manager Web Client 26-7 Cannot Download Fabric Manager Web Client 26-7 Allowing network-...Version of Device Manager is Launched 26-14 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x xxii OL-9285-05
... Manager Upgrade Without Losing Map Settings 26-5 Restrictions When Using Fabric Manager Across FCIP 26-5 Running Cisco Fabric Manager with Network Multiple Interfaces 26-5 Specifying an Interface for Fabric Manager Server 26-5 Specifying ... Manager 26-6 Configuring a Proxy Server 26-6 Clearing Topology Maps 26-6 Using Fabric Manager in a Mixed Software Environment 26-7 Troubleshooting Fabric Manager Web Client 26-7 Cannot Download Fabric Manager Web Client 26-7 Allowing network-...Version of Device Manager is Launched 26-14 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x xxii OL-9285-05
Troubleshooting Guide
Page 25
... of each new and changed troubleshooting guideline for the Cisco MDS SAN-OS Release 3.x software. Appendix C, "Configuration Limits for Cisco MDS SAN-OS Release 3.x" Updated troubleshooting information for Cisco SAN-OS 3.2(1) features. Select and view the troubleshooting guide pertinent to address each new and changed features for the Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x, and tells you...
... of each new and changed troubleshooting guideline for the Cisco MDS SAN-OS Release 3.x software. Appendix C, "Configuration Limits for Cisco MDS SAN-OS Release 3.x" Updated troubleshooting information for Cisco SAN-OS 3.2(1) features. Select and view the troubleshooting guide pertinent to address each new and changed features for the Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x, and tells you...
Troubleshooting Guide
Page 30
... Controller Storage Software for the Cisco MDS 9000 Family, refer to mdsfeedback-doc@cisco.com Related Documentation The documentation set for the Cisco MDS 9000 Family Hardware Installation • Cisco MDS 9124 Multilayer Fabric Switch Quick Start Guide • Cisco MDS 9500 Series Hardware Installation Guide • Cisco MDS 9200 Series Hardware Installation Guide • Cisco MDS 9100 Series Hardware Installation Guide • Cisco MDS 9020 Fabric...
... Controller Storage Software for the Cisco MDS 9000 Family, refer to mdsfeedback-doc@cisco.com Related Documentation The documentation set for the Cisco MDS 9000 Family Hardware Installation • Cisco MDS 9124 Multilayer Fabric Switch Quick Start Guide • Cisco MDS 9500 Series Hardware Installation Guide • Cisco MDS 9200 Series Hardware Installation Guide • Cisco MDS 9100 Series Hardware Installation Guide • Cisco MDS 9020 Fabric...
Troubleshooting Guide
Page 31
... Command-Line Interface • Cisco MDS 9000 Family Software Upgrade and Downgrade Guide • Cisco MDS 9000 Family Storage Services Module Software Installation and Upgrade Guide • Cisco MDS 9000 Family CLI Quick Configuration Guide • Cisco MDS 9000 Family CLI Configuration Guide • Cisco MDS 9000 Family Command Reference • Cisco MDS 9000 Family Quick Command Reference • Cisco MDS 9020 Fabric Switch Configuration Guide...
... Command-Line Interface • Cisco MDS 9000 Family Software Upgrade and Downgrade Guide • Cisco MDS 9000 Family Storage Services Module Software Installation and Upgrade Guide • Cisco MDS 9000 Family CLI Quick Configuration Guide • Cisco MDS 9000 Family CLI Configuration Guide • Cisco MDS 9000 Family Command Reference • Cisco MDS 9000 Family Quick Command Reference • Cisco MDS 9020 Fabric Switch Configuration Guide...
Troubleshooting Guide
Page 36
...correct fiber (SM or MM)? • Did you enable the server to see all the LUNs it can access? • If LUN masking software is used, is the server allowed to verify basic connectivity between your fabric: • ISL performance-In Fabric Manager, click the ISL Performance ...commands with the internal keyword, you must have an account that is no longer consolidated. Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 1-4 OL-9285-05 If yes, is the host's pWWN listed in Cisco SAN-OS Release 3.0(1) or later. Fabric Manager and Device Manager also provide the following ...
...correct fiber (SM or MM)? • Did you enable the server to see all the LUNs it can access? • If LUN masking software is used, is the server allowed to verify basic connectivity between your fabric: • ISL performance-In Fabric Manager, click the ISL Performance ...commands with the internal keyword, you must have an account that is no longer consolidated. Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 1-4 OL-9285-05 If yes, is the host's pWWN listed in Cisco SAN-OS Release 3.0(1) or later. Fabric Manager and Device Manager also provide the following ...
Troubleshooting Guide
Page 41
...VSAN Analyze link events Hardware issues? Primary Troubleshooting Flowchart The flowchart in Figure 1-3 shows the overall troubleshooting process. Software image issues Zoning FSPF Domain Manager 144817 OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 1-9 Begin any troubleshooting investigation by checking one of the following four areas:...-port and 48-port 4-Gbps Fibre Channel switching modules, the 32-port 2-Gbps Fibre Channel switching module, the Cisco MDS 9120 20-port 1/2-Gbps Fibre Channel module, and the Cisco MDS 9140 40-port 1/2-Gbps Fibre Channel module.
...VSAN Analyze link events Hardware issues? Primary Troubleshooting Flowchart The flowchart in Figure 1-3 shows the overall troubleshooting process. Software image issues Zoning FSPF Domain Manager 144817 OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 1-9 Begin any troubleshooting investigation by checking one of the following four areas:...-port and 48-port 4-Gbps Fibre Channel switching modules, the 32-port 2-Gbps Fibre Channel switching module, the Cisco MDS 9120 20-port 1/2-Gbps Fibre Channel module, and the Cisco MDS 9140 40-port 1/2-Gbps Fibre Channel module.
Troubleshooting Guide
Page 42
... Messages Chapter 1 Troubleshooting Overview Send documentation comments to mdsfeedback-doc@cisco.com System Messages The system software sends these variable fields changes from an authorized vendor. The action may involve a fix or a recommendation to contact technical support as shown in the Cisco MDS 9000 Family System Messages Reference. Please contact your system. This example...
... Messages Chapter 1 Troubleshooting Overview Send documentation comments to mdsfeedback-doc@cisco.com System Messages The system software sends these variable fields changes from an authorized vendor. The action may involve a fix or a recommendation to contact technical support as shown in the Cisco MDS 9000 Family System Messages Reference. Please contact your system. This example...
Troubleshooting Guide
Page 47
... and Security Guidelines" section on page A-1. Chapter 1 Troubleshooting Overview Contacting Customer Support Send documentation comments to mdsfeedback-doc@cisco.com Contacting Customer Support If you have already taken to isolate and resolve the problem After you are unable to solve...of software and release number • Maintenance agreement or warranty information • Brief description of the problem • Brief explanation of the steps you have collected this guide, contact a customer service representative for assistance and further instructions. OL-9285-05 Cisco MDS 9000...
... and Security Guidelines" section on page A-1. Chapter 1 Troubleshooting Overview Contacting Customer Support Send documentation comments to mdsfeedback-doc@cisco.com Contacting Customer Support If you have already taken to isolate and resolve the problem After you are unable to solve...of software and release number • Maintenance agreement or warranty information • Brief description of the problem • Brief explanation of the steps you have collected this guide, contact a customer service representative for assistance and further instructions. OL-9285-05 Cisco MDS 9000...
Troubleshooting Guide
Page 49
... switch, depending on a Fabric Switch, page 2-4 • Verifying Cisco SAN-OS Software Installations, page 2-6 • Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades, page 2-7 • Troubleshooting Cisco SAN-OS Software System Reboots, page 2-13 • Recovering the Administrator Password, page 2-32 • Miscellaneous Software Image Issues, page 2-32 Overview Each Cisco MDS 9000 switch ships with an operating system...
... switch, depending on a Fabric Switch, page 2-4 • Verifying Cisco SAN-OS Software Installations, page 2-6 • Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades, page 2-7 • Troubleshooting Cisco SAN-OS Software System Reboots, page 2-13 • Recovering the Administrator Password, page 2-32 • Miscellaneous Software Image Issues, page 2-32 Overview Each Cisco MDS 9000 switch ships with an operating system...
Troubleshooting Guide
Page 50
... new image is healthy and the impact that new load will have on images in the directories of the MDS file system. Follow these guidelines when installing Cisco SAN-OS software images: • Ensure that an FTP or TFTP server is available and can be accessed via the IP...the checklist, you are available at the following checklist to prepare for an upgrade: Checklist Check off Copy the new Cisco SAN-OS image onto your supervisor module type. Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-2 OL-9285-05 Verify that no SSM ports are upgrading or downgrading to....
... new image is healthy and the impact that new load will have on images in the directories of the MDS file system. Follow these guidelines when installing Cisco SAN-OS software images: • Ensure that an FTP or TFTP server is available and can be accessed via the IP...the checklist, you are available at the following checklist to prepare for an upgrade: Checklist Check off Copy the new Cisco SAN-OS image onto your supervisor module type. Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-2 OL-9285-05 Verify that no SSM ports are upgrading or downgrading to....
Troubleshooting Guide
Page 51
...to be updated for any step in the sequence fails, the command completes the step in progress and ends. This serial connection catches any Cisco SAN-OS software Release 2.x or later. - Using the install all [{asm-sfn | kickstart | ssi | system} URL] command to a file. After..., and SSH screens. - OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-3 In Fabric Manager, choose Fabricxx > VSAN 1 > Default Zone, select the Policies tab and set the default zone policy for example, due to Cisco SAN-OS Release 3.x software from the CLI" section on the intended changes...
...to be updated for any step in the sequence fails, the command completes the step in progress and ends. This serial connection catches any Cisco SAN-OS software Release 2.x or later. - Using the install all [{asm-sfn | kickstart | ssi | system} URL] command to a file. After..., and SSH screens. - OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-3 In Fabric Manager, choose Fabricxx > VSAN 1 > Default Zone, select the Policies tab and set the default zone policy for example, due to Cisco SAN-OS Release 3.x software from the CLI" section on the intended changes...
Troubleshooting Guide
Page 52
... image for example, FSPF timers are disruptive. If this occurs, you want to continue with the system. FAIL. Disruptive Module Upgrades Software upgrades for the SSM, MPS-14/2, MSM-18/4 module, or the IP Storage (IPS) services modules are not configured to the...DPPs for Layer 3 service. Disruptive Module Upgrades Chapter 2 Troubleshooting Installs, Upgrades, and Reboots Send documentation comments to mdsfeedback-doc@cisco.com Guidelines for Reboots Cisco SAN-OS allows for three different types of system restarts: • Recoverable-A process restarts and service is not affected. ...
... image for example, FSPF timers are disruptive. If this occurs, you want to continue with the system. FAIL. Disruptive Module Upgrades Software upgrades for the SSM, MPS-14/2, MSM-18/4 module, or the IP Storage (IPS) services modules are not configured to the...DPPs for Layer 3 service. Disruptive Module Upgrades Chapter 2 Troubleshooting Installs, Upgrades, and Reboots Send documentation comments to mdsfeedback-doc@cisco.com Guidelines for Reboots Cisco SAN-OS allows for three different types of system restarts: • Recoverable-A process restarts and service is not affected. ...
Troubleshooting Guide
Page 54
...will not start. It only displays the status of an install all status command to watch the progress of your software installation using the Cisco MDS 9000/Uninstall program, then reinstall Fabric Manager. Example 2-1 install all Command Output switch# show install all status There ... setting for the Fabric Manager release you can watch the progress of your software installation. Verify that you have started when the PC is issued from a console, SSH, or Telnet session. SUCCESS Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-6 OL-9285-05 SUCCESS Extracting ...
...will not start. It only displays the status of an install all status command to watch the progress of your software installation using the Cisco MDS 9000/Uninstall program, then reinstall Fabric Manager. Example 2-1 install all Command Output switch# show install all status There ... setting for the Fabric Manager release you can watch the progress of your software installation. Verify that you have started when the PC is issued from a console, SSH, or Telnet session. SUCCESS Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-6 OL-9285-05 SUCCESS Extracting ...
Troubleshooting Guide
Page 55
... and disable any problems and retry the installation. SUCCESS Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades This section discusses possible causes and solutions for both images. Chapter 2 Troubleshooting Installs, Upgrades, and Reboots Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades Send documentation comments to continue? (y/ n) [y]: n OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-7
... and disable any problems and retry the installation. SUCCESS Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades This section discusses possible causes and solutions for both images. Chapter 2 Troubleshooting Installs, Upgrades, and Reboots Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades Send documentation comments to continue? (y/ n) [y]: n OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-7
Troubleshooting Guide
Page 56
... indicates that is enabled Capability requirement : STRICT Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-8 OL-9285-05 switch# show incompatibility CLI command to identify the problem. Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades Chapter 2 Troubleshooting Installs, Upgrades..., and Reboots Send documentation comments to mdsfeedback-doc@cisco.com Use the show incompatibility system bootflash:new-image...
... indicates that is enabled Capability requirement : STRICT Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-8 OL-9285-05 switch# show incompatibility CLI command to identify the problem. Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades Chapter 2 Troubleshooting Installs, Upgrades..., and Reboots Send documentation comments to mdsfeedback-doc@cisco.com Use the show incompatibility system bootflash:new-image...
Troubleshooting Guide
Page 57
... indicating that there are not compatible. Restart the installation. See the "Installing SAN-OS Software Using Fabric Manager" section on page 2-11. OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-9 In Device Manager, choose Admin > Flash Files... Installs, Upgrades, and Reboots Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades Send documentation comments to mdsfeedback-doc@cisco.com Software Installation Ends with Error Symptom The software installation ends with an error. Table 2-4 Software Installation Ends with Error Problem Possible Cause...
... indicating that there are not compatible. Restart the installation. See the "Installing SAN-OS Software Using Fabric Manager" section on page 2-11. OL-9285-05 Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x 2-9 In Device Manager, choose Admin > Flash Files... Installs, Upgrades, and Reboots Troubleshooting Cisco SAN-OS Software Upgrades and Downgrades Send documentation comments to mdsfeedback-doc@cisco.com Software Installation Ends with Error Symptom The software installation ends with an error. Table 2-4 Software Installation Ends with Error Problem Possible Cause...