User Guide
Page 1
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 Text Part Number: OL-8787-04
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 Text Part Number: OL-8787-04
User Guide
Page 2
... MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS. All other company. (0609R) Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Copyright © 2006 Cisco Systems, Inc. The use the equipment may cause harmful interference to this product not authorized by Cisco Systems, Inc. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY...
... MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS. All other company. (0609R) Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Copyright © 2006 Cisco Systems, Inc. The use the equipment may cause harmful interference to this product not authorized by Cisco Systems, Inc. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY...
User Guide
Page 3
... a Service Request xiv Definitions of Service Request Severity xiv Obtaining Additional Publications and Information xiv Product Overview 1 SFS 7012 Feature Set 1 Strategic Benefits 1 Key Design Features 1 SFS 7012 Product Specifications 2 Mechanical/Thermal/Power Specifications 2 Thermal Management Features 2 Power Design Features 2 Switch Characteristics 2 Chassis Viewer Software 3 Chassis Viewer Functionality 3 Subnet Manager 5 Subnet Management 5 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide i
... a Service Request xiv Definitions of Service Request Severity xiv Obtaining Additional Publications and Information xiv Product Overview 1 SFS 7012 Feature Set 1 Strategic Benefits 1 Key Design Features 1 SFS 7012 Product Specifications 2 Mechanical/Thermal/Power Specifications 2 Thermal Management Features 2 Power Design Features 2 Switch Characteristics 2 Chassis Viewer Software 3 Chassis Viewer Functionality 3 Subnet Manager 5 Subnet Management 5 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide i
User Guide
Page 4
... Installing the Switch Face Plate 25 Removing a Module or Blank 26 Installing the Spine and Leaf Modules 26 Connect Equipment to the Ports and Power On the System 27 Bringing Up the System For the First Time 29 Changing the SFS 7012 IP Address and Default... Gateway via the CLI 30 Updating Management Spine IP Addresses in a Redundant Management Configuration 31 SFS 7012 Component LEDs 34 SFS 7012 Leaf and Spine Module LEDs 35 Accessing On-line Help 37 Shutdown Procedures 38 Rebooting Components from Chassis Viewer 38 Cisco SFS 7012 InfiniBand Server Switch ...
... Installing the Switch Face Plate 25 Removing a Module or Blank 26 Installing the Spine and Leaf Modules 26 Connect Equipment to the Ports and Power On the System 27 Bringing Up the System For the First Time 29 Changing the SFS 7012 IP Address and Default... Gateway via the CLI 30 Updating Management Spine IP Addresses in a Redundant Management Configuration 31 SFS 7012 Component LEDs 34 SFS 7012 Leaf and Spine Module LEDs 35 Accessing On-line Help 37 Shutdown Procedures 38 Rebooting Components from Chassis Viewer 38 Cisco SFS 7012 InfiniBand Server Switch ...
User Guide
Page 5
... Component Information Area Tabs 49 System Information Tab 49 Modifying Switch Component Information 52 Configuration and Monitoring Features 53 Chassis View Menu 53 Logging 53 Set Level 54 Reset Log Levels 57 Firmware Update 58 SNMP 59 Target Configuration 59 Filter Status 62 Setting Community Strings 63 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iii
... Component Information Area Tabs 49 System Information Tab 49 Modifying Switch Component Information 52 Configuration and Monitoring Features 53 Chassis View Menu 53 Logging 53 Set Level 54 Reset Log Levels 57 Firmware Update 58 SNMP 59 Target Configuration 59 Filter Status 62 Setting Community Strings 63 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iii
User Guide
Page 6
Contents A A P P E N D I X B A P P E N D I X Chassis Traps 64 SFS 7012 Port Statistics 67 Port Statistics Field Descriptions 68 Leaf and Spine Module IB Port Statistics 70 Leaf Modules 70 Spine Modules 70 Set Field Thresholds 71 Time Service 73 Configuring the Switch OOB IP Address 76 Configuring the Switch Default Gateway IP Address 76 Spine View Menu 78 Logging... 87 Accessing the CLI 87 Groups and Commands 88 General 88 Firmware 90 IbSwitchInfo 90 Chassis 91 Log 91 KeyManagement 92 TimeManagement 92 SNMP 92 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iv OL-8787-04
Contents A A P P E N D I X B A P P E N D I X Chassis Traps 64 SFS 7012 Port Statistics 67 Port Statistics Field Descriptions 68 Leaf and Spine Module IB Port Statistics 70 Leaf Modules 70 Spine Modules 70 Set Field Thresholds 71 Time Service 73 Configuring the Switch OOB IP Address 76 Configuring the Switch Default Gateway IP Address 76 Spine View Menu 78 Logging... 87 Accessing the CLI 87 Groups and Commands 88 General 88 Firmware 90 IbSwitchInfo 90 Chassis 91 Log 91 KeyManagement 92 TimeManagement 92 SNMP 92 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iv OL-8787-04
User Guide
Page 7
Contents C A P P E N D I X Capture 92 Deprecated 93 Troubleshooting 95 Hardware Checks 95 Switch 95 Problem 95 Fix 95 Power Supply 95 Problem 95 Fix 95 Problem 96 Fix 96 OOB Ethernet RJ45 Port 96 Problem 96 Fix 96 SFS 7012 Leaf Module IB Ports 96 Problem 96 Fix 96 Troubleshooting Scenarios 97 InfiniBand 97 Invalid IP Address entered for SWC via Console Port 97 Bad IB Cable 97 Improperly Seated IB Cable 97 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide v OL-8787-04
Contents C A P P E N D I X Capture 92 Deprecated 93 Troubleshooting 95 Hardware Checks 95 Switch 95 Problem 95 Fix 95 Power Supply 95 Problem 95 Fix 95 Problem 96 Fix 96 OOB Ethernet RJ45 Port 96 Problem 96 Fix 96 SFS 7012 Leaf Module IB Ports 96 Problem 96 Fix 96 Troubleshooting Scenarios 97 InfiniBand 97 Invalid IP Address entered for SWC via Console Port 97 Bad IB Cable 97 Improperly Seated IB Cable 97 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide v OL-8787-04
User Guide
Page 8
Contents Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vi OL-8787-04
Contents Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vi OL-8787-04
User Guide
Page 9
Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Feature Description Initial release of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Changed in Release Where Documented OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vii New and Changed Information The Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide applies to the SFS 7012 Release 3.1 or later. Table 1 lists the new and changed features available with each supported SFS 7012 release.
Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Feature Description Initial release of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Changed in Release Where Documented OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vii New and Changed Information The Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide applies to the SFS 7012 Release 3.1 or later. Table 1 lists the new and changed features available with each supported SFS 7012 release.
User Guide
Page 10
Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide (continued) Feature Redundant Management Description Changed in Release Added redundant management information. 3.3 Where Documented Installing the Spine and Leaf Modules, page 2-26 ... (DDR) capabilities 3.4 Product Overview, page 1-1 Port Statistics Field Descriptions, page 3-68 CLI command ismPortSetSpeed in the section IbSwitchInfo, page 5-83 of Appendix B: Command Line Interface. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide viii OL-8787-04
Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide (continued) Feature Redundant Management Description Changed in Release Added redundant management information. 3.3 Where Documented Installing the Spine and Leaf Modules, page 2-26 ... (DDR) capabilities 3.4 Product Overview, page 1-1 Port Statistics Field Descriptions, page 3-68 CLI command ismPortSetSpeed in the section IbSwitchInfo, page 5-83 of Appendix B: Command Line Interface. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide viii OL-8787-04
User Guide
Page 11
... monitoring the SFS 7012 SFS 7012 technical specifications Reference information for the SFS 7012 command line interface (CLI) Troubleshooting symptoms and resolutions for configuring and operating network equipment. It also provides information on how to obtain related documentation. Audience The intended audience for this document are network administrators responsible for the SFS 7012 OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users...
... monitoring the SFS 7012 SFS 7012 technical specifications Reference information for the SFS 7012 command line interface (CLI) Troubleshooting symptoms and resolutions for configuring and operating network equipment. It also provides information on how to obtain related documentation. Audience The intended audience for this document are network administrators responsible for the SFS 7012 OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users...
User Guide
Page 12
... be careful. To see translations of . Conventions This document uses the following documents: • Regulatory Compliance and Safety Information for the Cisco SFS 7012 and SFS 7024 • Cisco SFS 7012 InfiniBand Server Switch Release Notes for Cisco Releases • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide • Cisco SFS 7012 InfiniBand Server Switch Installation and Configuration Note Obtaining Documentation Cisco documentation and additional literature are in a situation that accompanied this device.
... be careful. To see translations of . Conventions This document uses the following documents: • Regulatory Compliance and Safety Information for the Cisco SFS 7012 and SFS 7024 • Cisco SFS 7012 InfiniBand Server Switch Release Notes for Cisco Releases • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide • Cisco SFS 7012 InfiniBand Server Switch Installation and Configuration Note Obtaining Documentation Cisco documentation and additional literature are in a situation that accompanied this device.
User Guide
Page 13
... list of the PDF files found on the Cisco Technical Support & Documentation site area by subscription. The DVD enables you will find information about Cisco technical documentation on the Cisco website at this URL: http://www.cisco.com/go /psirt OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xi DVDs are available singly or by entering...
... list of the PDF files found on the Cisco Technical Support & Documentation site area by subscription. The DVD enables you will find information about Cisco technical documentation on the Cisco website at this URL: http://www.cisco.com/go /psirt OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xi DVDs are available singly or by entering...
User Guide
Page 14
... be reported. This tool enables you to create a profile and choose those products for which you do ?local=en Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xii OL-8787-04 To see security advisories, security notices, and security responses as... active attack or a condition for example, GnuPG) to encrypt any sensitive information that you send to correct all vulnerabilities quickly. Information about Cisco products are considered nonemergencies. • For nonemergencies - You can subscribe to use a revoked encryption key or an expired encryption key. Never...
... be reported. This tool enables you to create a profile and choose those products for which you do ?local=en Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xii OL-8787-04 To see security advisories, security notices, and security responses as... active attack or a condition for example, GnuPG) to encrypt any sensitive information that you send to correct all vulnerabilities quickly. Information about Cisco products are considered nonemergencies. • For nonemergencies - You can subscribe to use a revoked encryption key or an expired encryption key. Never...
User Guide
Page 15
... Identification Tool to look in technical documentation, not the entire Cisco.com website. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiii The Cisco Technical Support & Documentation website on the Cisco Technical Support & Documentation website requires a Cisco.com user ID and password. If you suspect that the browser is available 24 hours a day at this tool...
... Identification Tool to look in technical documentation, not the entire Cisco.com website. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiii The Cisco Technical Support & Documentation website on the Cisco Technical Support & Documentation website requires a Cisco.com user ID and password. If you suspect that the browser is available 24 hours a day at this tool...
User Guide
Page 16
...minimally impaired or for a variety of Service Request Severity To ensure that you do not have Internet access, contact the Cisco TAC by inadequate performance of the network is impaired while most business operations remain functional. Severity 1 (S1)-An existing...visit the Cisco Online Subscription Center, go to resolve the situation. Severity 3 (S3)-Operational performance of Cisco products. Submitting a Service Request Using the online TAC Service Request Tool is the fastest way to this URL: http://www.cisco.com/offer/subscribe Cisco SFS 7012 InfiniBand Server Switch Hardware ...
...minimally impaired or for a variety of Service Request Severity To ensure that you do not have Internet access, contact the Cisco TAC by inadequate performance of the network is impaired while most business operations remain functional. Severity 1 (S1)-An existing...visit the Cisco Online Subscription Center, go to resolve the situation. Severity 3 (S3)-Operational performance of Cisco products. Submitting a Service Request Using the online TAC Service Request Tool is the fastest way to this URL: http://www.cisco.com/offer/subscribe Cisco SFS 7012 InfiniBand Server Switch Hardware ...
User Guide
Page 17
...OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xv Updated monthly, this URL: http://www.cisco.com/discuss/networking • "What's New in Cisco Documentation" is an online publication that provides information about the latest documentation releases for your products. Visit Cisco Marketplace, the company...private internets and intranets. To order and find out more about networking products and technologies with Cisco experts and other information, go to Cisco Press at this URL: http://www.ciscopress.com • Internet Protocol Journal is a quarterly journal published...
...OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xv Updated monthly, this URL: http://www.cisco.com/discuss/networking • "What's New in Cisco Documentation" is an online publication that provides information about the latest documentation releases for your products. Visit Cisco Marketplace, the company...private internets and intranets. To order and find out more about networking products and technologies with Cisco experts and other information, go to Cisco Press at this URL: http://www.ciscopress.com • Internet Protocol Journal is a quarterly journal published...
User Guide
Page 19
... creating large, single-system Grid/Cluster server fabrics, or as a building block for InfiniBand (4X) • SDR and DDR support • Embedded system management OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 1 To allow easy scaling, the SFS 7012 provides 12 expansion slots. Additionally, the SFS 7012 can scale to large server fabrics - Leveraging InfiniBand (IB) - an industry-standard interconnect...
... creating large, single-system Grid/Cluster server fabrics, or as a building block for InfiniBand (4X) • SDR and DDR support • Embedded system management OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 1 To allow easy scaling, the SFS 7012 provides 12 expansion slots. Additionally, the SFS 7012 can scale to large server fabrics - Leveraging InfiniBand (IB) - an industry-standard interconnect...
User Guide
Page 20
..." Depth x 1U height • 12V bulk power • Status indicators • Two (2) independent AC input lines Switch Characteristics • 7U form factor • Full module enclosure • Available power (all copper): 745 Watts max Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 2 Chapter OL-8787-04 Listed Thermal Management Features • Four (4) fan trays, hot plug...
..." Depth x 1U height • 12V bulk power • Status indicators • Two (2) independent AC input lines Switch Characteristics • 7U form factor • Full module enclosure • Available power (all copper): 745 Watts max Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 2 Chapter OL-8787-04 Listed Thermal Management Features • Four (4) fan trays, hot plug...