User Guide
Page 1
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 Text Part Number: OL-8787-04
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 Text Part Number: OL-8787-04
User Guide
Page 2
... provide reasonable protection against such interference in the United States and certain other company. (0609R) Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Copyright © 2006 Cisco Systems, Inc. In that event, your right to use of a program developed by Cisco Systems, Inc. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION...
... provide reasonable protection against such interference in the United States and certain other company. (0609R) Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Copyright © 2006 Cisco Systems, Inc. In that event, your right to use of a program developed by Cisco Systems, Inc. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION...
User Guide
Page 3
... a Service Request xiv Definitions of Service Request Severity xiv Obtaining Additional Publications and Information xiv Product Overview 1 SFS 7012 Feature Set 1 Strategic Benefits 1 Key Design Features 1 SFS 7012 Product Specifications 2 Mechanical/Thermal/Power Specifications 2 Thermal Management Features 2 Power Design Features 2 Switch Characteristics 2 Chassis Viewer Software 3 Chassis Viewer Functionality 3 Subnet Manager 5 Subnet Management 5 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide i
... a Service Request xiv Definitions of Service Request Severity xiv Obtaining Additional Publications and Information xiv Product Overview 1 SFS 7012 Feature Set 1 Strategic Benefits 1 Key Design Features 1 SFS 7012 Product Specifications 2 Mechanical/Thermal/Power Specifications 2 Thermal Management Features 2 Power Design Features 2 Switch Characteristics 2 Chassis Viewer Software 3 Chassis Viewer Functionality 3 Subnet Manager 5 Subnet Management 5 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide i
User Guide
Page 4
... Installing the Switch Face Plate 25 Removing a Module or Blank 26 Installing the Spine and Leaf Modules 26 Connect Equipment to the Ports and Power On the System 27 Bringing Up the System For the First Time 29 Changing the SFS 7012 IP Address and Default... Gateway via the CLI 30 Updating Management Spine IP Addresses in a Redundant Management Configuration 31 SFS 7012 Component LEDs 34 SFS 7012 Leaf and Spine Module LEDs 35 Accessing On-line Help 37 Shutdown Procedures 38 Rebooting Components from Chassis Viewer 38 Cisco SFS 7012 InfiniBand Server Switch ...
... Installing the Switch Face Plate 25 Removing a Module or Blank 26 Installing the Spine and Leaf Modules 26 Connect Equipment to the Ports and Power On the System 27 Bringing Up the System For the First Time 29 Changing the SFS 7012 IP Address and Default... Gateway via the CLI 30 Updating Management Spine IP Addresses in a Redundant Management Configuration 31 SFS 7012 Component LEDs 34 SFS 7012 Leaf and Spine Module LEDs 35 Accessing On-line Help 37 Shutdown Procedures 38 Rebooting Components from Chassis Viewer 38 Cisco SFS 7012 InfiniBand Server Switch ...
User Guide
Page 5
... Component Information Area Tabs 49 System Information Tab 49 Modifying Switch Component Information 52 Configuration and Monitoring Features 53 Chassis View Menu 53 Logging 53 Set Level 54 Reset Log Levels 57 Firmware Update 58 SNMP 59 Target Configuration 59 Filter Status 62 Setting Community Strings 63 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iii
... Component Information Area Tabs 49 System Information Tab 49 Modifying Switch Component Information 52 Configuration and Monitoring Features 53 Chassis View Menu 53 Logging 53 Set Level 54 Reset Log Levels 57 Firmware Update 58 SNMP 59 Target Configuration 59 Filter Status 62 Setting Community Strings 63 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iii
User Guide
Page 6
... Groups and Commands 88 General 88 Firmware 90 IbSwitchInfo 90 Chassis 91 Log 91 KeyManagement 92 TimeManagement 92 SNMP 92 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iv OL-8787-04 Contents A A P P E N D I X B A P P E N D I X Chassis Traps 64 SFS 7012 Port Statistics 67 Port Statistics Field Descriptions 68 Leaf and Spine Module IB Port Statistics 70 Leaf Modules 70...
... Groups and Commands 88 General 88 Firmware 90 IbSwitchInfo 90 Chassis 91 Log 91 KeyManagement 92 TimeManagement 92 SNMP 92 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iv OL-8787-04 Contents A A P P E N D I X B A P P E N D I X Chassis Traps 64 SFS 7012 Port Statistics 67 Port Statistics Field Descriptions 68 Leaf and Spine Module IB Port Statistics 70 Leaf Modules 70...
User Guide
Page 7
Contents C A P P E N D I X Capture 92 Deprecated 93 Troubleshooting 95 Hardware Checks 95 Switch 95 Problem 95 Fix 95 Power Supply 95 Problem 95 Fix 95 Problem 96 Fix 96 OOB Ethernet RJ45 Port 96 Problem 96 Fix 96 SFS 7012 Leaf Module IB Ports 96 Problem 96 Fix 96 Troubleshooting Scenarios 97 InfiniBand 97 Invalid IP Address entered for SWC via Console Port 97 Bad IB Cable 97 Improperly Seated IB Cable 97 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide v OL-8787-04
Contents C A P P E N D I X Capture 92 Deprecated 93 Troubleshooting 95 Hardware Checks 95 Switch 95 Problem 95 Fix 95 Power Supply 95 Problem 95 Fix 95 Problem 96 Fix 96 OOB Ethernet RJ45 Port 96 Problem 96 Fix 96 SFS 7012 Leaf Module IB Ports 96 Problem 96 Fix 96 Troubleshooting Scenarios 97 InfiniBand 97 Invalid IP Address entered for SWC via Console Port 97 Bad IB Cable 97 Improperly Seated IB Cable 97 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide v OL-8787-04
User Guide
Page 8
Contents Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vi OL-8787-04
Contents Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vi OL-8787-04
User Guide
Page 9
Table 1 lists the new and changed features available with each supported SFS 7012 release. New and Changed Information The Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide applies to the SFS 7012 Release 3.1 or later. Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Feature Description Initial release of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Changed in Release Where Documented OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vii
Table 1 lists the new and changed features available with each supported SFS 7012 release. New and Changed Information The Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide applies to the SFS 7012 Release 3.1 or later. Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Feature Description Initial release of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Changed in Release Where Documented OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vii
User Guide
Page 10
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide viii OL-8787-04 Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide (continued) Feature Redundant Management Description Changed in Release Added redundant management information. 3.3 Where Documented Installing the Spine and Leaf Modules, page 2-26 ...
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide viii OL-8787-04 Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide (continued) Feature Redundant Management Description Changed in Release Added redundant management information. 3.3 Where Documented Installing the Spine and Leaf Modules, page 2-26 ...
User Guide
Page 11
... network equipment. It also provides information on how to obtain related documentation. Audience The intended audience for this document are network administrators responsible for the SFS 7012 OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide ix It assumes a basic working knowledge of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide .
... network equipment. It also provides information on how to obtain related documentation. Audience The intended audience for this document are network administrators responsible for the SFS 7012 OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide ix It assumes a basic working knowledge of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide .
User Guide
Page 12
... publication. Conventions This document uses the following documents: • Regulatory Compliance and Safety Information for the Cisco SFS 7012 and SFS 7024 • Cisco SFS 7012 InfiniBand Server Switch Release Notes for Cisco Releases • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide • Cisco SFS 7012 InfiniBand Server Switch Installation and Configuration Note Obtaining Documentation Cisco documentation and additional literature are available on any equipment, be aware of the warnings that appear...
... publication. Conventions This document uses the following documents: • Regulatory Compliance and Safety Information for the Cisco SFS 7012 and SFS 7024 • Cisco SFS 7012 InfiniBand Server Switch Release Notes for Cisco Releases • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide • Cisco SFS 7012 InfiniBand Server Switch Installation and Configuration Note Obtaining Documentation Cisco documentation and additional literature are available on any equipment, be aware of the warnings that appear...
User Guide
Page 13
... • Obtain assistance with security incidents that involve Cisco products • Register to receive security information from Cisco Marketplace at the Product Documentation Store at this URL: http://www.cisco.com/go/psirt OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xi Registered users may order Cisco documentation at the Product Documentation Store at this URL...
... • Obtain assistance with security incidents that involve Cisco products • Register to receive security information from Cisco Marketplace at the Product Documentation Store at this URL: http://www.cisco.com/go/psirt OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xi Registered users may order Cisco documentation at the Product Documentation Store at this URL...
User Guide
Page 14
...that has been encrypted with PSIRT is under active attack or a condition for which a severe and urgent security vulnerability should be a registered Cisco.com user. (To register as they are updated in real time, you to or updates about how to subscribe to the PSIRT RSS ...access the Product Alert Tool, you must be reported. We test our products internally before sending any sensitive information that you do ?local=en Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xii OL-8787-04 Never use . If you have or use PGP, contact PSIRT to use in use a revoked ...
...that has been encrypted with PSIRT is under active attack or a condition for which a severe and urgent security vulnerability should be a registered Cisco.com user. (To register as they are updated in real time, you to or updates about how to subscribe to the PSIRT RSS ...access the Product Alert Tool, you must be reported. We test our products internally before sending any sensitive information that you do ?local=en Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xii OL-8787-04 Never use . If you have or use PGP, contact PSIRT to use in use a revoked ...
User Guide
Page 15
... under the Search box and then click the Technical Support & Documentation radio button. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiii Obtaining Technical Assistance Cisco Technical Support provides 24-hour-a-day award-winning technical assistance. If you have a valid service contract ... is not refreshing a web page, force the browser to look in technical documentation, not the entire Cisco.com website. If you have a valid Cisco service contract, contact your product and record the information before submitting a request for certain products, by ...
... under the Search box and then click the Technical Support & Documentation radio button. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiii Obtaining Technical Assistance Cisco Technical Support provides 24-hour-a-day award-winning technical assistance. If you have a valid service contract ... is not refreshing a web page, force the browser to look in technical documentation, not the entire Cisco.com website. If you have a valid Cisco service contract, contact your product and record the information before submitting a request for certain products, by ...
User Guide
Page 16
...that you can sign up for which you require product information.) After you describe your service request is assigned to a Cisco engineer. You and Cisco will commit full-time resources during normal business hours to restore service to satisfactory levels. To open S3 and S4 ... 1 800 805 227 EMEA: +32 2 704 55 55 USA: 1 800 553 2447 For a complete list of Cisco TAC contacts, go to this URL: http://www.cisco.com/offer/subscribe Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiv OL-8787-04 If your issue is impaired while most business operations remain functional.
...that you can sign up for which you require product information.) After you describe your service request is assigned to a Cisco engineer. You and Cisco will commit full-time resources during normal business hours to restore service to satisfactory levels. To open S3 and S4 ... 1 800 805 227 EMEA: +32 2 704 55 55 USA: 1 800 553 2447 For a complete list of Cisco TAC contacts, go to this URL: http://www.cisco.com/offer/subscribe Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiv OL-8787-04 If your issue is impaired while most business operations remain functional.
User Guide
Page 17
... URL: http://www.ciscopress.com • Internet Protocol Journal is updated twice a year and includes the latest Cisco channel product offerings. Visit Cisco Marketplace, the company store, at this online publication is a handy, compact reference tool that includes brief product ... view the latest release of Cisco books, reference guides, documentation, and logo merchandise. Updated monthly, this URL: http://www.cisco.com/en/US/learning/index.html OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xv • The Cisco Product Quick Reference Guide is ...
... URL: http://www.ciscopress.com • Internet Protocol Journal is updated twice a year and includes the latest Cisco channel product offerings. Visit Cisco Marketplace, the company store, at this online publication is a handy, compact reference tool that includes brief product ... view the latest release of Cisco books, reference guides, documentation, and logo merchandise. Updated monthly, this URL: http://www.cisco.com/en/US/learning/index.html OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xv • The Cisco Product Quick Reference Guide is ...
User Guide
Page 19
.... an industry-standard interconnect - The SFS 7012 is an industry leading modular system used for creating large, single-system Grid/Cluster server fabrics, or as a building block for InfiniBand (4X) • SDR and DDR support • Embedded system management OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 1 Product Overview CH A P T E R 1 The Cisco SFS 7012™ is designed to large...
.... an industry-standard interconnect - The SFS 7012 is an industry leading modular system used for creating large, single-system Grid/Cluster server fabrics, or as a building block for InfiniBand (4X) • SDR and DDR support • Embedded system management OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 1 Product Overview CH A P T E R 1 The Cisco SFS 7012™ is designed to large...
User Guide
Page 20
..." Depth x 1U height • 12V bulk power • Status indicators • Two (2) independent AC input lines Switch Characteristics • 7U form factor • Full module enclosure • Available power (all copper): 745 Watts max Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 2 Chapter OL-8787-04 Listed Thermal Management Features • Four (4) fan trays, hot plug...
..." Depth x 1U height • 12V bulk power • Status indicators • Two (2) independent AC input lines Switch Characteristics • 7U form factor • Full module enclosure • Available power (all copper): 745 Watts max Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 2 Chapter OL-8787-04 Listed Thermal Management Features • Four (4) fan trays, hot plug...