User Guide
Page 1
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 Text Part Number: OL-8787-04
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 Text Part Number: OL-8787-04
User Guide
Page 2
..., Aironet, BPX, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Enterprise/Solver, EtherChannel, EtherFast, EtherSwitch, Fast Step, Follow Me Browsing, FormShare,...and TransPath are trademarks of Cisco Systems, Inc.; This equipment has been tested and found to comply with the instruction manual, may be limited by Cisco Systems, Inc. All other company. (0609R) Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Copyright ©...
..., Aironet, BPX, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Enterprise/Solver, EtherChannel, EtherFast, EtherSwitch, Fast Step, Follow Me Browsing, FormShare,...and TransPath are trademarks of Cisco Systems, Inc.; This equipment has been tested and found to comply with the instruction manual, may be limited by Cisco Systems, Inc. All other company. (0609R) Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Copyright ©...
User Guide
Page 3
... a Service Request xiv Definitions of Service Request Severity xiv Obtaining Additional Publications and Information xiv Product Overview 1 SFS 7012 Feature Set 1 Strategic Benefits 1 Key Design Features 1 SFS 7012 Product Specifications 2 Mechanical/Thermal/Power Specifications 2 Thermal Management Features 2 Power Design Features 2 Switch Characteristics 2 Chassis Viewer Software 3 Chassis Viewer Functionality 3 Subnet Manager 5 Subnet Management 5 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide i
... a Service Request xiv Definitions of Service Request Severity xiv Obtaining Additional Publications and Information xiv Product Overview 1 SFS 7012 Feature Set 1 Strategic Benefits 1 Key Design Features 1 SFS 7012 Product Specifications 2 Mechanical/Thermal/Power Specifications 2 Thermal Management Features 2 Power Design Features 2 Switch Characteristics 2 Chassis Viewer Software 3 Chassis Viewer Functionality 3 Subnet Manager 5 Subnet Management 5 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide i
User Guide
Page 4
... Installing the Switch Face Plate 25 Removing a Module or Blank 26 Installing the Spine and Leaf Modules 26 Connect Equipment to the Ports and Power On the System 27 Bringing Up the System For the First Time 29 Changing the SFS 7012 IP Address and Default... Gateway via the CLI 30 Updating Management Spine IP Addresses in a Redundant Management Configuration 31 SFS 7012 Component LEDs 34 SFS 7012 Leaf and Spine Module LEDs 35 Accessing On-line Help 37 Shutdown Procedures 38 Rebooting Components from Chassis Viewer 38 Cisco SFS 7012 InfiniBand Server Switch ...
... Installing the Switch Face Plate 25 Removing a Module or Blank 26 Installing the Spine and Leaf Modules 26 Connect Equipment to the Ports and Power On the System 27 Bringing Up the System For the First Time 29 Changing the SFS 7012 IP Address and Default... Gateway via the CLI 30 Updating Management Spine IP Addresses in a Redundant Management Configuration 31 SFS 7012 Component LEDs 34 SFS 7012 Leaf and Spine Module LEDs 35 Accessing On-line Help 37 Shutdown Procedures 38 Rebooting Components from Chassis Viewer 38 Cisco SFS 7012 InfiniBand Server Switch ...
User Guide
Page 5
... Component Information Area Tabs 49 System Information Tab 49 Modifying Switch Component Information 52 Configuration and Monitoring Features 53 Chassis View Menu 53 Logging 53 Set Level 54 Reset Log Levels 57 Firmware Update 58 SNMP 59 Target Configuration 59 Filter Status 62 Setting Community Strings 63 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iii
... Component Information Area Tabs 49 System Information Tab 49 Modifying Switch Component Information 52 Configuration and Monitoring Features 53 Chassis View Menu 53 Logging 53 Set Level 54 Reset Log Levels 57 Firmware Update 58 SNMP 59 Target Configuration 59 Filter Status 62 Setting Community Strings 63 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iii
User Guide
Page 6
Contents A A P P E N D I X B A P P E N D I X Chassis Traps 64 SFS 7012 Port Statistics 67 Port Statistics Field Descriptions 68 Leaf and Spine Module IB Port Statistics 70 Leaf Modules 70 Spine Modules 70 Set Field Thresholds 71 Time Service 73 Configuring the Switch OOB IP Address 76 Configuring the Switch Default Gateway IP Address 76 Spine View Menu 78 Logging... 87 Accessing the CLI 87 Groups and Commands 88 General 88 Firmware 90 IbSwitchInfo 90 Chassis 91 Log 91 KeyManagement 92 TimeManagement 92 SNMP 92 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iv OL-8787-04
Contents A A P P E N D I X B A P P E N D I X Chassis Traps 64 SFS 7012 Port Statistics 67 Port Statistics Field Descriptions 68 Leaf and Spine Module IB Port Statistics 70 Leaf Modules 70 Spine Modules 70 Set Field Thresholds 71 Time Service 73 Configuring the Switch OOB IP Address 76 Configuring the Switch Default Gateway IP Address 76 Spine View Menu 78 Logging... 87 Accessing the CLI 87 Groups and Commands 88 General 88 Firmware 90 IbSwitchInfo 90 Chassis 91 Log 91 KeyManagement 92 TimeManagement 92 SNMP 92 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iv OL-8787-04
User Guide
Page 7
Contents C A P P E N D I X Capture 92 Deprecated 93 Troubleshooting 95 Hardware Checks 95 Switch 95 Problem 95 Fix 95 Power Supply 95 Problem 95 Fix 95 Problem 96 Fix 96 OOB Ethernet RJ45 Port 96 Problem 96 Fix 96 SFS 7012 Leaf Module IB Ports 96 Problem 96 Fix 96 Troubleshooting Scenarios 97 InfiniBand 97 Invalid IP Address entered for SWC via Console Port 97 Bad IB Cable 97 Improperly Seated IB Cable 97 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide v OL-8787-04
Contents C A P P E N D I X Capture 92 Deprecated 93 Troubleshooting 95 Hardware Checks 95 Switch 95 Problem 95 Fix 95 Power Supply 95 Problem 95 Fix 95 Problem 96 Fix 96 OOB Ethernet RJ45 Port 96 Problem 96 Fix 96 SFS 7012 Leaf Module IB Ports 96 Problem 96 Fix 96 Troubleshooting Scenarios 97 InfiniBand 97 Invalid IP Address entered for SWC via Console Port 97 Bad IB Cable 97 Improperly Seated IB Cable 97 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide v OL-8787-04
User Guide
Page 8
Contents Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vi OL-8787-04
Contents Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vi OL-8787-04
User Guide
Page 9
Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Feature Description Initial release of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Changed in Release Where Documented OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vii New and Changed Information The Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide applies to the SFS 7012 Release 3.1 or later. Table 1 lists the new and changed features available with each supported SFS 7012 release.
Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Feature Description Initial release of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Changed in Release Where Documented OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vii New and Changed Information The Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide applies to the SFS 7012 Release 3.1 or later. Table 1 lists the new and changed features available with each supported SFS 7012 release.
User Guide
Page 10
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide viii OL-8787-04 Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide (continued) Feature Redundant Management Description Changed in Release Added redundant management information. 3.3 Where Documented Installing the Spine and Leaf Modules, page 2-26 ...
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide viii OL-8787-04 Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide (continued) Feature Redundant Management Description Changed in Release Added redundant management information. 3.3 Where Documented Installing the Spine and Leaf Modules, page 2-26 ...
User Guide
Page 11
Audience The intended audience for this document are network administrators responsible for the SFS 7012 OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide ix It assumes a basic working knowledge of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide . Preface This preface describes the audience, organization, and conventions of : • Local Area Networks (LANs) • Ethernet concepts • Simple Network...
Audience The intended audience for this document are network administrators responsible for the SFS 7012 OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide ix It assumes a basic working knowledge of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide . Preface This preface describes the audience, organization, and conventions of : • Local Area Networks (LANs) • Ethernet concepts • Simple Network...
User Guide
Page 12
... for the SFS 7012 includes the following conventions for Cisco Releases • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide • Cisco SFS 7012 InfiniBand Server Switch Installation and Configuration Note Obtaining Documentation Cisco documentation and additional literature are available on any equipment, be aware of . Conventions This document uses the following documents: • Regulatory Compliance and Safety Information for the Cisco SFS 7012 and SFS 7024 • Cisco SFS 7012 InfiniBand Server Switch Release...
... for the SFS 7012 includes the following conventions for Cisco Releases • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide • Cisco SFS 7012 InfiniBand Server Switch Installation and Configuration Note Obtaining Documentation Cisco documentation and additional literature are available on any equipment, be aware of . Conventions This document uses the following documents: • Regulatory Compliance and Safety Information for the Cisco SFS 7012 and SFS 7024 • Cisco SFS 7012 InfiniBand Server Switch Release...
User Guide
Page 13
... a portable medium. With the DVD, you will find information about Cisco technical documentation on the Cisco website at this URL: http://www.cisco.com/go /psirt OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xi You can access international Cisco websites at this URL: http://tools.cisco.com/RPF/register/register.do Documentation Feedback You can provide...
... a portable medium. With the DVD, you will find information about Cisco technical documentation on the Cisco website at this URL: http://www.cisco.com/go /psirt OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xi You can access international Cisco websites at this URL: http://tools.cisco.com/RPF/register/register.do Documentation Feedback You can provide...
User Guide
Page 14
... products internally before sending any sensitive information that you send to Cisco. All other means of the Security Vulnerability Policy page at this URL: http://www.cisco.com/en/US/products/products_security_vulnerability_policy.html The link on Cisco.com. If you do ?local=en Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xii OL-8787-04 To see security...
... products internally before sending any sensitive information that you send to Cisco. All other means of the Security Vulnerability Policy page at this URL: http://www.cisco.com/en/US/products/products_security_vulnerability_policy.html The link on Cisco.com. If you do ?local=en Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xii OL-8787-04 To see security...
User Guide
Page 15
... & Documentation website provides online documents and tools for certain products, by holding down the Ctrl key while pressing F5. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiii Search results show command output. Obtaining Technical Assistance Cisco Technical Support provides 24-hour-a-day award-winning technical assistance. Locate the serial number label on...
... & Documentation website provides online documents and tools for certain products, by holding down the Ctrl key while pressing F5. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiii Search results show command output. Obtaining Technical Assistance Cisco Technical Support provides 24-hour-a-day award-winning technical assistance. Locate the serial number label on...
User Guide
Page 16
...require product information.) After you describe your business operations. To visit the Cisco Online Subscription Center, go to this URL: http://www.cisco.com/offer/subscribe Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiv OL-8787-04 If your issue is not resolved ...performance of the network is impaired while most business operations remain functional. Severity 4 (S4)-You require information or assistance with Cisco product capabilities, installation, or configuration. Create a profile and then select the subscriptions that all necessary resources around the clock...
...require product information.) After you describe your business operations. To visit the Cisco Online Subscription Center, go to this URL: http://www.cisco.com/offer/subscribe Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiv OL-8787-04 If your issue is not resolved ...performance of the network is impaired while most business operations remain functional. Severity 4 (S4)-You require information or assistance with Cisco product capabilities, installation, or configuration. Create a profile and then select the subscriptions that all necessary resources around the clock...
User Guide
Page 17
...-class networking training is updated twice a year and includes the latest Cisco channel product offerings. For current Cisco Press titles and other networking professionals. Join a discussion at this URL: http://www.cisco.com/en/US/learning/index.html OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xv You can view current offerings at this URL...
...-class networking training is updated twice a year and includes the latest Cisco channel product offerings. For current Cisco Press titles and other networking professionals. Join a discussion at this URL: http://www.cisco.com/en/US/learning/index.html OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xv You can view current offerings at this URL...
User Guide
Page 19
... an industry leading modular system used for creating large, single-system Grid/Cluster server fabrics, or as a building block for InfiniBand (4X) • SDR and DDR support • Embedded system management OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 1 Additionally, the SFS 7012 can be configured to run at 2.5 Gbps single data rate (SDR), 5.0 Gbps double...
... an industry leading modular system used for creating large, single-system Grid/Cluster server fabrics, or as a building block for InfiniBand (4X) • SDR and DDR support • Embedded system management OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 1 Additionally, the SFS 7012 can be configured to run at 2.5 Gbps single data rate (SDR), 5.0 Gbps double...
User Guide
Page 20
...VAC operation • 50/60 Hz Frequency • Redundant, isolated AC inputs • FCC and VCCI compliant • U.L. SFS 7012 Product Specifications Mechanical/Thermal/Power Specifications • 7U - 19" rack mount environment • Integrated thermal management • Front-to... height • 12V bulk power • Status indicators • Two (2) independent AC input lines Switch Characteristics • 7U form factor • Full module enclosure • Available power (all copper): 745 Watts max Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 2 Chapter OL-8787-04
...VAC operation • 50/60 Hz Frequency • Redundant, isolated AC inputs • FCC and VCCI compliant • U.L. SFS 7012 Product Specifications Mechanical/Thermal/Power Specifications • 7U - 19" rack mount environment • Integrated thermal management • Front-to... height • 12V bulk power • Status indicators • Two (2) independent AC input lines Switch Characteristics • 7U form factor • Full module enclosure • Available power (all copper): 745 Watts max Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 2 Chapter OL-8787-04