Installation Guide
Page 1
... contains these sections: • Safety Overview, page 2 • Parts List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated Safety Warnings, page 21 • Obtaining Documentation, page 27 • Documentation Feedback, page 27 • Cisco Product Security Overview, page 28 • Obtaining Technical...
... contains these sections: • Safety Overview, page 2 • Parts List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated Safety Warnings, page 21 • Obtaining Documentation, page 27 • Documentation Feedback, page 27 • Cisco Product Security Overview, page 28 • Obtaining Technical...
Installation Guide
Page 2
... warning symbol means danger. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. Before you if performed incorrectly. Safety Overview Safety Overview Safety warnings appear throughout this device. Serial cable document - Statement 1071 SAVE THESE INSTRUCTIONS Parts List The following : • A #2 Phillips screw driver • Screws (not provided) to attach the mounting brackets to the rack • Any associated mounting clips to secure the...
... warning symbol means danger. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. Before you if performed incorrectly. Safety Overview Safety Overview Safety warnings appear throughout this device. Serial cable document - Statement 1071 SAVE THESE INSTRUCTIONS Parts List The following : • A #2 Phillips screw driver • Screws (not provided) to attach the mounting brackets to the rack • Any associated mounting clips to secure the...
Installation Guide
Page 3
... as you have at least one management interface module installed in slot 15 at the back of the unit. (See Figure 1.) Slot 15 is paired with the Fabric Controller in the Cisco SFS 7008P switch (see Figure 1 and Figure 2) have removed the straps, lift the box up to 106 pounds fully loaded. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 Specific components in slot 11. (See...
... as you have at least one management interface module installed in slot 15 at the back of the unit. (See Figure 1.) Slot 15 is paired with the Fabric Controller in the Cisco SFS 7008P switch (see Figure 1 and Figure 2) have removed the straps, lift the box up to 106 pounds fully loaded. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 Specific components in slot 11. (See...
Installation Guide
Page 4
... 1 Back of Unit Chassis ID Management I.O modules Power plug 1 Power plug 2 4x copper line interface modules 144988 Main air exhaust Step 2 Step 3 Verify that you have a non-blocking fabric. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev. A0 Verify that you have a Fabric Controller installed in the Core slot (see slot 11 in slot 12) is not required for the chassis...
... 1 Back of Unit Chassis ID Management I.O modules Power plug 1 Power plug 2 4x copper line interface modules 144988 Main air exhaust Step 2 Step 3 Verify that you have a non-blocking fabric. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev. A0 Verify that you have a Fabric Controller installed in the Core slot (see slot 11 in slot 12) is not required for the chassis...
Installation Guide
Page 5
...: 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 The node slots are 9, 10, 13 and 14. (See Figure 2.) Verify that you have at least one of the connections between the LIMs and the fabric modules in the node slots. Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core...
...: 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 The node slots are 9, 10, 13 and 14. (See Figure 2.) Verify that you have at least one of the connections between the LIMs and the fabric modules in the node slots. Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core...
Installation Guide
Page 6
Installing the Cisco SFS 7008P Switch into a Rack Figure 3 LIM and Fabric Module Connections Fabric card ...Installing the Cisco SFS 7008P Switch into a Rack This section describes how to 106 pounds if all possible components are installed. If you have not already done so. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 6 78-17434-01 Rev. The shelf must support the weight of the chassis, which can be up to install the Cisco SFS 7008P switch in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. To mount the Cisco SFS 7008P switch...
Installing the Cisco SFS 7008P Switch into a Rack Figure 3 LIM and Fabric Module Connections Fabric card ...Installing the Cisco SFS 7008P Switch into a Rack This section describes how to 106 pounds if all possible components are installed. If you have not already done so. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 6 78-17434-01 Rev. The shelf must support the weight of the chassis, which can be up to install the Cisco SFS 7008P switch in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. To mount the Cisco SFS 7008P switch...
Installation Guide
Page 7
.... Figure 4 Install Appropriate Shelf Installing the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself using an approved ground wrist-strap. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 Determine the direction that the switch will be justified determines which set of mounting brackets, as shown in Figure 5: • If the switch will be justified toward the port-side in the rack, then unscrew the mounting brackets...
.... Figure 4 Install Appropriate Shelf Installing the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself using an approved ground wrist-strap. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 Determine the direction that the switch will be justified determines which set of mounting brackets, as shown in Figure 5: • If the switch will be justified toward the port-side in the rack, then unscrew the mounting brackets...
Installation Guide
Page 8
Step 8 Use screws that fit your rack to attach both mounting brackets to the rack posts. A0 Installing the Cisco SFS 7008P Switch into the rack as shown in Figure 6. Step 6 With 2 or 3 people working together, lift the switch into a Rack Figure 5 Unscrew Extra Mounting Brackets from the Chassis 144965 Step 5 Separate the mounting brackets from the chassis when all screws have been loosened. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note...
Step 8 Use screws that fit your rack to attach both mounting brackets to the rack posts. A0 Installing the Cisco SFS 7008P Switch into the rack as shown in Figure 6. Step 6 With 2 or 3 people working together, lift the switch into a Rack Figure 5 Unscrew Extra Mounting Brackets from the Chassis 144965 Step 5 Separate the mounting brackets from the chassis when all screws have been loosened. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note...
Installation Guide
Page 9
... package. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9 Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: • Redundant Power Supply; see the location of the Management I /O Module according to the directions in the Management Interface Module Installation Guide in the Front of the Unit with the Bezel Removed Power Supply Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node...
... package. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9 Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: • Redundant Power Supply; see the location of the Management I /O Module according to the directions in the Management Interface Module Installation Guide in the Front of the Unit with the Bezel Removed Power Supply Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node...
Installation Guide
Page 10
... section briefly describes configuring your Linux kernel is supported. Installing Host Channel Expansion Card Linux Drivers Make sure your InfiniBand host. Download the configuration software and an integrated suite of supported versions. Unpack the HCA module and insert it into a Rack Figure 8 Management I/O Modules Located in the Back of the Unit Chassis ID Management I.O modules Power plug 1 Power plug 2 4x copper line interface modules Main air exhaust 144988 Configuring and Connecting Host Channel Expansion Card...
... section briefly describes configuring your Linux kernel is supported. Installing Host Channel Expansion Card Linux Drivers Make sure your InfiniBand host. Download the configuration software and an integrated suite of supported versions. Unpack the HCA module and insert it into a Rack Figure 8 Management I/O Modules Located in the Back of the Unit Chassis ID Management I.O modules Power plug 1 Power plug 2 4x copper line interface modules Main air exhaust 144988 Configuring and Connecting Host Channel Expansion Card...
Installation Guide
Page 11
Execute the command ./tsinstall in the /usr/local/cisco directory. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11 Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for port-to-port redundancy, if desired. (Optional) Configure MPI by assigning an IP address to interface ib0 and/or ib1, which corresponds to use of the first HCA. Configure the IPoIB driver by following these steps: Step 1 Step 2 Step...
Execute the command ./tsinstall in the /usr/local/cisco directory. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11 Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for port-to-port redundancy, if desired. (Optional) Configure MPI by assigning an IP address to interface ib0 and/or ib1, which corresponds to use of the first HCA. Configure the IPoIB driver by following these steps: Step 1 Step 2 Step...
Installation Guide
Page 12
... Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. Figure 10 Found New Hardware Wizard WIZARD.TIF Step 3 Click Cancel. Installing the Cisco SFS 7008P Switch into a Rack Installing Non-WHQL Host Channel Expansion Card Drivers on to your Windows 2000 host. IN STEP 4, THE SDK COMES UP - OR DOWNLOAD?? A0
... Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. Figure 10 Found New Hardware Wizard WIZARD.TIF Step 3 Click Cancel. Installing the Cisco SFS 7008P Switch into a Rack Installing Non-WHQL Host Channel Expansion Card Drivers on to your Windows 2000 host. IN STEP 4, THE SDK COMES UP - OR DOWNLOAD?? A0
Installation Guide
Page 13
... to reboot. The Installation Complete window appears when the installation completes. The End User License Agreement window opens. Click Next. Click Next. If you have not previously installed host drivers on this system, you to the terms listed above radio button, and then click Next. Figure 11 InfiniBand SDK Setup Window Step 5 Step 6 Step 7 Step 8 Step 9 Step 10 Click Next. Installing the Cisco SFS 7008P Switch into a Rack Note...
... to reboot. The Installation Complete window appears when the installation completes. The End User License Agreement window opens. Click Next. Click Next. If you have not previously installed host drivers on this system, you to the terms listed above radio button, and then click Next. Figure 11 InfiniBand SDK Setup Window Step 5 Step 6 Step 7 Step 8 Step 9 Step 10 Click Next. Installing the Cisco SFS 7008P Switch into a Rack Note...
Installation Guide
Page 14
... Cisco Software Center at this URL: http://www.cisco.com/public/sw-center To install the Windows 2003 drivers, follow these steps: Step 1 Step 2 Log on to continue. Click the I START THIS The Product Install window appears (see Figure 13). Figure 12 Product Install Window Step 3 Step 4 Step 5 Click Next. Click Next. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel...
... Cisco Software Center at this URL: http://www.cisco.com/public/sw-center To install the Windows 2003 drivers, follow these steps: Step 1 Step 2 Log on to continue. Click the I START THIS The Product Install window appears (see Figure 13). Figure 12 Product Install Window Step 3 Step 4 Step 5 Click Next. Click Next. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel...
Installation Guide
Page 15
... Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Click Continue Anyway (Figure 14) each host channel adapter you have installed. Click Yes in Figure 15 appears for each time the Windows Logo testing dialog box appears. This dialog box explains that the new drivers do not contain a Windows signature. WHQL submission materials are tested using the Microsoft HCT suite. Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack...
... Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Click Continue Anyway (Figure 14) each host channel adapter you have installed. Click Yes in Figure 15 appears for each time the Windows Logo testing dialog box appears. This dialog box explains that the new drivers do not contain a Windows signature. WHQL submission materials are tested using the Microsoft HCT suite. Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack...
Installation Guide
Page 16
... Comment field (see Figure 17), if your server requires it will continue without user intervention. Click OK. Installing the Cisco SFS 7008P Switch into a Rack Figure 15 Driver Installation Notice Step 8 Important: Ignore the Found New Hardware Wizard (see Figure 16) when it appears because it . This window appears three times (twice for the IPoIB and once for the system reboot in Figure 17.
... Comment field (see Figure 17), if your server requires it will continue without user intervention. Click OK. Installing the Cisco SFS 7008P Switch into a Rack Figure 15 Driver Installation Notice Step 8 Important: Ignore the Found New Hardware Wizard (see Figure 16) when it appears because it . This window appears three times (twice for the IPoIB and once for the system reboot in Figure 17.
Installation Guide
Page 17
A login window opens. (See Figure 18.) 78-17434-01 Rev. SFS Chassis Manager supports the following browsers: • Microsoft Internet Explorer version 6 • Netscape Navigator version 6 • Mozilla version 1.4 To launch SFS Chassis Manager, follow these steps: Step 1 Type the Management IP address of your switch in a .ZIP file. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 THERE IS NOTHING HERE??!! Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a Rack Installing WHQL Drivers on a Windows 2000 or...
A login window opens. (See Figure 18.) 78-17434-01 Rev. SFS Chassis Manager supports the following browsers: • Microsoft Internet Explorer version 6 • Netscape Navigator version 6 • Mozilla version 1.4 To launch SFS Chassis Manager, follow these steps: Step 1 Type the Management IP address of your switch in a .ZIP file. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 THERE IS NOTHING HERE??!! Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a Rack Installing WHQL Drivers on a Windows 2000 or...
Installation Guide
Page 18
Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . A0 SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20.
Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . A0 SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20.
Installation Guide
Page 19
... Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series Product Family Element Manager User Guide. To install Element Manager, follow these steps: Step 1 Step 2 Ensure that you have sufficient system resources. To download the latest software, access the Cisco Software Center at this URL: http://www.cisco.com...
... Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series Product Family Element Manager User Guide. To install Element Manager, follow these steps: Step 1 Step 2 Ensure that you have sufficient system resources. To download the latest software, access the Cisco Software Center at this URL: http://www.cisco.com...
Installation Guide
Page 20
... the Cisco SFS 7008P switch, and community string for certain products, by tree view; Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. Cisco Technical Support Website The Cisco Technical Support Website provides online documents and tools for service. Start the SFS Element Manager by clicking the Tools & Resources link under Alerts & RMAs. You can register at this URL: http://tools.cisco.com/RPF/register/register.do Note Use the Cisco...
... the Cisco SFS 7008P switch, and community string for certain products, by tree view; Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. Cisco Technical Support Website The Cisco Technical Support Website provides online documents and tools for service. Start the SFS Element Manager by clicking the Tools & Resources link under Alerts & RMAs. You can register at this URL: http://tools.cisco.com/RPF/register/register.do Note Use the Cisco...