Installation Guide
Page 1
All rights reserved. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note Product number: PID=78-17434-01 Rev. This publication contains these sections: • Safety Overview, page 2 • Parts List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated...
All rights reserved. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note Product number: PID=78-17434-01 Rev. This publication contains these sections: • Safety Overview, page 2 • Parts List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated...
Installation Guide
Page 2
...this publication in a situation that could cause bodily injury. A0 Warning IMPORTANT SAFETY INSTRUCTIONS This warning symbol means danger. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. DB-9 connector male to RJ-45 - A warning symbol ...precedes each warning to the accessories provided with enough clearance for the Cisco SFS 7008P switch and cables. DB-9 connector female to RJ-45 - Statement 1071 SAVE THESE INSTRUCTIONS Parts List The following : • A ...
...this publication in a situation that could cause bodily injury. A0 Warning IMPORTANT SAFETY INSTRUCTIONS This warning symbol means danger. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. DB-9 connector male to RJ-45 - A warning symbol ...precedes each warning to the accessories provided with enough clearance for the Cisco SFS 7008P switch and cables. DB-9 connector female to RJ-45 - Statement 1071 SAVE THESE INSTRUCTIONS Parts List The following : • A ...
Installation Guide
Page 3
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 Before You Install Before you begin the installation, do the following these steps: Step 1 Verify that you have the minimum components ... management interface module installed in slot 15 at the back of the unit. (See Figure 1.) Slot 15 is paired with the Fabric Controller in the Cisco SFS 7008P switch (see Figure 1 and Figure 2) have removed the straps, lift the box up to complete the installation (highly recommended). Specific components in slot 11. (See Figure...
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 Before You Install Before you begin the installation, do the following these steps: Step 1 Verify that you have the minimum components ... management interface module installed in slot 15 at the back of the unit. (See Figure 1.) Slot 15 is paired with the Fabric Controller in the Cisco SFS 7008P switch (see Figure 1 and Figure 2) have removed the straps, lift the box up to complete the installation (highly recommended). Specific components in slot 11. (See Figure...
Installation Guide
Page 4
... Power plug 1 Power plug 2 4x copper line interface modules 144988 Main air exhaust Step 2 Step 3 Verify that you have a Chassis ID module installed. (See Figure 1). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev.
... Power plug 1 Power plug 2 4x copper line interface modules 144988 Main air exhaust Step 2 Step 3 Verify that you have a Chassis ID module installed. (See Figure 1). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev.
Installation Guide
Page 5
... for an example of the node slots. See Figure 3 for each fabric module in the node slots: 78-17434-01 Rev. Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core slot 1 Core slot 2 Node... installed. (See Figure 2.) Verify that you have at least one of the connections between the LIMs and the fabric modules in the node slots. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5
... for an example of the node slots. See Figure 3 for each fabric module in the node slots: 78-17434-01 Rev. Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core slot 1 Core slot 2 Node... installed. (See Figure 2.) Verify that you have at least one of the connections between the LIMs and the fabric modules in the node slots. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5
Installation Guide
Page 6
... in an industry-standard rack, follow the directions in Figure 4, if you purchased the custom Cisco SFS 7008P switch shelf, follow these steps: Step 1 Install a shelf for the chassis as shown in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. Installing the Cisco SFS 7008P Switch into a Rack Figure 3 LIM and Fabric Module Connections Fabric card in slot 9 Fabric card in...
... in an industry-standard rack, follow the directions in Figure 4, if you purchased the custom Cisco SFS 7008P switch shelf, follow these steps: Step 1 Install a shelf for the chassis as shown in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. Installing the Cisco SFS 7008P Switch into a Rack Figure 3 LIM and Fabric Module Connections Fabric card in slot 9 Fabric card in...
Installation Guide
Page 7
...Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 Figure 4 Install Appropriate Shelf Installing the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself using an approved ground wrist-strap. The direction that the switch will be installedand justified in the next step. Remove one set of the switch. 78-17434-01 Rev. Determine the direction that the switch...rack, then unscrew the mounting brackets from the port-side of the switch. • If the switch will be justified determines which set of mounting brackets need to be justified...
...Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 Figure 4 Install Appropriate Shelf Installing the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself using an approved ground wrist-strap. The direction that the switch will be installedand justified in the next step. Remove one set of the switch. 78-17434-01 Rev. Determine the direction that the switch...rack, then unscrew the mounting brackets from the port-side of the switch. • If the switch will be justified determines which set of mounting brackets need to be justified...
Installation Guide
Page 8
... 3 people working together, lift the switch into the rack until the mounting brackets are flush with the rails. Installing the Cisco SFS 7008P Switch into a Rack Figure 5 Unscrew Extra Mounting Brackets from the Chassis 144965 Step 5 Separate the mounting brackets from the chassis when all screws have been loosened. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434...
... 3 people working together, lift the switch into the rack until the mounting brackets are flush with the rails. Installing the Cisco SFS 7008P Switch into a Rack Figure 5 Unscrew Extra Mounting Brackets from the Chassis 144965 Step 5 Separate the mounting brackets from the chassis when all screws have been loosened. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434...
Installation Guide
Page 9
... Fan Slot 9 Slot 10 Slot 11 Slot 12 Slot 13 Slot 14 154497 Fan tray LED • Redundant Fan Tray; A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9 see the fan locations in Figure 8. Figure 7 Power Supplies and Fans Located in the Front of the ...the Fan Module Installation Guide in the package. see the power supply locations in the package. 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: ...
... Fan Slot 9 Slot 10 Slot 11 Slot 12 Slot 13 Slot 14 154497 Fan tray LED • Redundant Fan Tray; A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9 see the fan locations in Figure 8. Figure 7 Power Supplies and Fans Located in the Front of the ...the Fan Module Installation Guide in the package. see the power supply locations in the package. 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: ...
Installation Guide
Page 10
... section briefly describes configuring your Linux kernel is supported. Download the configuration software and an integrated suite of supported versions. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into an open 64-bit PCI or PCI-X slot. Installing Host Channel Expansion Card Linux Drivers Make sure your...
... section briefly describes configuring your Linux kernel is supported. Download the configuration software and an integrated suite of supported versions. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into an open 64-bit PCI or PCI-X slot. Installing Host Channel Expansion Card Linux Drivers Make sure your...
Installation Guide
Page 11
...the files are used for the first time. To assign ib interfaces, enter ifconfig ib# ip address netmask netmask. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11 IPoIB drivers load when the interfaces are saved in a terminal window. # cdmount ./tsinstall This... Step 5 Step 6 Step 7 Locate your environment PATH: /usr/local/cisco/mpi/mpich/bin /usr/local/cisco/bin or Add directories to the HCA uses port 1 of the first HCA. Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for IBM BladeCenter ...
...the files are used for the first time. To assign ib interfaces, enter ifconfig ib# ip address netmask netmask. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11 IPoIB drivers load when the interfaces are saved in a terminal window. # cdmount ./tsinstall This... Step 5 Step 6 Step 7 Locate your environment PATH: /usr/local/cisco/mpi/mpich/bin /usr/local/cisco/bin or Add directories to the HCA uses port 1 of the first HCA. Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for IBM BladeCenter ...
Installation Guide
Page 12
Installing the Cisco SFS 7008P Switch into a Rack Installing Non-WHQL Host Channel Expansion Card Drivers on to your Windows 2000 host. Figure 9 Found New Hardware Alert Step 2 Ignore the alert. ... HCA Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. A0 A Found New Hardware alert appears (see Figure 10). OR DOWNLOAD?? IN STEP 4, THE SDK COMES UP - Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev.
Installing the Cisco SFS 7008P Switch into a Rack Installing Non-WHQL Host Channel Expansion Card Drivers on to your Windows 2000 host. Figure 9 Found New Hardware Alert Step 2 Ignore the alert. ... HCA Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. A0 A Found New Hardware alert appears (see Figure 10). OR DOWNLOAD?? IN STEP 4, THE SDK COMES UP - Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev.
Installation Guide
Page 13
... appear, click Cancel. The Product Information window appears. Click Next. Click Yes. Step 4 Run Topspin-ib-W2k-releaseNumber.exe. Figure 11 InfiniBand SDK Setup Window Step 5 Step 6 Step 7 Step 8 Step 9 Step 10 Click Next. The End User License Agreement window opens. The.... Click Finish. Your host reboots. 78-17434-01 Rev. Click Next. Click the I Agree to Install window opens. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 13 If you have not previously installed host drivers on this system, you to reboot. The system prompts ...
... appear, click Cancel. The Product Information window appears. Click Next. Click Yes. Step 4 Run Topspin-ib-W2k-releaseNumber.exe. Figure 11 InfiniBand SDK Setup Window Step 5 Step 6 Step 7 Step 8 Step 9 Step 10 Click Next. The End User License Agreement window opens. The.... Click Finish. Your host reboots. 78-17434-01 Rev. Click Next. Click the I Agree to Install window opens. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 13 If you have not previously installed host drivers on this system, you to reboot. The system prompts ...
Installation Guide
Page 14
The Product Information window appears. Click Next. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. A0 The End User License Agreement appears. Click the I START THIS The Product Install window ...drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center To install the Windows 2003 drivers, follow these steps: Step 1 Step 2 Log on to continue. Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel Expansion Card Windows 2003 Drivers If...
The Product Information window appears. Click Next. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. A0 The End User License Agreement appears. Click the I START THIS The Product Install window ...drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center To install the Windows 2003 drivers, follow these steps: Step 1 Step 2 Log on to continue. Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel Expansion Card Windows 2003 Drivers If...
Installation Guide
Page 15
Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack Step 6 A Windows driver dialog box appears. Although the drivers are not digitally signed, they are available per request (CAB files, etc.). Click Continue ... 14 Testing Dialog Box Step 7 The driver installation notice shown in the Driver Installation Notice dialog window. (See Figure 15.) 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15
Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack Step 6 A Windows driver dialog box appears. Although the drivers are not digitally signed, they are available per request (CAB files, etc.). Click Continue ... 14 Testing Dialog Box Step 7 The driver installation notice shown in the Driver Installation Notice dialog window. (See Figure 15.) 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15
Installation Guide
Page 16
... from the drop-down menu(see Figure 17). The system reboots and new driver installation is complete. Reboot the server. a. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. You see the screen in the Comment field (see Figure 17), if your... server requires it will continue without user intervention. Installing the Cisco SFS 7008P Switch into a Rack Figure 15 Driver Installation Notice Step 8 Important: Ignore the Found New Hardware Wizard (see Figure...
... from the drop-down menu(see Figure 17). The system reboots and new driver installation is complete. Reboot the server. a. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. You see the screen in the Comment field (see Figure 17), if your... server requires it will continue without user intervention. Installing the Cisco SFS 7008P Switch into a Rack Figure 15 Driver Installation Notice Step 8 Important: Ignore the Found New Hardware Wizard (see Figure...
Installation Guide
Page 17
... HERE??!! Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a Rack Installing WHQL Drivers on a Windows 2000 or 2003 Server (BoIB and non-BoIB) WHQL drivers are packaged in the address field of your switch in a .ZIP file. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 Launching the SFS Chassis Manager (Optional) SFS Chassis Manager is a web-based...
... HERE??!! Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a Rack Installing WHQL Drivers on a Windows 2000 or 2003 Server (BoIB and non-BoIB) WHQL drivers are packaged in the address field of your switch in a .ZIP file. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 Launching the SFS Chassis Manager (Optional) SFS Chassis Manager is a web-based...
Installation Guide
Page 18
A0 Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20.
A0 Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20.
Installation Guide
Page 19
... 1 Step 2 Ensure that you have sufficient system resources. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series Product Family Element Manager User Guide. To download...
... 1 Step 2 Ensure that you have sufficient system resources. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series Product Family Element Manager User Guide. To download...
Installation Guide
Page 20
... the serial number label location highlighted. Start the SFS Element Manager by product ID or model name; The website is secret. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. On Windows, double-click install.exe. On Windows platforms, click Programs -> Cisco SFS Element Manager -> Cisco SFS EM On Linux platforms, change to all customers...
... the serial number label location highlighted. Start the SFS Element Manager by product ID or model name; The website is secret. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. On Windows, double-click install.exe. On Windows platforms, click Programs -> Cisco SFS Element Manager -> Cisco SFS EM On Linux platforms, change to all customers...