Installation Guide
Page 1
...List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated Safety Warnings, page 21 • Obtaining Documentation, page 27 •...: Cisco Systems, Inc., 170 West Tasman Drive, San Jose, CA 95134-1706 USA © 2006 Cisco Systems, Inc. All rights reserved. A0 This installation and configuration note describes how to install and configure the Cisco SFS 7008P switch. Cisco SFS 7008P InfiniBand Server Switch Installation...
...List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated Safety Warnings, page 21 • Obtaining Documentation, page 27 •...: Cisco Systems, Inc., 170 West Tasman Drive, San Jose, CA 95134-1706 USA © 2006 Cisco Systems, Inc. All rights reserved. A0 This installation and configuration note describes how to install and configure the Cisco SFS 7008P switch. Cisco SFS 7008P InfiniBand Server Switch Installation...
Installation Guide
Page 2
...to attach the mounting brackets to the rack • Any associated mounting clips to secure the brackets to your SFS 7008 package: • Chassis with the switch, you if performed incorrectly. Serial Cable - DB-9 connector male to RJ-45 - Serial cable document -...you work on any equipment, be familiar with standard practices for the Cisco SFS 7008P switch and cables. DB-9 connector female to RJ-45 - You are included in a situation that could cause bodily injury. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. MX-9-1 roll...
...to attach the mounting brackets to the rack • Any associated mounting clips to secure the brackets to your SFS 7008 package: • Chassis with the switch, you if performed incorrectly. Serial Cable - DB-9 connector male to RJ-45 - Serial cable document -...you work on any equipment, be familiar with standard practices for the Cisco SFS 7008P switch and cables. DB-9 connector female to RJ-45 - You are included in a situation that could cause bodily injury. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. MX-9-1 roll...
Installation Guide
Page 3
... Three people to run the chassis. Remove the packaging from the box. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 The Cisco SFS 7008P switch chassis weighs up and away from the switch and pallet. After you have removed the straps, lift the box up to ... have the right cables and sufficient ventilation. • Open the Cisco SFS 7008P package and remove the chassis, rack brackets, parts bag, and documentation from around the chassis. Specific components in the Cisco SFS 7008P switch (see Figure 1 and Figure 2) have at least one management ...
... Three people to run the chassis. Remove the packaging from the box. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 The Cisco SFS 7008P switch chassis weighs up and away from the switch and pallet. After you have removed the straps, lift the box up to ... have the right cables and sufficient ventilation. • Open the Cisco SFS 7008P package and remove the chassis, rack brackets, parts bag, and documentation from around the chassis. Specific components in the Cisco SFS 7008P switch (see Figure 1 and Figure 2) have at least one management ...
Installation Guide
Page 4
... (see slot 11 in slot 12) is not required for the chassis to function, but is required to have a Chassis ID module installed. (See Figure 1). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev. A second Fabric Controller module (installed in Figure 2). Verifying Basic Hardware Figure 1 Back of Unit Chassis ID Management...
... (see slot 11 in slot 12) is not required for the chassis to function, but is required to have a Chassis ID module installed. (See Figure 1). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev. A second Fabric Controller module (installed in Figure 2). Verifying Basic Hardware Figure 1 Back of Unit Chassis ID Management...
Installation Guide
Page 5
... node slots. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 The node slots are 9, 10, 13 and 14. (See Figure 2.) Verify that you have at least one of the connections between the LIMs and the fabric modules in the node slots: 78-17434-01 Rev. Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp...
... node slots. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 The node slots are 9, 10, 13 and 14. (See Figure 2.) Verify that you have at least one of the connections between the LIMs and the fabric modules in the node slots: 78-17434-01 Rev. Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp...
Installation Guide
Page 6
To mount the Cisco SFS 7008P switch chassis in an industry-standard rack, follow the directions in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. A0 Installing the Cisco SFS 7008P Switch into a Rack Figure 3 LIM and Fabric Module Connections Fabric card in slot ...if all possible components are installed. If you purchased the custom Cisco SFS 7008P switch shelf, follow these steps: Step 1 Install a shelf for the chassis as shown in an equipment rack. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 6 78-17434-01 Rev. The ...
To mount the Cisco SFS 7008P switch chassis in an industry-standard rack, follow the directions in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. A0 Installing the Cisco SFS 7008P Switch into a Rack Figure 3 LIM and Fabric Module Connections Fabric card in slot ...if all possible components are installed. If you purchased the custom Cisco SFS 7008P switch shelf, follow these steps: Step 1 Install a shelf for the chassis as shown in an equipment rack. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 6 78-17434-01 Rev. The ...
Installation Guide
Page 7
... the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself using an approved ground wrist-strap. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 Determine the direction that the switch will be justified determines which set of mounting brackets, as shown in Figure 5: • If the switch will be...-side of mounting brackets need to be installedand justified in the next step. The direction that the switch will be justified toward the bezel-side in the rack, then unscrew the mounting brackets from the port-side of the...
... the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself using an approved ground wrist-strap. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 Determine the direction that the switch will be justified determines which set of mounting brackets, as shown in Figure 5: • If the switch will be...-side of mounting brackets need to be installedand justified in the next step. The direction that the switch will be justified toward the bezel-side in the rack, then unscrew the mounting brackets from the port-side of the...
Installation Guide
Page 8
Installing the Cisco SFS 7008P Switch into the rack as shown in Figure 6. Step 8 Use screws that fit your rack to attach both mounting brackets to the rack posts. Step 6 With 2 or 3 people working together, lift the switch into a Rack Figure 5 Unscrew Extra Mounting Brackets... from the Chassis 144965 Step 5 Separate the mounting brackets from the chassis when all screws have been loosened. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434-01 Rev. Figure 6 Chassis Set onto Shelf 144966 Step 7 Push the chassis into ...
Installing the Cisco SFS 7008P Switch into the rack as shown in Figure 6. Step 8 Use screws that fit your rack to attach both mounting brackets to the rack posts. Step 6 With 2 or 3 people working together, lift the switch into a Rack Figure 5 Unscrew Extra Mounting Brackets... from the Chassis 144965 Step 5 Separate the mounting brackets from the chassis when all screws have been loosened. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434-01 Rev. Figure 6 Chassis Set onto Shelf 144966 Step 7 Push the chassis into ...
Installation Guide
Page 9
...the directions in the Power Supply Module Installation Guide in Figure 7. see the power supply locations in the package. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9 see the fan locations in the package. • Redundant Management Interface Module; see the ... Fan Tray; Install the second power supply according to the Fan Module Installation Guide in Figure 7. Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: •...
...the directions in the Power Supply Module Installation Guide in Figure 7. see the power supply locations in the package. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9 see the fan locations in the package. • Redundant Management Interface Module; see the ... Fan Tray; Install the second power supply according to the Fan Module Installation Guide in Figure 7. Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: •...
Installation Guide
Page 10
... Host Channel Expansion Card for a list of drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center Install the Host Channel Expansion Card for IBM BladeCenter by doing the following: Step 1...Power on the host system. Installing Host Channel Expansion Card Linux Drivers Make sure your InfiniBand host. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into an open 64-bit PCI or PCI-X slot. Download the configuration software and ...
... Host Channel Expansion Card for a list of drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center Install the Host Channel Expansion Card for IBM BladeCenter by doing the following: Step 1...Power on the host system. Installing Host Channel Expansion Card Linux Drivers Make sure your InfiniBand host. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into an open 64-bit PCI or PCI-X slot. Download the configuration software and ...
Installation Guide
Page 11
...MPI by assigning an IP address to interface ib0 and/or ib1, which corresponds to your downloaded software direcory. Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for IBM BladeCenter drivers after you can run commands between a ... ./tsinstall in the /usr/local/cisco directory. To assign ib interfaces, enter ifconfig ib# ip address netmask netmask. For example: export PATH=$PATH:/usr/local/cisco Configure all other drivers, including SDP. 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11
...MPI by assigning an IP address to interface ib0 and/or ib1, which corresponds to your downloaded software direcory. Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for IBM BladeCenter drivers after you can run commands between a ... ./tsinstall in the /usr/local/cisco directory. To assign ib interfaces, enter ifconfig ib# ip address netmask netmask. For example: export PATH=$PATH:/usr/local/cisco Configure all other drivers, including SDP. 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11
Installation Guide
Page 12
WHERE DID THAT COME FROM? A0 DRIVERS TOO? Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev. To install Windows drivers after you have installed the HCA Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. Figure...
WHERE DID THAT COME FROM? A0 DRIVERS TOO? Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev. To install Windows drivers after you have installed the HCA Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. Figure...
Installation Guide
Page 13
... window appears when the installation completes. The system prompts you do not need to reboot. Click Yes. Installing the Cisco SFS 7008P Switch into a Rack Note This wizard may not appear immediately. The Product Information window appears. The Ready to the terms...Click Finish. When the wizard does appear, click Cancel. The InfiniBand SDK Setup window opens (see Figure 11). Figure 11 InfiniBand SDK Setup Window Step 5 Step 6 Step 7 Step 8 Step 9 Step 10 Click Next. Click Next. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 13
... window appears when the installation completes. The system prompts you do not need to reboot. Click Yes. Installing the Cisco SFS 7008P Switch into a Rack Note This wizard may not appear immediately. The Product Information window appears. The Ready to the terms...Click Finish. When the wizard does appear, click Cancel. The InfiniBand SDK Setup window opens (see Figure 11). Figure 11 InfiniBand SDK Setup Window Step 5 Step 6 Step 7 Step 8 Step 9 Step 10 Click Next. Click Next. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 13
Installation Guide
Page 14
.../public/sw-center To install the Windows 2003 drivers, follow these steps: Step 1 Step 2 Log on to continue. Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel Expansion Card Windows 2003 Drivers If you have not already done so, download an integrated suite of..., and then click Next to your Windows 2003 host. Click the I START THIS The Product Install window appears (see Figure 13). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. Figure 12 Product Install Window Step 3 Step 4 Step 5 Click Next. A0
.../public/sw-center To install the Windows 2003 drivers, follow these steps: Step 1 Step 2 Log on to continue. Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel Expansion Card Windows 2003 Drivers If you have not already done so, download an integrated suite of..., and then click Next to your Windows 2003 host. Click the I START THIS The Product Install window appears (see Figure 13). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. Figure 12 Product Install Window Step 3 Step 4 Step 5 Click Next. A0
Installation Guide
Page 15
... 15 appears for each time the Windows Logo testing dialog box appears. Click Continue Anyway (Figure 14) each host channel adapter you have installed. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack Step 6 A Windows driver dialog box appears.
... 15 appears for each time the Windows Logo testing dialog box appears. Click Continue Anyway (Figure 14) each host channel adapter you have installed. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack Step 6 A Windows driver dialog box appears.
Installation Guide
Page 16
Figure 16 Ignore the Found New Hardware Wizard Windows Step 9 Step 10 Click Finish. You see Figure 17), if your server requires it will continue without user intervention. c. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. A0 b. d. Click OK. In Windows, click Start > Shutdown. Optionally, enter a reason for SRP). This window...
Figure 16 Ignore the Found New Hardware Wizard Windows Step 9 Step 10 Click Finish. You see Figure 17), if your server requires it will continue without user intervention. c. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. A0 b. d. Click OK. In Windows, click Start > Shutdown. Optionally, enter a reason for SRP). This window...
Installation Guide
Page 17
... these steps: Step 1 Type the Management IP address of your switch in a .ZIP file. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 THERE IS NOTHING HERE??!! Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a Rack Installing WHQL Drivers on a Windows 2000 or 2003 Server (BoIB and non-BoIB) WHQL drivers are packaged in the address...
... these steps: Step 1 Type the Management IP address of your switch in a .ZIP file. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 THERE IS NOTHING HERE??!! Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a Rack Installing WHQL Drivers on a Windows 2000 or 2003 Server (BoIB and non-BoIB) WHQL drivers are packaged in the address...
Installation Guide
Page 18
Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20. A0
Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20. A0
Installation Guide
Page 19
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 You need the following: • 32 MB free RAM • 50 MB disk space and 50MB additional temporary space ...To install Element Manager, follow these steps: Step 1 Step 2 Ensure that you have sufficient system resources. Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series Product Family Element Manager User Guide.
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 You need the following: • 32 MB free RAM • 50 MB disk space and 50MB additional temporary space ...To install Element Manager, follow these steps: Step 1 Step 2 Ensure that you have sufficient system resources. Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series Product Family Element Manager User Guide.
Installation Guide
Page 20
... tool offers three search options: by copying and pasting show an illustration of the Cisco SFS 7008P switch, and community string for the unrestricted user. On Solaris and Linux systems, enter sh ./install_yourOS.bin. The default community string for service. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. If you have a valid service...
... tool offers three search options: by copying and pasting show an illustration of the Cisco SFS 7008P switch, and community string for the unrestricted user. On Solaris and Linux systems, enter sh ./install_yourOS.bin. The default community string for service. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. If you have a valid service...