Installation Guide
Page 1
... List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated Safety Warnings, page 21 • Obtaining Documentation, page 27 •...; Obtaining Additional Publications and Information, page 31 Corporate Headquarters: Cisco Systems, Inc., 170 West Tasman Drive, San Jose, CA 95134-1706 USA © 2006 Cisco Systems, Inc. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note Product number: PID=78-17434-01 ...
... List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated Safety Warnings, page 21 • Obtaining Documentation, page 27 •...; Obtaining Additional Publications and Information, page 31 Corporate Headquarters: Cisco Systems, Inc., 170 West Tasman Drive, San Jose, CA 95134-1706 USA © 2006 Cisco Systems, Inc. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note Product number: PID=78-17434-01 ...
Installation Guide
Page 2
... locate its translation in procedures that may harm you should have the following items are in your rack (two for the Cisco SFS 7008P switch and cables. DB-9 connector female to RJ-45 - MX-9-1 roll-over cable • Power cord for each power supply...Any associated mounting clips to secure the brackets to the accessories provided with the switch, you if performed incorrectly. You are included in a situation that could cause bodily injury. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. Warning IMPORTANT SAFETY INSTRUCTIONS...
... locate its translation in procedures that may harm you should have the following items are in your rack (two for the Cisco SFS 7008P switch and cables. DB-9 connector female to RJ-45 - MX-9-1 roll-over cable • Power cord for each power supply...Any associated mounting clips to secure the brackets to the accessories provided with the switch, you if performed incorrectly. You are included in a situation that could cause bodily injury. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. Warning IMPORTANT SAFETY INSTRUCTIONS...
Installation Guide
Page 3
..., verify that you have the minimum components necessary to complete the installation (highly recommended). The Cisco SFS 7008P switch chassis weighs up and away from the switch and pallet. Do not cut the packaging, as a PC or laptop running a terminal program... switch. Save the box and packaging. • Prepare a management workstation, such as you have the right cables and sufficient ventilation. • Open the Cisco SFS 7008P package and remove the chassis, rack brackets, parts bag, and documentation from around the chassis. A0 Cisco SFS 7008P InfiniBand Server Switch ...
..., verify that you have the minimum components necessary to complete the installation (highly recommended). The Cisco SFS 7008P switch chassis weighs up and away from the switch and pallet. Do not cut the packaging, as a PC or laptop running a terminal program... switch. Save the box and packaging. • Prepare a management workstation, such as you have the right cables and sufficient ventilation. • Open the Cisco SFS 7008P package and remove the chassis, rack brackets, parts bag, and documentation from around the chassis. A0 Cisco SFS 7008P InfiniBand Server Switch ...
Installation Guide
Page 4
... the Core slot (see slot 11 in slot 12) is not required for the chassis to function, but is required to have a non-blocking fabric. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev. A second Fabric Controller module (installed in Figure 2). A0 Verifying Basic Hardware Figure 1 Back of Unit Chassis ID...
... the Core slot (see slot 11 in slot 12) is not required for the chassis to function, but is required to have a non-blocking fabric. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev. A second Fabric Controller module (installed in Figure 2). A0 Verifying Basic Hardware Figure 1 Back of Unit Chassis ID...
Installation Guide
Page 5
... fabric modules in the node slots. See Figure 3 for each fabric module in the node slots: 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core...
... fabric modules in the node slots. See Figure 3 for each fabric module in the node slots: 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core...
Installation Guide
Page 6
... slot 6 LIM card in slot 7 LIM card in slot 8 154550 Installing the Cisco SFS 7008P Switch into a Rack This section describes how to 106 pounds if all possible components are installed. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 6 78-17434-01 Rev. To mount the Cisco SFS 7008P switch chassis in an industry-standard rack, follow these steps: Step 1 Install a shelf...
... slot 6 LIM card in slot 7 LIM card in slot 8 154550 Installing the Cisco SFS 7008P Switch into a Rack This section describes how to 106 pounds if all possible components are installed. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 6 78-17434-01 Rev. To mount the Cisco SFS 7008P switch chassis in an industry-standard rack, follow these steps: Step 1 Install a shelf...
Installation Guide
Page 7
...be removed in the next step. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 Determine the direction that the switch will be justified determines which set of mounting brackets, as shown in Figure 5: • If the switch will be justified toward the port-side in...rack, then unscrew the mounting brackets from the bezel-side of the switch. • If the switch will be justified toward the bezel-side in the rack. Figure 4 Install Appropriate Shelf Installing the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself ...
...be removed in the next step. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 Determine the direction that the switch will be justified determines which set of mounting brackets, as shown in Figure 5: • If the switch will be justified toward the port-side in...rack, then unscrew the mounting brackets from the bezel-side of the switch. • If the switch will be justified toward the bezel-side in the rack. Figure 4 Install Appropriate Shelf Installing the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself ...
Installation Guide
Page 8
... 144965 Step 5 Separate the mounting brackets from the chassis when all screws have been loosened. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into the rack until the mounting brackets are flush with the rails. Step 6 With 2 or... 3 people working together, lift the switch into the rack as shown in Figure 6. Step 8 Use ...
... 144965 Step 5 Separate the mounting brackets from the chassis when all screws have been loosened. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into the rack until the mounting brackets are flush with the rails. Step 6 With 2 or... 3 people working together, lift the switch into the rack as shown in Figure 6. Step 8 Use ...
Installation Guide
Page 9
... power supply locations in the package. Install the second fan according to the directions in the Power Supply Module Installation Guide in Figure 7. Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: • Redundant Power Supply;...Installation Guide in the package. 78-17434-01 Rev. Install the second I /O Modules in Figure 7. see the fan locations in Figure 8. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9
... power supply locations in the package. Install the second fan according to the directions in the Power Supply Module Installation Guide in Figure 7. Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: • Redundant Power Supply;...Installation Guide in the package. 78-17434-01 Rev. Install the second I /O Modules in Figure 7. see the fan locations in Figure 8. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9
Installation Guide
Page 10
... an open 64-bit PCI or PCI-X slot. Power on the host system. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. Unpack the HCA module and insert it into a Rack Figure 8 Management I .O modules Power plug 1 Power ... Center at this URL: http://www.cisco.com/public/sw-center Install the Host Channel Expansion Card for a list of supported versions. Installing Host Channel Expansion Card Linux Drivers Make sure your InfiniBand host. See www.cisco.com for IBM BladeCenter by doing the following: Step 1 Step 2 Step 3 Power down ...
... an open 64-bit PCI or PCI-X slot. Power on the host system. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. Unpack the HCA module and insert it into a Rack Figure 8 Management I .O modules Power plug 1 Power ... Center at this URL: http://www.cisco.com/public/sw-center Install the Host Channel Expansion Card for a list of supported versions. Installing Host Channel Expansion Card Linux Drivers Make sure your InfiniBand host. See www.cisco.com for IBM BladeCenter by doing the following: Step 1 Step 2 Step 3 Power down ...
Installation Guide
Page 11
... you can run commands between a remote and local node without entering a login or password. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11 Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for the first time. Execute the command ..../tsinstall in the /usr/local/cisco directory. IPoIB drivers load when the interfaces are saved in a terminal window....
... you can run commands between a remote and local node without entering a login or password. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11 Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for the first time. Execute the command ..../tsinstall in the /usr/local/cisco directory. IPoIB drivers load when the interfaces are saved in a terminal window....
Installation Guide
Page 12
... Windows drivers after you have installed the HCA Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev. Figure 10 Found New Hardware Wizard WIZARD.TIF Step 3 Click...
... Windows drivers after you have installed the HCA Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev. Figure 10 Found New Hardware Wizard WIZARD.TIF Step 3 Click...
Installation Guide
Page 13
... window opens. Click Next. The Ready to the terms listed above radio button, and then click Next. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 13 The InfiniBand SDK Setup window opens (see Figure 11). Figure 11 InfiniBand SDK Setup Window Step 5 Step 6 Step 7 Step 8 Step 9 Step 10 Click Next. The Installation Complete ...not previously installed host drivers on this system, you to reboot. Click Yes. Click Finish. Your host reboots. 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Note This wizard may not appear immediately.
... window opens. Click Next. The Ready to the terms listed above radio button, and then click Next. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 13 The InfiniBand SDK Setup window opens (see Figure 11). Figure 11 InfiniBand SDK Setup Window Step 5 Step 6 Step 7 Step 8 Step 9 Step 10 Click Next. The Installation Complete ...not previously installed host drivers on this system, you to reboot. Click Yes. Click Finish. Your host reboots. 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Note This wizard may not appear immediately.
Installation Guide
Page 14
Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. The End User License Agreement appears. The Installation in Progress window appears with the status of HCA drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Software Center at this URL: http://www.cisco....?HOW DO I Agree to the terms listed above radio button, and then click Next to your Windows 2003 host. Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel Expansion Card Windows 2003 Drivers If you have not already done so, download an integrated suite of...
Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. The End User License Agreement appears. The Installation in Progress window appears with the status of HCA drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Software Center at this URL: http://www.cisco....?HOW DO I Agree to the terms listed above radio button, and then click Next to your Windows 2003 host. Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel Expansion Card Windows 2003 Drivers If you have not already done so, download an integrated suite of...
Installation Guide
Page 15
... appears. This dialog box explains that the new drivers do not contain a Windows signature. WHQL submission materials are tested using the Microsoft HCT suite. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Figure 14 Testing Dialog Box Step 7 The driver installation notice shown in the Driver Installation Notice dialog window. (See Figure...
... appears. This dialog box explains that the new drivers do not contain a Windows signature. WHQL submission materials are tested using the Microsoft HCT suite. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Figure 14 Testing Dialog Box Step 7 The driver installation notice shown in the Driver Installation Notice dialog window. (See Figure...
Installation Guide
Page 16
... Windows, click Start > Shutdown. b. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. c. Installing the Cisco SFS 7008P Switch into a Rack Figure 15 Driver Installation Notice Step 8 Important: Ignore the Found New Hardware Wizard (see Figure 16) when it appears because it . Optionally, enter a ... and new driver installation is complete. Select Restart from the drop-down menu(see the screen in the Comment field (see Figure 17), if your server requires it will continue without user intervention.
... Windows, click Start > Shutdown. b. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. c. Installing the Cisco SFS 7008P Switch into a Rack Figure 15 Driver Installation Notice Step 8 Important: Ignore the Found New Hardware Wizard (see Figure 16) when it appears because it . Optionally, enter a ... and new driver installation is complete. Select Restart from the drop-down menu(see the screen in the Comment field (see Figure 17), if your server requires it will continue without user intervention.
Installation Guide
Page 17
...Netscape Navigator version 6 • Mozilla version 1.4 To launch SFS Chassis Manager, follow these steps: Step 1 Type the Management IP address of your browser and press Enter. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 To install WHQL drivers, see the... documentation at http://www.cisco.com. A login window opens. (See Figure 18.) 78-17434-01 Rev. Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a...
...Netscape Navigator version 6 • Mozilla version 1.4 To launch SFS Chassis Manager, follow these steps: Step 1 Type the Management IP address of your browser and press Enter. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 To install WHQL drivers, see the... documentation at http://www.cisco.com. A login window opens. (See Figure 18.) 78-17434-01 Rev. Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a...
Installation Guide
Page 18
A0 Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20.
A0 Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20.
Installation Guide
Page 19
... Step 2 Ensure that you have sufficient system resources. To download the latest software, access the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center Step 3 Locate the appropriate install file. • Linux/install_linux_ia64.bin ...software. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series...
... Step 2 Ensure that you have sufficient system resources. To download the latest software, access the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center Step 3 Locate the appropriate install file. • Linux/install_linux_ia64.bin ...software. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series...
Installation Guide
Page 20
... features extensive online support resources. b. When prompted to locate your product with Cisco products and technologies. Cisco Technical Support Website The Cisco Technical Support Website provides online documents and tools for service. Search results show command output. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. Follow the onscreen instructions. Enter location and...
... features extensive online support resources. b. When prompted to locate your product with Cisco products and technologies. Cisco Technical Support Website The Cisco Technical Support Website provides online documents and tools for service. Search results show command output. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. Follow the onscreen instructions. Enter location and...