Installation Guide
Page 1
... how to install and configure the Cisco SFS 7008P switch. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note Product number: PID=78-17434-01 Rev. This publication contains these sections: • Safety Overview, page 2 • Parts List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting...
... how to install and configure the Cisco SFS 7008P switch. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note Product number: PID=78-17434-01 Rev. This publication contains these sections: • Safety Overview, page 2 • Parts List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting...
Installation Guide
Page 2
DB-9 connector female to RJ-45 - Serial Cable - Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. Use the statement number provided at the end of each warning to locate its translation in ... included in a situation that may harm you if performed incorrectly. A0 Before you should have the following items are in your rack (two for the Cisco SFS 7008P switch and cables. MX-9-1 roll-over cable • Power cord for each power supply • Bezel • Parts bag • Regulation and Compliance Statement • 1...
DB-9 connector female to RJ-45 - Serial Cable - Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. Use the statement number provided at the end of each warning to locate its translation in ... included in a situation that may harm you if performed incorrectly. A0 Before you should have the following items are in your rack (two for the Cisco SFS 7008P switch and cables. MX-9-1 roll-over cable • Power cord for each power supply • Bezel • Parts bag • Regulation and Compliance Statement • 1...
Installation Guide
Page 3
... you have removed the straps, lift the box up to 106 pounds fully loaded. Remove the packaging from the switch and pallet. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 Save the box and packaging. • Prepare a management workstation, such as you ...is paired with a rollover M/F DB-9 serial cable (included). Specific components in slot 11. (See Figure 2.) 78-17434-01 Rev. The Cisco SFS 7008P switch chassis weighs up and away from around the chassis. Do not cut the packaging, as a PC or laptop running a terminal program with the...
... you have removed the straps, lift the box up to 106 pounds fully loaded. Remove the packaging from the switch and pallet. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 Save the box and packaging. • Prepare a management workstation, such as you ...is paired with a rollover M/F DB-9 serial cable (included). Specific components in slot 11. (See Figure 2.) 78-17434-01 Rev. The Cisco SFS 7008P switch chassis weighs up and away from around the chassis. Do not cut the packaging, as a PC or laptop running a terminal program with the...
Installation Guide
Page 4
... Power plug 1 Power plug 2 4x copper line interface modules 144988 Main air exhaust Step 2 Step 3 Verify that you have a Chassis ID module installed. (See Figure 1). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev.
... Power plug 1 Power plug 2 4x copper line interface modules 144988 Main air exhaust Step 2 Step 3 Verify that you have a Chassis ID module installed. (See Figure 1). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev.
Installation Guide
Page 5
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 See Figure 3 for each fabric module in the node slots: 78-17434-01 Rev. The node slots are 9, 10, 13 and ... 2.) Verify that you have at least one of the connections between the LIMs and the fabric modules in the node slots. Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core slot 1 Core slot 2 Node...
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 See Figure 3 for each fabric module in the node slots: 78-17434-01 Rev. The node slots are 9, 10, 13 and ... 2.) Verify that you have at least one of the connections between the LIMs and the fabric modules in the node slots. Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core slot 1 Core slot 2 Node...
Installation Guide
Page 6
...the weight of the chassis, which can be up to install the Cisco SFS 7008P switch in an equipment rack. Installing the Cisco SFS 7008P Switch into a Rack Figure 3 LIM and Fabric Module Connections Fabric card ...Cisco SFS 7008P switch chassis in an industry-standard rack, follow these steps: Step 1 Install a shelf for the chassis as shown in Figure 4, if you purchased the custom Cisco SFS 7008P switch shelf, follow the directions in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. A0 If you have not already done so. Cisco SFS 7008P InfiniBand Server Switch...
...the weight of the chassis, which can be up to install the Cisco SFS 7008P switch in an equipment rack. Installing the Cisco SFS 7008P Switch into a Rack Figure 3 LIM and Fabric Module Connections Fabric card ...Cisco SFS 7008P switch chassis in an industry-standard rack, follow these steps: Step 1 Install a shelf for the chassis as shown in Figure 4, if you purchased the custom Cisco SFS 7008P switch shelf, follow the directions in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. A0 If you have not already done so. Cisco SFS 7008P InfiniBand Server Switch...
Installation Guide
Page 7
... bezel-side in the rack, then unscrew the mounting brackets from the bezel-side of the switch. • If the switch will be removed in the next step. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 The direction that the switch will be justified determines which set of mounting brackets, as shown in Figure 5: • If...
... bezel-side in the rack, then unscrew the mounting brackets from the bezel-side of the switch. • If the switch will be removed in the next step. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 The direction that the switch will be justified determines which set of mounting brackets, as shown in Figure 5: • If...
Installation Guide
Page 8
... Brackets from the Chassis 144965 Step 5 Separate the mounting brackets from the chassis when all screws have been loosened. Installing the Cisco SFS 7008P Switch into the rack until the mounting brackets are flush with the rails. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434-01 Rev. A0 Step 6 With 2 or 3 people working together, lift the...
... Brackets from the Chassis 144965 Step 5 Separate the mounting brackets from the chassis when all screws have been loosened. Installing the Cisco SFS 7008P Switch into the rack until the mounting brackets are flush with the rails. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434-01 Rev. A0 Step 6 With 2 or 3 people working together, lift the...
Installation Guide
Page 9
Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: • Redundant Power Supply; see the power ... Front of the Management I /O Module according to the directions in the Power Supply Module Installation Guide in the package. • Redundant Management Interface Module; A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9
Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: • Redundant Power Supply; see the power ... Front of the Management I /O Module according to the directions in the Power Supply Module Installation Guide in the package. • Redundant Management Interface Module; A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9
Installation Guide
Page 10
...system. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. A0 Download the configuration software and an integrated suite of drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Software Center at this URL: http://www.cisco.com/...Step 3 Power down the host system following proper grounding procedures. Installing Host Channel Expansion Card Linux Drivers Make sure your InfiniBand host. Installing the Cisco SFS 7008P Switch into an open 64-bit PCI or PCI-X slot. Unpack the HCA module and insert it into a Rack Figure ...
...system. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. A0 Download the configuration software and an integrated suite of drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Software Center at this URL: http://www.cisco.com/...Step 3 Power down the host system following proper grounding procedures. Installing Host Channel Expansion Card Linux Drivers Make sure your InfiniBand host. Installing the Cisco SFS 7008P Switch into an open 64-bit PCI or PCI-X slot. Unpack the HCA module and insert it into a Rack Figure ...
Installation Guide
Page 11
...corresponds to your downloaded software direcory. This is required to use of the first HCA. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11 For example: export PATH=$PATH:/usr/local/cisco Configure all other drivers, including SDP. 78-17434-01 Rev. Open a terminal or graphic ...window and access the top-level directory. Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for IBM BladeCenter drivers after you can run commands between a remote ...
...corresponds to your downloaded software direcory. This is required to use of the first HCA. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11 For example: export PATH=$PATH:/usr/local/cisco Configure all other drivers, including SDP. 78-17434-01 Rev. Open a terminal or graphic ...window and access the top-level directory. Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for IBM BladeCenter drivers after you can run commands between a remote ...
Installation Guide
Page 12
WHERE DID THAT COME FROM? Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev. DRIVERS TOO? IN STEP 4, THE SDK COMES UP - Installing the Cisco SFS 7008P Switch into a Rack Installing Non-WHQL Host Channel Expansion Card Drivers on to your Windows 2000 host. ...Windows drivers after you have installed the HCA Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. A Found New Hardware alert appears (see Figure 10). A0 ...
WHERE DID THAT COME FROM? Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev. DRIVERS TOO? IN STEP 4, THE SDK COMES UP - Installing the Cisco SFS 7008P Switch into a Rack Installing Non-WHQL Host Channel Expansion Card Drivers on to your Windows 2000 host. ...Windows drivers after you have installed the HCA Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. A Found New Hardware alert appears (see Figure 10). A0 ...
Installation Guide
Page 13
...to Install window opens. Click Next. Click Next. Installing the Cisco SFS 7008P Switch into a Rack Note This wizard may not appear immediately. Your host reboots. 78-17434-01 Rev. The InfiniBand SDK Setup window opens (see Figure 11). The Installation Complete window... appears when the installation completes. Click Yes. Click the I Agree to reboot. Click Finish. The installation executes. Step 4 Run Topspin-ib-W2k-releaseNumber.exe. A0 Cisco SFS 7008P InfiniBand Server Switch Installation...
...to Install window opens. Click Next. Click Next. Installing the Cisco SFS 7008P Switch into a Rack Note This wizard may not appear immediately. Your host reboots. 78-17434-01 Rev. The InfiniBand SDK Setup window opens (see Figure 11). The Installation Complete window... appears when the installation completes. Click Yes. Click the I Agree to reboot. Click Finish. The installation executes. Step 4 Run Topspin-ib-W2k-releaseNumber.exe. A0 Cisco SFS 7008P InfiniBand Server Switch Installation...
Installation Guide
Page 14
... the Windows 2003 drivers, follow these steps: Step 1 Step 2 Log on to continue. The End User License Agreement appears. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel Expansion Card Windows 2003 Drivers If you have not already done so, download an integrated...
... the Windows 2003 drivers, follow these steps: Step 1 Step 2 Log on to continue. The End User License Agreement appears. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel Expansion Card Windows 2003 Drivers If you have not already done so, download an integrated...
Installation Guide
Page 15
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Figure 14 Testing Dialog Box Step 7 The driver installation notice shown in the Driver Installation Notice dialog window. (See Figure ... new drivers do not contain a Windows signature. Click Continue Anyway (Figure 14) each host channel adapter you have installed. Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack Step 6 A Windows driver dialog box appears. Although the drivers are not digitally signed, they are available per request (CAB files, etc.). WHQL ...
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Figure 14 Testing Dialog Box Step 7 The driver installation notice shown in the Driver Installation Notice dialog window. (See Figure ... new drivers do not contain a Windows signature. Click Continue Anyway (Figure 14) each host channel adapter you have installed. Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack Step 6 A Windows driver dialog box appears. Although the drivers are not digitally signed, they are available per request (CAB files, etc.). WHQL ...
Installation Guide
Page 16
... a Rack Figure 15 Driver Installation Notice Step 8 Important: Ignore the Found New Hardware Wizard (see Figure 16) when it appears because it . b. c. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. a. This window appears three times (twice for the IPoIB and once for the system reboot in ...
... a Rack Figure 15 Driver Installation Notice Step 8 Important: Ignore the Found New Hardware Wizard (see Figure 16) when it appears because it . b. c. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. a. This window appears three times (twice for the IPoIB and once for the system reboot in ...
Installation Guide
Page 17
... drivers, see the documentation at http://www.cisco.com. SFS Chassis Manager supports the following browsers: • Microsoft Internet Explorer version 6 • Netscape Navigator version 6 • Mozilla version 1.4 To launch SFS Chassis Manager, follow these steps: Step 1 Type the Management IP address of your switch in a .ZIP file. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17
... drivers, see the documentation at http://www.cisco.com. SFS Chassis Manager supports the following browsers: • Microsoft Internet Explorer version 6 • Netscape Navigator version 6 • Mozilla version 1.4 To launch SFS Chassis Manager, follow these steps: Step 1 Type the Management IP address of your switch in a .ZIP file. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17
Installation Guide
Page 18
Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. A0 Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20.
Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. A0 Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20.
Installation Guide
Page 19
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 You need the following: • 32 MB free RAM • 50 MB disk space and 50MB additional temporary space ...Windows/install_x86.exe • Solaris/install_solaris_sparc.bin 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series Product Family Element Manager User Guide. To install Element Manager, follow...
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 You need the following: • 32 MB free RAM • 50 MB disk space and 50MB additional temporary space ...Windows/install_x86.exe • Solaris/install_solaris_sparc.bin 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series Product Family Element Manager User Guide. To install Element Manager, follow...
Installation Guide
Page 20
... user is available 24 hours a day, 365 days a year, at this URL: http://www.cisco.com/techsupport Access to the installation directory and run SFS Element Manager with the serial number label location highlighted. The website is secret. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. b. You can register at this...
... user is available 24 hours a day, 365 days a year, at this URL: http://www.cisco.com/techsupport Access to the installation directory and run SFS Element Manager with the serial number label location highlighted. The website is secret. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. b. You can register at this...