Installation Guide
Page 1
Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note Product number: PID=78-17434-01 Rev. All rights reserved. A0 This installation and configuration note describes how to install and configure the Cisco SFS 7008P switch. This publication contains these sections: • Safety Overview, page ... 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated Safety Warnings, page 21 • Obtaining Documentation, page ...
Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note Product number: PID=78-17434-01 Rev. All rights reserved. A0 This installation and configuration note describes how to install and configure the Cisco SFS 7008P switch. This publication contains these sections: • Safety Overview, page ... 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated Safety Warnings, page 21 • Obtaining Documentation, page ...
Installation Guide
Page 2
... of the hazards involved with electrical circuitry and be aware of the rack) • A rack with standard practices for the Cisco SFS 7008P switch and cables. A0 Before you if performed incorrectly. Statement 1071 SAVE THESE INSTRUCTIONS Parts List The following : • A #2... with enough clearance for preventing accidents. DB-9 connector male to RJ-45 - Serial Cable - Serial cable document - Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. You are included in procedures that could cause bodily injury. Use the...
... of the hazards involved with electrical circuitry and be aware of the rack) • A rack with standard practices for the Cisco SFS 7008P switch and cables. A0 Before you if performed incorrectly. Statement 1071 SAVE THESE INSTRUCTIONS Parts List The following : • A #2... with enough clearance for preventing accidents. DB-9 connector male to RJ-45 - Serial Cable - Serial cable document - Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. You are included in procedures that could cause bodily injury. Use the...
Installation Guide
Page 3
...Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 Remove the packaging from the switch and pallet. Do not cut the packaging, as a PC or laptop running a terminal program with the Fabric Controller in slot 11. (See Figure 2.) 78-17434-01 Rev. Before You Install • Three people to 106 pounds fully loaded. The Cisco SFS 7008P switch...these steps: Step 1 Verify that you have at least one management interface module installed in the Cisco SFS 7008P switch (see Figure 1 and Figure 2) have not purchased a fully loaded chassis with high-availability ...
...Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 Remove the packaging from the switch and pallet. Do not cut the packaging, as a PC or laptop running a terminal program with the Fabric Controller in slot 11. (See Figure 2.) 78-17434-01 Rev. Before You Install • Three people to 106 pounds fully loaded. The Cisco SFS 7008P switch...these steps: Step 1 Verify that you have at least one management interface module installed in the Cisco SFS 7008P switch (see Figure 1 and Figure 2) have not purchased a fully loaded chassis with high-availability ...
Installation Guide
Page 4
... (see slot 11 in slot 12) is not required for the chassis to function, but is required to have a Chassis ID module installed. (See Figure 1). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev.
... (see slot 11 in slot 12) is not required for the chassis to function, but is required to have a Chassis ID module installed. (See Figure 1). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev.
Installation Guide
Page 5
Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core slot 1 Core slot 2 Node ... installed. (See Figure 2.) Verify that you have at least one of the connections between the LIMs and the fabric modules in the node slots. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 See Figure 3 for each fabric module in the node slots: 78-17434-01 Rev.
Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core slot 1 Core slot 2 Node ... installed. (See Figure 2.) Verify that you have at least one of the connections between the LIMs and the fabric modules in the node slots. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 See Figure 3 for each fabric module in the node slots: 78-17434-01 Rev.
Installation Guide
Page 6
... the chassis, which can be up to install the Cisco SFS 7008P switch in Figure 4, if you have not already done so. To mount the Cisco SFS 7008P switch chassis in an industry-standard rack, follow the directions in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. If you purchased the custom Cisco SFS 7008P switch shelf, follow these steps: Step 1 Install a shelf for the...
... the chassis, which can be up to install the Cisco SFS 7008P switch in Figure 4, if you have not already done so. To mount the Cisco SFS 7008P switch chassis in an industry-standard rack, follow the directions in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. If you purchased the custom Cisco SFS 7008P switch shelf, follow these steps: Step 1 Install a shelf for the...
Installation Guide
Page 7
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 Determine the direction that the switch will be removed in the rack. Figure 4 Install Appropriate Shelf Installing the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself using an approved ground wrist-strap. The direction that the switch will be justified determines which set of mounting brackets, as shown...
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 7 Determine the direction that the switch will be removed in the rack. Figure 4 Install Appropriate Shelf Installing the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself using an approved ground wrist-strap. The direction that the switch will be justified determines which set of mounting brackets, as shown...
Installation Guide
Page 8
... Shelf 144966 Step 7 Push the chassis into the rack as shown in Figure 6. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434-01 Rev. Step 6 With 2 or 3 people working together, lift the switch into the rack until the mounting brackets are flush with the rails. A0 Step 8... Use screws that fit your rack to attach both mounting brackets to the rack posts. Installing the Cisco SFS 7008P Switch into a Rack Figure 5 Unscrew Extra Mounting Brackets from the Chassis 144965 Step 5 Separate the mounting brackets from the chassis when...
... Shelf 144966 Step 7 Push the chassis into the rack as shown in Figure 6. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434-01 Rev. Step 6 With 2 or 3 people working together, lift the switch into the rack until the mounting brackets are flush with the rails. A0 Step 8... Use screws that fit your rack to attach both mounting brackets to the rack posts. Installing the Cisco SFS 7008P Switch into a Rack Figure 5 Unscrew Extra Mounting Brackets from the Chassis 144965 Step 5 Separate the mounting brackets from the chassis when...
Installation Guide
Page 9
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9 Figure 7 Power Supplies and Fans Located in the Front of the Management I /O Module according to the directions in the Power Supply Module Installation Guide in Figure 8. Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components...
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9 Figure 7 Power Supplies and Fans Located in the Front of the Management I /O Module according to the directions in the Power Supply Module Installation Guide in Figure 8. Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components...
Installation Guide
Page 10
Installing Host Channel Expansion Card Linux Drivers Make sure your InfiniBand host. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. Unpack the HCA module and insert it into a Rack Figure 8 Management I/O Modules .../sw-center Install the Host Channel Expansion Card for IBM BladeCenter This section briefly describes configuring your Linux kernel is supported. Installing the Cisco SFS 7008P Switch into an open 64-bit PCI or PCI-X slot. A0 Download the configuration software and an integrated suite of supported versions. Power ...
Installing Host Channel Expansion Card Linux Drivers Make sure your InfiniBand host. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. Unpack the HCA module and insert it into a Rack Figure 8 Management I/O Modules .../sw-center Install the Host Channel Expansion Card for IBM BladeCenter This section briefly describes configuring your Linux kernel is supported. Installing the Cisco SFS 7008P Switch into an open 64-bit PCI or PCI-X slot. A0 Download the configuration software and an integrated suite of supported versions. Power ...
Installation Guide
Page 11
... required to use of the first HCA. Open a terminal or graphic window and access the top-level directory. Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for IBM BladeCenter drivers after you can run commands between a remote ...cisco/mpi/mpich/bin /usr/local/cisco/bin or Add directories to the two HCA ports. For example: export PATH=$PATH:/usr/local/cisco Configure all other drivers, including SDP. 78-17434-01 Rev. To assign ib interfaces, enter ifconfig ib# ip address netmask netmask. A0 Cisco SFS 7008P InfiniBand Server Switch...
... required to use of the first HCA. Open a terminal or graphic window and access the top-level directory. Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for IBM BladeCenter drivers after you can run commands between a remote ...cisco/mpi/mpich/bin /usr/local/cisco/bin or Add directories to the two HCA ports. For example: export PATH=$PATH:/usr/local/cisco Configure all other drivers, including SDP. 78-17434-01 Rev. To assign ib interfaces, enter ifconfig ib# ip address netmask netmask. A0 Cisco SFS 7008P InfiniBand Server Switch...
Installation Guide
Page 12
DRIVERS TOO? IN STEP 4, THE SDK COMES UP - A0 A Found New Hardware alert appears (see Figure 10). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev. WHERE DID THAT COME FROM? Figure 9 Found New Hardware Alert Step..., follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. The Found New Hardware Wizard window opens (see Figure 9). Installing the Cisco SFS 7008P Switch into a Rack Installing Non-WHQL Host Channel Expansion Card Drivers ...
DRIVERS TOO? IN STEP 4, THE SDK COMES UP - A0 A Found New Hardware alert appears (see Figure 10). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev. WHERE DID THAT COME FROM? Figure 9 Found New Hardware Alert Step..., follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. The Found New Hardware Wizard window opens (see Figure 9). Installing the Cisco SFS 7008P Switch into a Rack Installing Non-WHQL Host Channel Expansion Card Drivers ...
Installation Guide
Page 13
... Installation Complete window appears when the installation completes. If you have not previously installed host drivers on this system, you to reboot. Figure 11 InfiniBand SDK Setup Window Step 5 Step 6 Step 7 Step 8 Step 9 Step 10 Click Next. The Product Information window appears. Click Next. Step...78-17434-01 Rev. The End User License Agreement window opens. When the wizard does appear, click Cancel. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 13 Installing the Cisco SFS 7008P Switch into a Rack Note This wizard may not appear immediately.
... Installation Complete window appears when the installation completes. If you have not previously installed host drivers on this system, you to reboot. Figure 11 InfiniBand SDK Setup Window Step 5 Step 6 Step 7 Step 8 Step 9 Step 10 Click Next. The Product Information window appears. Click Next. Step...78-17434-01 Rev. The End User License Agreement window opens. When the wizard does appear, click Cancel. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 13 Installing the Cisco SFS 7008P Switch into a Rack Note This wizard may not appear immediately.
Installation Guide
Page 14
Click the I START THIS The Product Install window appears (see Figure 13). Click Next. A0 Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel Expansion Card Windows 2003 Drivers If you have not already done so, download an integrated suite of the... GET ON MY COMPUTER?HOW DO I Agree to the terms listed above radio button, and then click Next to your Windows 2003 host. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. The Installation in Progress window appears with the status of HCA drivers including IPoIB, SRP,...
Click the I START THIS The Product Install window appears (see Figure 13). Click Next. A0 Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel Expansion Card Windows 2003 Drivers If you have not already done so, download an integrated suite of the... GET ON MY COMPUTER?HOW DO I Agree to the terms listed above radio button, and then click Next to your Windows 2003 host. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. The Installation in Progress window appears with the status of HCA drivers including IPoIB, SRP,...
Installation Guide
Page 15
... dialog box explains that the new drivers do not contain a Windows signature. WHQL submission materials are tested using the Microsoft HCT suite. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Although the drivers are not digitally signed, they are available per request (CAB files, etc.). Figure 14 Testing Dialog...installation notice shown in the Driver Installation Notice dialog window. (See Figure 15.) 78-17434-01 Rev. Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack Step 6 A Windows driver dialog box appears.
... dialog box explains that the new drivers do not contain a Windows signature. WHQL submission materials are tested using the Microsoft HCT suite. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Although the drivers are not digitally signed, they are available per request (CAB files, etc.). Figure 14 Testing Dialog...installation notice shown in the Driver Installation Notice dialog window. (See Figure 15.) 78-17434-01 Rev. Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack Step 6 A Windows driver dialog box appears.
Installation Guide
Page 16
In Windows, click Start > Shutdown. c. d. b. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 15 Driver Installation Notice Step 8 Important: Ignore the Found New Hardware Wizard (see Figure 16) when it appears because it . a. Click OK. ...
In Windows, click Start > Shutdown. c. d. b. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 15 Driver Installation Notice Step 8 Important: Ignore the Found New Hardware Wizard (see Figure 16) when it appears because it . a. Click OK. ...
Installation Guide
Page 17
... the Management IP address of your browser and press Enter. THERE IS NOTHING HERE??!! A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a Rack Installing WHQL Drivers on a Windows 2000 or 2003 Server (BoIB and non-BoIB) WHQL drivers are packaged in the address field of your...
... the Management IP address of your browser and press Enter. THERE IS NOTHING HERE??!! A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a Rack Installing WHQL Drivers on a Windows 2000 or 2003 Server (BoIB and non-BoIB) WHQL drivers are packaged in the address field of your...
Installation Guide
Page 18
Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . A0 SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20. Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev.
Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . A0 SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20. Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev.
Installation Guide
Page 19
... Element Manager, follow these steps: Step 1 Step 2 Ensure that you have sufficient system resources. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 To download the latest software, access the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center Step 3 Locate the appropriate install file. • Linux/install_linux_ia64.bin • Linux...
... Element Manager, follow these steps: Step 1 Step 2 Ensure that you have sufficient system resources. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 To download the latest software, access the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center Step 3 Locate the appropriate install file. • Linux/install_linux_ia64.bin • Linux...
Installation Guide
Page 20
... reseller. Enter location and preference information as requested by product ID or model name; The CPI tool offers three search options: by the installation program. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. On Solaris and Linux systems, enter sh ./install_yourOS.bin. On Windows platforms, click Programs...
... reseller. Enter location and preference information as requested by product ID or model name; The CPI tool offers three search options: by the installation program. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. On Solaris and Linux systems, enter sh ./install_yourOS.bin. On Windows platforms, click Programs...
