Installation Guide
Page 1
All rights reserved. A0 This installation and configuration note describes how to install and configure the Cisco SFS 7008P switch. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note Product number: PID=78-17434-01 Rev. This publication contains these sections:... Parts List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated Safety Warnings, page 21 • Obtaining Documentation, page 27 • Documentation...
All rights reserved. A0 This installation and configuration note describes how to install and configure the Cisco SFS 7008P switch. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note Product number: PID=78-17434-01 Rev. This publication contains these sections:... Parts List, page 2 • Required Tools, Equipment, and Personnel, page 2 • Before You Install, page 3 • Installing the Cisco SFS 7008P Switch into a Rack, page 6 • Troubleshooting, page 20 • Translated Safety Warnings, page 21 • Obtaining Documentation, page 27 • Documentation...
Installation Guide
Page 2
... involved with electrical circuitry and be aware of each rail of the rack) • A rack with standard practices for the Cisco SFS 7008P switch and cables. Serial Cable - A0 You are included in your rack (two for each warning statement. DB-9 connector female to... to secure the brackets to locate its translation in a situation that could cause bodily injury. DB-9 connector male to RJ-45 - Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. Serial cable document - A warning symbol precedes each power supply • Bezel ...
... involved with electrical circuitry and be aware of each rail of the rack) • A rack with standard practices for the Cisco SFS 7008P switch and cables. Serial Cable - A0 You are included in your rack (two for each warning statement. DB-9 connector female to... to secure the brackets to locate its translation in a situation that could cause bodily injury. DB-9 connector male to RJ-45 - Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 2 78-17434-01 Rev. Serial cable document - A warning symbol precedes each power supply • Bezel ...
Installation Guide
Page 3
... the straps, lift the box up to 106 pounds fully loaded. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 Before You Install • Three people to run the chassis. The Cisco SFS 7008P switch chassis weighs up and away from the switch and pallet. Do not cut the packaging, as a PC or laptop ... and packaging. • Prepare a management workstation, such as you have the right cables and sufficient ventilation. • Open the Cisco SFS 7008P package and remove the chassis, rack brackets, parts bag, and documentation from around the chassis.
... the straps, lift the box up to 106 pounds fully loaded. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 3 Before You Install • Three people to run the chassis. The Cisco SFS 7008P switch chassis weighs up and away from the switch and pallet. Do not cut the packaging, as a PC or laptop ... and packaging. • Prepare a management workstation, such as you have the right cables and sufficient ventilation. • Open the Cisco SFS 7008P package and remove the chassis, rack brackets, parts bag, and documentation from around the chassis.
Installation Guide
Page 4
... Management I.O modules Power plug 1 Power plug 2 4x copper line interface modules 144988 Main air exhaust Step 2 Step 3 Verify that you have a non-blocking fabric. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev. Verify that you have a Fabric Controller installed in the Core slot (see slot 11 in slot 12...
... Management I.O modules Power plug 1 Power plug 2 4x copper line interface modules 144988 Main air exhaust Step 2 Step 3 Verify that you have a non-blocking fabric. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 4 78-17434-01 Rev. Verify that you have a Fabric Controller installed in the Core slot (see slot 11 in slot 12...
Installation Guide
Page 5
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core slot 1 Core slot 2 Node ...
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 5 Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel pp y Status LED Power Supply identity LED System Status LED Power supplies Fan Node slot 1 Node slot 2 Core slot 1 Core slot 2 Node ...
Installation Guide
Page 6
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 6 78-17434-01 Rev. To mount the Cisco SFS 7008P switch chassis in an industry-standard rack, follow the directions in Figure 4, if you purchased the custom Cisco SFS 7008P switch shelf, follow these steps: Step 1 Install a shelf for the chassis as shown in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. If you have not already...
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 6 78-17434-01 Rev. To mount the Cisco SFS 7008P switch chassis in an industry-standard rack, follow the directions in Figure 4, if you purchased the custom Cisco SFS 7008P switch shelf, follow these steps: Step 1 Install a shelf for the chassis as shown in the Cisco SFS 7008 InfiniBand Server Switch Hardware Installation Guide. If you have not already...
Installation Guide
Page 7
...brackets from the bezel-side of mounting brackets need to be removed in the next step. Figure 4 Install Appropriate Shelf Installing the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself using an approved ground wrist-strap. Remove one set of ... direction that the switch will be installedand justified in the rack, then unscrew the mounting brackets from the port-side of the switch. • If the switch will be justified determines which set of the switch. 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration ...
...brackets from the bezel-side of mounting brackets need to be removed in the next step. Figure 4 Install Appropriate Shelf Installing the Cisco SFS 7008P Switch into a Rack 144964 Step 2 Step 3 Step 4 Ground yourself using an approved ground wrist-strap. Remove one set of ... direction that the switch will be installedand justified in the rack, then unscrew the mounting brackets from the port-side of the switch. • If the switch will be justified determines which set of the switch. 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration ...
Installation Guide
Page 8
... 6. A0 Step 8 Use screws that fit your rack to attach both mounting brackets to the rack posts. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434-01 Rev. Step 6 With 2 or 3 people working together, lift the switch into a Rack Figure 5 Unscrew Extra Mounting Brackets from the Chassis 144965 Step 5 Separate the mounting brackets from...
... 6. A0 Step 8 Use screws that fit your rack to attach both mounting brackets to the rack posts. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 8 78-17434-01 Rev. Step 6 With 2 or 3 people working together, lift the switch into a Rack Figure 5 Unscrew Extra Mounting Brackets from the Chassis 144965 Step 5 Separate the mounting brackets from...
Installation Guide
Page 9
Install the second I /O Modules in Figure 8. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9 see the power supply locations in the Front of the Management I /O Module according to the directions in the ...78-17434-01 Rev. Install the second fan according to the directions in the Power Supply Module Installation Guide in Figure 7. Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: • Redundant Power Supply...
Install the second I /O Modules in Figure 8. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 9 see the power supply locations in the Front of the Management I /O Module according to the directions in the ...78-17434-01 Rev. Install the second fan according to the directions in the Power Supply Module Installation Guide in Figure 7. Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: • Redundant Power Supply...
Installation Guide
Page 10
...host system following proper grounding procedures. Power on the host system. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into an open 64-bit PCI or PCI-X slot. See www.cisco.com for a list of drivers including IPoIB, SRP, SDP, uDAPL... and MPI from the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center Install...
...host system following proper grounding procedures. Power on the host system. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 10 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into an open 64-bit PCI or PCI-X slot. See www.cisco.com for a list of drivers including IPoIB, SRP, SDP, uDAPL... and MPI from the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center Install...
Installation Guide
Page 11
... or graphic window and access the top-level directory. For example: export PATH=$PATH:/usr/local/cisco Configure all other drivers, including SDP. 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for port-to-port redundancy, if desired... so that you have installed the HCA Expansion Card, follow these steps: • Make sure that your PATH variable. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11 By default, the files are used for the first time. IPoIB drivers load when the interfaces are...
... or graphic window and access the top-level directory. For example: export PATH=$PATH:/usr/local/cisco Configure all other drivers, including SDP. 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for port-to-port redundancy, if desired... so that you have installed the HCA Expansion Card, follow these steps: • Make sure that your PATH variable. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 11 By default, the files are used for the first time. IPoIB drivers load when the interfaces are...
Installation Guide
Page 12
... Found New Hardware Alert Step 2 Ignore the alert. A0 OR DOWNLOAD?? A Found New Hardware alert appears (see Figure 10). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev. DRIVERS TOO? Figure 10 Found New Hardware Wizard WIZARD.TIF Step 3 Click Cancel...HCA Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. Installing the Cisco SFS 7008P Switch into a Rack Installing Non-WHQL Host Channel Expansion Card Drivers on to your...
... Found New Hardware Alert Step 2 Ignore the alert. A0 OR DOWNLOAD?? A Found New Hardware alert appears (see Figure 10). Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 12 78-17434-01 Rev. DRIVERS TOO? Figure 10 Found New Hardware Wizard WIZARD.TIF Step 3 Click Cancel...HCA Expansion Card, follow these steps: Step 1 Log on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. Installing the Cisco SFS 7008P Switch into a Rack Installing Non-WHQL Host Channel Expansion Card Drivers on to your...
Installation Guide
Page 13
... window appears when the installation completes. The system prompts you do not need to reboot. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 13 The Product Information window appears. Click Yes. Click Next. Click Finish. Installing the Cisco SFS 7008P Switch into a Rack Note This wizard may not appear immediately. The Ready to the terms listed above...
... window appears when the installation completes. The system prompts you do not need to reboot. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 13 The Product Information window appears. Click Yes. Click Next. Click Finish. Installing the Cisco SFS 7008P Switch into a Rack Note This wizard may not appear immediately. The Ready to the terms listed above...
Installation Guide
Page 14
... the installation (see Figure 12). The Product Information window appears. Figure 12 Product Install Window Step 3 Step 4 Step 5 Click Next. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. HOW DID SW GET ON MY COMPUTER?HOW DO I Agree to the terms listed above...Installation in Progress window appears with the status of HCA drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center To install the Windows 2003 drivers, follow these steps: Step 1 Step 2 Log on to...
... the installation (see Figure 12). The Product Information window appears. Figure 12 Product Install Window Step 3 Step 4 Step 5 Click Next. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 14 78-17434-01 Rev. HOW DID SW GET ON MY COMPUTER?HOW DO I Agree to the terms listed above...Installation in Progress window appears with the status of HCA drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center To install the Windows 2003 drivers, follow these steps: Step 1 Step 2 Log on to...
Installation Guide
Page 15
...7 The driver installation notice shown in the Driver Installation Notice dialog window. (See Figure 15.) 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Although the drivers are not digitally signed, they are available per request (CAB files, etc.). Click.... This dialog box explains that the new drivers do not contain a Windows signature. Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack Step 6 A Windows driver dialog box appears. Click Yes in Figure 15 appears for each time the Windows ...
...7 The driver installation notice shown in the Driver Installation Notice dialog window. (See Figure 15.) 78-17434-01 Rev. A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 15 Although the drivers are not digitally signed, they are available per request (CAB files, etc.). Click.... This dialog box explains that the new drivers do not contain a Windows signature. Figure 13 Installation Status Installing the Cisco SFS 7008P Switch into a Rack Step 6 A Windows driver dialog box appears. Click Yes in Figure 15 appears for each time the Windows ...
Installation Guide
Page 16
...c. The system reboots and new driver installation is complete. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. This window appears three times (twice for the IPoIB and once for the system reboot in Figure 17. Reboot the server. Installing the Cisco SFS 7008P Switch into a Rack Figure 15 Driver Installation Notice Step 8 Important... b. You see the screen in the Comment field (see Figure 17). Select Restart from the drop-down menu(see Figure 17), if your server requires it will continue without user intervention. d.
...c. The system reboots and new driver installation is complete. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 16 78-17434-01 Rev. This window appears three times (twice for the IPoIB and once for the system reboot in Figure 17. Reboot the server. Installing the Cisco SFS 7008P Switch into a Rack Figure 15 Driver Installation Notice Step 8 Important... b. You see the screen in the Comment field (see Figure 17). Select Restart from the drop-down menu(see Figure 17), if your server requires it will continue without user intervention. d.
Installation Guide
Page 17
... IS NOTHING HERE??!! A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 A login window opens. (See Figure 18.) 78-17434-01 Rev. Launching the SFS Chassis Manager (Optional) SFS Chassis Manager is a web-based GUI that can be used to manage a single InfiniBand chassis from a Web browser. Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a Rack Installing...
... IS NOTHING HERE??!! A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 17 A login window opens. (See Figure 18.) 78-17434-01 Rev. Launching the SFS Chassis Manager (Optional) SFS Chassis Manager is a web-based GUI that can be used to manage a single InfiniBand chassis from a Web browser. Figure 17 Restarting Windows Server Installing the Cisco SFS 7008P Switch into a Rack Installing...
Installation Guide
Page 18
Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. A0 SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20.
Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your browser window as shown in window and click Login . Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. A0 SFS Chassis Manager loads in your username and password in the log-in Figures 19 and 20.
Installation Guide
Page 19
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 You need the following: • 32 MB free RAM • 50 MB disk space and 50MB additional temporary space...; Linux/install_linux_x86.bin • Windows/install_x86.exe • Solaris/install_solaris_sparc.bin 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series Product Family Element Manager User Guide.
A0 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 19 You need the following: • 32 MB free RAM • 50 MB disk space and 50MB additional temporary space...; Linux/install_linux_x86.bin • Windows/install_x86.exe • Solaris/install_solaris_sparc.bin 78-17434-01 Rev. Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series Product Family Element Manager User Guide.
Installation Guide
Page 20
... community string for service. The CPI tool offers three search options: by following these steps: a. or for troubleshooting and resolving technical issues with Cisco products and technologies. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. On Solaris and Linux systems, enter sh ./install_yourOS.bin. The default community string for the...
... community string for service. The CPI tool offers three search options: by following these steps: a. or for troubleshooting and resolving technical issues with Cisco products and technologies. Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 20 78-17434-01 Rev. On Solaris and Linux systems, enter sh ./install_yourOS.bin. The default community string for the...