Installation Guide
Page 5
... Xeon Processor DP 16 1.5 SMP Expansion Module 17 1.6 IBM XceL4 Server Accelerator Cache 19 1.7 System memory 19 1.8 PCI subsystem 23 1.9 Redundancy 24 1.10 Light Path Diagnostics 25 1.11 Remote Supervisor Adapter 27 1.12 Operating system support 28 1.13 IBM Director 30 Chapter 2. iii Positioning 35 2.1 xSeries 440 application solutions 36 2.1.1 Server consolidation 36 2.1.2 Enterprise applications...
... Xeon Processor DP 16 1.5 SMP Expansion Module 17 1.6 IBM XceL4 Server Accelerator Cache 19 1.7 System memory 19 1.8 PCI subsystem 23 1.9 Redundancy 24 1.10 Light Path Diagnostics 25 1.11 Remote Supervisor Adapter 27 1.12 Operating system support 28 1.13 IBM Director 30 Chapter 2. iii Positioning 35 2.1 xSeries 440 application solutions 36 2.1.1 Server consolidation 36 2.1.2 Enterprise applications...
Installation Guide
Page 6
... Module connectivity 74 3.2.2 Remote Supervisor Adapter connectivity 77 3.2.3 Remote Expansion Enclosure 78 3.2.4 Serial connections 83 3.3 Storage considerations 83 3.3.1 xSeries storage solutions 84 3.3.2 Disk subsystem performance 88 3.3.3 Tape backup 89 3.4 Server partitioning and consolidation 90 3.5 Operating system considerations 90 ... 4. Installation 107 4.1 System BIOS settings 108 4.1.1 Updating BIOS and firmware 108 4.1.2 Enabling memory mirroring 108 4.1.3 Enabling Hyper-Threading 109 4.2 Device drivers 111 iv IBM ^ xSeries 440 Planning and Installation Guide
... Module connectivity 74 3.2.2 Remote Supervisor Adapter connectivity 77 3.2.3 Remote Expansion Enclosure 78 3.2.4 Serial connections 83 3.3 Storage considerations 83 3.3.1 xSeries storage solutions 84 3.3.2 Disk subsystem performance 88 3.3.3 Tape backup 89 3.4 Server partitioning and consolidation 90 3.5 Operating system considerations 90 ... 4. Installation 107 4.1 System BIOS settings 108 4.1.1 Updating BIOS and firmware 108 4.1.2 Enabling memory mirroring 108 4.1.3 Enabling Hyper-Threading 109 4.2 Device drivers 111 iv IBM ^ xSeries 440 Planning and Installation Guide
Installation Guide
Page 10
...trademarks of Sun Microsystems, Inc. viii IBM ^ xSeries 440 Planning and Installation Guide Trademarks The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both: Active Memory™ Active™ PCI-X Chipkill™...; DB2® Electronic Service Agent™ Enterprise Storage Server™ ESCON® FlashCopy® IBM® Informix® iSeries™ Memory ProteXion™ Netfinity® PowerPC® PowerPC 750™ Predictive Failure Analysis® pSeries™ Redbooks(logo...
...trademarks of Sun Microsystems, Inc. viii IBM ^ xSeries 440 Planning and Installation Guide Trademarks The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both: Active Memory™ Active™ PCI-X Chipkill™...; DB2® Electronic Service Agent™ Enterprise Storage Server™ ESCON® FlashCopy® IBM® Informix® iSeries™ Memory ProteXion™ Netfinity® PowerPC® PowerPC 750™ Predictive Failure Analysis® pSeries™ Redbooks(logo...
Installation Guide
Page 11
...Process Control. The team that wrote this redbook This redbook was produced by a team of specialists from 2 GB to 128 GB of memory, and up to 16-way SMP, from around the world working at the International Technical Support Organization in one single system image. It ... and price performance, and offers scalability from two-way to 24 PCI slots, all in Raleigh. A partner redbook is Server Consolidation with the IBM ^ xSeries 440 and VMware ESX Server, SG24-6852. All rights reserved. Chapter 3, "Planning" describes the aspects of installing Windows 2000, Red Hat Linux, NetWare...
...Process Control. The team that wrote this redbook This redbook was produced by a team of specialists from 2 GB to 128 GB of memory, and up to 16-way SMP, from around the world working at the International Technical Support Organization in one single system image. It ... and price performance, and offers scalability from two-way to 24 PCI slots, all in Raleigh. A partner redbook is Server Consolidation with the IBM ^ xSeries 440 and VMware ESX Server, SG24-6852. All rights reserved. Chapter 3, "Planning" describes the aspects of installing Windows 2000, Red Hat Linux, NetWare...
Installation Guide
Page 16
... are being each of nodes or as two or more external remote I /O support, storage and other 2 IBM ^ xSeries 440 Planning and Installation Guide Each scalable enterprise node contains processors, memory, I /O enclosures. The nodes can even be rearranged later into other nodes, or if desired multiple nodes... can be assigned to partition them is because the complexity associated with developing the new IBM XA-32 chipset, formerly known ...
... are being each of nodes or as two or more external remote I /O support, storage and other 2 IBM ^ xSeries 440 Planning and Installation Guide Each scalable enterprise node contains processors, memory, I /O enclosures. The nodes can even be rearranged later into other nodes, or if desired multiple nodes... can be assigned to partition them is because the complexity associated with developing the new IBM XA-32 chipset, formerly known ...
Installation Guide
Page 17
...-node configurations and the CPU and memory options. Figure 1-1 on models. Technical description 3 Table 1-1 Models available from November 2002 Model Standard processors Max SMP 8687-1RX 2x 1.4 GHz Intel Xeon MP 8-way 8687-2RX 2x 1.5 GHz Intel Xeon MP 8-way 8687-3RX 2x 1.6 GHz Intel Xeon MP 8-way 8687-4RX 2x 1.5 GHz Intel Xeon MP... 2x 2.4 GHz Intel Xeon DP 4-way 8687-4RY 4x 2.4 GHz Intel Xeon DP 4-way L2 cache 256 KB 256 KB 256 KB 256 KB 256 KB 256 KB 256 KB 512 KB 512 KB L3 cache 512 KB 512 KB 1 MB 1 MB 1 MB 1 MB 2 MB 0 0 Std memory 2 GB (4x 512 MB) 2 GB...
...-node configurations and the CPU and memory options. Figure 1-1 on models. Technical description 3 Table 1-1 Models available from November 2002 Model Standard processors Max SMP 8687-1RX 2x 1.4 GHz Intel Xeon MP 8-way 8687-2RX 2x 1.5 GHz Intel Xeon MP 8-way 8687-3RX 2x 1.6 GHz Intel Xeon MP 8-way 8687-4RX 2x 1.5 GHz Intel Xeon MP... 2x 2.4 GHz Intel Xeon DP 4-way 8687-4RY 4x 2.4 GHz Intel Xeon DP 4-way L2 cache 256 KB 256 KB 256 KB 256 KB 256 KB 256 KB 256 KB 512 KB 512 KB L3 cache 512 KB 512 KB 1 MB 1 MB 1 MB 1 MB 2 MB 0 0 Std memory 2 GB (4x 512 MB) 2 GB...
Installation Guide
Page 19
RXE expansion connections SMP expansion connections RXE-100 6 PCI-X slots 12 PCI-X slots One 16-way complex Each xSeries 440 has: Eight CPUs 4-64 GB memory Figure 1-2 16-way server configuration using two eight-way x440 nodes One eight-way complex x440 node 1: Four CPUs 2-32 GB memory One 12-way complex x440 node 1: Eight CPUs 4-64 GB memory SMP expansion connections x440 node 2: Four CPUs 2-32 GB memory Figure 1-3 Eight-way and 12-way two-node configurations SMP expansion connections x440 node 2: Four CPUs 2-32 GB memory Chapter 1. Technical description 5
RXE expansion connections SMP expansion connections RXE-100 6 PCI-X slots 12 PCI-X slots One 16-way complex Each xSeries 440 has: Eight CPUs 4-64 GB memory Figure 1-2 16-way server configuration using two eight-way x440 nodes One eight-way complex x440 node 1: Four CPUs 2-32 GB memory One 12-way complex x440 node 1: Eight CPUs 4-64 GB memory SMP expansion connections x440 node 2: Four CPUs 2-32 GB memory Figure 1-3 Eight-way and 12-way two-node configurations SMP expansion connections x440 node 2: Four CPUs 2-32 GB memory Chapter 1. Technical description 5
Installation Guide
Page 20
... partition a multinode complex at the individual processor level (with the IBM ^ xSeries 440 and VMware ESX Server, SG24-6852 and 3.5.7, "VMware ESX Server" on ESX Server, see the redbook Server Consolidation with associated memory, I/O and other required resources) or even lower (that Intel-based...system. 1.2 System partitioning Partitioning is the ability to divide a system to 1/8th of a CPU. For example, in for IBM Director. 6 IBM ^ xSeries 440 Planning and Installation Guide ESX Server does not, however, support hot-adding of hardware (such as disks and adapters). VMware ESX ...
... partition a multinode complex at the individual processor level (with the IBM ^ xSeries 440 and VMware ESX Server, SG24-6852 and 3.5.7, "VMware ESX Server" on ESX Server, see the redbook Server Consolidation with associated memory, I/O and other required resources) or even lower (that Intel-based...system. 1.2 System partitioning Partitioning is the ability to divide a system to 1/8th of a CPU. For example, in for IBM Director. 6 IBM ^ xSeries 440 Planning and Installation Guide ESX Server does not, however, support hot-adding of hardware (such as disks and adapters). VMware ESX ...
Installation Guide
Page 21
...and applications, all four nodes serving one operating system. one memory controller, code named "Cyclone", per four-way located within the SMP Expansion Module PCI bridges - Chapter 1. A product of the IBM Microelectronics Division in Austin, Texas, the XA-32 chipset ...simultaneously run multiple instances of one operating system in copper technology and is composed of the following components: Memory controllers - A partition can be managed independently by IBM Director. two PCI bridges, code named "Winnipeg", per eight-way located within the SMP Expansion Module Processor...
...and applications, all four nodes serving one operating system. one memory controller, code named "Cyclone", per four-way located within the SMP Expansion Module PCI bridges - Chapter 1. A product of the IBM Microelectronics Division in Austin, Texas, the XA-32 chipset ...simultaneously run multiple instances of one operating system in copper technology and is composed of the following components: Memory controllers - A partition can be managed independently by IBM Director. two PCI bridges, code named "Winnipeg", per eight-way located within the SMP Expansion Module Processor...
Installation Guide
Page 22
..., and SMP Expansion Module are used interchangeably in this redbook. 8 IBM ^ xSeries 440 Planning and Installation Guide CEC 1 CPU 1 CPU 2 CPU 3 CPU 4 IBM XA-32 core chipset 400 MHz 3.2 GBps 32 MB Processor & L4 cache 3.2 GBps cache controller SDRAM SDRAM SDRAM SDRAM 3.2 GBps 3.2 GBps Memory 3.2 controller GBps 100MHz 2 GBps 4-way interleave SMP Expansion Ports (3.2GBps...
..., and SMP Expansion Module are used interchangeably in this redbook. 8 IBM ^ xSeries 440 Planning and Installation Guide CEC 1 CPU 1 CPU 2 CPU 3 CPU 4 IBM XA-32 core chipset 400 MHz 3.2 GBps 32 MB Processor & L4 cache 3.2 GBps cache controller SDRAM SDRAM SDRAM SDRAM 3.2 GBps 3.2 GBps Memory 3.2 controller GBps 100MHz 2 GBps 4-way interleave SMP Expansion Ports (3.2GBps...
Installation Guide
Page 23
... processors are installed in an SMP Expansion Module. Chapter 1. Technical description 9 With 2 GB DIMMs, up to 64 GB of 200 MHz DDR memory. The memory is four-way interleaved so that DIMMs must hold air baffles to match the throughput of 400 MHz using all CPUs in CPU positions 1 and... the CPUs. Note: When Xeon DP processors are used, only two CPUs can be installed in matched fours and in specific DIMM sockets (see 3.1.2, "Memory" on page 65). Positions 2 and 3 must be installed when more than four Xeon MP processors, or two Xeon DP processors, are required. To...
... processors are installed in an SMP Expansion Module. Chapter 1. Technical description 9 With 2 GB DIMMs, up to 64 GB of 200 MHz DDR memory. The memory is four-way interleaved so that DIMMs must hold air baffles to match the throughput of 400 MHz using all CPUs in CPU positions 1 and... the CPUs. Note: When Xeon DP processors are used, only two CPUs can be installed in matched fours and in specific DIMM sockets (see 3.1.2, "Memory" on page 65). Positions 2 and 3 must be installed when more than four Xeon MP processors, or two Xeon DP processors, are required. To...
Installation Guide
Page 24
..., labeled "RXE Expansion Port B", connects to an additional 12 PCI-X slots. The RXE-100 provides up to the memory controller of the second SMP Expansion Module. 10 IBM ^ xSeries 440 Planning and Installation Guide CEC 1 CPU 1 CPU 2 CPU 3 CPU 4 400 MHz 3.2 GBps 32 MB Processor ...& L4 cache 3.2 GBps cache controller SDRAM SDRAM SDRAM SDRAM 3.2 GBps 3.2 GBps 3.2 GBps Memory controller 100 MHz 2 GBps CEC 2 CPU 4 CPU 3 CPU ...
..., labeled "RXE Expansion Port B", connects to an additional 12 PCI-X slots. The RXE-100 provides up to the memory controller of the second SMP Expansion Module. 10 IBM ^ xSeries 440 Planning and Installation Guide CEC 1 CPU 1 CPU 2 CPU 3 CPU 4 400 MHz 3.2 GBps 32 MB Processor ...& L4 cache 3.2 GBps cache controller SDRAM SDRAM SDRAM SDRAM 3.2 GBps 3.2 GBps 3.2 GBps Memory controller 100 MHz 2 GBps CEC 2 CPU 4 CPU 3 CPU ...
Installation Guide
Page 25
... CEC 1 32 MB L4 cache SDRAM SDRAM SDRAM SDRAM 1 Processor & 2 cache controller 3 Memory controller x440 Node 1 PCI bridge CEC 2 CPU 4 CPU 3 CPU 2 CPU 1 1 Processor & 2 cache controller 3 Memory controller PCI bridge 32 MB L4 cache SDRAM SDRAM SDRAM SDRAM CPU 1 CPU 2 CPU 3 CPU...3 CPU 2 CPU 1 32 MB L4 cache SDRAM SDRAM SDRAM SDRAM 1 Processor & 2 cache controller 3 Memory controller SMP Expansion Ports (3.2GBps) 1 Processor & 2 cache controller 3 Memory controller 32 MB L4 cache SDRAM SDRAM SDRAM SDRAM x440 Node 2 PCI bridge Figure 1-6 16-way configuration (...
... CEC 1 32 MB L4 cache SDRAM SDRAM SDRAM SDRAM 1 Processor & 2 cache controller 3 Memory controller x440 Node 1 PCI bridge CEC 2 CPU 4 CPU 3 CPU 2 CPU 1 1 Processor & 2 cache controller 3 Memory controller PCI bridge 32 MB L4 cache SDRAM SDRAM SDRAM SDRAM CPU 1 CPU 2 CPU 3 CPU...3 CPU 2 CPU 1 32 MB L4 cache SDRAM SDRAM SDRAM SDRAM 1 Processor & 2 cache controller 3 Memory controller SMP Expansion Ports (3.2GBps) 1 Processor & 2 cache controller 3 Memory controller 32 MB L4 cache SDRAM SDRAM SDRAM SDRAM x440 Node 2 PCI bridge Figure 1-6 16-way configuration (...
Installation Guide
Page 31
... Module part numbers for these components. Technical description 17 Note: Information about the features of the SMP Expansion Module when adding additional processors or memory. Feature Supported in multi-node configurations Core frequency (x440 models) Level 2 cache Level 3 cache Xeon Processor DP No 2.4 GHz 512 KB..., 1 MB or 2 MB For more information about the SMP Expansion Modules to be installed in it does not contain any processors or memory. The base x440 system includes one SMP Expansion Module. Each SMP Expansion Module contains slots for up to four Xeon MP processors (or...
... Module part numbers for these components. Technical description 17 Note: Information about the features of the SMP Expansion Module when adding additional processors or memory. Feature Supported in multi-node configurations Core frequency (x440 models) Level 2 cache Level 3 cache Xeon Processor DP No 2.4 GHz 512 KB..., 1 MB or 2 MB For more information about the SMP Expansion Modules to be installed in it does not contain any processors or memory. The base x440 system includes one SMP Expansion Module. Each SMP Expansion Module contains slots for up to four Xeon MP processors (or...
Installation Guide
Page 32
... 3 XceL4 cache CPU 4 Figure 1-10 SMP Expansion Module VRM CPU 2 Each SMP Expansion Module also contains 16 DIMM slots to take the memory up to center plane this single-node eight-way configuration. Tip: Be careful when removing or installed the SMP Expansion Modules, because you may... GB per node. See tip H176162 for details: http://www.pc.ibm.com/qtechinfo/MIGR-43675.html Locking levers SMP Expansion Module cover See-through hinged doors for Light Path Diagnostics: Each DIMM Each CPU Each VRM SMP Expansion Module board 18 IBM ^ xSeries 440 Planning and Installation Guide
... 3 XceL4 cache CPU 4 Figure 1-10 SMP Expansion Module VRM CPU 2 Each SMP Expansion Module also contains 16 DIMM slots to take the memory up to center plane this single-node eight-way configuration. Tip: Be careful when removing or installed the SMP Expansion Modules, because you may... GB per node. See tip H176162 for details: http://www.pc.ibm.com/qtechinfo/MIGR-43675.html Locking levers SMP Expansion Module cover See-through hinged doors for Light Path Diagnostics: Each DIMM Each CPU Each VRM SMP Expansion Module board 18 IBM ^ xSeries 440 Planning and Installation Guide
Installation Guide
Page 33
...have shown the XceL4 cache has improved overall system performance up to 64 GB RAM. 1.6 IBM XceL4 Server Accelerator Cache Integrated into each x440 can have up to 20% on various applications. 1.7 System memory The Xeon MP models of the x440 have 2 GB or 4 GB of RAM standard, ...x440 and what you should consider before an x440 installation. There are a number of advanced features implemented in the x440 memory subsystem, collectively known as Active Memory: Memory ProteXion Memory ProteXion, also known as four PC133 ECC SDRAM DIMMs (four 512 MB or four 1 GB DIMMs). Currently, other ...
...have shown the XceL4 cache has improved overall system performance up to 64 GB RAM. 1.6 IBM XceL4 Server Accelerator Cache Integrated into each x440 can have up to 20% on various applications. 1.7 System memory The Xeon MP models of the x440 have 2 GB or 4 GB of RAM standard, ...x440 and what you should consider before an x440 installation. There are a number of advanced features implemented in the x440 memory subsystem, collectively known as Active Memory: Memory ProteXion Memory ProteXion, also known as four PC133 ECC SDRAM DIMMs (four 512 MB or four 1 GB DIMMs). Currently, other ...
Installation Guide
Page 34
...the administrator. After the second DIMM failure, PFA and Light Path Diagnostics alerts would occur on that DIMM as normal. Memory scrubbing Memory scrubbing is an automatic daily test of RAID array). The error is then reported so that preventative maintenance can be ...memory scrubbing, the memory controller can do not require memory mirroring (as described below) to be enabled to work in the damaged DIMM is used until the system is powered down and the DIMM replaced. 20 IBM ^ xSeries 440 Planning and Installation Guide Memory scrubbing and Memory ProteXion work properly. If memory...
...the administrator. After the second DIMM failure, PFA and Light Path Diagnostics alerts would occur on that DIMM as normal. Memory scrubbing Memory scrubbing is an automatic daily test of RAID array). The error is then reported so that preventative maintenance can be ...memory scrubbing, the memory controller can do not require memory mirroring (as described below) to be enabled to work in the damaged DIMM is used until the system is powered down and the DIMM replaced. 20 IBM ^ xSeries 440 Planning and Installation Guide Memory scrubbing and Memory ProteXion work properly. If memory...
Installation Guide
Page 35
...is stored in BIOS by the hardware without any additional support required from the DIMM with the least amount of the Chapter 1. Memory scrubbing then reports the damaged DIMM and the Light Path Diagnostics display the error. All mirroring activities are redirected to the partner ...divided in two ports and one port is enabled, then the mirrored copy of reported memory errors through memory scrubbing. Technical description 21 Port 1 Port 2 Figure 1-12 Memory DIMMs are divided into two ports When memory mirroring is enabled (see Figure 1-12). One copy is kept in the port 1 ...
...is stored in BIOS by the hardware without any additional support required from the DIMM with the least amount of the Chapter 1. Memory scrubbing then reports the damaged DIMM and the Light Path Diagnostics display the error. All mirroring activities are redirected to the partner ...divided in two ports and one port is enabled, then the mirrored copy of reported memory errors through memory scrubbing. Technical description 21 Port 1 Port 2 Figure 1-12 Memory DIMMs are divided into two ports When memory mirroring is enabled (see Figure 1-12). One copy is kept in the port 1 ...
Installation Guide
Page 36
... than ECC technology, providing correction for up to placement and size of the redundant memory bank. 22 IBM ^ xSeries 440 Planning and Installation Guide If a memory chip error does occur, Chipkill is designed to four bits per DIMM (eight bits per memory port (8 DIMMs) on a single chip or multiple chips. These are discussed in concept to...
... than ECC technology, providing correction for up to placement and size of the redundant memory bank. 22 IBM ^ xSeries 440 Planning and Installation Guide If a memory chip error does occur, Chipkill is designed to four bits per DIMM (eight bits per memory port (8 DIMMs) on a single chip or multiple chips. These are discussed in concept to...
Installation Guide
Page 37
...) Three USB ports (one external (Adaptec AIC-7899 chipset) Gigabit Ethernet port (Broadcom 5700 chipset) The x440 was the first xSeries server to ensure the highest network performance and dual onboard RISC processors for failover, layer-3 load balancing, and comprehensive diagnostics. SVGA ... match the server's I /O devices: Two Wide Ultra 160 SCSI ports, one internal and one on front panel, two on -chip memory for buffering data transmissions to offer a Gigabit Ethernet controller integrated standard in what combinations. The BCM5700 supports full and half-duplex performance at...
...) Three USB ports (one external (Adaptec AIC-7899 chipset) Gigabit Ethernet port (Broadcom 5700 chipset) The x440 was the first xSeries server to ensure the highest network performance and dual onboard RISC processors for failover, layer-3 load balancing, and comprehensive diagnostics. SVGA ... match the server's I /O devices: Two Wide Ultra 160 SCSI ports, one internal and one on front panel, two on -chip memory for buffering data transmissions to offer a Gigabit Ethernet controller integrated standard in what combinations. The BCM5700 supports full and half-duplex performance at...