This chapter describes the function and physical components of the CPU expansion module. It also describes the possible configurations and the technical specifications for this module. Specifically, this chapter includes the following information.
The 2U CPU expansion module is an optional module that consists of 1 or 2 Intel
Itanium 2 processors and up to 24 GB of local memory available on 4, 8, or 12 dual inline memory modules (DIMMs). Your system may contain from 0 to 15 CPU expansion modules.
The CPU expansion module includes the following features:
L1 controller that manages and monitors functions of the CPU expansion module such as temperature. The module includes an L1 controller display, which displays system processes and error messages.
One or two power supplies. The second power supply, which is optional, is redundant to assure that your CPU expansion module always has power.
Two NUMAlink ports that can connect your CPU expansion module to base modules, other CPU expansion modules, optional router modules, and/or CMPX modules.
One L1 console port (console and diagnostic port) that enables you to connect a system console to the L1 controller of the CPU expansion module.
Type B USB (universal serial bus) L1 port that connects the L1 controller of the CPU expansion module to an L2 controller.
Figure 4-1 shows front panel and side views of the CPU expansion module.
The CPU expansion module architecture includes the following components, which are shown in Figure 4-2 and discussed in the following subsections:
The IP57 node board consists of the following components, which are discussed in the subsections that follow.
One or two Intel Itanium 2 processors (labeled CPU in Figure 4-3). Each processor has integrated L1, L2, and L3 caches.
Twelve dual inline memory module (DIMM) slots that provide up to 24 GB of memory. See “Local Memory (DIMMs)”, for more information about DIMMs.
SHub ASIC that enables communication between the processors, memory, and I/O devices.
Serial ID EEPROM that contains component information.
Two voltage regulators that convert incoming voltages to voltages required by components.
The Intel Itanium 2 processors, which are socketed components (not soldered), employ Explicitly Parallel Instruction Computing (EPIC) architecture. This architecture provides fast online transaction processing, the capability to execute multiple instructions simultaneously, and fast calculations and data analysis. The processors operate at core clock rates from 1.5 GHz and up. Each processor has the following integrated (on-chip) caches:
Two 32-KB L1 caches: one cache is for data and the other cache is for instructions
One 256-KB L2 cache
One L3 cache; the size of the L3 cache depends on the processor option you order (see Table 3-1).
Different L3 cache sizes and processor speeds may become available with new release options, see your SGI sales or service representative for the latest information.
The IP57 node boards use SECDED ECC to protect data when transferred to and from secondary cache, main memory, and directory memory.
The IP57 node boards use parity to protect data when transferred between a processor and primary cache, and to protect system commands sent between ASICs and a processor.
Each IP57 node board has up to 24 GB of local memory, which includes main memory and directory memory for cache coherence. Local memory can consist of 4, 8, or 12 dual-inline memory modules (DIMMs) that contain double data rate synchronous dynamic random-access memory (DDR SDRAM).
You can increase or decrease the size of memory by adding or removing the four DIMMs that compose a group. The four DIMMs that compose a group must be the same size; however, each group can be a different memory size.
The Super Hub (SHub) ASIC enables communication among the processors, memory, network, and I/O devices. It controls all activity within the node board (for example, error correction and cache coherency). The SHub ASIC also supports page migration.
The SHub ASIC consists of the following:
One central crossbar (XN) provides connectivity between the SHub ASIC interfaces.
One processor interface (PI) communicates directly with one or two processors.
One memory/directory interface (MD) controls all memory access.
Two network interfaces (NI) interface between the crossbar unit and the NUMAlink interconnect.
One I/O interface (II) allows I/O devices to read and write memory (direct memory access [DMA] operations) and allows the processors within the system to control the I/O devices (PIO operations).
One local block (LB) services processor I/O (PIO) requests that are local to the SHub ASIC.
The interface board contains the following components:
L1 controller logic
Power supply interface
NUMAlink connectors
Voltage regulators
Connectors to the IP57 node board and the PCI riser card
The CPU expansion module can contain one or two power supplies; the second power supply is optional and is required only when you want redundant power. The power supply can input 110/220 VAC and output 500 W (12 VDC, 5 VDC, and -12 VDC).
When the module contains two power supplies, both power supplies are hot–swappable. They are located at the front right side of the module. The primary power supply is the left supply, and the redundant power supply is the right supply.
This section describes the external components of a CPU expansion module, which are located in the front and rear panels.
This section describes the front-panel controls and indicators of a CPU expansion module, as shown in Figure 4-5.
L1 controller display. A liquid crystal display (LCD) displays status and error messages that the L1 controller generates.
Note: See the SGI L1 and L2 Controller Software User's Guide (007-3938-00x) for more information on the L1 controller. Power button with LED. Press this button to power on the internal components. Alternatively, you can power on the internal components at a system console. The LED illuminates green when the internal components are on.
Reset button. Press this button to reset the internal processors and ASICs. The reset will cause a memory loss. Use a paperclip or other small object to access the “pin-hole” acuator for this button.
NMI button. Press the NMI (non-maskable interrupt) button to reset the internal processors and ASICs, and to write register data and memory to the /var/adm/crash file. Use a paperclip or other small object to access the “pin-hole” acuator for this button.
Service-required LED. This LED illuminates yellow to indicate that an item has failed or is not operating properly, but the CPU expansion module is still operating.
Failure LED. This LED illuminates red to indicate that a failure has occurred and that the CPU expansion module is not operating.
This section describes the rear panel connectors and LEDs of the CPU expansion module, as shown in Figure 4-6.
Power connector. This connector connects the CPU expansion module to an AC power outlet.
Console port. This DB–9 serial port (console and diagnostic port) enables you to connect a system console to the L1 controller of the CPU expansion module.
L1 port (USB type B). This universal serial bus (USB) type B connector connects the CPU expansion module's L1 controller to an L2 controller.
Two NUMAlink connectors. These NUMAlink connectors can connect the CPU expansion module to other CPU expansion modules, base compute modules, and/or MPX modules. This connection is made with a NUMAlink cable at 3.2 GB/s in each direction.
NUMAlink LEDs. Each NUMAlink connector has two LEDs. These LEDs are located to the right of the NUMAlink connector. One LED lights yellow to indicate that the CPU expansion module and the module to which it is connected are powered on. The other LED lights green when the link between the CPU expansion module and the module to which it is connected is established.
The CPU expansion module contains the following configurable components:
Processors
Memory (DIMMs)
Warning: Only trained SGI system support engineers (SSEs) can install and remove the processors.
As a customer, you can add or remove memory. See Chapter 7, “Installing and Removing Customer-replaceable Units” for information about installing and removing memory DIMMs.
| Warning: To prevent personal injury or damage to your system, only trained SGI system support engineers (SSEs) can service or configure internal components of the CPU expansion module that are not specifically listed as serviceable and configurable by customers. |
Table 4-1 lists the bandwidth characteristics of the CPU expansion module.
Table 4-1. Bandwidth Characteristics of the CPU Expansion Module
Characteristic | Peak Bandwidth | Sustainable Bandwidth |
|---|---|---|
NUMAlink channel | 6.4 GB/s full duplex | ~2.8 GB/s each direction |
Main memory | Up to 10.8 GB/s | Up to 10.8 GB/s |
Front Side Bus (FSB) | 6.4 GB/s | ~6.4 GB/s |
Table 4-2 summarizes the general features of a CPU expansion module.
Table 4-2. General Features of the CPU Expansion Module
Feature | Description |
|---|---|
Intel Itanium 2 processor | 1 or 2 |
Memory | Up to 24 GB |
Console port | 1 |
NUMAlink-4 port | 2 (3.2 GB/s each direction) |
L1 port (USB, type B) | 1 |
Table 4-3 lists the specifications for the CPU expansion module.
Table 4-3. CPU Expansion Module Specifications
Characteristic | Specification |
|---|---|
Height | 3.44 in. (8.74 cm) |
Width | 17.06 in. (43.33 cm) |
Depth | 27 in. (68.58 cm) (with bezel) |
Weight | 50 lb (22.7 kg) maximum configuration[a] |
Noise | 6 Bels sound power, up to 30 ºC |
Heat dissipation | 1398 Btu/hr maximum |
Input power | 120 - 240 VAC |
[a] Weight will vary depending on whether the CPU expansion module has one or two processors, one or two power supplies and on the number of DIMMs installed. | |