This chapter describes the function and physical components of the base compute module. It also describes the possible configurations and the technical specifications for this module. Specifically, this chapter includes the following information.
The 2U base compute module can serve as a standalone Altix 350 system, or it can be cabled to other optional modules to create an Altix 350 system with more functionality. A base compute module consists of 1 or 2 Intel Itanium 2 processors, and up to 24 GB of local memory available on 4, 8, or 12 dual inline memory modules (DIMMs), and 4 PCI/PCI-X slots.
Your system can contain from 1 to 16 base compute modules. One of the base compute modules provides the base I/O functionality for the system; it is the module where the operating system resides. (Every system must have at least one base compute module that has I/O functionality.) This module has a factory–installed disk drive(s) and a base I/O card.
The base compute module includes the following features:
L1 controller that manages and monitors functions of the base compute module such as temperature. The module includes an L1 controller display, which displays system processes and error messages.
Optional internal read-only slim–line DVD–ROM drive, and one or two hard disk drives. These components require a base I/O PCI card.
One or two power supplies. The second power supply, which is optional, is redundant to assure that your base compute module always has power.
Two NUMAlink-4 ports that can connect your base compute module to a CPU expansion module, and/or a CMPX module.
Four PCI/PCI–X card slots on two busses. These 64-bit slots can contain 33-MHz and 66-MHz PCI cards, or 66-MHZ, 100-MHz, or 133-MHz PCI–X cards.
One L1 console port (console and diagnostic port) that enables you to connect a system console to the L1 controller of the base compute module.
Type B USB (universal serial bus) L1 port that connects the L1 controller of the base compute module to an optional L2 controller.
The base compute module can connect the following optional modules:
Other base compute modules to add processors, memory, and PCI/PCI-X slots.
CPU expansion modules to add processors and memory to your system. See Chapter 4, “CPU Expansion Module” for more information about this module.
CMPX modules to add processors, memory, and PCI/PCI-X card slots to your system. See Chapter 5, “CMPX Module” for more information about this module.
Router modules or “R-bricks” can be used in larger (8-16 module) systems to provide a NUMAlink-4 interconnect fabric. See Chapter 6, “Optional Router”for additional information on this module.
The SGI TP900 storage module to provide additional storage for the system. See SGI Total Performance 900 Storage System User's Guide (007-4428-00x) for information about this module.
Note: The Altix 350 system also supports other storage systems. See “Storage Expansion” in Chapter 2 for information.
Figure 3-1 shows front panel and side views of the base compute module.
The compute module architecture includes the following components, which are shown in Figure 3-2 and discussed in the following subsections:
The IP57 node board consists of the following components, which are discussed in the subsections that follow.
One or two Intel Itanium 2 processors (labeled CPU in Figure 3-3). Each processor has integrated L1, L2, and L3 caches.
Twelve dual inline memory module (DIMM) slots that provide up to 24 GB of memory. See “Local Memory (DIMMs)”, for more information about DIMMs.
SHub ASIC that enables communication between the processors, memory, and I/O devices.
Serial ID EEPROM that contains component information.
Two voltage regulators convert incoming voltages to voltages required by components.
The Intel Itanium 2 processors, which are socketed components (not soldered), employ Explicitly Parallel Instruction Computing (EPIC) architecture. This architecture provides fast online transaction processing, the capability to execute multiple instructions simultaneously, and fast calculations and data analysis. The processors operate at core clock rates from 1.5 GHz and up. Each processor has the following integrated (on-chip) caches:
Two 32-KB L1 caches: one cache is for data and the other cache is for instructions
One 256-KB L2 cache
One L3 cache; the size of the L3 cache depends on the version of the processor selected (see Table 3-1)
Table 3-1. L3 Cache Size Examples
Processor Speed
L3 Minimum Cache Size
1.5 GHz
4 MB
1.6 GHz
6 MB
1.6 GHz
9 MB
Note that additional processor speeds and cache sizes may become available. Check with your SGI sales or service representative for the latest information.
The IP57 node boards use SECDED ECC to protect data when transferred to and from secondary cache, main memory, and directory memory.
The IP57 node boards use parity to protect data when transferred between a processor and primary cache, and to protect system commands sent between the Bedrock ASIC and a processor.
Each module's node board has up to 24 GB of local memory, which includes main memory and directory memory for cache coherence. Local memory can consist of 4, 8, or 12 dual-inline memory modules (DIMMs) that contain double data rate synchronous dynamic random-access memory (DDR SDRAM). See Figure 3-4.
You can increase or decrease the size of memory by adding or removing the four DIMMs that compose a group. The four DIMMs that compose a group must be the same size; however, each group can be a different memory size.
| Note: Group 0 DIMMs must always be present in the base server module. |
The four DIMMs that compose a group must all be the same size (memory capacity), however each group of four DIMMs may be a different total size. The DIMM group locations are shown in Figure 3-5.
The Super Hub (SHub) ASIC enables communication among the processors, memory, network, and I/O devices. It controls all activity within the node board (for example, error correction and cache coherency). The SHub ASIC also supports page migration.
The SHub ASIC consists of the following:
One central crossbar (XN) provides connectivity between the SHub ASIC interfaces.
One processor interface (PI) communicates directly with one or two processors.
One memory/directory interface (MD) controls all memory access.
Two network interfaces (NI) interfaces between the crossbar unit and NUMAlinks.
One I/O interface (II) allows I/O devices to read and write memory (direct memory access [DMA] operations) and allows the processors within the system to control the I/O devices (PIO operations).
One local block (LB) services processor I/O (PIO) requests local to the SHub ASIC.
The Altix 350 is available with either the standard IO10 base I/O card or the optional IO9 card. Note the following guidelines for use of the base I/O cards:
Altix 350 base compute modules using the IO10 PCI card do not support SCSI internal hard drives. Likewise, optional IO9 cards do not support SATA drives.
Each system must have either an IO9 or IO10 as its base I/O.
Only one IO9 or IO10 base I/O card can be used in each system module and it must be installed in PCI slot 1.
You must use the optional multi-port serial adapter cable to convert the 36-pin MDR connector on the IO10 to four 9-pin serial ports.
The RTO and RTI functionality is not supported under SGI Linux + ProPack.
Caution: Only trained service personnel should install or remove a base I/O card (IO9 or IO10). Otherwise, your system could be damaged.
The standard base I/O card on Altix 350 systems is known as the IO10. The card is a full-size PCI expansion board that provides basic system I/O capabilities via the PCI bus. It connects to your system's internal serial ATA hard drive(s) and DVD-ROM drive and provides optional external serial ports. The IO10 is installed in the lower PCI slot of your system.
A multi-port serial cable that converts the serial output on the IO10 board into four DB-9 serial cables is required to use serial connections with a base compute module containing an IO10. Figure 3-6 shows an example connection.
| Note: Leave the multi-port serial adapter cable unplugged if you are not using it. |
If you do not wish to use the IO10 base I/O card in your system, an optional IO9 PCI card is required for base I/O functionality. Each system must contain at least one base I/O PCI card for base I/O functionality within the system. This PCI card must reside in bus 1, slot 1 (the bottom slot) of the lowest base compute module in the system. The IO9 PCI card has the following connectors:
External VHDCI 68-pin SCSI connector
10/100/1000BaseT Ethernet connector
Real-time interrupt output (RTO) and real-time interrupt input (RTI) connectors
Note: The RT interrupt input and RT interrupt output functionality of the IO9 PCI card is not supported under SGI Linux + ProPack.
The optional IO9 card also contains an IOC-4 ASIC that supports the following features:
One IDE channel for the DVD-ROM
NVRAM and time-of-day clock
The Altix 350 system will have some or all of the internal components listed in the following subsections, depending on the type of module and options you order.
The interface board contains the following components:
L1 controller logic
Power supply interface
NUMAlink connectors
Voltage regulators
Connectors to the IP57 node board and the PCI riser card
The PCI riser card provides the following:
PIC ASIC
Connectors that connect the PCI riser card to the interface board
Nonstandard PCI/PCI–X connector that connects to the system's base I/O card
Four PCI/PCI–X card slots (64 bit, 3.3 V) using speeds up to 133 MHz
A base compute module can contain an optional slim-line DVD-ROM that has CD-ROM capabilities. It is located at the front left side of the module (above the disk drives).
| Note: The DVD-ROM requires the presence of a base I/O PCI card. |
A base compute module that contains a base I/O PCI card supports one or two sled-mounted disk drives. The standard IO10 base I/O card supports one or two Serial Advanced Technology Attachment (SATA) system disk drives. When the module contains an optional IO9 card, the disk drives are Ultra3 SCSI disk drives that have a peak data transfer speed of up to 160 MB/s between the disks and system memory. The disk drives are located at the front left side of the module (below the DVD-ROM). The master drive is the bottom drive.
The base compute module can contain one or two power supplies; the second power supply is optional and is required only when you want redundant power. The power supply can input 110/220 VAC and output 500 W (12 VDC, 5 VDC, and -12 VDC).
When the module contains two power supplies, both power supplies are hot–swappable. They are located at the front right side of the module. The primary power supply is the left supply, and the redundant power supply is the right supply.
This section describes the external components of a base compute module, which are located in the front and rear panels.
This section describes the front-panel controls and indicators of a base compute module, as shown in Figure 3-7.
L1 controller display. A liquid crystal display (LCD) displays status and error messages that the L1 controller generates.
Note: See the SGI L1 and L2 Controller Software User's Guide (007-3938-00x) for more information on the L1 controller. Power button with LED. Press this button to power on the internal components. Alternatively, you can power on the internal components at a system console. The LED illuminates green when the internal components are on.
Reset button. Press this button to reset the internal processors and ASICs. The reset will cause a memory loss.
NMI button. Press the NMI (non-maskable interrupt) button to reset the internal processors and ASICs, and to write register data and memory to the /var/adm/crash file.
Service-required LED. This LED illuminates yellow to indicate that an item has failed or is not operating properly, but the base compute module is still operating.
Failure LED. This LED illuminates red to indicate that a failure has occurred and that the base compute module is not operating.
This section describes the rear panel connectors, PCI/PCI–X slots, and LEDs of the base compute module, as shown in Figure 3-8.
Power connector. This connector connects the base compute module to an AC power outlet.
Console port. This DB–9 serial port (console and diagnostic port) enables you to connect a system console to the L1 controller of the base compute module.
L1 port (USB type B). This universal serial bus (USB) type B connector connects the base compute module's L1 controller to an L2 controller.
Two NUMAlink connectors. These NUMAlink connectors can connect the base compute module to other base compute modules, CPU expansion modules, and/or CMPX modules. This connection is made with a NUMAlink cable at 3.2 GB/s in each direction.
NUMAlink LEDs. Each NUMAlink connector has two LEDs. These LEDs are located to the right of the NUMAlink connector. One LED lights yellow to indicate that the base compute module and the module to which it is connected are powered on. The other LED lights green when the link between the base compute module and the module to which it is connected is established.
PCI/PCI–X slots. These slots are labeled from bottom to top PCI 1, PCI 2, PCI 3, and PCI 4. Two of these slots are on one bus, and two slots are on another. These 64-bit slots can contain 33-MHz and 66-MHz PCI cards, and 66-MHz and 100-MHz PCI–X cards. (For an updated list of supported cards, see SGI Supportfolio at http://support.sgi.com.) The bottom slot contains an I/O PCI card.
Note: If you run PCI and PCI–X cards on the same bus at the same time, the PCI–X card runs in PCI mode. And if you run cards of different speeds on the same bus, the highest-speed card runs at the speed of the slower card. For example, if a 100-MHz card resides in one slot of a bus, and a 33-MHz card resides in the second slot of the same bus, both cards will run at 33 MHz.
The factory-installed base I/O PCI card provides the following connectors:
| Note: Real-time interrupt input and output. The RT interrupt input and RT interrupt output functionality of the base I/O PCI card is not supported under SGI Linux + ProPack. |
Ethernet port (10/100/1000 Mbits). This autonegotiating 10BaseT/100BaseT/1000BaseT twisted-pair Ethernet port connects the base compute module to an Ethernet network.
Multi-port Serial Adapter Connector (IO10 Only).
This 36-pin MDR external port enables you to connect up to four serial 9-pin DIN cables to the base I/O.
SCSI connector (Optional IO9 Only).
IO9 card: This 68-pin VHDCI external SCSI port enables you to connect to one SCSI device.
For an updated list of supported SCSI devices, see the SGI Supportfolio at http://support.sgi.com .
The base compute module contains the following configurable components:
Processors
PCI and PCI–X cards
Disk drives
Memory (DIMMs)
Warning: Only trained SGI system support engineers (SSEs) can install and remove the processors, and base I/O PCI card.
As a customer, you can add or remove PCI and PCI-X cards, disk drives, and memory. See Chapter 7, “Installing and Removing Customer-replaceable Units” for information about installing and removing these items.
| Warning: To prevent personal injury or damage to your system, only trained SGI system support engineers (SSEs) can service or configure internal components of the base compute module that are not specifically listed as serviceable and configurable by customers. |
The base compute module can be configured with the following optional modules to expand its function:
The CPU expansion module, which is interconnected to the base compute module via a NUMAlink cable, adds processors and memory. See Chapter 4, “CPU Expansion Module” for more information about this module.
The CMPX module which is interconnected to the base compute module via a NUMAlink cable, adds optional processors, memory and four PCI/PCI-X slots. See Chapter 5, “CMPX Module” for more information about this module.
The TP900 storage module provides additional storage to the system. See SGI Total Performance 900 Storage System User's Guide, 007-4428-00x, for information about this module.
Note: The Altix 350 system also supports other storage modules. See “Storage Expansion” in Chapter 2 for information.
Table 3-2 lists the bandwidth characteristics of the base compute module.
Table 3-2. Bandwidth Characteristics of the Base Compute Module
Characteristic | Peak Bandwidth | Sustainable Bandwidth |
|---|---|---|
NUMAlink-4 channel | 6.4 GB/s full duplex | ~2.8 GB/s each direction |
Main memory | Up to 10.8 GB/s | Up to 10.8 GB/s |
Front side bus (FSB) | 6.4 GB/s | ~6.4 GB/s |
Table 3-3 summarizes the general features of a base compute module that contains an IO9 PCI card.
Table 3-3. General Features of the Base Compute Module
Feature | Description |
|---|---|
Intel Itanium 2 processor | 1 or 2 |
Memory | Up to 24 GB |
Expansion slot | 1 PCI, 2 PCI-X |
Console port | 1 |
NUMAlink-4 port | 2 (3.2 GB/s each direction) |
L1 port (USB, type B) | 1 |
RT interrupt input port | 1 (not functional) |
RT interrupt output port | 1 (not functional) |
Ethernet port | One 10BaseT/100BaseT/1000BaseT |
SATA internal port | Serial ATA drive port (with IO10 base I/O card) |
Multi-port Serial Adapter Connector | One external 36-pin MDR (with IO10 base I/O card) |
SCSI port (internal) | 1 Ultra3 SCSI, 160 MB/s (optional with IO9 base I/O) |
SCSI port (external) | 1 Ultra3 SCSI (VHDCI) (optional with IO9 base I/O) |
3.5-in. drive bay | 2 |
Table 3-4 lists the specifications for the base compute module.
Table 3-4. Base Compute Module Specifications
Characteristic | Specification |
|---|---|
Height | 3.44 in. (8.74 cm) |
Width | 17.06 in. (43.33 cm) |
Depth | 27 in. (68.58 cm) (with bezel) |
Weight | 50 lb (22.7 kg) maximum configuration[a] |
Noise | 6 Bels sound power, up to 30 șC |
Heat dissipation | 1576 Btu/hr maximum |
Input power | 120 - 240 VAC |
[a] Weight will vary depending on whether the base compute module has one or two power supplies, on the number of DIMMs installed, and on the number of disk drives installed. | |