This chapter provides information about installing and removing PCIe cards and system disk drives from your SGI system, as follows:
This section describes how to open the system for maintenance and upgrade, protect the components from static damage, and return the system to operation. The following topics are covered:
“Returning the System to Operation”
Warning: To avoid problems that could void your warranty, your SGI or other approved system support engineer (SSE) should perform all the setup, addition, or replacement of parts, cabling, and service of your SGI Altix UV 1000 system, with the exception of the following items that you can perform yourself: Using your system console or network access workstation to enter commands and perform system functions such as powering on and powering off, as described in this guide.
Installing, removing or replacing cards in the optional PCIe equipped riser blade.
Installing, removing or replacing PCIe cards in the optional 1U PCIe expansion chassis.
Adding and replacing disk drives used with your system and using the ESI/ops panel (operating panel) on optional mass storage.
To prepare the system for maintenance, follow these steps:
If you are logged on to the system, log out. Follow standard procedures for gracefully halting the operating system.
Go to the section “Powering the System On and Off” in Chapter 1 if you are not familiar with power down procedures.
After the system is powered off, locate the power distribution unit(s) (PDUs) in the front of the rack and turn off the circuit breaker switches on each PDU.
Note: Powering the system off is not a requirement when replacing a RAID 1 system disk. Addition of a non-RAID disk can be accomplished while the system is powered on, but the disk is not automatically recognized by system software.
When you finish installing or removing components, return the system to operation as follows:
Turn each of the PDU circuit breaker switches to the “on” position.
Power up the system. If you are not familiar with the proper power down procedure, review the section “Powering the System On and Off” in Chapter 1.
Verify that the LEDs on the system power supplies and system blades turn on and illuminate green which indicates that the power-on procedure is proceeding properly.
If your system does not boot correctly, see “Troubleshooting Chart” in Chapter 6, for troubleshooting procedures.
This section provides a brief overview of the PCI Express (PCIe) technology available as an option with your system. PCI Express has both compatibility and differences with older PCI/PCI-X technology. Check with your SGI sales or service representative for more detail on specific PCI Express board options available with the SGI Altix UV 1000.
PCI Express is compatible with PCI/PCI-X in the following ways:
Compatible software layers
Compatible device driver models
Same basic board form factors
PCIe controlled devices appear the same as PCI/PCI-X devices to most software
PCI Express technology is different from PCI/PCI-X in the following ways:
PCI Express uses a point-to-point serial interface vs. a shared parallel bus interface used in older PCI/PCI-X technology
PCIe hardware connectors are not compatible with PCI/PCI-X, (see Figure 5-1)
Potential sustained throughput of x16 PCI Express is approximately four times that of the fastest PCI-X throughputs
PCI Express technology uses two pairs of wires for each transmit and receive connection (4 wires total). These four wires are generally referred to as a lane or x1 connection - also called “by 1”. SGI Altix UV 1000 PCIe technology is available up to a x16 connector (64 wires) or “by 16” in PCI Express card slots. This technology will support PCIe boards that use connectors up to x16 in size. Table 5-1 shows this concept.
For information on which slots in the PCIe expansion chassis support what lane levels, see Table 5-2.
Table 5-1. SGI Altix UV 1000 PCIe Support Levels
SGI x16 PCIe Connectors | Support levels in optional chassis |
|---|---|
x1 PCIe cards | Supported in all four slots |
x2 PCIe cards | Supported in all four slots |
x4 PCIe cards | Supported in all four slots |
x8 PCIe cards | Supported in two slots |
x16 PCIe cards | 1 slot supported |
x32 PCIe cards | Not supported |
| Warning: Before installing, operating, or servicing any part of this product, read the “Safety Information” in Appendix B. |
This section provides instructions for adding or replacing a PCIe card in a PCIe expansion enclosure installed in your system. To maximize the operating efficiency of your cards, be sure to read all the introductory matter before beginning the installation.
 | Caution: To protect the PCIe cards from ESD damage, SGI recommends that you use a grounding wrist strap while installing a PCIe card. |
The PCIe expansion chassis functions in a similar manner to a computer chassis that supports PCIe slots. Always follow the manufacturer's instructions or restrictions for installing their card.
 | Important: Replacement (swapping) of a PCIe card in the 1U chassis may be done while the system is powered on. Addition of a new card while the system is running requires a reboot to initiate recognition and functionality. Removal (without replacement) of an existing PCIe card may cause system error messages. When installing PCIe cards, ensure that the input current rating specified on the AC input label is not exceeded. |
The EB4-1U-SGI chassis provides space for up to four (4) PCIe cards in the following “lane” bandwidth configurations:
Table 5-2. PCIe Expansion Slot Bandwidth Support Levels
PCIe expansion enclosure slot # | PCIe connector level supported by slot | PCIe slot number location in board “carriage” |
|---|---|---|
Slot 1 | Up to x16 | Bottom-left side |
Slot 2 | Up to x4 | Top-left side |
Slot 3 | Up to x8 | Top-right side |
Slot 4 | Up to x4 | Bottom-right side |
| Note: Before installing the PCIe expansion cards, be sure to remove each respective slot cover and use its screw to secure your expansion card in place. |
Working from the front of the expansion chassis, locate the two “thumb screws” that hold the PCIe board “carriage” in the expansion chassis.
Turn the two thumb screws counter-clockwise until they disengage from the 1U chassis.
Pull the T-shaped board “carriage” out of the chassis until the slots are clear of the unit.
Select an available slot based on the lane support your PCIe card requires, see Table 5-2.
Remove the metal slot cover from the selected slot and retain its screw.
Fit the PCIe card into the slot connector with the connector(s) extending out the front of the bracket, then secure the board with the screw that previously held the metal slot cover.
Push the PCIe board “carriage” back into the enclosure until it is seated and twist the retaining thumb screws clockwise (right) until fully secure.
Important: After installation, be sure to power on the PCIe expansion enclosure before re-booting your system.
If your system is equipped with an optional PCIe riser blade, you can install or replace PCIe cards (up to x16) using the following steps and illustrations:
Obtain a T10 torx driver to perform the necessary disasembly of the blade. It is recommended that you use an anti-static wrist strap during this procedure.
Shut down the system or the individual blade you will be upgrading and open the front door of the rack.
Grasp the front pull bars and depress the black release button on the blade and pull it out of the IRU, see Figure 5-4. Place it on a flat static-safe working surface.
Unscrew and remove the two T10 torx-head screws located on either side of the rear part of the blade's sheetmetal housing, see Figure 5-5. Set the screws aside for the re-installation process.
Slide the blade's sheetmetal cover back slightly and then lift it away from the unit.
Near the front of the blade you will remove a single T10 torx-head screw from the C-shaped bracket that holds both of the optional PCIe cards in place on the blade's riser board. Set the screw aside for the reinstallation process.
If you are replacing a PCIe card, gently remove the existing board from the PCIe connector on the riser and place in a static-safe bag or container.
Install a new PCIe card by aligning the board's interface connector with the riser's and inserting until the card is flush to the connector, see Figure 5-6. The PCIe connector(s) such as graphics, Fibre Channel, etc. should protrude from the blade's front.
Re-secure the C-shaped bracket that holds the PCIe option cards in place on the blade's riser.
Replace the blade's sheetmetal top cover and securing screws.
Slide the blade back into the IRU (see Figure 5-7) seat it fully and restart the system or blade.
The dual-disk drive riser card permits a blade to house two system disk drive bays as shown in Figure 5-8. This section describes how to install or remove the drives. The blade supports RAID 1, RAID 0 and jbod disk drives.
| Note: A RAID 1 drive may be replaced while the system is operating. Removal of a jbod or RAID 0 drive while the system is operating will cause generation of system errors and possible loss of data. |
Use the following steps and illustrations to add or replace a disk drive in the Altix UV 1000 dual disk drive riser blade.
To remove a disk drive:
Press in and down on the red button until the handle is released, see Figure 5-9.
Pull the handle upward and out until the locking mechanism is cleared.
Grasp the disk drive by the side and extract it from the disk riser blade.
Installation of a disk drive into the riser blade is the opposite of extraction , use the following steps:
Install a drive (pre-mounted on sled) into the dual disk drive riser blade (see Figure 5-8) with the red button at the bottom.
Slide the disk and sled into the riser until the actuating teeth can grab the riser plate.
Important: Use care - do not insert the drive too far into the disk riser blade. Push the drive handle down until the handle clicks into place (this completes the insertion of the disk drive).
