This chapter describes the general interaction and functions of the overall Altix UV 1000 system control. System control parameters depend somewhat on the overall size and complexity of the SGI Altix UV 1000 but will generally include the following three areas:
The system management node (SMN) which runs the SGI Management Center software
The chassis management controllers (CMC) boards - one per IRU
The individual blade-based board management controllers (BMC) - report to the CMCs
| Note: While it is possible to operate and administer a very basic (single-rack) SGI Altix UV 1000 system without using an SMN and SGI Management Center, this is an exception rather than rule. |
The system control network configuration of your server will depend on the size of the system and control options selected. Typically, an Ethernet LAN connection to the system controller network is used. This Ethernet connection is made from a remote PC/workstation connected to the system management node (SMN). The SMN is a separate stand-alone server installed in the SGI Altix UV 1000 rack. The SMN acts as a gateway and buffer between the UV system control network and any other public or private local area networks.
| Important: The SGI Altix UV system control network is a private, closed network. It should not be reconfigured in any way to change it from the standard SGI Altix UV factory installation. It should not be directly connected to any other network. The Altix UV system control network is not designed for and does not accommodate additional network traffic, routing, address naming (other than its own schema), or DCHP controls (other than its own configuration). The Altix UV system control network also is not security hardened, nor is it tolerant of heavy network traffic, and is vulnerable to Denial of Service attacks. |
An Ethernet connection directly from the SMN (Figure 2-1) to a local private or public Ethernet allows the system to be administered directly from a local or remote console via the SGI Management Center interface (most often installed on the SMN). Note that there is no direct inter-connected system controller function in the optional expansion PCIe modules.
The system controller network is designed into all IRUs. Controllers within the system report and share status information via the CMC Ethernet interconnect cables. This maintains controller configuration and topology information between all controllers in an SSI. Figure 2-2 shows an example system control network using an optional and separate (remote) workstation to monitor a single-rack SGI Altix UV 1000 system. It is also possible to connect an optional PC or console directly to the SMN, see Figure 2-4.
| Note: Mass storage option enclosures are not specifically monitored by the system controller network. Most optional mass storage enclosures have their own internal microcontrollers for monitoring and controlling all elements of the disk array. See the owner's guide for your mass storage option for more information on this topic. |
For information on administering network connected SGI systems using the SGI Management Center, see the SGI Management Center System Administrator's Guide (P/N 007-5642-00x).
The CMC system for the SGI Altix UV 1000 servers manages power control and sequencing, provides environmental control and monitoring, initiates system resets, stores identification and configuration information, and provides console/diagnostic and scan interface.
Viewing the system from the rear, the CMC blade is on the right side of the IRU. The CMC accepts direction from the SMN and supports powering-up and powering-down individual or groups of compute blades and environmental monitoring of all units within the IRU. The CMC sends operational requests to the Baseboard Management Controller (BMC) on each compute/memory blade installed. The CMC provides data collected from the compute nodes within the IRU to the system management node upon request.
CMCs can communicate with the blade BMCs and other IRU CMCs when they are linked together under a single system image (SSI); also called a partition. Each CMC shares its information with the SMN and other CMCs within the SSI. Note that the system management node (server), optional mass storage units and PCIe expansion enclosures do not have a CMC installed.
Each compute blade in an IRU has a baseboard management controller (BMC). The BMC is a built-in specialized microcontroller hardware component that monitors and reports on the functional “health” status of the blade. The BMC provides a key functional element in the overall Intelligent Platform Management Interface (IPMI) architecture.
The BMC acts as an interface to the higher levels of system control such as the IRU's CMC board and the higher level control system used in the system management node. The BMC can report any on-board sensor information that it has regarding temperatures, power status, operating system condition and other functional parameters that may be reported by the blade.When any of the preset limits fall out of bounds, the information will be reported by the BMC and an administrator can take some corrective action. This could entail a node shutdown, reset (NMI) or power cycling of the individual blade.
The individual blade BMCs do not have information on the status of other blades within the IRU. This function is handled by the CMCs and the system management node. Note that blades equipped with an optional BaseIO riser board have a dedicated BMC Ethernet port.
In all Altix UV 1000 servers all the system controller types (SMNs, CMCs and BMCs) communicate with each other in the following ways:
System control commands and communications are passed between the SMN and CMCs via a private dedicated gigabit Ethernet. The CMCs communicate directly with the BMC in each installed blade by way of the IRU's internal backplane.
All CMCs can communicate with each other via an Ethernet “ring” configuration network established within an SSI.
In larger configurations the system control communication path includes a private, dedicated Ethernet switch that allows communication between SSI environments.
All IRUs have a chassis management controller (CMC) board installed. The following subsection describes the basic features of the controllers:
| Note: For additional information on controller commands, see the SGI UV CMC Controller Software User's Guide (P/N 007-5636-00x). |
The following list summarizes the control and monitoring functions that the CMC performs. Many of the controller functions are common across all IRUs, however, some functions are specific to the type of enclosure.
Monitors individual blade status via blade BMCs
Controls and monitors IRU fan speeds
Reads system identification (ID) PROMs
Monitors voltage levels and reports failures
Monitors and controls warning LEDs
Monitors the On/Off power process
Provides the ability to create multiple system partitions
Provides the ability to flash system BIOS
The SGI optional 1U console (Figure 2-3) is a rackmountable unit that includes a built-in keyboard/touchpad. It uses a 17-inch (43-cm) LCD flat panel display of up to 1280 x 1024 pixels.
The 1U flat panel console option has the following listed features:
Slide Release - Move this tab sideways to slide the console out. It locks the drawer closed when the console is not in use and prevents it from accidentally sliding open.
Handle - Used to push and pull the module in and out of the rack.
LCD Display Controls - The LCD controls include On/Off buttons and buttons to control the position and picture settings of the LCD display.
Power LED - Illuminates blue when the unit is receiving power.
The 1U console attaches to the system management node server using PS/2 and HD15M connectors or to an optional KVM switch (not provided by SGI). See Figure 2-4 for the SMN video connection points. The 1U console is basically a “dumb” VGA terminal, it cannot be used as a workstation or loaded with any system administration program.
The 27-pound (12.27-kg) console automatically goes into sleep mode when the cover is closed.