Page 2
The information disclosed in this document, including all designs and related materials, is the valuable property of NEC Corporation of America, Inc. and/or its licensors. NEC Corporation of America and/or its licensors, as appropriate, reserve all patent, copyright and other proprietary rights to this document, including all design, manufacturing, reproduction, use, and sales rights thereto, except to the extent said rights are expressly granted to others.
Page 7
Tables Tables Table 2-1 DIMM Capacity and Cell Memory ... 2-7 Table 2-2 Device Names on the EXPRESSSCOPE® Monitor LCD ... 2-18 Table 3-1 Relation of Interconnect Port and Cable End to Cell ID ... 3-3 Table 3-2 Minimum and Maximum Configurations ... 3-7 Table A-1 Component on the Front of the Cell ...
Using This Guide This guide contains information how to operate and administrate Express5800/A1160 server. Who Should Use This Guide This guide is intended for system administrators and operation personnel who are using Express5800/A1160 server. Symbols and Conventions This guide uses the following text conventions and graphic symbols.
Page 10
Related Documents The NECCare Guide contains information about NEC’s warranty and server registration.
In an emergency, such as a dangerous event that requires turning off the power supply, turn off the breaker at the rear of the server. Turning off the breaker may cause data destruction. Therefore, users should determine when to turn off the breaker in accordance with specified operation criteria.
Page 12
To avoid risk of electric shock, turn off all server power and disconnect power cables before working inside the server unit. The main power of your server is turned off by turning off the power source to the server or removing the power cable.
Page 13
To prevent shock, take care not to drop or leave conductive parts, such as a screw, in the server when servicing the system. Be careful when accessing a fan or rotating parts to avoid cutting your hand or fingers.
Section 1 Introduction This overview provides a detailed introduction to Express5800/A1160 systems and the technologies on which they are based. It describes features that might be available to customers in a series of hardware and software releases. For information about the availability of any feature, contact your sales representative.
System Partitioning Each cell in an Express5800/A1160 system can function as an independent partition. In multiple-cell systems, two or more cells can be combined into a single partition. Each partition can run an operating system different from the operating system in any other partition.
Windows Server 2003, 32-bit Datacenter Edition, are restricted to a maximum of two cells. Linux Operating Systems Express5800/A1160 systems support the following Linux operating systems: Red Hat Enterprise Linux Advanced Platform 5.2 for x64 SUSE LINUX Enterprise Server 10 (x64 with Service Pack 2) Virtual Machine Monitors A virtual machine monitor is the base component that enables virtualization.
Section 2 Cell Component Express5800/A1160 Cell In Express5800/A1160 systems, hardware components are organized into cells. The main components of a cell are • Main logic module that hosts the processors, processor voltage regulator modules, and node controller. (The node controller interconnects the components of a cell and provides the connection among the cells in a multiple-cell system.)
Processors Within each cell, the processor board in the main logic module hosts the processors. The processor board contains the processor sockets, processor voltage regulator modules, node controller, and the scalability ports, which are the ports that enable you to connect up to four cells.
Figure 2-2 Processor Socket Location on Processor Board Supported Processors Express5800/A1160 systems support the following Intel Xeon processor 7400 series (Dunnington) processors: • Model E7440 (2.4 GHz with 2 x 3-MB L2 cache, 16-MB L3 cache, quad core, 1066 MHz front-side bus) •...
Page 22
Node Controller The node controller provides scalability, native PCIe, and fully buffered DIMM memory for the Express5800/A1160 cell. It maintains coherency between the processors, memory, and I O subsystem and contains extensive error detection and correction logic.
Memory Express5800/A1160 systems use a directory-based cache-coherent memory system. The directory-based memory tracks ownership of data. The cache coherency protocols force the processor cache components and main storage components to Keep track of all copies of a cache line. Determine which processor has permission to update an instance of a cache line.
Each channel pair operates in lockstep; that is, a single cache line is stored across two DIMMs with each DIMM on a different channel of the lockstep pair. Eight fully buffered DIMM slots for each channel. A cell with two memory boards contains 32 DIMM slots.
DIMM Capacity and Cell Memory Table 2-1 lists the minimum and maximum memory in the cell if DIMMs of a specific capacity are used. Table 2-1 DIMM Capacity and Cell Memory DIMM Capacity 2 GB 4 GB Check with your sales representative for the availability of specific DIMMs. Rules for Memory Expansion Note the following rules when expanding system memory: DIMMs must be installed in pairs.
Indicators on the Memory Board The memory board contains a green LED to indicate that the board is in service and an amber LED to indicate that the board needs attention. Do not remove a memory board while the green LED is lit. Dynamic DIMM Sparing Dynamic DIMM sparing automatically substitutes a spare DIMM in place of an operational DIMM before a high rate of correctable errors leads to an uncorrectable error...
I/O Subsystem Each slot has its own power and attention indicators (LEDs). Internal slot for PCIe Serial Attached SCSI (SAS) RAID controller Figure 2-6 shows the I/O riser board. Figure 2-6 I/O Riser Board PCIe Card Carrier The PCIe card carrier enables an administrator or technician to insert or remove the PCIe cards from the rear of the cell.
Figure 2-8 shows the location of the external card slots on the back of the cell. Ports A cell includes the following ports: Partition video port 2-10 Figure 2-7 PCIe Card Carrier Figure 2-8 External Card Slots...
Partition universal serial bus (USB) ports — Two USB 2.0 ports on the front and two USB 2.0 ports on the back of the cell Partition serial port Partition LAN ports — Two 1-Gigabit Ethernet (LAN) ports In addition, the cell includes the following ports on the management board: Maintenance LAN port (10/100 Ethernet port) USB management port Management serial port...
Power Each cell is independently powered. The power system is fully distributed and consists of the following components. AC Connections The AC input for each cell is two 15-ampere line cords. The line cords are connected to the power strips mounted in the rear of the cell. AC/DC Power Supplies The AC/DC power supplies take the AC input power and produce the DC power used by the cell components.
Page 31
The main logic module contains the single master power controller for the cell. The master power controller Controls and monitors the power supplies, and monitors the voltages on all cell components Responds when someone presses the power button (to turn the power on or off) Monitors and controls the fans Monitors thermal sensors Communicates with the management system...
Cooling Each cell is cooled by two fan modules. Each fan module contains two 12-volt high-performance fans that provide the airflow required to cool the cell components and processors. The fan modules are mounted in the front of the cell. Note: The power supplies within the cell are self-cooled.
Peripherals The cell supports the following peripherals through the drive tray: Six 2.5-inch Serial Attached SCSI (SAS) disk drives with one of the following capacities: 73 GB (15000 RPM) 146 GB (10000 RPM) DVD drive (DVD-RW) The drive tray also hosts the two USB ports on the front of the cell. Figure 2-12 illustrates the peripherals on the drive tray.
Externally from SCSI storage Externally from iSCSI storage Express5800/A1160 systems are capable of being deployed in a preboot execution environment (PXE) provided that the external LAN connections exist at boot time. For more information about implementing this feature, see the Web site for your operating system vendor.
System Clocks A clock synthesizer on the main logic module is the master clock source. This source provides a number of output clocks that are further distributed to the system components as needed. The clock distribution system is self-contained within each cell. Systems with multiple cells do not provide redundant system clocks.
Figure 2-13 EXPRESSSCOPE® Monitor Fault Messages on the EXPRESSSCOPE® Monitor LCD If a hardware problem occurs, a message is displayed on the EXPRESSSCOPE® Monitor LCD on the front of the cell. The display identifies the failed unit, sometimes with abbreviated language. The following table gives the full unit name as it appears in documentation, the name as it appears on the EXPRESSSCOPE®...
Page 37
EXPRESSSCOPE® Full Name Monitor LCD Name fan module Fan_Modx interconnect cable Intercon_Cablex I/O riser board IOR_Brd PCI expansion card IO_Slotx_y_z voltage regulator IPVRMx module main logic module MainLogic_Module memory board Mem_Brdx DIMM Mem_Brdx_DIMMyy management board Mgmt_brd PCIe card PCIe_Slotx RAID controller PCIe_Slot6 power supply PwrSupplyx...
PCIe carrier Inbuilt Virtualization Inbuilt virtualization is an optional capability for Express5800/A1160 systems. This capability enables a partition to boot with VMware Infrastructure 3. The partition contains a USB drive with a preloaded copy of the embedded version of VMware ESX 3.5. The USB drive is attached to the compatibility hardware of the partition.
Section 3 System Configuration This section describes the packaging of Express5800/A1160 systems and the different configuration options. Cell Interconnect and Multiple Cell Systems A four-processor socket cell is capable of containing all the hardware it needs to boot as a server. To create a larger system, a cell can be connected together with up to three other cells using interconnect cables.
Cell Interconnect and Multiple Cell Systems A cell can be connected together with up to three other cells to create a multiple-cell system. > shows a system made up of two cells (eight processor sockets). The two cells are connected together with two interconnect cables. > shows a system made up of four cells (16 processor sockets).
Cell Identification Each cell in a system has a unique physical cell identifier-cell 0, cell 1, cell 2, or cell 3. The management firmware uses the cell identifier to enable the cells within the system to communicate with each other. The cell identifier is established by the interconnect cables.
Cabinets Express5800/A1160 systems can be installed in any standard 19-inch-wide cabinet. You can either order a cabinet from NEC or provide your own. See the System Planning Guide for the requirements for customer-provided cabinets. Optionally, each system can have a directly connected keyboard, monitor, and mouse to serve as a system console.
Partitions You can configure one or more cells as a partition to support an instance of an operating system or a virtual machine monitor. A partition is a logical computer in the system. You use partitions to run user applications that perform work to support your business. Each cell in the system can support one partition.
Replaceable Components Replaceable components are hardware assemblies or subassemblies that can be replaced onsite to either upgrade the server or replace a failing component. Hot-swappable components can be replaced when the power is on and the operating system is running. Hot-pluggable components can be replaced when the power is on but the operating system is stopped.
See the User's Guide for additional information on the customer-replaceable components. Express5800/A1160 Configuration Summary Table 3-2 summarizes the configuration options for Express5800/A1160 systems. Table 3-2 Minimum and Maximum Configurations Component One Cell Minimum Packaging type 4U rack-mounted cell Power and cooling...
Section 4 Server Management This section provides an overview of the hardware and software components used to manage Express5800/A1160 systems. System Components The following illustration shows how the components are connected in a typical system environment. Your system can include the following components.
Linux, SUSE Linux, or any supported Windows operating system. The virtual machine monitor can be VMware ESX or Xen. You can purchase the operating system or virtual machine monitor from NEC or supply it yourself. A system comprises a minimum of one and a maximum of four partitions.
Page 49
Express5800 systems and monitor older Express5800 systems in your environment. A management server is necessary in order for your system to report problems to the NEC client support center using remote maintenance service requests. The ESMPRO Manager is installed on the management server. It is designed to help you manage your enterprise at a glance.
Management Architecture Management of Express5800/A1160 systems is based on a modular, distributed, and scalable architecture. This architecture distributes the processing load among various processing engines and grows as the size of the system increases. Intelligent Platform Management Interface Express5800/A1160 systems implement the message-based Intelligent Platform Management Interface (IPMI) version 2.0 with extensions to support the partitioning of...
Management Board Figure 4-1 Management Architecture Management Board The management board in each cell is the main hardware component of server management. Figure 4-2 illustrates the management board.
The following paragraphs describe the main components on the management board in more detail. Service Processor The Service Processor is a management controller. For Express5800/A1160 systems, the Service Processor Executes the management firmware to provide the management and maintenance capabilities...
Remote Console Interfaces Management firmware is a comprehensive means of configuring, controlling, and monitoring individual components of the Express5800/A1160 system and the system as a whole. Management firmware runs on the Service Processor. The remote console interfaces are client user interfaces to management firmware that are provided by Web servers running on Service Processors.
(processors, memory, I/O, and so on) in the partition. Running in the partition, the BIOS provides many configuration, setup, diagnostic, and recovery functions. In Express5800/A1160 systems, the BIOS is stored in the firmware hub in each cell. Server Management Software Server Management software enables a centralized operations environment for your systems.
Management Software Components The Server Management software includes the following components. ESMPRO Manager and Agent Server Management software includes ESMPRO Manager and ESMPRO Agent software. ESMPRO Manager enables a system administrator to manage a network by monitoring system hardware and software configurations, system failures, and system performance.
Internet access is the method for Remote Monitoring to communicate with the NEC Support Center. Using this communication path to the NEC Support Center is beneficial because a modem and an additional phone line are not required.
Appendix A Cell Components The following text identifies the main components, ports, and connectors that are visible on the front and back of a cell. Components on the Front of a Cell Figure A-1 identifies the components that are visible on the front of the cell. describes each component in more detail.
Component EXPRESSSCOPE® Monitor LED fan status indicators Power button ID button Navigation buttons LED status indicators DVD-RW drive Partition USB connections Components on the Rear of a Cell Figure A-1 identifies the components that are visible on the rear of the cell. describes these components in more detail.
Table A-2 Component on the Rear of the Cell Component PCIe carrier/cards Cell ID Partition USB ports Management serial port Partition serial port Maintenance LAN port Partition video port USB management port Partition LAN ports Navigation buttons Figure A-1 Rear of the Cell Description Six hot-plug switched PCIe 8x card slots.
Page 60
Component LED status indicators Power supplies Interconnect cable connectors Description Provides status for the cell. The top light indicates power status. The bottom light indicates cell status. See the EXPRESSSCOPE® Monitor LCD or the remote console interface for additional information on the power or cell status. Two power supplies that provide n+1 redundancy when used in high-voltage configurations.
Page 61
Customers of the product may vary. Therefore, the suitability of a product for a specific purpose or application must be determined by the Customer and is not warranted by NEC Corporation of America. For more information, telephone 1-866-269-1239...