Page 1
IBM Cloud Object Storage System Version 3.14.13 Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual 4957-J11/4958-J11, 4957-J12/4958-...
Contents Figures........................v Tables......................... vii Document information..................ix Safety and environmental notices................. xi Safety notices.............................. xi Environmental notices..........................xiv Electromagnetic Compatibility Notices....................xiv Declared noise emissions........................xvii Support information....................xix Chapter 1. Appliance safety precautions..............1 Physical................................ 1 Electrical...............................1 Electronic components..........................1 Chapter 2.
Page 4
Fault isolation methodology........................52 Host I/O..............................52 Dealing with hardware faults........................53 Continuous operation during replacement....................53 Firmware..............................53 CRUs for IBM COS Medium / Large Disk Enclosure.................. 53 Chapter 7. Module removal and installation............55 Overview..............................55 ESD precautions............................55 Replacing a PSU module..........................56 Removing a PSU module........................
3. IBM COS Medium and Large Disk Enclosure - front panel components............8 4. IBM COS Medium and Large Disk Enclosure - rear panel components............8 5. IBM COS Medium and Large Disk Enclosure - rear panel module slot index diagram........9 6. Expansion unit detail............................. 9 7.
Page 6
23. Unpacking the Disk Enclosure using lift handles..................29 24. Typical AC power cord connection from PDU to PSU................42 25. SAS cable connections..........................43 26. Drive carrier module LED.......................... 48 27. Removing a PSU (1 of 2)........................... 57 28. Removing a PSU (2 of 2)........................... 57 29.
Page 7
18. Expansion module LED states........................49 19. Alarm conditions............................49 20. PSU and system fan faults........................50 21. Thermal monitoring and control....................... 51 22. Thermal alarm............................51 23. IBM COS Medium/Large Disk Enclosure product components for 4U 106-drive chassis...... 53...
Page 8
24. 4U enclosure dimensions......................... 71 25. Disk Enclosure weights..........................71 26. Ambient temperature and humidity......................71 27. Power cooling module specifications....................... 72 28. Unpacking the enclosure: 3-piece box with packing................77 viii...
Intended purpose and audience This manual contains the instructions for installing and maintaining this appliance. The audience for this ™ guide consists of those individuals responsible for installing IBM Cloud Object Storage System appliances and enclosures. Note: • The equipment and device described for installation herein are sophisticated and relatively complex to install.
Page 10
IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Suitability for telecommunication environment - This product is not intended to connect directly or indirectly by any means whatsoever to interfaces of public telecommunications networks. Examples of a caution and a danger notice. Numbers in parentheses refer to message numbers in the IBM Safety Notices publication G229-9054, which is included with your product.
Page 12
• Each rack cabinet might have more than one power cord. – For AC powered racks, be sure to disconnect all power cords in the rack cabinet when directed to disconnect power during servicing. xii IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 13
– For racks with a DC power distribution panel (PDP), turn off the circuit breaker that controls the power to the system unit(s), or disconnect the customer's DC power source, when directed to disconnect power during servicing. • Connect all devices installed in a rack cabinet to power devices installed in the same rack cabinet.
(C011) Environmental notices This information contains all of the environmental notices for IBM Systems products in English and other languages. The IBM Systems Environmental Notices information includes statements on limitations, product information, product recycling and disposal, battery information, flat panel display, refrigeration and water-cooling systems, external power supplies, and safety data sheets.
Page 15
European Community and Morocco Notice Germany Notice Safety and environmental notices xv...
Page 16
Japan Electronics and Information Technology Industries Association (JEITA) Notice Japan Voluntary Control Council for Interference (VCCI) Notice Korea Notice People's Republic of China Notice Russia Notice xvi IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Taiwan Notice United States Federal Communications Commission (FCC) Notice Declared noise emissions (1-5) Declared noise emissions in accordance with ISO 9296 (1-5) Table 1. Declared noise emissions in accordance with ISO 9296 Product description Declared A-weighted Declared A- Statistical adder for Weighted verification Models: A10, C10, M10, J10,...
Page 18
IBM recommends that you consult with qualified experts in this field to determine whether you are in compliance with the applicable regulations. xviii IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 22
• Remove any jewelry or metal objects from your body. They are excellent metal conductors that can create short circuits and harm you if they come into contact with printed circuit boards or areas where power is present. 2 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
• IBM COS Medium and Large Disk Enclosures are suitable for connection to intra-building or non- exposed wiring or cabling only. • IBM COS Medium and Large Disk Enclosures are suitable for installation in locations where the NEC (National Electrical Code) applies. These enclosures are not suitable for Outside Plant (OSP) installations.
Medium and Large Disk Enclosure are described. The IBM COS Medium and Large Disk Enclosures support a 4U (rack space) chassis – see the two figures below. The large Disk Enclosures holds up to 106 low profile (1-inch high) 3.5 inch form factor disk drive modules in a vertical orientation and the medium Disk Enclosure holds 53 disks in the same orientation.
Medium and Large Disk Enclosure variants are described. The IBM COS Medium and Large Disk Enclosure is configured as an expansion enclosure, as shown in the table below. The enclosure supports 106 qualified disk drive modules installed via the top panel.
Table 2. IBM COS Medium and Large Disk Enclosure variants Description PSUs System IOMs IOM fans Disks fans expanders configuratio 12 Gb/s direct dock Enclosure Rear Rear Rear location of CRU variant Redundant PSUs must be compatible modules of the same type (both AC).
Figure 3. IBM COS Medium and Large Disk Enclosure - front panel components The enclosure front panel provides access to the seven (7) main enclosure system LEDs, located in the lower left corner. See also the section, “Front panel LEDs” on page 14. The front panel also provides access to the left and right enclosure pull handles used to slide the enclosure forward for in-rack servicing tasks.
The following figure shows a conceptual diagram showing module slot-indexing as viewed from the rear panel. Figure 5. IBM COS Medium and Large Disk Enclosure - rear panel module slot index diagram Expansion module The following figure shows the expansion module used in either IOM slot located on the enclosure rear panel.
The enclosure top panel has three different covers, labeled A, B, and C. Two of the covers can be removed to provide access to internal components. 10 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Figure 9. Top panel with covers installed Table 4. Enclosure top panel Item Description Removable lid provides access to HS expanders and disk modules. Removable lid provides access to disk modules, IOM fan modules, and limited access to IOMs. Fixed cover does not remove. It provides protection for the IOMs.
Partially populated Medium Disk Enclosure (J11) disk drive slots The IBM COS Medium J11 Disk Enclosure provides support for up to 53 disk drive modules. It can be partially populated to allow use with fewer than 53 disk drive modules. To ensure proper thermal and vibrational characteristics are maintained, the disk population must be increased in fixed increments and installed in specific slot locations.
Partially populated Large Disk Enclosure (J12) disk drive slots The IBM COS Large J12 Disk Enclosure provides support for up to 106 disk drive modules. It can be partially populated to allow use with fewer than 106 disk drive modules. To ensure proper thermal and vibrational characteristics are maintained, the disk population must be increased in fixed increments and installed in specific slot locations.
The enclosure front panel displays several LEDs. The front panel displays the functions shown in the illustration below and listed in the table. See also Figure 3 on page 8 14 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 35
Figure 14. panel - lower left corner (partial view) Table 7. LEDs: enclosure front panel Front panel functions Front panel functions (lower left corner of (lower left corner of panel) panel) System Power LED Firmware Fault LED (green) (amber) ID LED (blue) Module Fault LED –...
In the figure below, the dimetric rear orientation shows the PSU aligned for insertion into either PSU slot located on the enclosure rear panel. 16 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Figure 15. LEDs - 2000W PSU - rear panel Table 8. LEDs - 2000W PSU - rear panel Module LED LED behavior states PSU Status LED (Bitonal) PCM OK (Green) PSU fault/failure Power off (Off) (Amber/blinking amber) Multiple power supply unit modules The 4U storage system includes two PSUs which provide redundant power control for the system so that if one module fails, the other maintains the power supply, and enclosure operation is not affected while you replace the faulty module.
5 pascals (0.5mm water gauge). The cooling system provides sufficient capacity to ensure that maximum temperatures are not exceeded. Important: 18 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
The environment in which the enclosure operates must be dust-free to ensure adequate airflow. Expansion module IOMs are used in IBM COS Medium and Large Disk Enclosures 12Gb/s storage enclosures. The figure below is a dimetric rear orientation that shows a pictorial view of an expansion module. You would revolve the module by 90º...
Page 40
This LED description applies to all 12Gb SAS ports (Port 0 through 3). This LED description applies to both management ports (Port 0 and Port 1). 20 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Top panel LEDs Overview To view LEDs of components that are accessible from the top panel, you must first remove the lid for the compartment in which the component is installed. The enclosure top panel is shown in Figure 9 on page Drive carrier module The drive carrier module comprises a hard disk held by a carrier.
IOMs. The replacement procedure should be completed within an absolute maximum of three minutes. Figure 20. LEDs: Controller channel fan module - top panel 22 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Table 12. LEDs: Controller channel fan module - top panel Module LED LED behavior states Channel Fan Status LED Channel Fan OK (Off) Fan fault ID (amber/ Power off (Off) blinking amber) HS Expander module The replacement procedure should be completed within an absolute maximum of 3 minutes. Figure 21.
Page 44
24 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
See “ESD precautions” on page Install the Disk Enclosure into See “Installing the Disk the rack space Enclosure” on page 30 Cable the Disk Enclosure to IBM See “Routing cables using the COS Medium and Large Disk CMA” on page 38 and “Power Enclosures cord connection”...
• Disk drive modules for use in populating the disk slots after the enclosure is secured into the rack. Contact IBM support for a list of qualified accessories for use with the enclosure. The accessories box contains the power cords and other accessories.
Preparing for installation There are important preparation requirements and handling procedures for use during product installation. Overview CAUTION: The Disk Enclosure - together will all its component parts - is too heavy to manually lift and install into the rack cabinet. A minimum of three people and a suitable mechanical lift are required to hoist the Disk Enclosure and install it into the rail kit assembly within the rack.
CRUs only (as shipped). The handles are not designed to hold the weight of a fully populated enclosure that also includes the disk drives. 28 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Figure 23. Unpacking the Disk Enclosure using lift handles CAUTION: With two persons - positioned one on each side of the enclosure - grip the handles securely, and lift the enclosure out of the box using appropriate lifting technique. Place the enclosure in a static-protected area.
1. Measure the rail-span depth distance from rear rack post to front rack post, and record this dimension. 2. Take the left outer rail subassembly in hand; then rotate the middle slide release, and fully extend the middle slide. 30 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 51
3. Unscrew and remove the quantity-4 rail kit rear-mounting bracket screws to adjust the rack post-to- post distance for the left rail subassembly. 4. Relocate the left rail mounting bracket to approximately match the rack post-to-post distance recorded in Step 1, above. This bracket has one inch of available adjustment after the screws are secured.
Page 52
Ensure that the quantity-2 all-in-one rail kit mounting hardware fully seats into the rack post mounting hole. 32 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 53
9. Attach the front mounting bracket to the rack post, ensuring that the rail subassembly occupies the lower 2U portion of the allotted 4U space. The front mounting bracket spring will clip onto the post. Ensure that the quantity-2 all-in-one rail kit mounting hardware fully seats into the rack post mounting hole.
Page 54
In the example on the left (below), the ball bearing track is not fully seated to the front of the middle slide. Warning: Safe handling precautions: 34 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 55
• Do not drop or lift the chassis using a mechanical lift while inner rails are engaged with middle rails. The middle and inner rails should be properly aligned before engagement, so they glide smoothly during the entire insertion • The Disk Enclosure must be entirely supported by the mechanical lift until the rails are locked in the service position.
Page 56
CMA shelf, on its inner surface. Torque screws to 1.36 N-m (12 lbf-in). The images below show the progression of steps from left to right. 36 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 57
23. Clip the CMA "B" bracket onto the right rail subassembly CMA attachment bracket (from Step 7). Ensure that the blue spring clips onto the C-shaped CMA attachment bracket securely, and the arrow next to the "B" mark on the CMA arm is pointed upward. The "B" bracket should reside outside of the CMA ramp "lip"...
Note: This model of the Disk Enclosure does not contain an IOM in slot 1. Thus, disregard the red cables in the figures below. 38 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 59
2. Rotate the inner CMA cable capture arm into the C-bracket to secure the rest of the data cables. The outer CMA cable capture arm may need to be pushed down in the C-bracket to allow the inner cable capture arm to seat properly. The CMA bracket may need to be shifted slightly in order for the thumbscrew to find the PEM thread in the CMA shelf.
Page 60
Reinstall the M3 panhead screw from Step 3a, while torquing the screw to 0.56 N-m (5 lbf-in). Note: This model of the Disk Enclosure does not contain an IOM in slot 1. Thus, disregard the red cables in the figure below. 40 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 61
4. Route cables through CMA baskets. a) Route cables through the first two baskets, ensuring minimal cable crossover to maximize space b) Use all available space on the CMA shelf to make the first 180º bend into the first CMA basket. c) Keep pairs of dual SAS cables parallel and close together.
Examine the earth connection to the rack before power on. An electrical engineer who is qualified to the appropriate local and national standards must do the examination. 42 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
SAS cable connections The following figure and steps describe how to connect the SAS cables from a single IBM COS Medium or Large Disk Enclosure connected to a single IBM COS Controller Node, and when to power the unit on.
Page 64
44 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Unit Identification Number Software/SES The enclosure UID number can be read and set through the management interfaces and SES. 46 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
See the “Fault isolation methodology” on page 52 section when conducting system diagnostics. Initial start-up problems Faulty power cords Check that you have correctly cabled the system. Contact IBM support for replacements if: • Power cables are missing or damaged. • Plugs are incorrect.
Enclosure is not powered on. Disk drive module is installed and operational Blinking: 1s on/1s off SES device identity set SES device fault bit set Power control circuit failure 48 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
– Re-seat the IOM in its slot. – Check for logs pertaining to the failure • If the above actions do not resolve the fault, contact IBM support for assistance. Temperature sensors Temperature sensors throughout the enclosure and its components monitor the thermal health of the storage system.
The storage enclosure system uses extensive thermal monitoring and takes a number of actions to ensure component temperatures are kept low, and to also minimize acoustic noise. Air flow is from the front to back of the enclosure. 50 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Table 21. Thermal monitoring and control Symptom Cause Recommended action If the ambient air is below 25ºC The first stage in the thermal 1. Check the installation for any (77ºF), and the fans are observed control process is for the fans to airflow restrictions at either to increase in speed, then some automatically increase in speed...
When troubleshooting disk drive and connectivity faults, stop I/O to the affected disk groups from all hosts as a data protection precaution. See also the “Stopping I/O” on page 67 section. 52 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
CRUs for IBM COS Medium / Large Disk Enclosure A listing of Customer Replaceable Units for the Medium and Large Disk Enclosures. Table 23. IBM COS Medium/Large Disk Enclosure product components for 4U 106-drive chassis Item Enclosure CRU and related...
Page 74
Table 23. IBM COS Medium/Large Disk Enclosure product components for 4U 106-drive chassis (continued) Item Enclosure CRU and related Access component description Rail kit (variable attachment Note 3 options) 1. Rack mount kit, shelf, long (1.2 m), HW 2. Cable Management Arm...
6. Grasp the PSU handle latch between the thumb and forefinger and press the latch tab down to unlock the handle. Revolve the handle out and downward to lever the PSU out of the enclosure as shown in the figure below. 56 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 77
Figure 27. Removing a PSU (1 of 2) 7. Grip the handle and withdraw the PSU, taking care to support the base of the module with both hands as you remove it from the enclosure as shown in the figure below. Figure 28.
It is important that all fan module slots are filled when the enclosure is in operation. 58 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Procedure 1. Press down on the latch tab to release the fan from its locked position. See detail No. 1 in the figure below. Figure 29. Removing a system fan (1 of 2) 2. Grasp the fan module handle and carefully pull the fan out of its slot. See also the detail in the figure below.
1. Grasp the latch tab on the interior channel wall of the enclosure, and squeeze the tab against the wall to release the channel fan from its locked position as shown in the figure below. 60 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Figure 31. Removing a controller fan (1 of 2) 2. With your other hand, grasp the handle located on the top of the fan, and pull upwards to remove the fan from its slot as shown in the figure below. Figure 32.
Figure 33. Removing an HS Expander (1 of 2) 3. Revolve each swing-arm upward to release the PCBA carrier from its slot as shown in the figure below. 62 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Figure 34. Removing an HS Expander (2 of 2) 4. While grasping the swing-arm handle, pull upwards to lift the HS Expander and remove it from its slot. Installing an HS Expander module About this task Refer to Figure 33 on page 62 and Figure 34 on page 63 when performing this procedure, but ignore the directional arrow - since you will insert the module into the slot - rather than remove it.
2. Revolve the handle outward to lever the module out of its connector on the base-plane. Figure 36. Removing a disk drive module (2 of 2) 3. Lift and remove the module fully from the drive slot. 64 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Installing a drive carrier module Procedure 1. Release the drive carrier handle by pressing the latch in the carrier handle towards the handle hinge to release the carrier handle as shown in the figure below. Figure 37. Drive carrier module in open position 2.
• Check Module Fault LED – rear (front of enclosure): Amber = Fault condition. • Check Fault LED (back of enclosure on IOM face plate): Amber = Fault condition. 66 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
• Check that the OK LED (back of enclosure) is off. Stopping I/O When troubleshooting disk drive and connectivity faults, stop I/O to the affected disk groups from all hosts as a data protection precaution. As an additional data protection precaution, it is helpful to conduct regularly scheduled backups of your data.
See CAUTION bullets regarding electrostatic discharge and anti-static protection in the “ESD precautions” on page 55 section. CAUTION: If passive copper cables are connected, the cable must not have a connection to a common ground/earth point. 68 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Note: When performing the following procedure, refer to Figure 41 on page 68 and Figure 40 on page 68 while ignoring the directional arrow. For installation, the IOM will travel in the opposite direction relative to the arrow shown. Procedure 1.
Page 90
70 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 92
• Z-axis length: 211.1 mm (8.3 in) Maximum output power 2000 W Voltage range 200–240 VAC rated Frequency 50–60 Hz Voltage range selection Auto-ranging: 90–264 VAC, 47–63 Hz 72 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Page 93
Table 27. Power cooling module specifications (continued) Specification Measurement/description Maximum inrush current Power conversion efficiency ³ 94% @ 230 VAC (50% load) Harmonics Meets EN61000-3-2 (EU), EN 31000-3-3 (EU), EN 55024 (EU), KN 24/KN 35 (S. Korea) Output +12V @ 164A, +12V Standby Voltage @3.5A Hot pluggable Switches and LEDs AC power cable connect and one bi-tonal status...
Page 94
74 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...
Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at Copyright and trademark information at www.ibm.com/legal/copytrade.shtml.
This product may not be certified in your country for connection by any means whatsoever to interfaces of public telecommunications networks. Further certification may be required by law prior to making any such connection. Contact an IBM representative or reseller for any questions. Notices 81...
Page 102
82 IBM Cloud Object Storage System: Medium/Large J11/J12 Disk Enclosure Hardware Installation and Maintenance Manual...