Managing pcie adapters for ibm power system l922 9008-22l; ibm power system s922 9009-22a; ibm power system h922 9223-22h; ibm power system s914 9009-41a; ibm power system s924 9009-42a; ibm power system h924 9223-42h; ibm emx0 pcie gen3 i/o expansion dra (226 pages)
Page 1
Power Systems PCIe adapters for the 9080-M9S...
Page 2
Note Before using this information and the product it supports, read the information in “Safety notices” on page v, “Notices” on page 41, the IBM Systems Safety Notices manual, G229-9054, and the IBM Environmental Notices and User Guide, Z125–5823. ®...
Verifying that the hot-plug PCI tools are installed for Linux............... 36 Checking the amount of remaining life in NVMe devices..............37 Notices........................41 Accessibility features for IBM Power Systems servers................42 Privacy policy considerations ........................43 Trademarks..............................43 Electronic emission notices........................43 Class A Notices.............................
Das Produkt ist nicht für den Einsatz an Bildschirmarbeitsplätzen im Sinne § 2 der Bildschirmarbeitsverordnung geeignet. Laser safety information IBM servers can use I/O cards or features that are fiber-optic based and that utilize lasers or LEDs. Laser compliance IBM servers may be installed inside or outside of an IT equipment rack.
Page 6
– For racks with a DC power distribution panel (PDP), connect the customer’s DC power source to the PDP. Ensure that the proper polarity is used when attaching the DC power and DC power return wiring. • Connect any equipment that will be attached to this product to properly wired outlets. •...
Page 7
• Rack-mounted devices are not to be used as shelves or work spaces. Do not place objects on top of rack-mounted devices. In addition, do not lean on rack mounted devices and do not use them to stabilize your body position (for example, when working from a ladder). •...
Page 8
CAUTION: Removing components from the upper positions in the rack cabinet improves rack stability during relocation. Follow these general guidelines whenever you relocate a populated rack cabinet within a room or building. • Reduce the weight of the rack cabinet by removing equipment starting at the top of the rack cabinet.
Page 9
DANGER: Rack-mounted devices are not to be used as shelves or work spaces. Do not place objects on top of rack-mounted devices. In addition, do not lean on rack-mounted devices and do not use them to stabilize your body position (for example, when working from a ladder). Stability hazard: •...
Page 10
DANGER: Multiple power cords. The product might be equipped with multiple AC power cords or multiple DC power cables. To remove all hazardous voltages, disconnect all power cords and power cables. (L003) (L007) CAUTION: A hot surface nearby. (L007) x Power Systems: PCIe adapters for the 9080-M9S...
Page 11
Exchange only with the IBM-approved part. Recycle or discard the battery as instructed by local regulations. In the United States, IBM has a process for the collection of this battery. For information, call 1-800-426-4333. Have the IBM part number for the battery unit available when you call.
Page 12
• LIFT TOOL intended for use to assist, lift, install, remove units (load) up into rack elevations. It is not to be used loaded transporting over major ramps nor as a replacement for such designated tools like pallet jacks, walkies, fork trucks and such related relocation practices. When this is not practicable, specially trained persons or services must be used (for instance, riggers or movers).
Page 13
Freewheeling will cause uneven cable wrapping around winch drum, damage cable, and may cause serious injury. • This TOOL must be maintained correctly for IBM Service personnel to use it. IBM shall inspect condition and verify maintenance history before operation. Personnel reserve the right not to use TOOL if inadequate.
Page 14
xiv Power Systems: PCIe adapters for the 9080-M9S...
PCIe3 6-slot fanout module that you have in your EMX0 PCIe3 expansion drawer. • If you have a CCIN 50CB PCIe3 6-slot fanout module: – You must use one of the following PCIe3 cable adapters: - FC EJ08 (CCIN 2CE2) - FC EJ07 (CCIN 6B52) - FC EJ05 (CCIN 2B1C) –...
Page 16
3. If you are installing a PCIe3 cable adapter, ensure that the target slot is Unassigned in the I/O properties field for the managed server you are working on. 4. If applicable, open the rack door at the rear of the system. 5.
Page 17
“10” on page 5. • If the system power is turned on and if the IBM i operating system controls the slot, continue with step “11” on page 5. • If the system power is turned on and if the Linux operating system controls the slot, continue with step “12”...
Page 18
Stop the system. For instructions, see Stopping a system (www.ibm.com/support/ knowledgecenter/POWER9/p9haj/crustopsys.htm). 8. If you chose to complete this repair with the power off, label and disconnect both UPIC cables from the system control unit as shown in the following figure.
Page 19
Continue with step “13” on page 7. 11. To prepare the system to install a PCIe adapter by using the IBM i operating system, complete the following steps: a) If necessary, start a System Service Tools (SST) session by typing strsst on the command line of the Main Menu and then press Enter.
Page 20
b) Type your service tools user ID and service tools password on the System Service Tools Sign On display, and then press Enter. c) Select Start a service tool > Hardware service manager > Packaging hardware resources (system, frames, cards). d) Type 9 (Hardware contained within package) in the System Unit field or Expansion Unit field of the unit where you are installing the PCIe adapter.
Page 21
• Use the blue identify LED on the enclosure to locate the system. Ensure that the serial number of the system matches the serial number to be serviced. • Look for a flashing amber LED, which identifies the unoccupied slot that was selected by using the identify function.
• When you use an ESD wrist strap, follow all electrical safety procedures. An ESD wrist strap is used for static control. It does not increase or decrease your risk of receiving electric shock when using or working on electrical equipment. •...
Page 23
Figure 6. Removing the PCIe adapter cassette from the 9080-M9S system 5. Remove the side cover from the cassette. a) Press the release button on the side cover and slide the cover in the direction that is shown. b) Lift the side cover off the cassette. Installing PCIe adapters in the 9080-M9S system 9...
Page 24
Figure 7. Removing the side cover from the PCIe adapter cassette for the 9080-M9S system 6. Remove the top cover from the cassette. a) Press the release button on the top cover and slide the cover in the direction that is shown. b) Lift the top cover off the cassette.
Page 25
Figure 8. Removing the top cover from the PCIe adapter cassette for the 9080-M9S system 7. Remove the PCIe tailstock filler from the cassette. a) Pull the tailstock filler away from the cassette in the direction that is shown. b) Save the tailstock filler for a future use. You must have a tailstock filler in an empty PCIe cassette in a system to ensure proper airflow.
Page 26
Figure 9. Removing a tailstock filler from the cassette for the 9080-M9S system 8. Insert the PCIe adapter into the cassette. a) Choose from the following options: • If you do not have PCIe adapter retainers, continue with the next step. •...
Page 27
Figure 10. Opening the PCIe adapter retainers for the 9080-M9S system so you can slide them off and discard them. Note: The PCIe adapter retainers are not needed. b) Press the adapter firmly into its connector as shown in the following figure, ensuring that it is seated.
Page 28
Figure 11. Installing a PCIe adapter in a cassette for the 9080-M9S system Note: Ensure that the adapter is secured in the adapter retainer channel. 9. Replace the top cover on the cassette. a) Lower the top cover on the top of the cassette. b) Slide the top cover in the direction that is shown in the following figure until it latches securely.
Page 29
Figure 12. Replacing the top cover on the PCIe adapter cassette for the 9080-M9S system 10. Replace the side cover on the cassette. a) Place the side cover on the side of the cassette. b) Slide the side cover in the direction that is shown in the following figure until it latches securely. Installing PCIe adapters in the 9080-M9S system 15...
Page 30
Figure 13. Replacing the side cover on the PCIe adapter cassette for the 9080-M9S system 11. Slide the PCIe cassette into the PCIe cassette slot by completing the following steps: Attention: Ensure proper alignment when you insert a PCI adapter cassette into the system. a) Align the cassette on the cassette rail in the cassette slot.
2. If you installed a PCIe3 cable adapter, and want to connect an EMX0 PCIe3 expansion drawer to your system, continue with Connecting an EMX0 PCIe Gen3 I/O expansion drawer to your system (http:// www.ibm.com/support/knowledgecenter/POWER9/p9egp/p9egp_connect_kickoff.htm). If you have an HMC-managed 9040-MR9 or 9080-M9S system, you can connect and activate the expansion drawer cable when the system power is turned on.
Page 32
Figure 15. Placing the cable management bracket in the lowered operating position 6. Close the rack door at the rear of the system. 7. To complete the procedure with the power on, access the ASMI and run the Cable Plugging Validation utility to validate only the UPIC cables.
Page 33
• If you completed the procedure with the system power turned on and used the AIX operating system, continue with step “12” on page 20. • If you completed the procedure with the system power turned on and used the IBM i operating system, continue with step “13” on page 21.
Page 34
4) Lightly pull on the UPIC cable from both attachment points to ensure it is locked into place. Pull the cable connector; do not pull on the wire. The cables should be firmly attached to the system. b) Start the system. For instructions, see Starting a system (www.ibm.com/support/ knowledgecenter/POWER9/p9haj/crustartsys.htm). c) Continue with step “18” on page 21.
Page 35
On the console, enter cfgmgr to configure the adapter. c) Continue with step “18” on page 21. 13. If you are using the IBM i operating system, return to the Hardware Resource Concurrent Maintenance display and select Power on domain.
Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard: • If IBM supplied the power cord(s), connect power to this unit only with the IBM provided power cord. Do not use the IBM provided power cord for any other product.
Updating the worldwide port name for a new 5735 IOA If you exchange a 5735 Fibre Channel input/output adapter (IOA), the IBM external storage subsystem must be updated to use the worldwide port name (WWPN) of the new 5735 IOA. Any SAN hardware that uses the WWPN zoning might also need updating.
The WWPN for the Fibre Channel IOA can be found by using the Hardware Service Manager in SST or DST to display details about the 5735 IOA Logical Hardware Resource information, and use the port worldwide name field. The 16-digit WWPN can also be determined by appending the digits 1000 to the beginning of the 12-digit IEEE address that is found on the tailstock label of the Fibre Channel IO adapter.
Page 39
Figure 18. Removing the low-profile tailstock from a PCIe adapter 3. Detach the tailstock from the PCIe adapter and place the tailstock and the screws on a flat, static- protective surface. 4. If you are removing the tailstock from a 4-Port 10/100/1000 Base-TX PCIe adapter, there is only one screw to remove.
Page 40
Figure 19. Removing SFP transceivers from adapters 6. If necessary, remove the adapter from the antistatic package. Attention: Avoid touching the components and gold connectors on the adapter. Removing the tailstock from a new adapter 7. Ensure that you have the electrostatic discharge (ESD) wrist strap on and that the ESD clip is plugged into a ground jack or connected to an unpainted metal surface.
Page 41
Figure 20. Removing the high-profile tailstock from a new PCIe adapter 9. If the new adapter is a 4-Port 10/100/1000 Base-TX PCIe adapter, see “4” on page 25 for removing the tailstock and then return here. 10. If the new adapter is an Ethernet or Fibre Channel adapter, see “5” on page 25 for removing the tailstock and then return here.
Page 42
Figure 21. Attaching the low-profile tailstock to a PCIe adapter 15. If the new adapter is a 4-Port 10/100/1000 Base-TX PCI Express adapter, first engage the tailstock with the tabs on the card hardware. After the tailstock is attached, secure the tailstock with its screw. 16.
Figure 22. Replacing SFP transceivers in the adapter 17. Put the failed PCIe adapter in the shipping material and return it. What to do next Return to the procedure that sent you here. PCIe hot-plug manager access for AIX Find information about how to service PCIe adapters with the system power on in AIX. The instructions for servicing PCIe adapters with the system power on in AIX refer you to these procedures when it is appropriate to perform them.
Page 44
2. At the command line, type smitty. 3. Select Devices. 4. Select PCI Hot Plug Manager and press Enter. The PCI Hot-Plug Manager menu displays. For details about the menu options in the PCI Hot-Plug Manager screen, see “PCI hot-plug manager menu”...
• If you receive a warning indicating that needed device packages are not installed, the system administrator must install the specified packages before you can configure or diagnose the adapter. • If you receive a failure message indicating a hardware error, the problem might be either the adapter or the PCI slot.
Page 46
Procedure 1. Log in to the system unit as root user. 2. Insert the media containing the device driver software (for example, the CD) into the media device. If your system does not have a CD-ROM drive, refer to your system documentation for performing a Network Installation Management (NIM) installation.
• If you are installing a new adapter, ensure that you have the software required to support the new adapter and determine whether there are any existing PTF prerequisites to install. For information about software prerequisites, see the IBM Prerequisite website (http://www-912.ibm.com/e_dir/ eServerPrereq.nsf).
Page 48
c. Finish the adapter installation task in diagmenu. 4. Enter cfgdev to configure the device for the Virtual I/O Server. Results If you are installing a PCIe, Fibre Channel adapter, it is now ready to be attached to a SAN and have LUNs assigned to the Virtual I/O Server for virtualization.
Page 49
If the adapter supports physical volumes that are in use by a client logical partition, then You can perform steps on the client logical partition before unconfiguring the storage adapter. For instructions, see “Preparing the client logical partitions” on page 35. For example, the adapter might be in use because the physical volume was used to create a virtual target device, or it might be part of a volume group used to create a virtual target device.
You do not have redundant Virtual I/O Server Shut down the client logical partition. logical partitions. For systems that are managed by the HMC, see Stopping a system (www.ibm.com/support/ knowledgecenter/POWER9/p9haj/ stopsyshmc.htm). Verifying that the hot-plug PCI tools are installed for Linux Find information about using the hot-plug PCI tools for a PCI adapter installed in a system with a Linux operating system.
Learn how to use operating system commands to find the amount of remaining life in an NVMe device. Using the operating system commands The AIX, IBM i, and Linux operating systems have commands that you can use to determine the amount of life that is remaining in an NVMe device.
Page 52
Find information about using the IBM i operating system to find the amount of remaining life in an NVMe device. About this task To find the amount of remaining life in an NVMe device by using the IBM i operating system, complete the steps in this procedure. Procedure 1.
Page 53
Note: Failure of IBM NVMe devices is covered in the standard warranty and during the maintenance period only for devices that have not reached the maximum number of write cycles. Devices that reach this limit might fail to operate according to specifications and must be replaced. This replacement cost is not covered under the standard warranty or during the maintenance period.
Page 54
NVMe device at your earliest convenience. Note: Failure of IBM NVMe devices is covered in the standard warranty and during the maintenance period only for devices that have not reached the maximum number of write cycles. Devices that reach this limit might fail to operate according to specifications and must be replaced.
Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
This product uses standard navigation keys. Interface information The IBM Power Systems servers user interfaces do not have content that flashes 2 - 55 times per second. The IBM Power Systems servers web user interface relies on cascading style sheets to render content properly and to provide a usable experience.
Contact the vendor for accessibility information about its products. Related accessibility information In addition to standard IBM help desk and support websites, IBM has a TTY telephone service for use by deaf or hard of hearing customers to access sales and support services:...
Page 58
Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben. Des Weiteren dürfen auch nur von der IBM empfohlene Kabel angeschlossen werden. IBM übernimmt keine Verantwortung für die Einhaltung der Schutzanforderungen, wenn das Produkt ohne Zustimmung von IBM verändert bzw.
Page 59
Tel: +49 (0) 800 225 5426 email: HalloIBM@de.ibm.com Generelle Informationen: Das Gerät erfüllt die Schutzanforderungen nach EN 55024 und EN 55022 / EN 55032 Klasse A. Japan Electronics and Information Technology Industries Association (JEITA) Notice This statement applies to products less than or equal to 20 A per phase.
Page 60
Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. Proper cables and connectors are available from IBM-authorized dealers. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment.
Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben. Des Weiteren dürfen auch nur von der IBM empfohlene Kabel angeschlossen werden. IBM übernimmt keine Verantwortung für die Einhaltung der Schutzanforderungen, wenn das Produkt ohne Zustimmung von IBM verändert bzw.
Page 62
Japan Electronics and Information Technology Industries Association (JEITA) Notice This statement applies to products less than or equal to 20 A per phase. This statement applies to products greater than 20 A, single phase. This statement applies to products greater than 20 A per phase, three-phase. Japan Voluntary Control Council for Interference (VCCI) Notice Taiwan Notice United States Federal Communications Commission (FCC) Notice...
Permissions for the use of these publications are granted subject to the following terms and conditions. Applicability: These terms and conditions are in addition to any terms of use for the IBM website. Personal Use: You may reproduce these publications for your personal, noncommercial use provided that all proprietary notices are preserved.
Page 64
50 Power Systems: PCIe adapters for the 9080-M9S...