HX1521 series servers. The best practice is to use three or more servers of the same machine type and configuration to provide a balanced and high-performance solution. In addition, the server is designed to utilize the Lenovo system management tools to create a unified hardware management solution for Nutanix deployments: •...
Helpful links You might find the following links helpful: Warranty lookup Lenovo open source projects Lenovo ServerProven Lenovo product guides (Lenovo Press) Lenovo Configuration and Options ThinkAgile HX Best Recipes Guide Lenovo Support Lenovo forums Drivers and Firmware Updates Best...
ThinkAgile HX1521-R. The systems are connected through switches for management and data: • A dedicated management network is used by the Lenovo XClarity Administrator to communicate with the Lenovo XClarity Controller (XCC) on each of the ThinkAgile HX Series servers.
Identifying your server When you contact Lenovo for help, the machine type and serial number information helps support technicians to identify your server and provide faster service. The machine type and serial number are on the ID label on the right rack latch in the front of the server.
Page 9
• Scalable up to 28 cores • Thermal Design Power (TDP): up to 205 watts For a list of supported processors, see: • ThinkAgile HX3521-G https://lenovopress.com/lp0728-lenovo-thinkagile-hx3320-hx3520-g-hx3720- appliances • ThinkAgile HX5521, ThinkAgile HX5521-C, and ThinkAgile HX1521-R https://lenovopress.com/lp0729-lenovo-thinkagile-hx5520-hx5520-c-appliances https://lenovopress.com/lp0726-lenovo-thinkagile-hx1320-hx1520-r-appliances • ThinkAgile HX7521 https://lenovopress.com/lp0730-lenovo-thinkagile-hx7520-appliance Note: DIMM •...
Page 10
GPUs, 1600-watt power supplies installed Host bus adapters The following host bus adapters are supported: • Lenovo ThinkSystem 430-8i SAS/SATA 12Gb HBA • Lenovo ThinkSystem 430-16i SAS/SATA 12Gb HBA System fans • One processor: five hot-swap fans (including one redundant fan) •...
Page 11
Table 1. Server specifications (continued) Specification Description Electrical input • Sine-wave input (50 Hz to 60 Hz) required • Input voltage low range: – Minimum: 100 V ac – Maximum: 127 V ac • Input voltage high range: – Minimum: 200 V ac –...
Configuration settings (such as local storage, I/O adapters, boot settings, firmware, ports, and Lenovo XClarity Controller and UEFI settings) are saved as a server pattern that can be applied to one or more managed servers. When the server patterns are updated, the changes are automatically deployed to the applied servers.
Page 13
Documentation for Lenovo XClarity Administrator is available at: http://sysmgt.lenovofiles.com/help/index.jsp?topic=%2Fcom.lenovo.lxca.doc%2Faug_product_page.html Lenovo XClarity Integrator Lenovo also provides the following integrators that you can use to manage Lenovo servers from higher-level management tools: • Lenovo XClarity Integrator for VMware vCenter • Lenovo XClarity Integrator Microsoft System Center For more information about Lenovo XClarity Integrator, see: https://www3.lenovo.com/us/en/data-center/software/systems-management/xclarity-integrators...
Page 16
Figure 5. Front view of the ThinkAgile HX7521 Table 2. Components on the front of server Callout Callout Pull-out information tab Front I/O assembly Rack latch (right) Drive bays Rack latch (left) VGA connector (available on some models) Drive activity LED Drive status LED Drive bay filler Pull-out information tab...
Each hot-swap drive has two LEDs. Drive LED Status Description Drive activity LED Solid green The drive is powered but not active. Blinking green The drive is active. Drive status LED Solid yellow The drive has an error. Blinking yellow (blinking slowly, about one The drive is being rebuilt.
Page 18
Each time you press the system ID button, the state of both the system ID LEDs changes. The LEDs can be changed to on, blinking, or off. You can also use the Lenovo XClarity Controller or a remote management program to change the state of the system ID LEDs to assist in visually locating the server among other servers.
If the XClarity Controller USB connector is set to have both the USB 2.0 function and XClarity Controller management function, you can press the system ID button for three seconds to switch between the two functions. System error LED The system error LED provides basic diagnostic functions for your server. If the system error LED is lit, one or more LEDs elsewhere in the server might also be lit to direct you to the source of the error.
Page 20
The hot-swap redundant power supplies help you avoid significant interruption to the operation of the system when a power supply fails. You can purchase a power supply option from Lenovo and install the power supply to provide power redundancy without turning off the server.
• Observe the following PCIe slot selection priority when installing an Ethernet adapter or a converged network adapter: Number of installed processors PCIe slot selection priority One processor 4, 2, 3, 1 Two processors 4, 2, 6, 3, 5, 1 PCIe slots 1, 2, and 3 on riser 1: There are four different riser cards that can be installed in riser 1.
Page 22
Each time you press the system ID button, the state of both the system ID LEDs changes. The LEDs can be changed to on, blinking, or off. You can also use the Lenovo XClarity Controller or a remote management program to change the state of the system ID LEDs to assist in visually locating the server among other servers.
Page 23
Each hot-swap power supply has three status LEDs. Description Power input LED • Green: The power supply is connected to the ac power source. • Off: The power supply is disconnected from the ac power source or a power problem occurs.
System board components The illustration in this section shows the component locations on the system board. Figure 9. System board components Table 6. Components on the system board Callout Callout Riser 2 slot Serial-port-module connector PCIe slot 4 RAID adapter slot Riser 1 slot BIOS ROM programming connector LOM adapter connector...
Table 6. Components on the system board (continued) Callout Callout System fan 5 connector System fan 6 connector Backplane power connector 1 NVMe 2–3 connector NVMe 0–1 connector GPU power connector 1 CMOS battery M.2 module slot (SATA / PCIe slot 8) Notes: •...
Page 26
Each time you press the system ID button, the state of both the system ID LEDs changes. The LEDs can be changed to on, blinking, or off. You can also use the Lenovo XClarity Controller or a remote management program to change the state of the system ID LEDs to assist in visually locating the server among other servers.
Use the parts list to identify each of the components that are available for your server. For more information about ordering the parts shown in Figure 11 “Server components” on page 24: • ThinkAgile HX3521-G https://datacentersupport.lenovo.com/us/en/products/solutions-and-software/thinkagile-hx/hx3520-g/7x84/ parts • ThinkAgile HX5521 https://datacentersupport.lenovo.com/us/en/products/solutions-and-software/thinkagile-hx/hx5520/7x84/...
Page 28
Tier 1 CRU at your request with no service agreement, you will be charged for the installation. • Tier 2 customer replaceable unit: You may install a Tier 2 CRU yourself or request Lenovo to install it, at no additional charge, under the type of warranty service that is designated for your server.
Index Tier 1 CRU Tier 2 CRU Structural parts For more information about ordering the parts shown in Figure 11 “Server components” on page 24: • ThinkAgile HX3521-G https://datacentersupport.lenovo.com/us/en/products/solutions-and-software/thinkagile-hx/hx3520-g/7x84/parts • ThinkAgile HX5521 https://datacentersupport.lenovo.com/us/en/products/solutions-and-software/thinkagile-hx/hx5520/7x84/parts • ThinkAgile HX7521 https://datacentersupport.lenovo.com/us/en/products/solutions-and-software/thinkagile-hx/hx7520/7x84/parts Top cover √...
Page 30
Table 8. Parts listing (continued) Consumable Description Index Tier 1 CRU Tier 2 CRU Structural parts Front I/O assembly, server models with √ eight 3.5-inch drive bays Front I/O assembly, server models with √ eight or sixteen 2.5-inch drive bays Filler, 3.5-inch drive √...
1. Go to: http://dcsc.lenovo.com/#/ 2. Click Software Defined Infrastructure. 3. Under Lenovo ThinkAgile HX Series, click Learn more. 4. Choose the appropriate series and click Customize. 5. Select the model type and click Customize. 6. Click Line Cord to view a list of supported power cords.
For more information, see Chapter 5 “Installing and configuring a cluster on ThinkAgile HX Series servers” on page 35. 4. Connect the Lenovo XClarity Controller to the management network. See “Set the network connection for the Lenovo XClarity Controller” on page 33.
Note: Items marked with asterisk (*) are available on some models only. Server Rail kit*. Detailed instructions for installing the rail kit are provided in the package with the rail kit. Cable management arm* Material box, including items such as accessory kit, power cords* and documentation Cable the server Attach all external cables to the server.
Power off the server The server remains in a standby state when it is connected to a power source, allowing the Lenovo XClarity Controller to respond to remote power-on requests. To remove all power from the server (power status LED off), you must disconnect all power cables.
Page 38
(once every couple of seconds). To connect using the Lenovo XClarity Administrator Mobile app: 1. Connect the USB cable of your mobile device to the Lenovo XClarity Administrator USB connector on the front panel. 2. On your mobile device, enable USB tethering.
• All ThinkAgile HX Series servers must be connected to a network that is reachable from the host where the Foundation tool is running. Note: This includes both the Lenovo XClarity Controller connections, as well as the data connections (10Gb, 25Gb, etc.) •...
Deploying Lenovo XClarity Administrator Use this information to deploy Lenovo XClarity Administrator Before you begin, make sure that you download the Lenovo XClarity Administrator from Lenovo. Refer to the ThinkAgile HX Series Best Recipe to determine the correct version to be downloaded.
Page 42
Information about managing servers from Lenovo XClarity Administrator is available at: http://sysmgt.lenovofiles.com/help/topic/com.lenovo.lxca.doc/server_manage.html Step 4. Optionally, add the rack to Lenovo XClarity Administrator that manages ThinkAgile HX 1521-R, HX3521-G, HX5521, HX5521-C, HX7521 Certified Node servers. Information about adding rack views to Lenovo XClarity Administrator is available at: http://sysmgt.lenovofiles.com/help/topic/com.lenovo.lxca.doc/racks_manage.html...
HX5521-C, HX7521 Certified Node servers using the ESXi hypervisor. Lenovo XClarity Integrator for VMware vCenter expands the management capabilities of VMware vCenter by integrating Lenovo hardware management functionality. Lenovo XClarity Integrator is used to perform the following functions for the ThinkAgile HX 1521-R, HX3521- G, HX5521, HX5521-C, HX7521 Certified Node cluster: • Deployment •...
Page 44
Configure Lenovo XClarity Integrator and Lenovo XClarity Administrator. Note: Make sure that you connect to VMware vCenter Server Appliance using port 9443 when you are working with Lenovo XClarity Integrator. Information about configuring Lenovo XClarity Integrator is available at: http://sysmgt.lenovofiles.com/help/topic/com.lenovo.lxci_vcenter.doc/vcenter_install_config_lxci.html Step 4.
Important: Some cluster solutions require specific code levels or coordinated code updates. If the component is part of a cluster solution, verify that the latest level of code is supported for the cluster solution before you update the code. • It is good practice to make sure that the server is working correctly before you install an optional component.
• For proper cooling and airflow, refit the server cover before you turn the power on. Do not operate the server for more than 30 minutes with the server cover removed, for it might damage server components. • Cabling instructions that come with optional components must be followed. •...
Page 48
• When handling a device, carefully hold it by the edges or the frame. • Do not touch solder joints, pins, or exposed circuitry. • Keep the device from others’ reach to prevent possible damages. User Guide forThinkAgile HX1521-R Node ThinkAgile HX3521-G NodeThinkAgile HX5521 NodeThinkAgile HX5521-C NodeThinkAgile HX7521 Node...
Hot-swap drive replacement Follow these instructions to replace a front HDD/SSD in the ThinkAgile HX 1521-R, HX3521-G, HX5521, HX5521-C, HX7521 Certified Node server. Each ThinkAgile HX 1521-R, HX3521-G, HX5521, HX5521-C, HX7521 Certified Node appliance supports solid-state-drives (SSDs) and hard-disk-drives (HDDs). As user data are striped across these drives, they are referred to as data drives.
Page 50
Figure 12. Opening the drive tray handle of a 2.5-inch hot-swap drive Figure 13. Opening the drive tray handle of a 3.5-inch hot-swap drive Grasp the handle and slide the drive out of the drive bay. User Guide forThinkAgile HX1521-R Node ThinkAgile HX3521-G NodeThinkAgile HX5521 NodeThinkAgile HX5521-C NodeThinkAgile HX7521 Node...
Figure 14. 2.5-inch hot-swap drive removal Figure 15. 3.5-inch hot-swap drive removal After removing a hot-swap drive: 1. Install the drive filler or a new drive to cover the drive bay. See “Install a hot-swap drive” on page 47. 2. If you are instructed to return the old hot-swap drive, follow all packaging instructions and use any packaging materials that are provided.
Page 52
Before installing a hot-swap drive: 1. If the drive bay has a drive filler installed, pinch the two tabs to remove the drive filler. Keep the drive filler in a safe place. Figure 16. 2.5-inch drive filler removal Figure 17. 3.5-inch drive filler removal 2.
Page 53
Figure 18. 2.5-inch hot-swap drive installation Figure 19. 3.5-inch hot-swap drive installation Ensure that the drive tray handle is in the open position. Slide the drive into the drive bay until it snaps into position. Close the drive tray handle to lock the drive in place. Step 2.
• The Nutanix Prism Web console shows a power supply alert. • Amber warning LED on node front panel is illuminated. • The Lenovo XClarity Controller Web interface shows a power supply alert. • The Lenovo XClarity Administrator Web console shows a power supply alert.
Page 55
S035 CAUTION: Never remove the cover on a power supply or any part that has this label attached. Hazardous voltage, current, and energy levels are present inside any component that has this label attached. There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician.
Page 56
To Connect: To Disconnect: 1. Turn everything OFF. 1. Turn everything OFF. 2. First, attach all cables to devices. 2. First, remove power cords from outlet. 3. Attach signal cables to connectors. 3. Remove signal cables from connectors. 4. Attach power cords to outlet. 4.
Page 57
S019 CAUTION: The power-control button on the device does not turn off the electrical current supplied to the device. The device also might have more than one connection to dc power. To remove all electrical current from the device, ensure that all connections to dc power are disconnected at the dc power input terminals.
Page 58
To remove a hot-swap power supply, complete the following steps: Step 1. If the server is in a rack, adjust the cable management arm (CMA) to gain access to the power supply bay. If you have installed the 2U CMA Upgrade Kit for Toolless Slide Rail or Toolless Slide Rail Kit with 2U CMA, do the following: Figure 21.
Step 3. Press the release tab toward the handle and carefully pull the handle at the same time to slide the hot-swap power supply out of the chassis. Note: Slightly pull the power supply upwards when sliding the power supply out of the chassis, if you have installed one of the following CMA kits: •...
Page 60
• Ensure that the devices that you are installing are supported. For a list of supported optional devices for the server, go to: http://www.lenovo.com/us/en/serverproven/ Notes: • Ensure that the two power supplies installed on the server have the same wattage.
Page 61
DANGER Electrical current from power, telephone, and communication cables is hazardous. To avoid a shock hazard: • Do not connect or disconnect any cables or perform installation, maintenance, or reconfiguration of this product during an electrical storm. • Connect all power cords to a properly wired and grounded electrical outlet. •...
Page 62
S035 CAUTION: Never remove the cover on a power supply or any part that has this label attached. Hazardous voltage, current, and energy levels are present inside any component that has this label attached. There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician.
Page 63
To Connect: To Disconnect: 1. Turn OFF all power sources and equipment that is to 1. Turn OFF all power sources and equipment that is to be attached to this product. be attached to this product. 2. Attach signal cables to the product. •...
Page 64
Step 1. If the server is in a rack, adjust the cable management arm (CMA) to gain access to the power supply bay. If you have installed the 2U CMA Upgrade Kit for Toolless Slide Rail or Toolless Slide Rail Kit with 2U CMA, do the following: Figure 24.
• The Nutanix Prism Web console shows a system fan alert. • Amber warning LED on node front panel is illuminated. • The Lenovo XClarity Controller Web interface shows a system fan alert. • The Lenovo XClarity Administrator Web console shows a system fan alert.
Remove a system fan Use this information to remove a system fan. You can remove a hot-swap fan without powering off the server, which helps you avoid significant interruption to the operation of the system. “Read the “ATTENTION: installation Static Sensitive Device Guidelines”...
Page 67
3. View the fan error LEDs to locate the failing system fan. Figure 27. Viewing the fan error LEDs from the top of the system fans To remove a system fan, complete the following steps: Figure 28. System fan removal Step 1.
After removing the system fan: 1. Install a new system fan or install a fan filler to cover the place. See “Install a system fan” on page 64. 2. If you are instructed to return the old system fan, follow all packaging instructions and use any packaging materials that are provided.
• The error LED for the replaced system fan is off. • Amber warning LED on node front panel is off. • No error is shown in the Lenovo XClarity Controller Web interface. • No error is shown in the Lenovo XClarity Administrator Web console.
Figure 30. HBA removal Step 1. Slide the left-side latch to the unlocked position. Step 2. Push and hold the right-side latch in the direction as shown. Step 3. Grasp the HBA by its edges and carefully remove it from the RAID adapter slot on the system board.
– If the LSI HBA card is not present, ensure the card is properly connected. If the card is still not detected, contact Lenovo Support. – If the system fails to boot from the boot drive after replacing the HBA, verify the option ROM is turned off for the HBA adapter.
• No LED is illuminated for the network interface. • Guest VM performance degrades. • Guest VMs, the vSphere Web console, and nCLIi are unavailable. • VM migration fails with an error message, such as: The migration was cancelled because the amount of changing memory for the VM was greater than the available network bandwidth Remove the LOM adapter Use this information to remove the LOM adapter.
Step 1. Remove the LOM-adapter air baffle by pinching the tab and then lifting the air baffle out of the server. Step 2. Loosen the thumbscrew that secures the LOM adapter. Step 3. Push the LOM adapter out of the connector on the system board. Step 4.
Step 5. Align the mounting stud on the chassis with the hole in the LOM-adapter air baffle. Then, pinch the and lower the LOM-adapter air baffle onto the LOM adapter. After installing the LOM adapter: 1. Replace the top cover. 2.
Page 76
Before removing a PCIe adapter from the riser assembly: 1. ThinkAgile HX 1521-R, HX3521-G, HX5521, HX5521-C, HX7521 Certified Node appliances can contain zero or one LOM NIC, with two or four ports, as well as up to two PCIe NICs. For nodes with multiple NICs, verify which has failed.
Step 2. Grasp the PCIe adapter by its edges and carefully pull it out of the PCIe slot. Note: The PCIe adapter might fit tightly into the PCIe slot. If necessary, alternatively move each side of the PCIe adapter a small and equal amount until it is removed from the slot. Figure 35.
Page 78
Step 1. Align the PCIe adapter with the PCIe slot on the riser card. Then, carefully press the PCIe adapter straight into the slot until it is securely seated and its bracket also is secured. Figure 36. PCIe adapter installation Note: Carefully handle the PCIe adapter by its edges.
• The Nutanix Prism Web console shows a memory error. • A post error on boot. • An error in the Lenovo XClarity Controller interface. • Not all memory is detected. For example, the appliance should have 256 GB per node and the host only...
Page 80
– Handle DIMMs with care: never bend, twist, or drop a DIMM. Before removing a DIMM: 1. Identify the failed DIMM by either checking the event logs in UEFI setup or use the Lenovo XClarity Controller Web console to browse the post event log. The event log contains information about the location of the DIMM fault.
– 3 TB using 3DS RDIMMs (two processors installed and one 128 GB 3DS RDIMM installed in each of the 24 DIMM slots) For a list of supported DIMM options, see: http://static.lenovo.com/us/en/serverproven/index.shtml Before installing a DIMM, ensure that all DIMMs to be installed must be the same type. Your server supports the following types of DIMMs: •...
Page 82
DIMM to be installed in slot 8 to slot 1. • If there are ten identical DIMMs to be installed for CPU1, and the ten DIMMs have the same Lenovo part number, move the DIMM to be installed in slot 6 to slot 12.
Page 83
• If there are ten identical DIMMs to be installed for CPU1, and the ten DIMMs have the same Lenovo part number, move the DIMM to be installed in slot 6 to slot 12. • If there are ten identical DIMMs to be installed for CPU2, and the ten DIMMs have the same Lenovo part number, move the DIMM to be installed in slot 18 to slot 24.
Page 84
Table 13. Mirroring mode with one processor Total Processor 1 Total DIMMs DIMMs The following table shows the DIMM population sequence for mirroring mode when two processors (CPU1 and CPU2) are installed. Table 14. Mirroring mode with two processors Total Processor 2 Processor 1 Total...
• If the rank of installed DIMMs is one rank, follow the installation rules listed in the following tables. If the rank of installed DIMMs is more than one rank, follow the installation rules of independent mode. The following table shows the DIMM population sequence for rank sparing mode when only one processor (CPU1) is installed.
Page 86
• DIMMs are sensitive to static discharge and require special handling. In addition to the standard guidelines for Handling static-sensitive devices: – Always wear an electrostatic-discharge strap when removing or installing DIMMs. Electrostatic- discharge gloves can also be used. – Never hold two or more DIMMs together so that they touch. Do not stack DIMMs directly on top of each other during storage.
• No errors are displayed in the Lenovo XClarity Integrator M.2 backplane and M.2 drive replacement An assembled M.2 backplane and M.2 drive is also known as M.2 module. Lenovo support may ask that the M.2 module or M.2 backplane and M.2 drive be replaced.
Page 88
Step 1. Grasp the M.2 backplane at both ends and pull it straight up to remove it from the system board. Figure 41. M.2 backplane removal User Guide forThinkAgile HX1521-R Node ThinkAgile HX3521-G NodeThinkAgile HX5521 NodeThinkAgile HX5521-C NodeThinkAgile HX7521 Node...
Step 2. Remove the M.2 drive from the M.2 backplane by doing the following: Figure 42. M.2 drive removal Press both sides of the retainer Slide the retainer backward to loosen the M.2 drive from the M.2 backplane. Note: If the M.2 backplane has two M.2 drives, they will both release outward when you slide the retainer backward.
Figure 43. M.2 retainer adjustment Step 1. Press both sides of the retainer Step 2. Move the retainer forward until it is in the large opening of the keyhole. Step 3. Take the retainer out of the keyhole. Step 4. Insert the retainer into the correct keyhole.
Page 91
Figure 44. M.2 drive installation Step 1. Insert the M.2 drive at an angle of approximately 30 degrees into the connector. Note: If your M.2 backplane supports two M.2 drives, insert the M.2 drives into the connectors at both sides. Step 2.
Page 92
3. Install the node back into the rack and reconnect all cables. 4. Power on the node. 5. Exit maintenance mode. 6. Use the Lenovo XClarity Provisioning Manager to configure the RAID. For more information, see: http://sysmgt.lenovofiles.com/help/topic/LXPM/RAID_setup.html 7. Verify that the M.2 module is replaced successfully: •...
Page 94
Additional information about using Lenovo XClarity Provisioning Manager to update firmware is available http://sysmgt.lenovofiles.com/help/index.jsp?topic=%2FLXPM%2Fplatform_update.html • Lenovo XClarity Controller If you need to install a specific update, you can use the Lenovo XClarity Controller interface for a specific server. Notes: – To perform an in-band update through Windows or Linux, the operating system driver must be installed and the Ethernet-over-USB (sometimes called LAN over USB) interface must be enabled.
Page 95
Lenovo XClarity Administrator monitors changes to the inventory for those endpoints and flags any endpoints that are out of compliance. Specific details about updating firmware using Lenovo XClarity Administrator are available at: http://sysmgt.lenovofiles.com/help/index.jsp?topic=%2Fcom.lenovo.lxca.doc%2Fupdate_fw.html Chapter 9 Updating firmware...
2. From the DCA drop-down list, click Enable. Set Power/Performance Bias To set the power/performance biasA: 1. From the Lenovo XClarity Provisioning Manager , click UEFI Settings ➙ System Settings ➙ Power. 2. From the Power/Performance Bias drop-down list, click Max Performance. Modify the Operating Mode To modify the Operating Mode: 1.
Page 98
Configure Boot Order 1. From the Lenovo XClarity Provisioning Manager , click UEFI Settings ➙ Boot Manager. 2. Click Change Boot Order.. 3. Set the order to: a. CD/DVD Rom b. Hard Disk 0 c. Network User Guide forThinkAgile HX1521-R Node ThinkAgile HX3521-G NodeThinkAgile HX5521 NodeThinkAgile HX5521-C...
Appendix B. Getting help and technical assistance If you need help, service, or technical assistance or just want more information about Lenovo products use the Lenovo Support Plan for ThinkAgile HX. Details for the ThinkAgile HX Support Plan are available at the following site: https://datacentersupport.lenovo.com/us/en/products/solutions-and-software/thinkagile-hx/hx1520-r/7x84/...
Page 104
rear view static-sensitive devices rear view LED handling removing system board components DIMM system board LED hot-swap drive system error LED 13, 21 hot-swap power supply system fan LOM adapter installing M.2 backplane and M.2 drive removing RAID adapter replacing system fan system ID button replacing...