Page 1
ThinkSystem SD650 Dual Node DWC Tray and NeXtScale n1200 DWC Enclosure Setup Guide Machine Type: 7X58 and 5468...
Page 2
(PDU) or Uninterruptible Power Supply (UPS) supplying a maximum 20 A branch circuit protection. The overall system/rack connection to mains power is to be a Pluggable Type B connector. In addition, be sure that you are familiar with the terms and conditions of the Lenovo warranty for your solution, which can be found at: http://datacentersupport.lenovo.com/warrantylookup...
Page 6
For more information on TPM configurations, see “Enable TPM/TCM” in the Maintenance Manual. Note: For customers in the People’s Republic of China, a Lenovo-qualified TPM 2.0 adapter or a Trusted Cryptographic Module (TCM) adapter (sometimes called a daughter card) may be pre-installed.
The solution provides a QR code on the system service label, which is on the cover of the solution, that you can scan using a QR code reader and scanner with a mobile device to get quick access to the Lenovo Service Information website.
Page 8
Table 1. Enclosure specifications (continued) Specification Description Acoustical noise emissions Note: The following readings are worst case for the air cooling. The water cooling results would be significantly less. • Operation: 7.0 bels • Idle: 6.5 bels Heat output Approximate heat output: •...
Page 9
Tray specifications Table 2. Tray specifications Specification Description Size Tray • Height: 41.0 mm (1.6 inches) • Depth: 742.0 mm (29.2 inches) • Width: 438.0 mm (17.25 inches) • Weight estimation: 17.2 kg (38 lb) Environment The SD650 tray complies with ASHRAE class A2 specifications. The SD650 tray is supported in the following environment: •...
Page 10
1. Use the Setup utility to determine the type and speed of the processors in the node. 2. For a list of supported processors, see http://www.lenovo.com/us/en/ serverproven/ 3. With certain processors installed, if UEFI Boot Mode is set to Legacy then PXE Boot from the onboard Gigabit Ethernet port may not work as expected and is not supported.
The following enclosure requirements are mandatory if you are upgrading existing NeXtScale nx360 M5 to ThinkSystem SD650. Attention: Only Lenovo Professional Service - Data Center Services is allowed to perform the upgrading task. • Update all firmware to the latest level •...
Page 12
UEFI updates only. Firmware updates for optional devices, such as adapters, are not supported. 4. The server UEFI settings for option ROM must be set to Auto or UEFI to update firmware using Lenovo XClarity Administrator or Lenovo XClarity Essentials.
Page 13
Configuration settings (such as local storage, I/O adapters, boot settings, firmware, ports, and Lenovo XClarity Controller and UEFI settings) are saved as a server pattern that can be applied to one or more managed servers. When the server patterns are updated, the changes are automatically deployed to the applied servers.
Page 14
Windows, Linux, or VMware ESXi operating systems and associated device drivers. Note: When you start a server and press F1, the Lenovo XClarity Provisioning Manager interface is displayed by default. However, the text-based interface to system configuration (the Setup Utility) is also available.
Page 15
• Cloning. Use this function to clone settings in one server to other similarly configured Lenovo servers. – Export: Export UEFI, RAID, and BMC settings for the current server to files respectively and save the files to a USB storage drive or a shared network folder.
Page 16
Lenovo XClarity Controller Lenovo XClarity Controller is the management processor for the server. It is the third generation of the Integrated Management Module (IMM) service processor that consolidates the service processor functionality, super I/O, video controller, and remote presence capabilities into a single chip on the server system board.
Page 17
Lenovo Business Vantage Lenovo Business Vantage is a security software tool suite designed to work with the Trusted Cryptographic Module (TCM) adapter for enhanced security, to keep user data safe, and to erase confidential data completely from a hard disk drive.
Use the information in this section to learn about each of the components associated with your solution. Identifying your component When you contact Lenovo for help, the machine type, model, and serial number information helps support technicians to identify your components and provide faster service.
Page 20
Network access tag The Lenovo XClarity Controller network access information for both nodes can be found on the pull out information tag located at the front of the tray. You can use the information on the pull out tag to access the XCC MAC address and LLA for each node.
Figure 5. Network access information on the pull out tag Front view The following illustration shows the controls, LEDs, and connectors on the front of the solution. Enclosure Note: The illustrations in this document might differ slightly from your hardware. The enclosure supports up to six trays.
Table 6. Tray indicators, controls, and connectors Left node (odd bay numbers) Identification LED Right node (even bay numbers) Power button/LED Dedicated LAN RJ45 port for Lenovo XClarity Controller Ethernet RJ45 port with share-NIC feature to access access Lenovo XClarity Controller USB 3.0 connector...
(Ethernet) port to the management network. Power supplies The NeXtScale n1200 DWC Enclosure Type 5468 supports six autoranging power supplies. The power supplies get electrical power from a 200 - 240 V ac power source and convert the ac input into 12 V outputs.
Page 24
You have to install all of the six power supplies regardless of the type of power supply, the enclosure power load, or selected enclosurepower policy. The NeXtScale n1200 DWC Enclosure Type 5468 does not support mixing of low input voltage power supplies with high input voltage power supplies. For example, if you install a power supply with an input voltage of 100 - 127 V ac in a enclosure that is powered by 200 - 240 V ac power supplies, the 100 - 127 V power supply will not power on.
Power supply error LED (yellow): When this LED is lit (yellow), it indicates that there is a fault with the power supply. Note: Before unplugging the ac power cord from the power supply, or removing the power supply from the enclosure, verify that the capacity of the remaining power supplies are sufficient to meet the minimum power requirements for all components in the enclosure.
For more information about ordering the parts shown in Figure 14 “Enclosure components” on page 22: 1. Go to and navigate to the support page for your solution. http://datacentersupport.lenovo.com 2. Click Service Parts. 3. Enter the serial number to view a listing of parts for your solution.
Page 27
Tier 1 CRU at your request with no service agreement, you will be charged for the installation. – Tier 2 customer replaceable unit: You may install a Tier 2 CRU yourself or request Lenovo to install it, at no additional charge, under the type of warranty service that is designated for your solution.
Page 29
For more information about ordering the parts shown in Figure 15 “DWC tray components” on page 24: 1. Go to and navigate to the support page for your solution. http://datacentersupport.lenovo.com 2. Click Service Parts. 3. Enter the serial number to view a listing of parts for your solution.
Page 30
For more information about ordering the parts shown in Figure 15 “DWC tray components” on page 24: 1. Go to and navigate to the support page for your solution. http://datacentersupport.lenovo.com 2. Click Service Parts. 3. Enter the serial number to view a listing of parts for your solution.
Several power cords are available, depending on the country and region where the solution is installed. To view the power cords that are available for the server: 1. Go to: http://dcsc.lenovo.com/#/ 2. Click Preconfigured Model or Configure to order. 3. Enter the machine type and model for your server to display the configurator page.
Validate that the solution hardware was set up successfully. 3. Configure the system. a. Connect the Lenovo XClarity Controller to the management network. See “Set the network connection for the Lenovo XClarity Controller” on page 67. b. Update the firmware for the solution, if necessary. See “Update the firmware” on page 68.
• Make sure the components you are installing are supported by the solution. For a list of supported optional components for the solution, see http://www.lenovo.com/us/en/serverproven/ • When you install a new solution, download and apply the latest firmware. This will help ensure that any known issues are addressed, and that your solution is ready to work with optimal performance.
• Orange on a component or an orange label on or near a component indicates that the component can be hot-swapped if the solution and operating system support hot-swap capability, which means that you can remove or install the component while the solution is still running. (Orange can also indicate touch points on hot-swap components.) See the instructions for removing or installing a specific hot-swap component for any additional procedures that you might have to perform before you remove or install the component.
• Make sure the components you are installing are supported by the solution. For a list of supported optional components for the solution, see http://www.lenovo.com/us/en/serverproven/ • Always download and apply the latest firmware. This will help ensure that any known issues are addressed, and that your solution is ready to work with optimal performance.
Page 37
• To maintain proper system cooling, do not operate the NeXtScale n1200 DWC Enclosure Type 5468 without a DWC tray or tray bay filler installed in each tray bay. • When you remove the DWC tray, note the tray bay number. Reinstalling a DWC tray into a different tray bay from the one it was removed from can have unintended consequences.
Step 3. Once the DWC tray has been serviced, place the tray back into the original position as soon as possible. If you are instructed to return the component or optional device, follow all packaging instructions, and use any packaging materials for shipping that are supplied to you. Remove the tray cover Use this information to remove the tray cover.
Page 39
• “Installation Guidelines” on page 30 2. Turn off the corresponding DWC tray that you are going to perform the task on. 3. Remove the tray (see “Remove a DWC tray from the enclosure” on page 32). 4. Remove the tray cover (see “Remove the tray cover” on page 34). You can find the DIMM tool attached to the air baffle.
Page 40
Figure 19. DIMM cover removal Step 2. Carefully use the DIMM tool to press the retaining clips outward on each end of the DIMM connector. Figure 20. DIMM removal Attention: To avoid breaking the retaining clips or damaging the DIMM connectors, open and close the clips gently.
Figure 21. DIMM removal If you are instructed to return the component or optional device, follow all packaging instructions, and use any packaging materials for shipping that are supplied to you. Remove a drive Use this information to remove a drive. Before you remove a drive: 1.
Page 42
Figure 22. Releasing the drive cage Step 2. Push the release latch forward to release the drive; then, slide the drive out of the drive cage. Figure 23. Drive removal Note: For individuals with large fingers, it may be useful to remove the blank bezel filler to provide more access to drives.
Figure 24. Blank bezel filler removal If you are instructed to return the component or optional device, follow all packaging instructions, and use any packaging materials for shipping that are supplied to you. Remove the M.2 backplane Use this information to remove the M.2 backplane. S001 DANGER Electrical current from power, telephone, and communication cables is hazardous.
To Connect: To Disconnect: 1. Turn everything OFF. 1. Turn everything OFF. 2. First, attach all cables to devices. 2. First, remove power cords from outlet. 3. Attach signal cables to connectors. 3. Remove signal cables from connectors. 4. Attach power cords to outlet. 4.
Page 45
• “Installation Guidelines” on page 30 2. Turn off the corresponding DWC tray that you are going to perform the task on. 3. Remove the tray (see “Install a DWC tray in the enclosure” on page 63). 4. Remove the tray cover (see “Remove the tray cover” on page 34). Complete the following steps to remove an adapter.
Figure 27. PCIe riser-cage assembly removal Step 3. Grasp the adapter by its edges and carefully pull it out of the PCIe riser-cage. Figure 28. Adapter removal If you are instructed to return the component or optional device, follow all packaging instructions, and use any packaging materials for shipping that are supplied to you.
Page 47
3. Remove the tray (see “Install a DWC tray in the enclosure” on page 63). 4. Remove the tray cover (see “Remove the tray cover” on page 34). Complete the following steps to remove an IFT adapter. Watch the procedure. A video of the installation process is available: •...
The following notes describe the types of DIMMs that the node supports and other information that you must consider when you install DIMMs. • Confirm that the node supports the DIMM that you are installing (see http://www.lenovo.com/us/en/ serverproven/ ThinkSystem SD650 Dual Node DWC Tray and NeXtScale n1200 DWC Enclosure Setup Guide...
Page 49
• When you install or remove DIMMs, the node configuration information changes. When you restart the node, the system displays a message that indicates that the memory configuration has changed. You can use the Setup utility to view the node configuration information, see ThinkSystem SD650 Dual Node DWC Tray and NeXtScale n1200 DWC Enclosure Setup Guide for more information.
– aa is the SDRAM speed grade – m is the DIMM type – E = Unbuffered DIMM (UDIMM), x64 primary + 8 bit ECC module data bus – L = Load Reduced DIMM (LRDIMM), x64 primary + 8 bit ECC module data bus –...
Page 52
• Never touch the gold memory module connector contacts or allow these contacts to touch the outside of the memory-module connector housing. • Handle memory modules with care: never bend, twist, or drop a memory module. You can find the DIMM tool attached to the air baffle. Figure 33.
Page 53
Important: Before installing a memory module, make sure that you understand the required installation order, depending on whether you are implementing memory mirroring, memory rank sparing, or independent memory mode. See “Installation order” on page 46 for the required installation order. Step 1.
Page 54
Figure 36. DIMM removal Attention: • DIMMs are static-sensitive devices. The package must be grounded before it is opened. • To avoid breaking the retaining clips or damaging the DIMM connectors, open and close the clips gently. Step 3. Touch the static-protective package that contains the DIMM to any unpainted metal surface on the outside of the node.
Figure 37. DIMM installation Note: If there is a gap between the DIMM and the retaining clips, the DIMM has not been correctly inserted; open the retaining clips, remove the DIMM, and then reinsert it. Step 6. Reinstall the DIMM cover. Figure 38.
Page 56
Dual 32 GB M.2 drives (42 mm long) with RAID backplane Supported Dual 128 GB M.2 drives (80mm long) with RAID Only supported in certain environments. Contact Lenovo backplane Services for additional details. Complete the following steps to install an M.2 drive in the M.2 backplane.
Page 57
• Youtube: https://www.youtube.com/playlist?list=PLYV5R7hVcs-BHNs9o9uS9u93aeU5BCI8I • Youku: http://list.youku.com/albumlist/show/id_51372950.html Step 1. Locate the connector on each side of the M.2 backplane. Notes: • Some M.2 backplanes support two identical M.2 drives. When two drives are installed, align and support both drives when sliding the retainer forward to secure the drives. Step 2.
3. Reinstall the tray (see “Install a DWC tray in the enclosure” on page 63). 4. Check the power LED on each node to make sure it changes from fast blink to slow blink to indicate both nodes are ready to be powered on. Install the M.2 backplane Use this information to install the M.2 backplane.
Figure 41. M.2 backplane installation Step 1. Align the openings located at the bottom of the blue plastic supports at each end of the M.2 backplane with the guide pins on the system board; then, insert the backplane in the system board connector.
Page 60
Figure 42. Releasing the drive cage Step 2. Align the drive with drive cage and carefully slide the drive into the drive cage. Figure 43. Drive installation Step 3. Pull the blue retention latch and rotate the drive cage down. Carefully push down on the top of drive cage to make sure it is correctly seated.
1. Reinstall the tray cover (see “Install the tray cover” on page 61). 2. Reinstall the tray (see “Install a DWC tray in the enclosure” on page 63). 3. Check the power LED on each node to make sure it changes from fast blink to slow blink to indicate both nodes are ready to be powered on.
Page 62
Figure 46. PCIe riser-cage assembly installation Slide the retaining clamp underneath the heat pipe; then, rotate the clamp over the heat pipe in the trough. Secure the clamp by inserting and tightening two silver Torx T10 screws. Figure 47. Screws and retaining clamp installation After you install an adapter, complete the following steps: 1.
Install an Internal Faceplate Transition (IFT) adapter Use this information to install an IFT adapter. Before you install an IFT adapter: 1. Read the following section(s) to ensure that you work safely. • “Installation Guidelines” on page 30 Complete the following steps to install an IFT adapter. Watch the procedure.
Page 64
Figure 49. Connector connection Step 3. Align the adapter with the PCIe slot on the riser-cage. Then, carefully press the adapter straight into the slot until it is securely seated. Figure 50. Adapter installation Step 4. Connect the connector; then, align the PCI riser-cage assembly with slots and press the PCI riser- cage assembly firmly into the node.
Figure 51. PCIe riser-cage assembly installation Step 5. Carefully route cables as illustrated. Note: Ensure the IFT cable is routed in the notch and use the cable tie to collect cables. Figure 52. Cable routing After you install an IFT adapter, complete the following steps: 1.
Page 66
• “Installation Guidelines” on page 30 2. Reinstall the blank bezel filler if you have removed it. Figure 53. Blank bezel filler installation Complete the following steps to install the tray cover. Watch the procedure. A video of the installation process is available: •...
• To maintain proper system cooling, do not operate the NeXtScale n1200 DWC Enclosure Type 5468 without a DWC tray or tray bay filler installed in each tray bay. • If you are reinstalling a DWC tray that you removed, you must install it in the same tray bay from which you removed it.
have unintended consequences. If you reinstall the DWC tray into a different tray bay, you might have to reconfigure the DWC nodes in the tray. Step 2. Make sure that the front handles on the DWC tray are in the open position. Step 3.
For information about powering off nodes, see “Power off nodes” on page 65. Power off nodes Each node remains in a standby state when it is connected to a power source, allowing the Lenovo XClarity Controller to respond to remote power-on requests.
The following methods are available to set the network connection for the Lenovo XClarity Controller if you are not using DHCP: • If a monitor is attached to the server, you can use Lenovo XClarity Controller to set the network connection.
Machine-type-specific firmware-only UXSPs are also available. See the following table to determine the best Lenovo tool to use for installing and setting up the firmware: Note: The server UEFI settings for option ROM must be set to Auto or UEFI to update firmware using Lenovo XClarity Administrator or Lenovo XClarity Essentials.
Page 73
The latest firmware can be found at the following site: http://datacentersupport.lenovo.com/products/servers/thinksystem/sd650-dwc-dual-node-tray/7x58/downloads • Lenovo XClarity Provisioning Manager From Lenovo XClarity Provisioning Manager, you can update the Lenovo XClarity Controller firmware, the UEFI firmware, and the Lenovo XClarity Provisioning Manager software. Chapter 4...
Page 74
Additional information about using Lenovo XClarity Provisioning Manager to update firmware is available http://sysmgt.lenovofiles.com/help/topic/LXPM/platform_update.html • Lenovo XClarity Controller If you need to install a specific update, you can use the Lenovo XClarity Controller interface for a specific solution. Notes: – To perform an in-band update through Windows or Linux, the operating system driver must be installed and the Ethernet-over-USB (sometimes called LAN over USB) interface must be enabled.
Several options are available to install and set up the firmware for the server. Important: Do not configure option ROMs to be set to Legacy unless directed to do so by Lenovo Support. This setting prevents UEFI drivers for the slot devices from loading, which can cause negative side effects for Lenovo software, such as Lenovo XClarity Administrator and Lenovo XClarity Essentials OneCLI, and to the Lenovo XClarity Controller.
Several options are available to install an operating system on the solution. • Lenovo XClarity Administrator If you are managing your solution using Lenovo XClarity Administrator, you can use it to deploy operating- system images to up to 28 managed servers concurrently. For more information about using Lenovo XClarity Administrator to deploy operating system images, see: http://sysmgt.lenovofiles.com/help/topic/com.lenovo.lxca.doc/compute_node_image_deployment.html...
Alternatively, you can use the s s a a v v e e command from Lenovo XClarity Essentials OneCLI to create a backup of all configuration settings. For more information about the s s a a v v e e command, see: http://sysmgt.lenovofiles.com/help/topic/toolsctr_cli_lenovo/onecli_r_save_command.html...
• “Displayed system memory less than installed physical memory” on page 76 • “A Lenovo optional device that was just installed does not work.” on page 77 • “Voltage planar fault is displayed in the event log” on page 77...
Page 80
• If a DIMM was disabled by the user or by POST, reseat the DIMM; then, run the Setup utility and enable the DIMM. 4. Run memory diagnostics. When you start a solution and press F1, the Lenovo XClarity Provisioning Manager interface is displayed by default. You can perform memory diagnostics from this interface.
Page 81
8. (Trained technician only) Replace the system board. A Lenovo optional device that was just installed does not work. 1. Make sure that: • The device is supported for the solution (see http://www.lenovo.com/us/en/serverproven/ • You followed the installation instructions that came with the device and the device is installed correctly.
Appendix A. Getting help and technical assistance If you need help, service, or technical assistance or just want more information about Lenovo products, you will find a wide variety of sources available from Lenovo to assist you. On the World Wide Web, up-to-date information about Lenovo systems, optional devices, services, and support are available at: http://datacentersupport.lenovo.com...
Collecting service data To clearly identify the root cause of a solution issue or at the request of Lenovo Support, you might need collect service data that can be used for further analysis. Service data includes information such as event logs and hardware inventory.
• Lenovo XClarity Essentials OneCLI Lenovo XClarity Essentials OneCLI has inventory application to collect service data. It can run both in- band and out-of-band. When running in-band within the host operating system on the solution, OneCLI can collect information about the operating system, such as the operating system event log, in addition to the hardware service data.
Page 88
before you call hardware M.2 backplane software installation service data removal software management options software service and support telephone numbers memory solution setup install solution setup checklist UDIMM solution, front view memory configuration 71–72 static-sensitive devices memory module handling remove support web page, custom memory module installation order System configuration - ThinkSystem SD650 Dual Node...
Page 90
Part Number: SP47A36229 Printed in China (1P) P/N: SP47A36229 *1PSP47A36229*...