Page 1 Design and Deploy a SAP HANA Single-Node Solution Based on Standalone Cisco UCS C460 M4 Rack Servers with SLES for SAP 12 SP1 February 2017 © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 1 of 146...
Page 2: Table Of Contents
Install Emulex OneCommand Manager ......................119 Install the Multipath Driver..........................119 Restore the Multipath Connection ........................119 SLES 11 and 12 Installation: iSCSI ........................121 © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 2 of 146...
Page 3 SAP HANA Hardware Configuration Check Tool Preparation ................. 142 OS Validation ..............................142 Storage Test ..............................142 Example (user = <SID>adm) ..........................145 For More Information ............................146 © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 3 of 146...
Page 4: Prerequisites
9000 Series Switches ◦ Configuration of a Fibre Channel SAN switch that is compatible with the Cisco C880 M4 Server (ideally, a Cisco MDS 9000 Family switch) If you find any procedures that do not work as documented here, please collect as much information as you can and open a case at support.cisco.com:...
Page 5: Architecture Overview
Storage components ◦ This document describes how to use existing customer storage to connect the Cisco C880 M4 to it. Recommended Network Layout Figure 1 shows a possible network configuration for an SAP Business Warehouse (BW) on SAP HANA system running on four hosts (one master, two workers, and one standby) that are connected through an internode network (red).
Page 6 Figure 1. SAP HANA Network Layout Source: SAP HANA TDI Network Guide (SAP_TDI_Network_Guide) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 6 of 146...
Page 7: Disk And File System Layout
Shared volume for storing the HANA executable files /hana/data/<SID>/mnt00[001-999] Data volumes /hana/log/<SID>/mnt00[001-999] Log volumes Figure 2 shows the layout. Figure 2. Disk and File System Layout © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 7 of 146...
Page 8: Configuration Overview: San Environment
Configuration Overview: SAN Environment Figure 3 shows how to connect the Cisco C880 M4 in a SAN environment. The base unit will be delivered with four 16-Gbps Fibre Channel interfaces, which can be used for OS SAN boot and for SAP HANA shared, data, and log volumes.
Page 9: Configuration Overview: Nas Environment
Configuration Overview: NAS Environment Figure 4 shows how to connect the Cisco C880 M4 in an NAS environment. The base unit will be delivered with eight 10 Gigabit Ethernet interfaces, which can be used for SAP HANA shared, data, and log volumes.
Page 10 (see SAP IT Planning for details). ● Cisco Advanced Service offers support to customers to set up an environment that meets all the SAP rules to successfully pass the Hardware Configuration Check Tool test and help ensure a successful project runtime environment.
Page 11: Physical Components Of The Cisco C880 M4 Server
Figure 5 shows the front of the Cisco C880 M4. Figure 5. Cisco C880 M4: Front View of Connectors and System Boards © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 11 of 146...
Page 12 Figure 6 shows the rear of the Cisco C880 M4. Make sure that the power supply units (PSUs) and fans are placed in the slots as shown in this figure. Figure 6. Cisco C880 M4: Rear View of Connectors Figure 7 shows the management board (MMB) connectors on the Cisco C880 M4.
Page 13: Cisco C880 M4 Server Configuration
Set up the IP address for the IMC. Open a new serial connection using putty with the settings shown in Table 1. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 13 of 146...
Page 14: Set The Integrated Management Controller Ip Address
The default HTTP port is 8081. You can change this port if required by entering the following command: Administrator> set http_port 80 © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 14 of 146...
Page 15: Log In To The Web User Interface
Cisco IMC Web User Interface Login Screen Figure 10 shows the system status and health screen that appears after you log in. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 15 of 146...
Page 16: Update The Firmware
MMB session. Now perform the update. Log in to the system MMB through a web browser (Figure 12). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 16 of 146...
Page 17 The web user interface session is disconnected during the firmware update process. For a single MMB configuration, log in to the web user interface again after about 5 minutes. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 17 of 146...
Page 18: Configure The System Intelligent Platform Management Interface
Configure the System Intelligent Platform Management Interface By default, the Intelligent Platform Management Interface (IPMI) is not activated on the Cisco C880 M4 (Figure 14). If you want to use this function, you must enable it by configuring it at the command line interface (CLI).
Page 19 Administrator Password: *** Last login: Tue Aug 2 12:00:37 from 172.25.1.6 Administrator > set bmc user admin admin admin quiet Connection closed. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 19 of 146...
Page 20 LOC_STONITH_Server01 STONITH-Server01 -inf: server01 crm(live)configure# location LOC_STONITH_Server02 STONITH-Server02 -inf: server02 © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 20 of 146...
Page 21: Configure Bios Settings
Configure BIOS Settings Before you configure BIOS settings, you should check for new system firmware. To check for new system firmware, go to http://www.cisco.com/. Choose Support and search for the Cisco C880 M4 (Figure 16). Figure 16. Checking for New Firmware Before you can set up the correct performance BIOS settings, you need to configure console redirection.
Page 22 Select the Video Redirection check box and click the Apply button at the bottom of the page (Figure 18). Figure 18. Selecting Video Redirection Select Mode to configure the memory performance mode (Figure 19). Figure 19. Selecting the Memory Mode © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 22 of 146...
Page 23 Figure 20. Cisco C880 M4: KVM Initial Screen Figure 21. Cisco C880 M4: Selecting the Media Menu © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 23 of 146...
Page 24 Select Power On and set the boot selector to Force Boot into EFI Boot Manager. Then click Apply at the bottom of the page (Figure 23). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 24 of 146...
Page 25 The server boots (Figure 24). Figure 24. Booting the Server After the servers boots, it displays the BIOS menu. Select CPU Configuration. Disable C-State. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 25 of 146...
Page 26 10. Enable Uncore Frequency Override (Figure 25). Figure 25. CPU Configuration (1) 11. Configure other settings as shown in Figures 26 and 27. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 26 of 146...
Page 28 12. Select the Commit Changes and Exit option and press Enter. 13. Press Esc to exit from the menu and return to the Main BIOS menu. 14. Select Memory Configuration (Figure 28). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 28 of 146...
Page 29 15. Select the Commit Changes and Exit option and press Enter. 16. Press Esc to exit from the menu and return to the main BIOS menu. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 29 of 146...
Page 30: C880M4 System Monitoring Via Snmp
SNMP monitoring and how the system can be integrated into Nagios/Check_MK. First of all prepare the system to be able to respond on SNMP requests: Log in on the MMB: © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 30 of 146...
Page 31 Navigate to Network Configuration  SNMP Configuration Figure 29. Set the SNMP community, the Network and the SNMP version. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 31 of 146...
Page 32 SNMPv2-MIB::sysLocation.0 = STRING: Walldorf CISCO 4th. SNMPv2-MIB::sysORLastChange.0 = Timeticks: (5) 0:00:00.05 SNMPv2-MIB::sysORID.1 = OID: SNMP-MPD-MIB::snmpMPDMIBObjects.3.1.1 SNMPv2-MIB::sysORID.2 = OID: SNMP-USER-BASED-SM-MIB::usmMIBCompliance SNMPv2-MIB::sysORID.3 = OID: SNMP-FRAMEWORK-MIB::snmpFrameworkMIBCompliance SNMPv2-MIB::sysORID.4 = OID: SNMPv2-MIB::snmpMIB © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 32 of 146...
Page 33 Figure 31. Configure the SNMP trap destination where traps will be automatically send to. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 33 of 146...
Page 34 Create a hostname for this system and fill in the IP address. Figure 32. Once you select SNMP Appliance a new field with the SNMP Community string appears. Save and go to Services. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 34 of 146...
Page 35 Now the main system parameters are monitored with Check_mk and Nagios. View from Nagios: © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 35 of 146...
Page 36: Iscsi Boot Configuration
(Figure 33). This selection will start the Device Manager. Figure 33. Starting the Device Manager Select LAN Remote Boot Configuration (Figure 34). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 36 of 146...
Page 37 Figure 34. Selecting LAN Remote Boot Configuration Enable the LAN controller BIOS (Figure 35). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 37 of 146...
Page 38 Figure 35. Enabling the LAN Controller BIOS Select Commit Changes and Exit (Figure 36). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 38 of 146...
Page 39: Configure Iscsi Boot
Now you are ready to configure iSCSI boot. Reboot the system. After the system has booted, restart the Device Manager (Figure 37). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 39 of 146...
Page 40 Select iSCSI Configuration (Figure 38). Figure 38. Selecting iSCSI Configuration Define the iSCSI initiator name of the system (Figures 39 and 40). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 40 of 146...
Page 42 Defining the iSCSI Initiator (2) Configure the iSCSI adapter that you will use for the initial system boot (Figures 41 and 42). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 42 of 146...
Page 56: San Boot Configuration
(HBAs) to be used to start the system. ● Before turning on the power to the partition of the Cisco C880 M4, confirm that the SAN storage in which the OS will be stored and the Fibre Channel switch are completely ready.
Page 57: Notes On San Boot System Design
1. Use the Synchronous Versatile Input Module (SVIM) to install the OS and bundled software. 2. Install the multipath driver as required. 3. Following the Fibre Channel cabling diagram created in step 1, connect the Cisco C880 M4 to the SAN storage and Fibre Channel Fibre Channel switch.
Page 58: Configure The San Boot Environment
Start the system (Figure 54). Figure 54. Starting the System When the Cisco logo appears, press any key except the Enter key to display the Boot Manager main page. Select Boot Maintenance Manager (Figure 55). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public.
Page 59 On the Boot Maintenance Manager screen, select Boot Options (Figure 56). Figure 56. Selecting Boot Options On the Boot Options screen, select Add Boot Option (Figure 57). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 59 of 146...
Page 60 On the File Explorer screen, select Fiber Disk Volume (Main). For …/Fiber (connected to WWN, connected to LUN), select Volume(Main); see Figure 58. Figure 58. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 60 of 146...
Page 61 OS. For example, for an RHEL server, select <EFI> and then <redhat> and then grub.efi (Figures 59, 60, and 61). Figure 59. Selecting the Boot File (1) Figure 60. Selecting the Boot File (2) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 61 of 146...
Page 62 On the “Please type in your data” screen, enter <<Boot Option Name (Main)>> (Figure 63). The boot option name should contain five or more characters. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 62 of 146...
Page 63 11. Repeat steps 6 through 10 to set up Boot Option (Sub). 12. On the Boot Maintenance Manager screen, select Boot Options (Figure 65). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 63 of 146...
Page 64 Figure 65. Selecting Boot Options 13. On the Boot Options screen, select Change Boot Order (Figure 66). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 64 of 146...
Page 65 15. On the Change Boot Order screen, press the + key or the - key and set the boot priority as follows (Figure 68): a. Move <<Boot Option Name (Main)>> to the top. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 65 of 146...
Page 66 Figure 69. 17. On the Change Boot Order screen, select Commit Changes and Exit and then press the Enter key (Figure 70). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 66 of 146...
Page 67 18. On the Boot Maintenance Manager screen, select Boot Options. 19. On the Boot Options screen, select Delete Boot Option (Figure 71). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 67 of 146...
Page 68 72). Press the Enter key to delete it (the ID boot option is shown as an entry named HD(….)/). Figure 72. Deleting the ID Boot Option © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 68 of 146...
Page 69 Saving the Changes 22. On the Boot Maintenance Manager screen, select Reset System (Figure 74). Then reboot the system. Figure 74. Selecting Reset System © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 69 of 146...
Page 70 For information about resetting the Fibre Channel card, see the following sections in this document: “Settings on the 8-Gbps Fibre Channel Card” ● “16-Gbps Fibre Channel Card Settings” ● © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 70 of 146...
Page 71: Notes On San Boot System Operation
Fibre Channel port in advance of startup in Rescue mode to prevent operational errors. For details, see the section “Notes on SAN Boot System Installation.” © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 71 of 146...
Page 72: 16-Gbps Fibre Channel Card Settings: Uefi Driver Version 6.11A5 Or Later
16-Gbps Fibre Channel Card Settings: UEFI Driver Version 6.11a5 or Later This section describes the settings on the 16-Gbps Fibre Channel card in the Cisco C880 M4 Server. With these settings, the system starts from a LUN of the SAN storage unit in the Fibre Channel SAN boot environment.
Page 73: Select The Method For Configuring The 16-Gbps Fibre Channel Card
Manager.” Then turn on the power. Start the UEFI shell. The Boot Manager main page appears. Select Device Manager and then press the Enter key (Figure 76). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 73 of 146...
Page 75: Display The Device Manager
MMB web user interface, select Reset to restart the system. Then reenter the settings for the 16- Gbps Fibre Channel card. Display the Device Manager Display the Device Manager screen. Select Device Manager (Figure 78). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 75 of 146...
Page 76: Start The Hba Setup Utility And Select The Hba
Select Port 001:Emulex LPe16002B-M6-F 16Gb 2-port PCIe Fiber Chann. (Figure 79). In the example here, port 0 of the LPE16002B-M6-F dual-port Fibre Channel card is selected. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 76 of 146...
Page 77 Selecting the HBA Press Enter. The Emulex Adapter Configuration Main Menu screen is displayed (Figure 80). Figure 80. Emulex Adapter Configuration Main Menu Screen © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 77 of 146...
Page 78: Acquire An Hba Wwn
PCI Slot Number Power Status Slot Status Link Width Seg/Bus/Dev PCIe Card Information Firmware Version Standyby Not present 0/13/0 0/14/0 Standby Not present © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 78 of 146...
Page 79: Initialize The Hba Settings
Selecting Set Emulex Adapter to Default Settings The Set Emulex Adapter to Default Settings screen appears. Select Set Adapter Defaults and then press the Enter key (Figure 83). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 79 of 146...
Page 80: Enable The Bios
On the Emulex Adapter Configuration Main Menu screen, select Set Boot from SAN <Disable>. The screen for selecting Disable or Enable appears. Select Enable and then press the Enter key (Figure 84). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 80 of 146...
Page 81 Confirm that Set Boot from SAN < Enable > is displayed (Figure 85). Figure 85. Confirming That Set Boot from SAN Is Enabled © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 81 of 146...
Page 82: Set The Link Speed And Topology
Selecting Configure HBA and Boot Parameters For Topology Selection, select <AUTO Loop First – default.> and then press the Enter key (Figure 87). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 82 of 146...
Page 83 For a fabric connection, select the Point to Point option (Figures 88 and 89). ● For a FCAL connection, select the FCAL option (for 4- and 8-Gbps connections only). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 83 of 146...
Page 85 Select the link speed that corresponds to the connection environment (connected Fibre Channel switch or SAN storage unit) and then press the Enter key (Figure 91). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 85 of 146...
Page 86 Confirm that the specified link speed is displayed for [Force Link Speed (Figure 92). Figure 92. Topology and Link Speed Change Confirmation (1) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 86 of 146...
Page 87: Set The Boot Device
On the Port 001:Emulex LPe16002B-M6-F 16Gb 2-port PCIe Fiber Chann screen, select Scan for Fiber Devices and then press the Enter key (Figure 94). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 87 of 146...
Page 88 Press the Esc key or select Go to Configuration Main Menu to return the previous page. Then press the Enter key (Figure 95). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 88 of 146...
Page 89 Fibre Channel switch may be incorrect. Confirm these settings again. On the Configuration Main Menu screen, press the Enter key (Figure 96). Figure 96. Boot Device Settings (3) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 89 of 146...
Page 90 Devices option. Select the Fibre Channel device that specifies the boot device and then press the Enter key (Figure 98). Figure 98. Boot Device Settings (5) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 90 of 146...
Page 91 Figure 99. Boot Device Settings (6) Select Commit Changes and then press the Enter key (Figure 100). Figure 100. Boot Device Settings (7) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 91 of 146...
Page 92 Select Go to Configuration Main Menu and then press the Enter key to return to the next higher menu level (Figure 102). Figure 102. Boot Device Settings (9) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 92 of 146...
Page 93 12. Confirm the registration of the boot device that was set with Commit Changes. In the following example, LUN 0007 is confirmed as connected to the target WWN: 207100B 5D6A0510 (Figure 104). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 93 of 146...
Page 94 Figure 105. Boot Device Settings (12) 14. Press the Esc key and then press the Y key to return to the next higher menu level (Figure 106). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 94 of 146...
Page 95 (Figure 107). If you do, your system will hang. If your system hangs and does not operate for three minutes and more, reset the system and restart the configuration process. Figure 107. Boot Device Settings (14) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 95 of 146...
Page 96: Apply The Settings
Reset from the Power Control window of the MMB web user interface. Press the Esc key to go to the Boot Manager main page (Figure 108). Figure 108. Restarting the System (1) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 96 of 146...
Page 97 (Figure 109). Figure 109. Restarting the System (2) Select Reset System and then press the Enter key. The system is restarted (Figure 110). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 97 of 146...
Page 98: Record The Wwn Information Of The Fibre Channel Port
Confirm the WWN with Port Name in the Adapter Selection menu. The menu appears after the Emulex Configuration Utility restarts (Figure 111). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 98 of 146...
Page 99 WWN after the firmware update. To clearly identify the mounting location of the 8-Gbps Fibre Channel card, record the host name (the name that identifies the Cisco C880 M4 Server), mounted card, mounting slot location, BUS number, and DEV number. For the BUS number and slot number, check the BUS number and slot number of the target HBA from the IOU menu and PCI_Box menu of the MMB web user interface.
Page 100 ● When an 8-Gbps Fibre Channel card is moved or hardware is replaced for maintenance purposes, the WWN may be changed. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 100 of 146...
Page 101: 16-Gbps Fibre Channel Card Settings: Traditional Bios Driver Version 6.02X6 Or Later
Start the Emulex LightPulse BIOS Utility. Fibre Channel ports of the Fibre Channel card appear on the HBA list screen. Select a Fibre Channel port to set up and press the Enter key (Figure 113). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 101 of 146...
Page 102 Base), firmware version, World Wide Port Name (WWPN), World Wide Node Name (WWNN), and topology for the Fibre Channel port also are listed (Figure 114). Figure 114. Emulex LightPulse BIOS Utility (2) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 102 of 146...
Page 103: Enable The Bios
Figure 115. Enable/Disable Boot from SAN Setup Screen (1) Select Enable for the boot BIOS and then press the Enter key (Figure 116). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 103 of 146...
Page 104: Set The Link Speed And Topology
Follow these steps to set the topology: In the main menu, select Configure Advanced Adapter Parameters and then press the Enter key (Figure 117). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 104 of 146...
Page 105 Figure 117. Topology Selection Settings (1) Select Topology Selection and then press the Enter key (Figure 118). Figure 118. Topology Selection Settings (2) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 105 of 146...
Page 106 Configure the setting that corresponds to the connection kink speed (2, 4, or 8 Gbps). Do not set Auto Select (Default). In the main menu, select Configure Advance Adapter Parameters and press the Enter key (Figure 120). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 106 of 146...
Page 107 Figure 120. Configure Advanced Adapter Parameters Screen On the next screen, select Link Speed Selection and then press Enter key (Figure 121). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 107 of 146...
Page 108 Select the link speed that corresponds to the connection environment (connected Fibre Channel switch or SAN storage unit) and then press the Enter key (Figure 122). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 108 of 146...
Page 109 Press the Esc key three times to return to the LightPulse BIOS Utility (Figure 123). Figure 123. Emulex LightPulse BIOS Utility Screen © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 109 of 146...
Page 110: Set The Boot Device
Now set the boot device. Note that the settings for the 8-Gbps (12002) and the 16-Gbps (16002) devices are identical. Select a connected boot device from the Fibre Channel port and then press the Enter key (Figure 125). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 110 of 146...
Page 111 In the main menu, select Configure Boot Devices and then press the Enter key (Figure 126). Figure 126. BIOS Device Settings (2) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 111 of 146...
Page 112 Figure 127. BIOS Device Settings (3) Select the boot device: in this case, FUJITSU ETERNUS_DXL, and then press the Enter key (Figure 128). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 112 of 146...
Page 113 Figure 128. BIOS Device Settings (4) The device information is displayed. Press the Enter key (Figure 129). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 113 of 146...
Page 114 Figure 129. BIOS Device Settings (5) Select the device that is registered (Figure 130). Figure 130. BIOS Device Settings (6) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 114 of 146...
Page 115 Select “Boot this device via WWPN” and then press the Enter key (Figure 131). Figure 131. BIOS Device Settings (7) The boot device is added (Figure 132). Figure 132. BIOS Device Settings (8) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 115 of 146...
Page 116 The search results for the boot device are displayed (Figure 134). Figure 134. BIOS Device Settings (10) Press the Esc key to return to the main menu (Figure 135). © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 116 of 146...
Page 117 12. After all the settings are configured, select Exit Emulex HBA Configuration Utility and then press the Enter key to return to the Device Manager menu. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 117 of 146...
Page 118: Considerations For Linux Installation
If the OS supports UEFI mode, you can install it in this mode using the following procedure to change the boot order: After powering on the partition, press any key other than the Enter key while the Cisco logo is displayed to display the Boot Manager main page.
Page 119: Install Emulex Onecommand Manager
OS is started. After it shuts down after the start by the multipath is confirmed, internal hard-disk drive (HDD) into is added when internal HDD into is used. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 119 of 146...
Page 120 Review the screen (Figure 137). If multiple HDDs are not listed, you need to recover the multipath connection. Figure 137. Set Legacy HardDisk Drive Order Menu (Multipath) After confirming the existence of multiple HDDs, reboot OS. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 120 of 146...
Page 121: Sles 11 And 12 Installation: Iscsi
After the system has been prepared for iSCSI or SAN boot, you can install the OS. Boot the system (Figures 138 and 139). Figure 138. Booting the System (1) © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 121 of 146...
Page 122 Figure 139. Booting the System (2) After the Cisco C880 M4 reboots, the installation option for SLES appears. Select it (Figure 140) Figure 140. Installing SLES © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public.
Page 123: Post-Installation Configuration
Configure and tune the OS for all nodes installed to run SAP HANA. SUSE Change the host name to the customer-specific host name: linux:~ # vi /etc/HOSTNAME server01.wdf.sap.corp © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 123 of 146...
Page 124: Bond Linux Ethernet Interfaces
You usually must have a redundant network environment for a successful and stable system configuration. Only active-standby configurations are recommended for this configuration. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 124 of 146...
Page 125 BOOTPROTO='none' MTU='9000' NAME='vNIC' REMOTE_IPADDR='' STARTMODE='off' UNIQUE='rBUF.FgrwMRwr45' USERCONTROL='no' _nm_name='bus-pci-0000:00:0d.0' ifcfg-bond0 BOOTPROTO='static' BROADCAST='172.16.32.255' IPADDR='172.16.32.10' MTU='9000' NETMASK='255.255.255.0' NETWORK='172.16.32.0' REMOTE_IPADDR='' STARTMODE='onboot' BONDING_MASTER="yes" BONDING_MODULE_OPTS="mode=1 miimon=100" BONDING_SLAVE0='bus-pci-0000:00:0c.0' BONDING_SLAVE1='bus-pci-0000:00:0d.0' © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 125 of 146...
Page 126: Vlan Configuration
# Next line modified for SAP HANA Database on 2016.01.04_06.52.38 vm.max_map_count=588100000 fs.file-max = 20000000 fs.aio-max-nr = 196608 vm.memory_failure_early_kill = 1 net.core.rmem_max = 16777216 © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 126 of 146...
Page 127 = 1 sunrpc.tcp_slot_table_entries = 128 # Linux SAP swappiness recommendation vm.swappiness=10 # Next line added for SAP HANA Database on 2015.09.16_02.09.34 net.ipv4.ip_local_port_range=40000 65300 © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 127 of 146...
Page 128: Network Time Protocol Configuration
============================================================================== *mgmtsrv01m 10.17.120.30 0.280 -1.087 0.863 +mgmtsrv02m 10.17.122.27 0.311 -1.254 0.914 server01:~ # © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 128 of 146...
Page 129: Sap Hana Setup (Network File System)
Refer to NetApp TR-4290 for detailed storage information. Figure 142. Volume Layout Figure 143 shows the volume layout for the NetApp FAS8040. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 129 of 146...
Page 130: Sap Hana Setup (San)
# Disable THP on the system echo never > /sys/kernel/mm/transparent_hugepage/enabled . /etc/rc.status # IO scheduler echo deadline > /sys/block/<DEVICE>/queue/scheduler echo 4096 > /sys/block/<DEVICE>/queue/nr_requests echo 4096 > /sys/block/<DEVICE>/queue/read_ahead_kb © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 130 of 146...
Page 131: Sap Hana Installation
SAP Note 1740136: SAP HANA: Wrong mount option may lead to corrupt persistency ● SAP Note 1829651: Time-zone settings in SAP HANA scale-out landscapes © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 131 of 146...
Page 132: Sap Application Notes
SAP Note 1788665: SAP HANA running on VMware vSphere virtual machines ● SAP Note 1788665 (update September 10, 2013): Note now mentions SAP HANA TDI tool © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 132 of 146...
Page 133: Sap Hana High Availability (Scale-Out Only)
The management node contains the two configuration files located in the C880_HA_Scripts.tar package. Copy both files to /hana/shared/HA and adapt the user settings. At the Cisco C880 M4 console, prepare the script to match the configured IPMI user name and password. The default settings are ipmi-user sapadm and ipmi-user-password cisco.
Page 134: Enable The Sap Hana Storage Connector Api
02 08 00 01 02 03 80 81 82 83 mgmtsrv01:/ # Make sure that all nodes respond to the ipmitool command. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 134 of 146...
Page 135: Autostart Sap Hana
SAP HANA. You will need to configure this function in all instance profiles. server01:/hana/shared/ANA/profile # vi ANA_HDB00_server01 Autostart = 1 © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 135 of 146...
Page 136: Sap Hana Failover Test (Scale-Out Only)
Aug 17 02:52:35 cishana01 logger: anaadm HANA Node cishana02 switched from OFF to ON Aug 17 02:52:35 cishana01 logger: anaadm Release NFS locks of HANA Node cishana02 done, system is booting cishana01:/hana/shared # © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 136 of 146...
Page 137 From the SAP HANA Studio, failover will look like Figures 143 through 146. Figure 143. Normal Operation Figure 144. Failover Detected Figure 145. Failover Initiated © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 137 of 146...
Page 138: Sap Hana Server Network Configuration
SAP HANA Studio. For more information, refer to the SAP HANA administration guide. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 138 of 146...
Page 140 0 48992286 0 BMRU eth6 1500 0 BMRU eth7 9000 0 BMRU eth8 9000 0 BMRU 16436 0 LRU [root@server01 ~]# linux1:~ # © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 140 of 146...
Page 141 Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP eth0 9000 0 20242 20171 eth1 1500 0 505653 1902027 eth2 1500 03158299 0 41251411 eth3 1500 0 linux1:~ # © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 141 of 146...
Page 142: Sap Hana Hardware Configuration Check Tool Preparation
The values presented for the data and log tests (async…) + (max_pa…) are storage specific and must be checked and validated by the SAP HANA TDI storage vendor. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 142 of 146...
Page 143 "async_write_submit_blocks":"all"}, "duration":"long" "class": "DataVolumeIO" Configure the settings to persist in the database (SAP Note http://service.sap.com/sap/support/notes/1930979). Make sure that the database is running. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 143 of 146...
Page 144 3 18:42 datavolume_0000.dat Run these commands for all four parameters: max_parallel_io_requests = 128 async_read_submit = on async_write_submit_active = on async_write_submit_blocks = all © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 144 of 146...
Page 145: Example (User = Adm)
NameServer ActiveYes; pid 30859 2: host [cishana01] port 030002 Preprocessor ActiveYes; pid 30987 Continue this process for every SAP HANA data file. © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 145 of 146...
Page 146: For More Information
Cisco UCS C220 M3 Rack Server hardware installation guide: http://www.cisco.com/en/US/docs/unified_computing/ucs/c/hw/C220/install/C220.pdf ● Cisco R Series Rack PDU installation guide: http://www.cisco.com/en/US/docs/unified_computing/ucs/hw/rack_power/installation/guide/Rack-PDU.pdf Printed in USA C11-737762-01 02/17 © 2017 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 146 of 146...

Cisco C880 M4 Configuration Manual

Prerequisites

Architecture Overview

Cisco C880 M4 Server Configuration

Log in to the Web User Interface

C880M4 System Monitoring Via SNMP

Iscsi Boot Configuration

SAN Boot Configuration

16-Gbps Fibre Channel Card Settings: UEFI Driver Version 6.11A5 or Later

16-Gbps Fibre Channel Card Settings: Traditional BIOS Driver Version 6.02X6 or Later

Considerations for Linux Installation

SLES 11 and 12 Installation: Iscsi

Post-Installation Configuration

SAP HANA Setup (Network File System)

SAP HANA Setup (SAN)

SAP HANA Installation

SAP HANA High Availability (Scale-Out Only)

SAP HANA Failover Test (Scale-Out Only)

SAP HANA Hardware Configuration Check Tool Preparation

For more Information

Quick Links

Related Manuals for Cisco C880 M4

Summary of Contents for Cisco C880 M4

Table of Contents