Page 1
ES3000 V5 NVMe PCIe SSD User Guide Issue Date 2019-03-19 HUAWEI TECHNOLOGIES CO., LTD.
Page 2
Notice The purchased products, services and features are stipulated by the contract made between Huawei and the customer. All or part of the products, services and features described in this document may not be within the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements, information, and recommendations in this document are provided "AS IS"...
About This Document Purpose This document provides the product information about the Huawei ES3000 V5 PCIe SSD (ES3000 V5 for short) and describes how to install, configure, operate, and maintain the ES3000 V5. NOTE The document does not contain the commands for production, equipment, and return detection. These commands are commonly used during engineering implementation and fault locating.
Page 4
ES3000 V5 NVMe PCIe SSD User Guide About This Document Symbol Description Calls attention to important information, best practices and tips. NOTE is used to address information not related to personal injury, equipment damage, and environment deterioration. Provides a tip that may help you solve a problem or save time.
3.2 Installing the ES3000 V5..............................20 3.2.1 Installing the ES3000 V5 NVMe PCIe SSD Disk.....................21 3.2.2 Installing the ES3000 V5 NVMe PCIe SSD Card on a Riser Card................23 3.2.3 Installing the ES3000 V5 NVMe PCIe SSD Card on the Mainboard............... 24 3.3 Confirming Driver Information............................
Page 6
5.1.3 Uninstalling the Driver in ESXi..........................73 5.2 Upgrading the Driver..............................74 5.2.1 Upgrading the Driver in Linux..........................74 5.2.2 Upgrading the ES3000 V5 Driver in Windows......................76 5.2.3 Upgrading the Driver in ESXi........................... 77 5.3 Uninstalling the Tool Package............................77 5.3.1 Uninstalling the Tool Package in Linux........................
Page 7
5.12.1 Removing a Non-Hot-Swappable ES3000 V5 NVMe PCIe SSD Disk..............95 5.12.2 Removing a Hot Swappable ES3000 V5 NVMe PCIe SSD Disk................96 5.12.3 Removing an ES3000 V5 NVMe PCIe SSD Card from a Riser Card..............97 5.12.4 Removing an ES3000 V5 NVMe PCIe SSD Card from the Mainboard..............98 6 Command Description......................
Page 8
ES3000 V5 NVMe PCIe SSD User Guide Contents 6.13 Querying and Configuring Namespaces........................137 6.13.1 Querying the Namespace Distribution of an SSD....................137 6.13.2 Creating a Namespace for an SSD........................138 6.13.3 Attaching a Namespace to an NVMe Controller....................139 6.13.4 Detaching a Namespace from an NVMe Controller....................140 6.13.5 Deleting a Namespace of an SSD..........................142...
Page 9
C.3 Configuring the SNMP Function in Linux........................ 212 C.4 Querying SNMP Information............................ 213 C.5 SNMP OID.................................214 D Using the VROC Function on the ES3000 V5..............217 E Obtaining Device Logs by Using an Open-Source Tool........... 219 F Introduction to Windows GUI....................221 G Installing an OS on the ES3000.....................
They are only supplements to the safety instructions. Local Safety Regulations When operating Huawei equipment, you must follow the local laws and regulations. The safety instructions in this document are only supplements to the local laws and regulations.
ES3000 V5 NVMe PCIe SSD User Guide 1 Safety Ground Do not damage the ground conductor or operate the device in the absence of a properly installed ground conductor. Conduct the electrical inspection carefully. The device must be connected permanently to the protection ground before an operation.
ES3000 V5 NVMe PCIe SSD User Guide 1 Safety Label Meaning Description External grounding This label indicates grounding of external devices. The terminals of the ground cable are connected to different devices. This ensures normal running of the devices and the safety of the operator.
ES3000 V5 NVMe PCIe SSD User Guide 1 Safety Do not perform any operation, including high voltage and AC operations, on a steel tower or mast during a thunderstorm. High Electrical Leakage Ground the device before powering it on. Otherwise, personal injury or device damage may be caused by high leakage current.
ES3000 V5 NVMe PCIe SSD User Guide 1 Safety To prevent electrostatic-sensitive components from being damaged by the static on human bodies, you must wear a well-grounded ESD wrist strap when touching the device or handling boards or application-specific integrated circuits (ASICs).
Page 16
ES3000 V5 NVMe PCIe SSD User Guide 1 Safety This is a class A product, operation in a residential environment this product may cause radio interference in which case the user may be required to take adequate measures. Issue 07 (2019-03-19)
Huawei is committed to ensuring stability and security of customer networks and services. As a storage device within a server or storage host, the ES3000 V5 provides the following security features based on the security hardening measures taken according to the minimum...
PCIe SSD consists of the ES3500P V5 and ES3600P V5 series. The ES3000 V5 NVMe PCIe SSD disk is a 2.5-inch PCIe 3.0 x 4 SSD disk that uses the HiSilicon Hi1812E chip and complies with the SFF-8639 standard. This SSD disk can be installed in universal servers, such as rack servers.
Indicates the year and month (two characters). Indicates the serial number (six characters). The ES3000 V5 NVMe PCIe SSD card is a standard half-height half-length (HHHL) PCIe 3.0 x 4 card. It can be installed on universal servers, such as rack servers.
Page 20
Besides the basic feature and the mandatory commands, it also supports Name Space feature, a maximum of 64 Name Spaces are supported. The ES3000 V5 NVMe PCIe SSD provides the following features: Uses the PCIe 3.0 x4 interface, complies with PCIe 3.0 electrical specifications, and is backward compatible with PCIe 2.0 and 1.0.
This section describes the specifications of the ES3000 V5. The ES3000 V5 comes in two form factors: disk and card. The disk consists of the ES3500P V5, ES3600P V5. The card consists of the ES3600C V5 series.The ES3000 V5 NVMe PCIe SSD consists of the ES3500P V5 and ES3600P V5 series.The default power consumption...
Page 22
ES3000 V5 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V5 Power Consumption Table 2-1 lists the power consumption specifications for the ES3500P V5 series. Table 2-1 Power consumption specifications for the ES3500P V5 series Parameter Specifications...
ES3000 V5 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V5 Environmental Specifications Table 2-3 lists the environmental specifications for the ES3500P V5 series. Table 2-3 Environmental specifications for the ES3500P V5 series Parameter Specifications Temperature l Storage temperature: –40°C to +85°C (–40°F to +185°F) l Drive case temperature: 0°C to 70°C (32°F to 158°F)
Page 24
ES3000 V5 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V5 Figure 2-5 ES3600P V5 series nameplate Power Consumption Table 2-4 lists the power consumption specifications for the ES3600P V5 series. Table 2-4 Power consumption specifications for the ES3600P V5 series...
Page 25
ES3000 V5 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V5 Table 2-5 Reliability specifications for the ES3600P V5 series Parameter Specifications Mean time between 2.5 x 10 hours failures (MTBF) Annual failure rate (AFR) ≤ 0.35%...
ES3000 V5 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V5 Parameter Specifications Shock l Operating shock: 1000 G/0.5 ms l Non-operating shock: 1000 G/0.5 ms 2.4.3 ES3600C V5 Specifications Nameplates Figure 2-6 shows the nameplate for the ES3600C V5 series.
Page 27
ES3000 V5 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V5 Reliability Specifications Table 2-5 lists the reliability specifications for the ES3600C V5 series. Table 2-8 Reliability specifications for the ES3600C V5 series Parameter Specifications Mean time between 2.5 x 10...
The minimum requirements for server hardware are as follows: 2 GB memory To use the ES3000 V5 NVMe PCIe SSD disk, the server must provide at least one 2.5- inch SSD disk slot that supports the PCIe SFF-8639 connector. To use the ES3000 V5 NVMe PCIe SSD card, the server must provide at least one HHHL (167.5 mm x 70 mm x 18.6 mm) PCIe 3.0 x4 card slot.
3.1 Installation and Configuration Process The installation and configuration process includes the overall procedures for installing and configuring the ES3000 V5. You can learn about ES3000 V5 installation and configuration logic. The flowchart for installing and configuring ES3000 V5 is shown in Figure 3-1.
3.2.1 Installing the ES3000 V5 NVMe PCIe Disk. If the PCIe card slots are on a riser card, the ES3000 V5 NVMe PCIe SSD card needs to be installed on the riser card. For details, see 3.2.2 Installing the ES3000 V5 NVMe PCIe SSD Card on a Riser Card.
3.2.1 Installing the ES3000 V5 NVMe PCIe SSD Disk Step 1 Wear ESD gloves. Step 2 Take the ES3000 V5 out of the ESD bag. Check whether a 2.5-inch or 3.5-inch drive tray is used. For a 2.5-inch drive tray, go to Step For a 3.5-inch drive tray, go to...
Figure 3-4. Figure 3-4 Securing the ES3000 V5 to the drive tray Step 8 Open the ejector lever and push the ES3000 V5 into the server until it does not move. See (1) Figure 3-5. Step 9 Close the ejector lever to push the ES3000 V5 into place. See (2) in Figure 3-5.
User Guide 3 Installation and Configuration Step 4 Hold the upper edge of the ES3000 V5, align its connecting part with a PCIe slot on the riser card, and insert the ES3000 V5 slowly into the PCIe slot. See Figure 3-6.
Confirm the scenario before downloading the driver. If the server uses only ES3000 V5 NVMe PCIe SSD and does not use SSD provided by other vendors. You can use either the NVMe driver integrated in the OS or that provided by Huawei.
– OEL 6.5 or later – Ubuntu 14.04 or later – SUSE Linux Enterprise Server (SLES) 11 SP4 or later You can download drivers as follows: log in to Huawei Enterprise support website http:// support.huawei.com/enterprise, choose Products > Cloud Data Center > Servers >...
Page 37
ES3000 V5 NVMe PCIe SSD User Guide 3 Installation and Configuration NOTE To change the UI language, click Languages. Figure 3-8 WinSCP login Step 2 Set the login parameters. The parameters are described as follows: Host name: Enter the IP address of the remote host to be connected. For example, 191.100.34.32.
If you decide to use Huawei's NVMe driver after reading 3.3 Confirming Driver Information, install it by referring to this section before using the ES3000 V5 for the first time. If you install multiple ES3000 V5s on a server, you need to install the driver only once.
Page 39
Procedure Step 1 Log in to the OS as an administrator. Step 2 Go to the directory that stores the ES3000 V5 driver package, for example, /home. Step 3 Run the installation command based on the OS type. For RHEL, CentOS, OEL, SLES, UVP, or RHEL, run rpm -ivh driver package name.
Page 40
ES3000 V5 NVMe PCIe SSD User Guide 3 Installation and Configuration NOTE l If the CPU hardware capabilities are insufficient for processing high-speed I/O services of NVMe devices during interruption, it is recommended that you configure the NVMe driver to work in threaded_irq mode before installing it.
Page 41
Help. NOTE If the ES3000 V5 hiodriver is used, certain operating systems such as SUSE Linux will record the module verification failed error in dmesg logs. This error message is a notification indicating that an operating system detects a third-party driver with an unmatched signature. It does not affect services.
If you install multiple ES3000 V5s on a server, you need to install the driver only once. l The ES3000 V5 tool is incompatible with the NVMe driver built in the Windows OS. Ensure that you have installed Huawei's NVMe driver before using the tool.
Page 43
ES3000 V5 NVMe PCIe SSD User Guide 3 Installation and Configuration Figure 3-9 System Click Device Manager. The Device Manager is displayed, as shown in Figure 3-10. Figure 3-10 Device Manager The following are three possible cases: Issue 07 (2019-03-19)
Page 44
Determine the next step based on the driver type. – If the driver is provided by the OS, go to 5. – If the driver is provided by Huawei, uninstall the driver by referring to 5.1.2 Uninstalling the Driver in Windows and go to in Install the driver.
Page 45
ES3000 V5 NVMe PCIe SSD User Guide 3 Installation and Configuration Figure 3-12 Installation interface Click Next. The End-User License Agreement window is displayed, as shown in Figure 3-13. Figure 3-13 End-User License Agreement window Select I accept the terms in the License Agreement and click Next.
Page 46
ES3000 V5 NVMe PCIe SSD User Guide 3 Installation and Configuration The Choose Setup Type window is displayed, as shown in Figure 3-14. Figure 3-14 Choose Setup Type window Click Complete. The Ready to install window is displayed, as shown in Figure 3-15.
Page 47
Check whether NVMe HWE32P43032M000N SCSI Disk Device exists under Disk drives. See Figure 3-18. – If yes, the driver has been successfully installed. – If no, contact Huawei technical support for help. For details, see H Getting Help. Figure 3-18 Expanding Disk drives Issue 07 (2019-03-19)
3 Installation and Configuration 3.6.3 Installing the ES3000 V5 Driver in ESXi Operation Scenario You need to install the ES3000 V5 driver on the server before using the ES3000 V5 for the first time. NOTE l If you install multiple ES3000 V5s on a server, you need to install the driver only once.
[root@esxi113:~] vmkload_mod -l | grep hiodriver hiodriver If yes, no further action is required. If no, go to Step Step 7 Contact Huawei technical support for help. For details, see H Getting Help. ----End 3.7 Installing the Tool Package This section describes how to install the tool package in Linux, Windows, and ESXi operating systems (OSs).
3.7.2 Installing the Tool Package (Windows) Operation Scenario Install the tool package for managing the ES3000 V5. The ES3000 V5 tool is incompatible with the NVMe driver built in the Windows OS. Ensure that you have installed Huawei's NVMe driver before using the tool.
Page 51
ES3000 V5 NVMe PCIe SSD User Guide 3 Installation and Configuration Procedure Step 1 Log in to the operating system (OS) as an administrator or administrator group member. Step 2 Double-click the tool package file hioadm_V5.3.5.4_x86_64.msi. NOTE V5.3.5.4 indicates a driver version number. This procedure uses hioadm_V5.3.5.4_x86_64.msi as an example.
Page 52
ES3000 V5 NVMe PCIe SSD User Guide 3 Installation and Configuration Figure 3-20 End-User License Agreement window Step 4 Select I accept the terms in the License Agreement and click Next. The Destination Folder window is displayed, as shown in Figure 3-21.
Page 53
ES3000 V5 NVMe PCIe SSD User Guide 3 Installation and Configuration Step 5 Select a folder for installing the tool and click Next. The Ready to install window is displayed, as shown in Figure 3-22. Figure 3-22 Ready to install window Step 6 Click Install to start installation.
The following procedure assumes that the tool package is in the /tmp directory, and the tool package name is hioadm-5.0.1.0-1OEM.vib. Run the following command to install the ES3000 V5 tool package: esxcli software vib install -v tool package in a directory The following is an example command: esxcli software vib install -v /tmp/hioadm-5.0.1.0-1OEM.vib...
Page 55
ES3000 V5 NVMe PCIe SSD User Guide 3 Installation and Configuration NOTE l In the tool package name, 5.0.1.0 is the software version. The actual tool version may differ. l Enter a complete directory after -v. l If the "Could not find a trusted signer" error occurs indicating that the tool version is not certified by ESXi IOVP, add --no-sig-check at the end of the command to skip signature check.
SSD hot swap may affect services running on the SSD. Before performing a hot swap, notify system maintenance personnel to ensure service security. l If you insert the ES3000 V5 SSD when it is not installed on a drive tray, it may fail to be detected.
Mainstream Linux OSs: RHEL 7.3 and 7.4 4.2 Orderly Hot Swap You can insert the ES3000 V5 SSDs to running servers. For Linux and Windows, notify the OS before hot removing the ES3000 V5. For ESXi OSs, notify the OS before hot-swapping the ES3000 V5.
Page 58
4 Hot Swap Configuring Linux Kernel Parameters In Linux, such as Red Hat Enterprise Linux (RHEL) 7.0, hot swap of the ES3000 V5 NVMe PCIe SSD disk will cause unmatched maximum payload size, I/O write errors, and other issues. This is because Linux does not fully support hot swap. To avoid this issue, make changes to the Linux kernel file.
Page 59
ES3000 V5 NVMe PCIe SSD User Guide 4 Hot Swap else search --no-floppy --fs-uuid --set=root 8f04e328-185b-40d9-8f8a-19d3561dd769 linux16 /vmlinuz-3.10.0-514.el7.x86_64 root=/dev/mapper/rhel-root ro crashkernel=auto rd.lvm.lv=rhel/root rd.lvm.lv=rhel/swap rhgb quiet LANG=en_US.UTF-8 pciehp.pciehp_force=1 pci=pcie_bus_perf initrd16 /initramfs-3.10.0-514.el7.x86_64.img menuentry 'Red Hat Enterprise Linux Server (0- rescue-144afff501d4492e8c752cca7ff44971) 7.3 (Maipo)' --class red --class gnu-...
Page 60
ES3000 V5 NVMe PCIe SSD User Guide 4 Hot Swap gnu-linux --class gnu --class os --unrestricted $menuentry_id_option 'gnulinux-3.10.0-123.el7.x86_64-advanced-b054ccd0-c3d3-47eb-a449-f897f63f1b76' { load_video set gfxpayload=keep insmod gzio insmod part_msdos insmod xfs set root='hd0,msdos1' if [ x$feature_platform_search_hint = xy ]; then search --no-floppy --fs-uuid --set=root --hint-bios=hd0,msdos1 --hint-...
Page 61
ES3000 V5 NVMe PCIe SSD User Guide 4 Hot Swap Step 3 Enter i. Step 4 In the boot configuration file, add pciehp.pciehp_force=1 pci=pcie_bus_perf to the boldface part shown in the following: Between the added content and its preceding content, a space is required and no line feed is allowed.
Page 63
ES3000 V5 NVMe PCIe SSD User Guide 4 Hot Swap Step 7 Go to Notifying the ----End Kernel Parameter Configuration on Oracle Enterprise Linux 7.0/7.1/7.2 The following procedure uses Oracle Enterprise Linux 7.0 as an example. Step 1 Log in to the operating system (OS) as an administrator.
Page 64
ES3000 V5 NVMe PCIe SSD User Guide 4 Hot Swap search --no-floppy --fs-uuid --set=root fcf9f115-8f51-496e- a7a8-905f03350b4e linux16 /vmlinuz-3.8.13-35.3.1.el7uek.x86_64 root=UUID=eba3dd96-8be3-46ce- a8d9-21699e3fbedb ro crashkernel=auto vconsole.font=latarcyrheb-sun16 rd.lvm.lv=ol/swap rd.lvm.lv=ol/root vconsole.keymap=us rhgb quiet pciehp.pciehp_force=1 pci=pcie_bus_perf initrd16 /initramfs-3.8.13-35.3.1.el7uek.x86_64.img menuentry 'Oracle Linux Server, with Linux 0-rescue- a6e5b98906f643a09908dd24f3b775f7' --class oracle --class gnu-linux --class gnu --...
Page 65
ES3000 V5 NVMe PCIe SSD User Guide 4 Hot Swap Between the added content and its preceding content, a space is required and no line feed is allowed. …(Some code omitted.) ### BEGIN /etc/grub.d/10_linux ### menuentry 'SLES 12-SP2' --class sles --class gnu-linux --class gnu --class os...
Page 70
ES3000 V5 NVMe PCIe SSD User Guide 4 Hot Swap Between the added content and its preceding content, a space is required and no line feed is allowed. …(Some code omitted.) ###Don't change this comment - YaST2 identifier: Original name: xen### title Xen -- SUSE Linux Enterprise Server 11 SP4 - 3.0.101-63...
Page 71
ES3000 V5 NVMe PCIe SSD User Guide 4 Hot Swap …(Some code omitted.) ### BEGIN /etc/grub.d/10_linux ### function gfxmode { set gfxpayload="${1}" if [ "${1}" = "keep" ]; then set vt_handoff=vt.handoff=7 else set vt_handoff= if [ "${recordfail}" != 1 ]; then if [ -e ${prefix}/gfxblacklist.txt ];...
Page 72
ES3000 V5 NVMe PCIe SSD User Guide 4 Hot Swap echo 'Loading Linux 4.4.0-21-generic ...' linux /boot/vmlinuz-4.4.0-21-generic root=UUID=e2afe344-3108-497b- ae46-014a53fe3cb5 ro pciehp.pciehp_force=1 pci=pcie_bus_perf echo 'Loading initial ramdisk ...' initrd /boot/initrd.img-4.4.0-21-generic menuentry 'Ubuntu, with Linux 4.4.0-21-generic (recovery mode)' --class ubuntu -- class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.4.0-21-...
Page 73
ES3000 V5 NVMe PCIe SSD User Guide 4 Hot Swap function gfxmode { set gfxpayload="${1}" if [ "${1}" = "keep" ]; then set vt_handoff=vt.handoff=7 else set vt_handoff= if [ "${recordfail}" != 1 ]; then if [ -e ${prefix}/gfxblacklist.txt ]; then if hwmatch ${prefix}/gfxblacklist.txt 3;...
Page 74
Step 1 Log in to the OS as the root user. Step 2 Stop all services accessing the ES3000 V5 SSD. Step 3 If you have used the mount command to attach the SSD partitions to certain paths, use the umount command to detach the partitions.
----End 4.2.2 Orderly Hot Swap of a Drive in Windows Operation Scenario Notify the Windows OS before hot removing the ES3000 V5 SSD. Preparations You have correctly installed the ES3000 V5 SSD on the server. You have installed the Windows tool package. For details, see 3.7.2 Installing the Tool...
Page 77
ES3000 V5 NVMe PCIe SSD User Guide 4 Hot Swap Figure 4-2 Making a logical drive offline Do not read or write data during this operation. Otherwise, I/O errors may occur. Step 3 Go to the directory where the tool package is located and open the Windows CLI, as shown in Figure 4-3.
----End 4.2.3 Orderly Hot Swap of a Drive in ESXi Operation Scenario Notify the ESXi OS before hot removing the ES3000 V5 SSD. Preparations You have correctly installed the ES3000 V5 SSD on the server. You have installed the ESXi tool package. For details, see 3.7.3 Installing the Tool...
4.3 Surprise Hot Swap Before performing surprise hot swap, ensure that: l The server where the ES3000 V5 installed is a V5 server. l The VMD function is enabled in the BIOS. For details about surprise hot swap operations, see the server version requirements and operation guide of each vendor.
Page 81
Procedure Step 1 Log in to the OS as an administrator. Step 2 Stop or exit the programs or files that are accessing the ES3000 V5. Step 3 Run the uninstallation command based on the OS type. For RHEL, CentOS, or OEL, run the rpm -e kmod-hiodriver command.
Uninstall the ES3000 V5 driver by following the procedure described in this section. Do not uninstall the ES3000 V5 driver by using Device Manager. If you have uninstalled the ES3000 V5 driver by using Device Manager, you still need to uninstall the driver by following the procedure described in this section before installing the driver again.
5.1.3 Uninstalling the Driver in ESXi Operation Scenario If you want to stop using or replace the ES3000 V5, uninstall the driver first. Procedure Step 1 Log in to the OS as an administrator or a member of the administrator group.
ES3000 V5 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade 5.2 Upgrading the Driver This section describes how to upgrade the ES3000 V5 driver in different operating systems (OSs). 5.2.1 Upgrading the Driver in Linux Operation Scenario You can upgrade the driver after a new version is released.
Page 85
ES3000 V5 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade For Ubuntu or Debian, run dpkg -i driver package name. An example package name for Ubuntu is dpkg -i hiodriver-5.0.3.3-3.13.0_24_generic.ubuntu.amd64.deb. Step 4 Check whether the following message indicating an incorrect upgrade package is displayed.
----End 5.2.2 Upgrading the ES3000 V5 Driver in Windows Operation Scenario You can upgrade the ES3000 V5 driver after a later version is released. Preparations Before upgrading the driver, check that: You have downloaded the later driver software to the server, and verified the package integrity.
5.3 Uninstalling the Tool Package 5.3.1 Uninstalling the Tool Package in Linux Operation Scenario Uninstall the tool package to free up space when ES3000 V5 management is not needed. Procedure Step 1 Log in to the operating system (OS) as an administrator.
5.3.2 Uninstalling the Tool Package in Windows Operation Scenario Uninstall the tool package to free up space when ES3000 V5 management is not needed. Procedure Step 1 Log in to the operating system (OS) as an administrator or administrator group member.
5.4.1 Upgrading the Tool Package in Linux Operation Scenario Upgrade the tool package to better manage the ES3000 V5 when a new version is available. The tool package naming rules are as follows: For RHEL, CentOS, OEL, or SLES, the package name is hioadm-version number- release number.hardware architecture.rpm, for example, hioadm-5.0.3.5-1.x86_64.rpm.
This section describes how to upgrade the ES3000 V5 controller firmware in different OSs. NOTE The ES3500 and ES3600P series use the same drivers and firmware. You can also use eSight to upgrade the ES3000 V5 controller firmware. For details, see the esight user guide. 5.5.1 Upgrade Paths Only ES3000 V5 SSDs are supported.
Preparations Before upgrading the firmware, check that: Stop or exit the ES3000 V5 SSD applications or services, and unmount the file system that uses the SSD device. The firmware upgrade does not damage data on SSDs. However, you are advised to back up important data on SSDs.
Preparations Before upgrading the firmware, check that: You have uploaded the ES3000 V5 software package to a directory on the server, for example, the D:\ directory. Stop or exit the ES3000 V5 SSD applications or services, and uninstall the file system that uses the SSD device (make the to-be-upgraded SSD to be offline in the disk manager).
Page 93
ES3000 V5 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Step 2 Choose Start > Run. The Windows CLI is displayed. Step 3 Run the cd command to go to the directory where the hioadm.exe file is stored. Step 4 Run the following command to view the name of the SSD to be upgraded: hioadm.exe info...
You can upgrade the controller firmware when a new version is released. Preparations Before upgrading the firmware, check that: Stop or exit the ES3000 V5 SSD applications or services. The firmware upgrade does not damage data on SSDs. However, you are advised to back up important data on SSDs.
ES3000 V5 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Reset activation mode: Run the hioadm updatefw -d nvme0 -f ES3000V5_FW_2151.bin command and perform steps 6 to 8. Immediate activation mode: Run the hioadm updatefw -d nvme0 -f ES3000V5_FW_2151.bin -a 1 command and perform steps 6 and 8.
ES3000 V5 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade 5.7.1 Collecting SSD Information Operation Scenario Collect SSD information when maintaining SSDs. Procedure Step 1 Log in to the OS as an administrator or a member in the administrator group.
Download tab at http://support.huawei.com/enterprise (Product Support > Enterprise Data Center > Servers > Accelerator Components > ES3000 V5). You have already installed hioadm, which integrates one-click log collection scripts. Linux Step 1 Log in to the OS as an administrator or a member in the administrator group.
ES3000 V5 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Windows Step 1 Log in to the OS as an administrator or a member in the administrator group. Step 2 Double-click host_info_collect.bat in C:\Program Files (x86)\hioadm. Step 3 Obtain all log files from the C:\Program Files (x86)\hioadm\ directory.
ES3000 V5 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Procedure Step 1 Log in to the OS as an administrator or a member in the administrator group. Step 2 Run the following command to securely erase data from the SSD (such as nvme0): hioadm secure -d nvme0 The warning of the risks of data erasure is displayed.
The percentage used parameter displays the used lifespan percentage of the SSD. If the value of percentage used exceeds 100%, the SSD lifespan has expired, and Huawei's warranty service is unavailable. You need to back up data on the SSD as soon as possible and replace the SSD.
Page 101
ES3000 V5 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Use Instance Step 1 Determine the drive health status. For details, see 6.1.3 Querying Basic Information About a Device6.1.3 Querying Basic Information About a Device. # Query the basic information about nvme0.
Page 102
ES3000 V5 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Table 5-1 Critical Warning parameters Parameter Description Value critical Critical warning, such as Example: no warning warning overtemperature and There are the following types of critical insufficient redundant warning: space.
ES3000 V5 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade The temperature exceeds the threshold. Step 1 Check that the server where the drive resides provides proper cooling. If the server reports no temperature alarm and the fan modules are operating properly, go to Step Step 2 Check that the equipment room where the drive resides provides proper cooling.
ES3000 V5 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Activity Indicator Fault Indicator State Description (Green) (Amber/Blue) Blinking at 2 Hz The NVMe SSD disk is in the hot swap process. Blinking at 0.5 Hz The NVMe SSD disk completes the hot swap process and is removable.
Preparations Before removing an ES3000 V5 NVMe PCIe SSD, make the following preparations: Wear ESD gloves. Used to prevent ESD damage when you insert, remove, or hold the ES3000 V5 or a precision device. Back up data. – Stop the access to a hot swappable SSD disk.
Step 3 Holding onto the drive ejector lever, pull out the drive. See (2) and (3) in Figure 5-8. Step 4 Place the removed drive into an ESD bag. ----End 5.12.2 Removing a Hot Swappable ES3000 V5 NVMe PCIe SSD Disk Prerequisites Check that the current environment supports 4.1 OSs Supporting Hot Swap4.1 OSs Supporting Hot Swap.
Step 1 Turn off the power to the server and remove the chassis cover. Step 2 Remove all the cables from the riser card. Step 3 Hold the upper part of an ES3000 V5 NVMe PCIe SSD card and remove it slowly. Issue 07 (2019-03-19)
Step 1 Turn off the power to the server and remove the chassis cover. Step 2 Open the latch on the PCIe card. Step 3 Hold the upper part of an ES3000 V5 NVMe PCIe SSD card and remove it upwards slowly. Figure 5-11.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Command Description About This Chapter After installing the driver, you can use the hioadm tool to manage and configure the ES3000 V5. This chapter describes the hioadm command. The command output varies according to the actual operation result.
Page 111
6 Command Description sanitize: device clea-up hotplug: orderly hot-swap atomicwrite: atomic write (This command is supported by ES3000 V5 2151 or later. For details about how to query the firmware version of an SSD, see 6.2.1 Querying the Firmware Version of an SSD.)
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description 6.10 Querying the Diagnosis Result of a Specified SSD 6.11 Querying the Electronic Label Information About an SSD 6.12 Recovering Data 6.13 Querying and Configuring Namespaces 6.14 Querying Historical Amount of Written Data 6.15 Setting and Querying Time Synchronization...
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Example #Query the list of existing SSDs. [root@localhost tool]# hioadm info-l Device nvme0 0503023HDCN107C80013 HWE32P43032M000N 1510 nvme1 0503023HDCN107C80014 HWE32P43016M000N 1510 HS000000000000253015 HSSD-D5220AS0200 1510 Output Description The command output in the preceding example is explained as follows:...
Page 115
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description current capacity : 3200.6GB volatile write cache : Disable serial number : 0503023HDCN107C80013 model number : HWE32P430016M00N firmware version : 1010 NVMe version : 1.3 device status : healthy # Query the basic information about nvme0 when the size of formatted metadata is not 0.
Example: healthy follows: l healthy l warning l unknown NOTE If an unknown status occurs, contact Huawei technical support for help. For details, see Getting Help. 6.1.4 Querying the SMART Information About a Device Function This command is used to query the SMART (Self-Monitoring, Analysis and Reporting Technology) information about an SSD (SSD controller).
Page 117
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameters Parameter Description Value devicename Name of a device Examples: nvme0 and nvme1 Usage Guidelines None Example # Query the SMART information about nvme0. [root@localhost tool]# hioadm info -d nvme0 -s...
Page 118
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameter Parameter Value Description available spare Redundant space Example: 100% proportion. available spare Warning threshold of Example: 10% threshold the redundant space proportion. percentage used Percentage of used Example: 0% service life.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameter Parameter Value Description data status Data health status. Example: OK Values are as follows: l OK: The status is normal. l need recovery: Data needs to be restored. 6.1.5 Querying Advanced Information of a Device Function This command is used to query the advanced information about an SSD (SSD controller).
Page 120
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description capacitance status : OK capacitance charging time : 12 times active power : 5266 mW maximum power : 5403 mW number of power states support: 3 atomic write : OFF bad block rate : 1.926386%...
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameter Parameter Description Value capacitance Capacitor health status. Values Example: OK status are as follows: l OK: The capacitor is normal. l Invalid: The capacitor is invalid. capacitance Number of discharge/charge...
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameters Parameter Description Value devicename Name of an SSD Example: nvme0 or nvme1 Usage Guidelines None Example # Query the firmware version of nvme0. [root@localhost tool]# hioadm updatefw -d nvme0...
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameter Description Value slot Slot of the target 1 or 2 firmware. NOTE l If this parameter is not specified, a slot with firmware not in use will be selected.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Format hioadm updatefw -d devicename [-s slot] [-a activeflag] Parameters Parameter Description Value devicename Name of an SSD. Example: nvme0 and sda slot Slot of the target firmware 1 and 2 image.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameters Parameter Description Value devicename Name of an SSD. Example: nvme0 Usage Guidelines None Example # Query the current capacity of nvme0. [root@localhost tool]# hioadm capacity -d nvme0 current capacity : 1600.3GB (1600321314816Byte) maximum capacity : 1600.3GB (1600321314816Byte)
Page 126
Before running this command, stop all I/O services of the SSD, and unmount all logical drives of the SSD. If a Huawei-developed driver is installed, the setting takes effect immediately. If an open-source or system-provided driver is installed, the setting takes effect after the driver is uninstalled and reinstalled or the server is restarted.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameter Parameter Description Value maximum Original available capacity (with one decimal Example: 1600.3 GB capacity place) of the SSD. Unit: GB or TB. (1600321314816Byte In Linux and ESXi, 1 GB equals 1000 MB. In Windows, 1 GB equals 1024 MB.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description following information indicates that a process is using the logical drive. Stop the process. [root@localhost tool]# fuser /dev/nvme0n1 /dev/nvme0n1: 14789 – For ESXi, delete all partitions of the logical drive.
Page 129
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Format hioadm format -d devicename -q Parameters Parameter Description Value devicename Name of an SSD. Example: nvme0 Output Description Parameter Description Value LBA Format l This parameter specifies supported Example:...
Page 130
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameter Description Value Protection l This parameter specifies whether Example: Information DIF verification information is Protection information is enabled, and supported information not enabled, Type 0: types. Supported (in use)
Page 131
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameter Description Value Metadata l This parameter specifies supported Example: Capabilities metadata modes. Metadata being transferred l Metadata being transferred as as part of an extended data part of a separate buffer: Metadata...
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description 6.4.3 Formatting an SSD Function This command is used to format an SSD. Secure formatting and quick formatting are supported. Format hioadm format -d devicename [-m formatmode] [-t lbasize] [-pt protectiontype] [-pil...
Page 133
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameter Description Value protectionty Protection l 0: indicates that the protection is not enabled. enabling and l 1: indicates that the protection is enabled and the type. protection type is 1 (not supported yet).
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Figure 6-2 Making a logical drive offline Do not read or write data when running this command. Otherwise, I/O errors may occur. Example # Perform secure formatting of the nvme0 SSD, and set the sector size to 512 B and metadata size to 0 B.
Page 135
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Format hioadm secure -d devicename Parameters Parameter Description Value devicename Name of an SSD. Example: nvme0 Usage Guidelines This command supports NVMe SSDs provided by other vendors. Before running this command, stop all I/O services of the SSD and perform the following: –...
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description WARNING! You have selected the secure operation. Proceed with the secure? (Y|N): y Format Progress..100% The secure operate succeeded. Please remove and then install the NVMe driver or reboot the OS.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameters Parameter Description Value devicename Name of an SSD. Example: nvme0 powerstate Power consumption level. l 0: 25 W l 1: 18 W l 2: 14 W NOTE l The power consumption level affects device performance. The lower the power consumption, the poorer the performance.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameter Description Value logtype Log type. l 0: firmware key log l 1: firmware log l 2: core dump log The default value is 0. Usage Guidelines The path and name of the generated log file is as follows. nvme0 is an example device name.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description ESXi: The log file path is /scratch/hio/. Windows: The log file path is the directory storing hioadm.exe. Example # In Linux, obtain all logs of the nvme0 SSD at a time.
Page 141
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Format hioadm temperature -d devicename [-i index] -o overtemperature_threshold -u undertemperature_threshold Parameters Parameter Description Value devicename Name of a device. Example: nvme0 index Number of a temperature l 0: overall temperature sensor.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description 6.10 Querying the Diagnosis Result of a Specified SSD Function Query the diagnosis result of a specified SSD. Format hioadm selftest -d devicename Parameters Parameter Description Value devicename Name of a device.
Page 144
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description System Response Parameter Parameter Description Value selftest result Overall test result. The value is passed or Example: passed empty. If the result is success, all the following sub-tests succeed and sub-test results are not displayed.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description 6.12.1 Recovering Data for an SSD Function This command is used to recover data for an SSD. Format hioadm recovery -d devicename [-t type] Parameters Parameter Description Value devicename Name of a device.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Format hioadm recovery -d devicename -q Parameter Parameter Description Value devicename Name of a device. Example: nvme0 Example # Query the data recovery progress of the nvme0 SSD. [root@localhost host]# hioadm recovery -d nvme0 -q Recovering progress…100% The recovery operation completed successfully.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description total capacity: 3840.7GB unallocated capacity: 3740.7GB maximum capacity to creat single namespace: 3740.7GB namespace id capacity shared controller id 100.0GB System Response Parameter Parameter Description Value total capacity Total SSD capacity with one decimal place. Unit: Example: 3200.6 GB...
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameter Description Value size Size of a namespace. Unit: G If the unit is not specified, the default unit G is used. NOTE If this parameter is set to 0, the remaining unallocated space is all used for creating a namespace.
Usage Guidelines If a Huawei-developed driver is installed, the setting takes effect immediately without needing to stop I/O services. If an open-source or system-provided driver is installed, the setting takes effect after the server is restarted.
Page 151
6-4. Figure 6-4 Making a logical drive offline If a Huawei-developed driver is installed, the setting takes effect immediately without needing to stop I/O services. If an open-source or system-provided driver is installed, the setting takes effect after the server is restarted.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Example # Detach namespace 1 of the nvme0 SSD to NVMe controller 1. [root@localhost tool]# hioadm namespace -d nvme0 -t 3 -i 1 -c 1 detaching the namespace succeeded. Please remove and then install the NVMe driver or reboot the OS.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Example # Delete namespace 1 of the nvme0 SSD. [root@localhost tool]# hioadm namespace -d nvme0 -t 1 -i 1 WARNING! The delete namespace operation will clear all data of this namespace.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description [root@localhost tool]# hioadm namespace -d nvme1 -t 6 -n 2 Setting the namespace number 2 succeeded. NOTE For the Windows operating system, when the command is executed, restart the operating system to make it take effect.
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description 6.15 Setting and Querying Time Synchronization 6.15.1 Querying the Time of a Specified SSD Function This command is used to query the time of a specified SSD. Format hioadm synctime -d devicename...
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Usage Guidelines None Example # Synchronize the time of the specified SSD nvme0. [root@localhost tool]# hioadm synctime -d nvme0 -s Time synchronization succeeded. Current device time:Thu Mar 22 10:51:51 EDT 2018.
3: overwrite operation l 4: crypto erase operation NOTE ES3000 V5 whose firmware versions earlier than 2151 supports type 1 and 2. Firmware versions later than 2151 support types 1, 2, and 3. For details about how to query the firmware version of an SSD, see 6.2.1 Querying the Firmware...
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description Parameter Description Value invert Indicates whether the l 0: The overwrite mode is not inverted. overwrite mode is inverted l 1: The overwrite mode is inverted. between two overwrites. l The default value is 0.
SSD. Usage Guidelines Before running this command, hot insert the ES3000 V5 NVMe SSD to the disk slot. After the SSD is started, run the hioadm info command to confirm the device to which the SSD is to be inserted, for example, nvme0. Then run this command again to instruct the OS to power on the device.
The hotplug insert operation succeeded,the NVMe driver has been inserted to the 6.19 Querying or Setting the Atomic Write Status This command is supported by ES3000 V5 2151 and later. For details about how to query the firmware version of an SSD, see 6.2.1 Querying the Firmware Version of an...
ES3000 V5 NVMe PCIe SSD User Guide 6 Command Description 6.19.2 Setting the Atomic Write Status for a Specified SSD Function This command is used to set the atomic write status for a specified SSD. Format hioadm atomicwrite -d devicename -f flag...
User Guide A Supported NVMe Commands Supported NVMe Commands The ES3000 V5 supports all management and I/O commands required by the NVMe 1.3 protocol. A.1 Supported NVMe Management Commands The ES3000 V5 supports all management commands required by the NVMe 1.3 protocol. The...
The ES3000 V5 also supports the following optional commands: Dataset Management (De-allocate only) A.3 Supported Get Log Page Commands The ES3000 V5 supports all get log page commands required by the NVMe 1.3 protocol. The commands are as follows: Error information (log identifier 01h)
Page 164
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Description Value 1 indicates that the component reliability is reduced due to a critical media error. Value 1 indicates that the media is read-only. Value 1 indicates that the non-volatile component of the controller fails. This domain is valid only when the controller is integrated with a non-volatile component.
Page 165
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Description 159: Unsafe Shutdowns: indicates the number of abnormal power-offs. The value is increased by 1 if CC.SHN is not received after an abnormal power-off. 175: Media Errors: indicates the number of unrecoverable data integrity errors detected by the controller, including incorrigible error-correcting code (ECC) errors, cyclic redundancy check (CRC) errors, and LBA tag errors.
Page 166
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description Current power consumption. Unit: mW Highest power consumption recorded. Unit: mW Highest SSD temperature recorded. Unit: Kelvin Number of SSD overtemperature occurrences 13:10 Period of SSD overtemperature. Unit: minute 15:14 Highest controller temperature recorded.
Page 167
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description 95:80 Number of flash read failures. 111:96 Number of flash read operations. 127:112 Reserved 143:128 Number of flash write failures. 159:144 Number of flash write operations. 175:160...
Page 168
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description 443:440 Number of UNC bad blocks 447:444 Number of DIE bad blocks 451:448 Number of DDR single-bit ECC errors 459:452 I/O write count 463:460 I/O write failure count...
Page 169
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description 603:596 Reserved 635:604 Reserved 643:636 Detailed alarm 1 Description Firmware bootloader error Storage firmware failure BBU check exception BBU check exception Insufficient available space Lifespan alarm Temperature alarm...
Page 171
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description 691:688 Reserved 695:692 Port 0 function reset count 699:696 Reserved 703:700 Port 0 subsystem reset count 707:704 Reserved 711:708 Port 0 controller reset count 715:712 Reserved 719:716...
Page 172
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description Reserved 22:17 Current Raw Value (Erase_Fail_Count) Reserved Wear Leveling Count 26:25 Reserved Normalized Value (Wear Leveling) Reserved 34:29 Current Raw Value (Wear Leveling) Reserved End To End Error Detection Count...
Page 173
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description Reserved 82:77 Current Raw Value (Timed Workload Host Reads) Reserved Timed Workload Timer Count 86:85 Reserved Normalized Value (Timed Workload Timer) Reserved 94:89 Current Raw Value (Timed Workload Timer)
Besides SMART information, the host can use the Get Features command to obtain feature parameters related to working and health status. The ES3000 V5 can also use the following Set Features commands defined by NVMe 1.3 to change the feature parameter settings:...
Host Time (s) records the number of seconds from 1970-1-1 00:00:00 until now. A.6 Supported Vendor Specific Command The ES3000 V5 support vendor specific command for information query and management functions. NOTE To be compatible with Huawei ES3000 V3 SSDs, the custom management commands (customized Opcode:0xC0 and 0xC1) are inherited.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-7 PRP1 Description 63:00 PRP Entry 1 (PRP1): indicates the data buffer. This buffer cannot have more than one physical discontinuity. The minimum unit is 4 KB. Table A-8 PRP2...
Page 178
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-11 Sub_OpCode Sub_OpCode Description 0x010009h Obtain full logs 0x020009h Obtain key logs 0x030009h Obtain CoreDump logs 0x040009h Obtain statistical information Table A-12 Command Dword 13 Description 31:00 Offset: log offset. 1 indicates 4 KB.
Page 179
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-15 Structure of full logs and key logs entries Byte Description 07:00 Current_time: number of seconds since January 1, 1970. 11:08 Power_on_num: number of power-on times since delivery.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-17 CoreDump log structure Byte Description MSB:0 CoreDump logs are comprised of tiled characters. NOTE The process for obtaining complete logs is as follows: 1. Send the vendor-defined log length obtaining command to obtain the total length of valid logs and apply for log storage space based on the total length of valid logs.
Page 181
A Supported NVMe Commands In the following table, "Field" indicates the combination of the field name, equal sign, field value, and carriage return. For example, "VendorName=Huawei\r\n" is a string, where "VendorName" is the field name and "Huawei" is the field value.
Page 182
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Area Description Maximum Maximum Remarks Field Field Value Length Length (Bytes) (Bytes) VendorName FRUs made by Huawei or =<Manufactu Huawei's outsourced rer Name>\r vendors are all branded by Huawei.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Model The subcommand is used to set the SSD model number. The host uses PRP1 and PRP2 to send model information in the format described in Table6. Table A-22 Model...
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Sub_OpCode Description F10009h DDR inspection enablement EF0009h Temperature inspection enablement 0D0005h CE concurrency enablement 0E0005h Read Retry enablement 180006h Wear leveling enablement 190006h Inter-chip RAID enablement 1A0006h Garbage collection (GC) enablement The enablement status of each function is returned through CQ Dword0.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-28 Querying the maximum available capacity of the SSD Bytes Description Maximum available capacity of the SSD (unit: byte) A.6.1.1.5 Obtaining the Vendor Log Length This command is used to obtain the length of vendor logs (including the log parsing package, full logs, and key logs).
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-31 Sub_OpCode Sub_OpCode Description 0x350009h Query the PCB version. Table A-32 CQ DW0 Description 31:0 PCB version A.6.1.1.7 Obtaining Self-Diagnosis Results This command is used to obtain the self-diagnosis result from the formal firmware.
1: Forcibly restore SSDs so that the SSDs can function properly. 1: Restart or power on and then off SSDs to restore SSDs. 1: The fault cannot be rectified. Contact Huawei support engineers. A.6.1.1.8 Obtaining the DIEID of a Chip...
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Test results are returned to the host through the host's physical memory that PRP1 and PRP2 point to. The data structure is defined in the following table. Table A-36 DIEID structure...
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands A.6.1.1.10 Querying UniqueID Information This interface is used to obtain the UniqueID information. The host issues a command for obtaining the data length, and then issues a command for obtaining the content based on the length.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands This command uses the PRP1, PRP2, Dword10, Dword12, and Dword13 fields. Enter reserved value 0 for other fields that are not involved. Table A-44 Command Dword 10 Description 31:00 Data_Len: Data transmission length.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-47 Command Dword 10 Description 31:00 Data_Len: data transmission length, in Dword. The length is 16 bytes. Table A-48 Command Dword 13 Description 15:00 Macro: 0 corresponds to Macro0, and 1 corresponds to Macro0.
Page 192
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-52 Sub_OpCode Sub_OpCode Description 0x070000h Obtain the full digital eye diagram of the PCIe. This command uses the PRP1, PRP2, Dword10, and Dword13 to Dword15 fields. Enter reserved value 0 for other fields that are not involved.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands A.6.1.2 Configuration Command The commands use the PRP1, PRP2, and Dword10 to Dword14 fields. Enter reserved value 0 for fields that are not involved. Table A-57 PRP1 Description 63:00 PRP Entry 1 (PRP1): indicates the data buffer.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-61 Sub_OpCode Sub_OpCode Description 0x170000h SMART information (including information defined by the protocol and vendor) and protocol error logs. A.6.1.2.2 Configuring the SSD Capacity This command is used to configure the available capacity of the entire SSD.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-65 Command Dword13 Description 31:00 0: Normal recovery (Restore data as much as possible and make the SSD able to process read commands, but the SSD will still be in error status.)
A.6.2 Legacy Command (Deprecated) In addition to the commands defined in protocols, the ES3000 V5 supports the commands defined by vendors to provide extensive device management functions. The interfaces described in this section are historical versions and provide the same functions as the Commands.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-72 Command Dword 10 Description 31:00 Data_Len: The length of data transmission is in the unit of Dword. If data transmission is not needed, then the value is 0 h.
Page 198
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands This command uses the PRP1, PRP2, Dword10, Dword12, and Dword13 fields. Enter reserved value 0 for other fields that are not involved Sub_OpType indicates the log type. Table A-75 Sub_OpType...
In the following table, "Field" indicates the combination of the field name, equal sign, field value, and carriage return. For example, "VendorName=Huawei\r\n" is a string, where "VendorName" is the field name and "Huawei" is the field value. Table A-80 Electronic label information...
Page 200
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Area Description Maximum Maximum Remarks Field Field Value Length Length (Bytes) (Bytes) be displayed during query on $ArchivesInf network elements. The oVersion=<V current label version is 3.0, ersion which indicates the number Number>\r\n...
Page 201
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Area Description Maximum Maximum Remarks Field Field Value Length Length (Bytes) (Bytes) BOM=<BO Item of a finer granularity. M Code>\r\n This field is reserved for products whose Huawei item...
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands The subcommand is used to set the SSD SN. The host uses PRP1 and PRP2 to send SN information in the format described in Table6 Table A-84 SN Bytes...
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Sub_OpType Description Aging test enablement The enablement status of each function is returned through CQ Dword0. Table A-87 CQ-Dword0 Description Enable Status: 1 indicates that the function is enabled.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Sub_OpType Description CoreDump information Statistics The obtained valid log length is returned to the host software as Dword0 in the CQ. Table A-90 Completion Queue Entry Dword 0 Description...
1: Forcibly restore SSD disks so that the SSD disks can function properly. 1: Restart or power on and then off SSD disks to restore SSD disks. 1: The fault cannot be rectified. Contact Huawei support engineers. A.6.2.1.8 Obtaining the DIEID of a Chip...
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Test results are returned to the host through the host's physical memory that PRP1 and PRP2 point to. The data structure is defined in the following table. Table A-93 DIEID structure...
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-96 SubOpType SubOpType Description Length of data to be obtained. Content to be obtained. When SubOpType delivered to obtain the uniqueID length is 0, the length is returned by DWORD0 of CQ.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-100 PRP2 Description 63:00 PRP Entry 2 (PRP2): indicates the second PRP entry. If PRP Entry 1 specifies enough space for the data structure, this field is reserved.
ES3000 V5 NVMe PCIe SSD User Guide A Supported NVMe Commands Sub_OpType indicates the type of data to be deleted. Table A-104 Sub_OpType Sub_OpType Description Vendor logs SMART information (including information defined by the protocol and vendor) and protocol error logs.
ES3000 V5 NVMe PCIe SSD User Guide B Out-of-Band Management Out-of-Band Management This section describes the out-of-band management functions of the ES3000 V5. The ES3000 V5 provides the following out-of-band management functions: NVMe basic management commands VPD information Temperature sensors NOTE To use out-of-band management functions, the server must support them.
Page 211
ES3000 V5 NVMe PCIe SSD User Guide B Out-of-Band Management Command Offset Description Code (Byte) Status Flags (SFLGS): This field indicates the status of the NVM subsystem. SMBus Arbitration: Bit 7 is set 1 after a SMBus block read is complete all the way to the stop bit without bus contention and cleared to 0 if a SMBus Send Byte FFh is received on this SMBus slave address.
Page 212
ES3000 V5 NVMe PCIe SSD User Guide B Out-of-Band Management Command Offset Description Code (Byte) Composite Temperature (CTemp): This field indicates the current temperature in degrees Celsius. If a temperature value is reported, it should be the same temperature as the Composite Temperature from the SMART log of hottest controller in the NVM subsystem.
Page 213
ES3000 V5 NVMe PCIe SSD User Guide B Out-of-Band Management Command Offset Description Code (Byte) 10:09 Vendor ID: The 2-byte vendor ID, assigned by the PCI SIG. Should match VID in the Identify Controller command response. MSB is transmitted first.
If you must perform write operations, use the byte mode. If you must write data in page mode, write data of less than 16 bytes from the beginning of each page to prevent overwriting data. The ES3000 V5 VPD information meets the requirements of the NVME-MI1.0 protocol. Table B-3 VPD definition...
Page 215
ES3000 V5 NVMe PCIe SSD User Guide B Out-of-Band Management Factory Description Default Chassis Info Area Starting Offset (CIAOFF): This field indicates the starting offset in multiples of 8 bytes for the Chassis Info Area. A value of 00h may be used to indicate the Chassis Info Area is not...
Page 216
ES3000 V5 NVMe PCIe SSD User Guide B Out-of-Band Management Byte Factory Description Default Management Endpoint Form Factor (MEFF): This field indicates the form factor of the Management Endpoint. Value Definition Other - unknown 1-15 Reserved 2.5" Form Factor -unknown 2.5"...
Page 217
ES3000 V5 NVMe PCIe SSD User Guide B Out-of-Band Management Byte Factory Description Default Maximum 1.8V Power Supply Requirements: This field specifies the maximum 1.8V power supply requirements in Watts. A value of zero indicates that the power supply voltage is not used.
Page 218
ES3000 V5 NVMe PCIe SSD User Guide B Out-of-Band Management Table B-6 NVMe PCIe PortMultiRecord Area Byte Factory Description Default NVMe PCIe Port Record Type ID Bit 7 – end of list; record format version = 2h Record Length (RLEN): This field indicates the length of the MultiRecord Area in bytes.
Page 219
ES3000 V5 NVMe PCIe SSD User Guide B Out-of-Band Management Byte Factory Description Default PCIe Maximum Link Width: The maximum PCIe link width for this NVM Subsystem port. This is the expected negotiated link width that the port link trains to if the platform supports it. A...
ES3000 V5 NVMe PCIe SSD User Guide B Out-of-Band Management Byte Factory Description Default Set to 1 if the PCIe link supports Separate ReClk with SSC (SRIS). Otherwise cleared to 0. Set to 1 if the PCIe link supports Separate ReClk with no SSC (SRNS).
You have installed the SNMP service utility in Windows. For details, see https:// msdn.microsoft.com/en-us/library/cc759570(v=ws.10).aspx. You have uploaded the ES3000 V5 software package to a directory on the server, for example, D:\. Installing the Software Step 1 Log in to the OS as an administrator.
This section describes how to configure the SNMP function in Linux. Preparations Before configuring the SNMP function, check that: You have correctly installed the ES3000 V5 on the server. Net-SNMP is correctly installed in Linux and you have determined the Net-SNMP software version by running the following command: [root]#snmpd -v You have determined the directory storing the snmpd.conf file as follows:...
/usr/lib/hioadmsnmp_5.7.so ----End C.4 Querying SNMP Information This section describes the software for querying ES3000 V5 SNMP information and where to obtain the software. Using the Net-SNMP Command Set You need to install net-snmp-utils before using the Net-SNMP command set to query ES3000 V5 SNMP information.
#snmpd -Dread_config -H 2>&1 | grep "Reading" | sort -u Example If Net-SNMP 5.7 is used, use the snmpd.conf file provided by the ES3000 V5 to start the snmpd program. snmpd -d -Lo -c /opt/hio/snmpd.conf Use the snmpwalk command tool to query ES3000 V5 through SNMPv2c.
Page 225
ES3000 V5 NVMe PCIe SSD User Guide C SNMP Function Table C-1 Node OIDs Node Name Node OID Description Type Permis sion driverVersion 1.3.6.1.4.1.2011.2.319. Driver version OCTET Read- STRING only cardCount 1.3.6.1.4.1.2011.2.319. Number of Integer32 Read- devices only deviceIndex 1.3.6.1.4.1.2011.2.319.
Page 226
ES3000 V5 NVMe PCIe SSD User Guide C SNMP Function Node Name Node OID Description Type Permis sion percentageUsed 1.3.6.1.4.1.2011.2.319. Life used (%) Integer32 Read- 3.1.17 only powerOnHours 1.3.6.1.4.1.2011.2.319. Total power-on Integer32 Read- 3.1.18 time (h) only capacitanceStatu 1.3.6.1.4.1.2011.2.319. Capacitor status...
Volume Management Device (VMD) interface to create and manage virtual storage pools for NVMe SSDs. The Intel VROC uses the architecture to implement NVMe RAID. The Intel VROC function can be used on the ES3000 V5 to easily expand the RAID solution with flexible drives.
Page 228
ES3000 V5 NVMe PCIe SSD User Guide D Using the VROC Function on the ES3000 V5 Usage For details about how to use the VROC, see the VROC guide of Intel. Visit https://downloadcenter.intel.com/, search for VROC in the search box, and download the required software package.
ES3000 V5 NVMe PCIe SSD User Guide E Obtaining Device Logs by Using an Open-Source Tool Obtaining Device Logs by Using an Open- Source Tool This section describes how to obtain ES3000 NVMe PCIe SSD device logs by using the open-source tool nvme-cli.
Page 230
ES3000 V5 NVMe PCIe SSD User Guide E Obtaining Device Logs by Using an Open-Source Tool Example # Obtain the key logs of the nvme1 SSD. [root@localhost ~]# python hiolog.py -d nvme1 Reading log fw(2359) 100% ||..................... done Reading log key(32) 100% ||.........
ES3000 V5 NVMe PCIe SSD User Guide F Introduction to Windows GUI Introduction to Windows GUI Introduction to Windows GUI This section describes the Windows GUI tool in the Windows tool package. After 3.7.2 Installing the Tool Package (Windows), access the Windows GUI tool as follows: If the .NET Framework version is 2.0 or 3.5, double-click the...
Page 232
ES3000 V5 NVMe PCIe SSD User Guide F Introduction to Windows GUI eject: Used to notify the OS to eject a device before manually removing a device. In the left pane, NS indicates a namespace associated with the controller; ns indicates a namespace not associated with any controllers.
Page 233
ES3000 V5 NVMe PCIe SSD User Guide F Introduction to Windows GUI Update Page This page is used to upgrade the ES3000 firmware, as shown in Figure F-4 Figure F-5. Figure F-4 Update page with no firmware upgrade image selected on the ES3000...
Page 234
Select an activation mode. For details, see 6.2.3 Activating the Firmware of SSD. DiskMgnt Page This page is used to format the ES3000 V5, as shown in Figure F-6. Figure F-6 NVMeDiskMgnt page Functions on this page are the same as the operations described in...
Page 235
ES3000 V5 NVMe PCIe SSD User Guide F Introduction to Windows GUI Figure F-7 SelfTest page Functions on this page are the same as the operations described in 6.10 Querying the Diagnosis Result of a Specified SSD. NS Mgnt Page...
Page 236
ES3000 V5 NVMe PCIe SSD User Guide F Introduction to Windows GUI This page provides the following functions, which are the same as the operations described in 6.13 Querying and Configuring Namespaces. Create a namespace. You can create a namespace with a size not exceeding the remaining capacity.
Page 237
ES3000 V5 NVMe PCIe SSD User Guide F Introduction to Windows GUI Figure F-10 NVMe DevMgnt page This page provides the following functions: power state: Set the power consumption level. write mode: Set the write mode. temperature: View drive temperature information, including the highest historical temperature, number of overtemperature occurrences, and overtemperature duration.
ES3000 V5. To install RHEL 7.0, CentOS 7.0, or OEL 7.0 in an ES3000 V5 with a 4K sector size, secure formatting the ES3000 V5 first by referring to 6.4.2 Formatting an SSD to ensure that the ES3000 V5 has no GPT partition information.
Page 239
G Installing an OS on the ES3000 Figure G-1 Creating partitions manually Preparations You have correctly installed the ES3000 V5 on the server. Installing Windows Server 2012 64-Bit on the ES3000 V5 Step 1 Download the hiodriver_2012_x86_64.imgdriver image and mount it to the virtual floppy drive of the server.
Page 241
ES3000 V5 NVMe PCIe SSD User Guide G Installing an OS on the ES3000 Figure G-3 Installing the driver Step 4 After the driver is installed, select the ES3000 V5 for OS installation, as shown in Figure G-4. Figure G-4 Selecting the ES3000 V5 If the ES3000 V5 has previous partition information, such as OS data, the installation may fail.
Page 242
Step 6 Enter diskpart and press Enter, as shown in Figure G-6. Figure G-6 Running the diskpart command Step 7 Enter select disk # (# indicates the number of the ES3000 V5 drive for OS installation) and press Enter, as shown in Figure G-7.
Page 244
After the OS is installed by using its built-in drivers, install the SSD driver hiodriver_v*.*.*.*_2012R2_x84_64.msi released by Huawei. For details about how to install, uninstall, and upgrade the Huawei SSD driver, see 3.6.2 Installing the ES3000 V5 Driver in Windows, 5.1.2 Uninstalling the Driver in Windows, and 5.2.2 Upgrading the ES3000 V5 Driver in Windows respectively.
Huawei provides the documents delivered with the equipment. This document provides guidance for you to solve common problems that occur during routine maintenance or troubleshooting. To better rectify the fault, you are advised to use the guide before contacting Huawei technical support engineers. Issue 07 (2019-03-19)
ES3000 V5 NVMe PCIe SSD User Guide H Getting Help H.4 Obtaining Technical Support Huawei's timely and efficient response is available from: Local branch offices Secondary technical support system Telephone support Remote support Onsite support Technical Support Website Obtain technical documents at http://e.huawei.com.
ES3000 V5 NVMe PCIe SSD User Guide I Acronym or Abbreviation Acronym or Abbreviation Acronym or Abbreviation China Compulsory Certification Cyclic Redundancy Check error checking and correcting HHHL Half-height Half-length IOPS I/O operations per second Logical Block Addressing NVMe NVM Express...