background image

Workloads Performance & Optimizations

- 32 -

5.2.2 Memory Settings and Memory Allocators

It is recommended that memory allocators be configured to use large pages 
(as example THP - the Linux Transparent Huge Pages), while correctly 
configuring them to (1) save on memory use, and (2) avoid memory 
fragmentation. For example, if the application was pre-compiled with the 
default libc allocator or with jemalloc, or links to one of them using the OS 
dynamic linker, please use the following guidelines:

1.    For jemalloc, ensure THP operation is maintained by running the command:

Figure 5-1. Performance Data Collection

2.    For libc, the following environment variables may be useful to increase 

memory allocation size by the application, and to reduce virtualization 
overheads:

Figure 5-2. Performance Data Collection

5.2.3 Application Settings

Application parallelism or concurrency yields great benefits with Ultrastar 
memory drive. Make sure your application is configured to use many threads 
in order to process data, where available. CPU over-subscription increases the 
throughput of Ultrastar memory drive. 

# ln -sf ‘lg_dirty_mult:-1’ /etc/malloc.conf

# export MALLOC_TOP_PAD_=$((16777216))
# export MALLOC_TRIM_THRESHOLD_=$((16777216))

Summary of Contents for Ultrastar DC ME200

Page 1: ...Ultrastar DC ME200 Memory Extension Drive PRODUCT MANUAL...

Page 2: ...Revision Date Description Reference 1 0 January 10 2019 Initial release 2 0 March 22 2019 Added best practices for benchmarking and enhanced troubleshooting 3 0 May 07 2019 Update to links within Sect...

Page 3: ...based on tort warranty contract or any other legal theory even if advised of the possibility of such damages This document and its contents including diagrams schematics methodology work product and i...

Page 4: ...IMIZATIONS 30 5 1 Target Workloads for Ultrastar Memory 30 5 1 1 Workloads That Do Not Benefit From Ultrastar Memory Drive 31 5 2 Optimized Workload Settings 31 5 2 1 Operating System 31 5 2 2 Memory...

Page 5: ...aller 16 Figure 3 7 Software Installer 17 Figure 3 8 Systems Settings and Diagnostics 1 18 Figure 3 9 Systems Settings and Diagnostics 2 19 Figure 3 10 Systems Settings and Diagnostics 3 20 Figure 3 1...

Page 6: ...tware defined Memory SDM Capacity 28 Table 4 2 Maximum Software defined Memory SDM capacity for Ultrastar Memory 29 Table 5 1 Workloads and Applications 30 Table 7 1 Common Installation Error Codes 37...

Page 7: ...DRAM like performance across a variety of applications especially targeting highly parallel workloads with high numbers of transactions Once installed the solution is transparent requiring no changes...

Page 8: ...astar memory drive is accidentally deleted or corrupted refer to Chapter 8 Reload the Ultrastar Memory Software Figure 2 1 Preloaded Software Installing the Ultrastar memory drive is as simple as phys...

Page 9: ...8 6 2535 77 sh in t Preparing installer Please take a moment to read the below Welcome to WDC Ultrastar DC ME200 memory version 8 6 2535 77 By installing and or using this software you acknowledge th...

Page 10: ...ch the installer with the update flag and follow on screen instructions 6 Press the U key to start the update process 7 Reboot the system The new version of the Ultrastar memory software will load and...

Page 11: ...booting from the NVMe is not available refer to the Chapter 8 Reload the Ultrastar Memory Software of this publication 3 Save changes in BIOS configuration and reboot the system 4 Re enter the BIOS s...

Page 12: ...feature is a default setting To enable Intel Virtualization Technology VT navigate via the menu and proceed with the following steps 1 Select Advanced then select Socket Configuration 2 Click on Proc...

Page 13: ...menu and proceed with the following steps 1 Select Advanced then select Socket Configuration 2 Click on Integrated IO Configuration and set Intel Virtualization Technology for Direct I O to Enabled Fi...

Page 14: ...It is important to note that for data centers in which KVM console access is not available the Ultrastar memory drive can be configured for those outputs and controls to be available via Serial over...

Page 15: ...ystem reports a total of 2 816GiB available for use Warning messages if any displayed in yellow font notify the user about deviations from best practices and recommendations A prompt is displayed to o...

Page 16: ...768GB RAM of which 728GB are available for use 2 x NVMe SSDs Boards with 1 788GiB each of which 1 044GiB each are available for use The system reports total 2 816GB available for use NVMe SMART attrib...

Page 17: ...mespace ID Namespace size NSZE 543076758 Namespace capacity NCAP 543076758 Namespace utilization NUSE 543076758 SMART HEALTH Information Log Critical Warning 0x0 Composite Temperature 48 C Available S...

Page 18: ...the default or set it manually The physical board memory used typically used in benchmarking otherwise keep as Default Set the system to auto restart in case of critical failure of a system component...

Page 19: ...drive to set the number to the optimal value for performance Switch this setting to Manual and set any other value from the range allowed by the system if desired Setting a higher number than the defa...

Page 20: ...y NUMA domain which is the default setting Expand Local Memory Domains to expand each processor s memory domain with a portion of the memory made available by Ultrastar memory drive The Expand Local M...

Page 21: ...mains Memory from Ultrastar memory drive is a single additional numa node without CPUs Figure 3 11 Unify Remote Memory Domains Expand Local Memory Domains Memory from Ultrastar memory drive is divided...

Page 22: ...e Hardware tab the following can be set 1 Intel processor Hyper threading 2 Turbo boost 3 Hardware virtualization support 4 Enable or disable the use of Ultrastar memory devices as storage devices To...

Page 23: ...cs Menu 23 Figure 3 14 Boot Tab In the Boot tab select the device containing the desired operating system The boot device can be an optical device or a disk connected directly to the system a SAN conn...

Page 24: ...s tests to run or run All Tests The test results will be presented on screen see next screen shot Go back to the Diagnostics tab and select to save the test results to a USB Flash Drive or make them a...

Page 25: ...ostic test results on screen and navigate using the keyboard arrows and page up page down keys To save the diagnostics results press ESC to go back to the Diagnostics tab and choose the option desired...

Page 26: ...ot Settings and Diagnostics Menu 26 Figure 3 18 TFTP Option Alternatively Diagnostics results can also be obtained via TFTP this option requires a DHCP server on your network to assign an IP address t...

Page 27: ...ith capacity of 1TiB attached two to each socket would perform better than a two 2TiB Ultrastar memory device attached one to each socket 4 2 DRAM to Ultrastar Memory Drive Ratio Ultrastar memory driv...

Page 28: ...5632 7168 4864 5632 7168 10240 3 2048 6144 768 1536 3072 6144 7680 9216 6144 7680 9216 12288 4 2048 8192 768 1536 3072 6144 9728 11264 6144 9728 11264 14336 5 2048 10240 768 1536 3072 6144 11776 1331...

Page 29: ...32 7168 10240 3 2048 6144 6048 6336 6528 6912 7680 9216 6912 7680 9216 12288 4 2048 8192 6048 8384 8576 8960 9728 11264 8960 9728 11264 14336 5 2048 10240 6048 10432 10624 11008 11776 13312 11008 1177...

Page 30: ...n be Databases tuples In memory columnar database Reading database indexes Large in core matrices Block of memory stored from a disk through DMA While relevant application workloads can be row or colu...

Page 31: ...andwidth of 100GB s total on their memory controllers link to DRAM An example for that is a program constantly accessing memory and doing little compute on the fetched memory before moving over to con...

Page 32: ...oc ensure THP operation is maintained by running the command Figure 5 1 Performance Data Collection 2 For libc the following environment variables may be useful to increase memory allocation size by t...

Page 33: ...amount of DRAM aggregated with Ultrastar memory drive to create the same memory foot print In many cases due to the limitation of obtaining a comparable system with sufficient amount of DRAM a scaled...

Page 34: ...l demonstrated value based price performance enhanced capabilities and overall cost reduction savings DRAM expansion by up to 8x DRAM like performance not more than 25 difference Memory cost reduction...

Page 35: ...tion After the workload execution is complete if you wish to have the statistics reviewed create a zipped tar archive of the files collected or the complete target directory tmp stats in the example a...

Page 36: ...th Ultrastar memory where 2 would be a cost effective alternative to DRAM Memory Expansion Validate that a workload with a memory footprint higher than DRAM capacity can successfully execute with near...

Page 37: ...rastar memory loads but OS fails to boot OS installation is erroneous Make sure a supported Linux OS is installed Collect information report to L2 Ultrastar memory drive reports error 279 or 700 The b...

Page 38: ...t the Ultrastar memory drive Press F5 to access the Ultrastar memory drive menu settings and run diagnostic tests Ultrastar memory drive and OS successfully boots problems arise after booting process...

Page 39: ...port wdc data center drives ssd ultrastar dc me200 Install the Ultrastar memory drive software to the Ultrastar memory device 1 If the system is capable of booting directly from the Ultrastar memory d...

Page 40: ...ccept to accept the terms and conditions above Accept terms and conditions accepted WDC Ultrastar DC ME200 NVMe SSD licensing status Block Device Vendor and Model Number Serial Number Size GB GiB 01 d...

Page 41: ...e device proceed with the following steps 1 Insert a bootable flash media to the system such as USB flash drive 2 Ensure the bootable flash media is unmounted 3 Install the Ultrastar memory drive soft...

Page 42: ...rms and conditions above accept Terms and conditions accepted WDC Ultrastar DC ME200 memory version 8 6 2535 77 found the following bootable media Block Device Vendor and Model Number Serial Number Si...

Page 43: ...TiB 2TiB 4TiB AIC 1TiB 2TiB 4TiB Form Factors U 2 2 5 15mm dual port NVMe AIC HH HL NVMe Operating Systems For an updated list of operating systems please refer to the latest release notes Ultrastar m...

Page 44: ...Specifications 44...

Page 45: ...e CA 95119 U S A For service and literature support wdc com www westerndigital com 800 ASK 4WDC North America 800 6008 6008 Asia Pacific 00800 ASK 4WDEU Europe toll free where available 31 88 0062100...

Reviews: