background image

Overview 

Tesla K40 GPU Accelerator 

BD-06902-001_v05  |  3 

NVIDIA GPU BOOST ON TESLA K40 

NVIDIA GPU Boost

 is a feature available on Tesla K40. It makes use of any power 

headroom to run the core clock to a higher frequency. Application workloads that have 

power headroom can run at high GPU clocks to boost application performance.  

 

 

Note: The memory clock remains constant at 3 GHz. It's likely that the effective 

memory bandwidth utilization will change depending on the core clock frequency. 

 

NVIDIA GPU Boost for HPC Workloads 

NVIDIA GPU Boost for Tesla K40 is optimized to deliver a robust and deterministic 

boost behavior for a wide range of HPC workloads.  

Tesla K40 gives full control to end-users to select the core clock frequency that fits their 
workload the best. The workload may have one or more of the following characteristics.   

 

Problem set is spread across multiple GPUs and requires periodic synchronization.  

 

Problem set spread across multiple GPUs and runs independent of each other.  

 

Workload has “compute spikes.” For example, some portions of the workload are 

extremely compute intensive pushing the power higher and some portions are 
moderate.  

 

Workload is compute intensive through-out without any spikes.  

 

Workload requires fixed clocks and is sensitive to clocks fluctuating during the 
execution. 

 

Workload runs in a cluster where all GPUs need to start, finish, and run at the same 

clocks.  

 

Workload or end user requires predictable performance and repeatable results.  

 

Datacenter is used to run different types of workload at different hours in a day to 

better manage the power consumption.  

 

Some boards in a cluster have access to better cooling than others. 

By default the Tesla K40 ships with the core clock set to the base clock. HPC workloads 

can have one or more characteristics as described. When selecting one of the supported 
boost clocks a good strategy is to characterize the workload with the available boost 
clocks. For example, DGEMM/Linpack are extremely demanding on power. Therefore, 

the “base clock” may be the correct choice when running Linpack. Some workloads in 
life sciences, manufacturing, CFD, CAD, etc., may have power headroom and can take 
advantage of one of the boost clocks. 

Summary of Contents for TESLA K40

Page 1: ...BD 06902 001_v05 November 2013 Board Specification TESLA K40 GPU ACCELERATOR...

Page 2: ...change 02 August 1 2013 GG SM Updated product name Updated core clocks speeds Updated block diagram in Figure 1 03 September 19 2013 GG SM Added new section NVIDIA GPU Boost on Tesla K40 Updated Powe...

Page 3: ...IA GPU Boost for HPC Workloads 3 API for NVIDIA GPU Boost on Tesla 4 Tesla K40 Block Diagram 6 Environmental Conditions 6 Configuration 7 Mechanical Specifications 8 PCI Express System 8 Tesla K40 Bra...

Page 4: ...6 Pin PCI Express Power Connector 10 Figure 6 8 Pin PCI Express Power Connector 11 LIST OF TABLES Table 1 nvidia smi Commands 5 Table 2 Board Environmental Conditions 6 Table 3 Board Configuration 7 T...

Page 5: ...ervers and offers a total of 12 GB of GDDR5 on board memory and supports PCI Express Gen3 The Tesla K40 uses a passive heat sink for cooling Tesla K40 boards ship with ECC enabled by default protectin...

Page 6: ...selected using NVML or NVSMI Refer to the NVML NVSMI documentation for more details Board PCI Express Gen3 16 system interface Physical dimensions 111 15 mm height 267 mm length dual slot Thermal Solu...

Page 7: ...ad has compute spikes For example some portions of the workload are extremely compute intensive pushing the power higher and some portions are moderate Workload is compute intensive through out withou...

Page 8: ...nd users to select the core clock frequency via NVML or nvidia smi NVML is a C based API for monitoring and managing the various states of Tesla products It provides a direct access to submit queries...

Page 9: ...nning on the GPU This maintains current state including requested applications clocks If persistence mode is not enabled and no applications are using the GPU the driver will unload and any current us...

Page 10: ...ocessor module Figure 2 Tesla K40 Block Diagram ENVIRONMENTAL CONDITIONS Table 2 lists the environmental operating and storage conditions for the Tesla K40 board Table 2 Board Environmental Conditions...

Page 11: ...e 12 GB Memory I O 384 bit GDDR5 Memory configuration 24 pieces of 256M 16 GDDR5 SDRAM Display connectors None Power connectors 8 pin PCI Express power connector 6 pin PCI Express power connector Boar...

Page 12: ...e 3 conforms to the PCI Express full height form factor Figure 3 Tesla K40 GPU Accelerator TESLA K40 BRACKET As shown in Figure 4 the Tesla K40 includes a vented bracket If you are an OEM who qualifie...

Page 13: ...Mechanical Specifications Tesla K40 GPU Accelerator BD 06902 001_v05 9 Figure 4 Tesla K40 Bracket...

Page 14: ...ator is a performance optimized high end product and uses power from the PCI Express connector as well as external power connectors Figure 5 and Figure 6 show the specifications and Table 4 and Table...

Page 15: ...Mechanical Specifications Tesla K40 GPU Accelerator BD 06902 001_v05 11 Figure 6 8 Pin PCI Express Power Connector...

Page 16: ...902 001_v05 12 Table 4 6 Pin PCI Express Power Connector Pinout Pin Number Description 1 12 V 2 12 V 3 12 V 4 GND 5 Sense 6 GND Table 5 8 Pin PCI Express Power Connector Pinout Pin Number Description...

Page 17: ...iliary Power Connectors 8 Pin Header 6 Pin Header Support Notes Connect 8 pin cable Connect 6 pin cable Yes Connect 8 pin cable No cable installed Yes 8 pin cable must supply 175 W Connect 6 pin cable...

Page 18: ...um Currents Amps 3 3 8 8 1 0 12 8 8 19 6 Note System power qualification with the Tesla cards should be done with the Thermal Design Power TDP application provided by NVIDIA The peak current values ar...

Page 19: ...Radio Spectrum Management Group of New Zealand C Tick Bureau of Standards Metrology and Inspection BSMI Conformit Europ enne CE Federal Communications Commission FCC Industry Canada Interference Causi...

Page 20: ...Server 2008 R2 Linux English US X X English UK X Arabic X Chinese Simplified X Chinese Traditional X Danish X Dutch X Finnish X French X French Canada X German X Italian X Japanese X Korean X Norwegia...

Page 21: ...on planned by customer and to do the necessary testing for the application in order to avoid a default of the application or the product Weaknesses in customer s product designs may affect the quality...

Reviews: