CUDA-GPU\CUDA开发手册，纤细介绍了CUDA的开发原理，开发步骤，以及相关的API-CUDA

CUDA

Version 1.1

III

目 录

2

............................................................................................................................................................ 7

2.1

............................................................................................................................... 7

2.2

................................................................................................................................................... 7

2.2.1

.............................................................................................................................................. 7

2.2.2

...................................................................................................................................... 8

2.3

................................................................................................................................................. 10

3

........................................................................................................................................................ 13

3.1

SIMD

4.1 C

4.2

................................................................................................................................................. 17

4.2.1

4.2.2

4.2.3

........................................................................................................................................ 21

4.2.4

........................................................................................................................................ 21

4.2.5

NVCC

........................................................................................................................... 22

4.3

..................................................................................................................................... 23

4.3.1

................................................................................................................................ 23

4.3.2

........................................................................................................................................ 24

Version 1.1

IV

4.4.4

................................................................................................................................ 27

4.4.5

........................................................................................................................................ 27

4.4.6

........................................................................................................................................ 28

4.5

....................................................................................................................................... 28

4.5.1

........................................................................................................................................ 29

4.5.2

API ..................................................................................................................................... 32

4.5.3

API ................................................................................................................................. 39

5

........................................................................................................................................................ 47

5.5

6

6.1

6.2

................................................................................................................................................. 69

6.3

................................................................................................................................................. 71

6.3.1 Mul() ............................................................................................................................................ 71

6.3.2 Muld() .......................................................................................................................................... 71

........................................................................................................................................................ 73

........................................................................................................................................................ 83

C.1

C.1.1 atomicAdd() ............................................................................................................................... 83

C.1.2 atomicSub() ............................................................................................................................... 83

C.1.3 atomicExch() ............................................................................................................................. 83

CUDA

Version 1.1

V

C.1.4 atomicMin() ............................................................................................................................... 84

C.1.5 atomicMax() ............................................................................................................................... 84

C.1.6 atomicInc() ............................................................................................................................... 84

C.1.7 atomicDec() ............................................................................................................................... 84

C.2

..................................................................................................................................................... 85

API

........................................................................................................................................... 87

D.1.3 cudaGetDevice() ...................................................................................................................... 87

D.1.4 cudaGetDeviceProperties() .............................................................................................. 88

D.1.5 cudaChooseDevice() .............................................................................................................. 89

D.2

.................................................................................................................................................. 89

D.2.1 cudaThreadSynchronize() .................................................................................................. 89

D.2.2 cudaThreadExit() ................................................................................................................... 89

D.3

...................................................................................................................................................... 89

D.3.1 cudaStreamCreate() .............................................................................................................. 89

D.3.2 cudaStreamQuery() ................................................................................................................. 89

D.3.3 cudaStreamSynchronize() .................................................................................................. 89

D.4.1 cudaEventCreate() ................................................................................................................. 90

D.4.2 cudaEventRecord() ................................................................................................................. 90

D.4.3 cudaEventQuery() ................................................................................................................... 90

D.4.4 cudaEventSynchronize() ..................................................................................................... 90

D.5.1 cudaMalloc() ............................................................................................................................. 91

D.5.2 cudaMallocPitch() ................................................................................................................. 91