Model of parallelism? #37
Description
What model of parallelism NVIDIA fork uses? Is there any documentation or paper about it?
How much speed improvement we may to expect using "-gpus all" switch for 2 and 4 GPUs?
{{ message }}
What model of parallelism NVIDIA fork uses? Is there any documentation or paper about it?
How much speed improvement we may to expect using "-gpus all" switch for 2 and 4 GPUs?