Skip to content

Commit 9344afd

Browse files
committed
openib: Disable CUDA async by default
Disable async receive for CUDA under OpenIB. While a performance optimization, it also causes incorrect results for transfers larger than the GPUDirect RDMA limit. This change has been validated and approved by Akshay. References #3972 Signed-off-by: Brian Barrett <[email protected]>
1 parent dccf780 commit 9344afd

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

opal/mca/btl/openib/btl_openib_mca.c

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -573,7 +573,7 @@ int btl_openib_register_mca_params(void)
573573
CHECK(reg_bool("cuda_async_recv", NULL,
574574
"Enable or disable CUDA async recv copies "
575575
"(true = async; false = sync)",
576-
true, &mca_btl_openib_component.cuda_async_recv));
576+
false, &mca_btl_openib_component.cuda_async_recv));
577577
/* Also make the max send size larger for better GPU buffer performance */
578578
mca_btl_openib_module.super.btl_max_send_size = 128 * 1024;
579579
/* Turn of message coalescing - not sure if it works with GPU buffers */

0 commit comments

Comments
 (0)