Skip to content

Find libcuda.so automatically if --with-cuda-lib is not passed. #12382

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Mar 5, 2024
Merged

Find libcuda.so automatically if --with-cuda-lib is not passed. #12382

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
9437b62
Find libcuda.so automatically if --with-cuda-lib is not passed.
nsarka Feb 26, 2024
e69aae0
Update docs to reflect change that configure script will automaticall…
nsarka Feb 29, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 10 additions & 1 deletion config/opal_check_cuda.m4
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,9 +50,18 @@ AC_ARG_WITH([cuda],
[AS_HELP_STRING([--with-cuda(=DIR)],
[Build cuda support, optionally adding DIR/include])])
AC_MSG_CHECKING([if --with-cuda is set])

# Search for libcuda.so in $with_cuda if the user didn't pass --with-cuda-libdir
# Otherwise check for cuda in the default path, /usr/local/cuda. If the default
# path doesn't exist, set with_cuda_libdir to empty.
AC_ARG_WITH([cuda-libdir],
[AS_HELP_STRING([--with-cuda-libdir=DIR],
[Search for CUDA libraries in DIR])])
[Search for CUDA libraries in DIR])],
[],
[AS_IF([test -d "$with_cuda"],
[with_cuda_libdir=$(dirname $(find $with_cuda -name libcuda.so 2> /dev/null) 2> /dev/null)],
[with_cuda_libdir=$(dirname $(find /usr/local/cuda -name libcuda.so 2> /dev/null) 2> /dev/null)])
])

# Note that CUDA support is off by default. To turn it on, the user has to
# request it. The user can just ask for --with-cuda and it that case we
Expand Down
10 changes: 6 additions & 4 deletions docs/tuning-apps/networking/cuda.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,14 +41,16 @@ Open MPI offers two flavors of CUDA support:
shell$ ./configure --prefix=/path/to/ucx-cuda-install --with-cuda=/usr/local/cuda --with-gdrcopy=/usr

# Configure Open MPI this way
shell$ ./configure --with-cuda=/usr/local/cuda --with-cuda-libdir=/usr/local/cuda/lib64/stubs/ --with-ucx=/path/to/ucx-cuda-install <other configure params>
shell$ ./configure --with-cuda=/usr/local/cuda --with-ucx=/path/to/ucx-cuda-install <other configure params>

#. Via internal Open MPI CUDA support

Regardless of which flavor of CUDA support (or both) you plan to use,
Open MPI should be configured using the ``--with-cuda=<path-to-cuda>``
and ``--with-cuda-libdir=<path-to-libcuda.so>`` configure options to
build CUDA support into Open MPI.
configure option to build CUDA support into Open MPI. The configure
script will automatically search the path given for ``libcuda.so``. If it cannot
be found, please also pass ``--with-cuda-libdir``. For example:
``--with-cuda=<path-to-cuda> --with-cuda-libdir=/usr/local/cuda/lib64/stubs``.

Open MPI supports building with CUDA libraries and running on systems
without CUDA libraries or hardware. In order to take advantage of
Expand All @@ -65,7 +67,7 @@ An example configure command would look like the following:
.. code-block:: sh

# Configure Open MPI this way
shell$ ./configure --with-cuda=/usr/local/cuda --with-cuda-libdir=/usr/local/cuda/lib64/stubs \
shell$ ./configure --with-cuda=/usr/local/cuda \
--enable-mca-dso=btl-smcuda,rcache-rgpusm,rcache-gpusm,accelerator-cuda <other configure params>

/////////////////////////////////////////////////////////////////////////
Expand Down