[UR] Add inter-process communication extension functionality #20095
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This commit adds functions for handling inter-process communication (IPC) of device USM memory allocations. Support for these functions are implemented for both level zero adapters and the CUDA adapter. Signed-off-by: Larsen, Steffen <[email protected]>
steffenlarsen
temporarily deployed
to
WindowsCILock
GitHub Actions
Inactive
|
Draft SYCL extension building on this: #20018 |
steffenlarsen
commented
Sep 16, 2025
| @@ -439,3 +440,10 @@ struct ur_mem_handle_t_ : ur::cuda::handle_base { | |||
| } | |||
| } | |||
| }; | |||
|
|
|||
| struct ur_exp_ipc_mem_handle_t_ { | |||
| umf_memory_pool_handle_t UMFPool; | |||
There was a problem hiding this comment.
Asked by @vinser52 in #20018 (comment):
Why do you need UMFPool to be part of the handle?
There was a problem hiding this comment.
The use-case of IPC handles are two-fold:
Owner:
- Create a handle with
urIPCGetMemHandleExp. This uses the pool tied to the USM pointer argument. - Pool should not be used after this, but theoretically an implementation could allow a call to
urIPCOpenMemHandleExpeven though it may not make much sense to do in the same process.
Consumer:
- Create a handle from passed data using
urIPCCreateMemHandleFromDataExp. This uses the default device memory pool associated with both the associated context and device. - Open the handle using
urIPCOpenMemHandleExp. This uses the pool retrieved in the previous step in order to get the UMF IPC handler. If we did not have this, I believe we would need to add the device to this API as well, but doing so means the device could differ between these two steps.
steffenlarsen
temporarily deployed
to
WindowsCILock
GitHub Actions
Inactive
steffenlarsen
temporarily deployed
to
WindowsCILock
GitHub Actions
Inactive
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This commit adds functions for handling inter-process communication (IPC) of device USM memory allocations. Support for these functions are implemented for both level zero adapters and the CUDA adapter.