Skip to content

Commit cb7c13d

Browse files
committed
update CANN.md
1 parent f66e152 commit cb7c13d

File tree

1 file changed

+6
-11
lines changed

1 file changed

+6
-11
lines changed

docs/backend/CANN.md

Lines changed: 6 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -286,25 +286,20 @@ Please add the **[CANN]** prefix/tag in issues/PRs titles to help the CANN-team
286286

287287
### GGML_CANN_ASYNC_MODE
288288

289-
`GGML_CANN_ASYNC_MODE` controls whether asynchronous commit mode is enabled(default closed state), which can help speed up model execution. Yes, enable, y, 1, on ,true(case insensitive) are all valid values to enable `GGML_CANN_ASYNC_MODE`, such as `export GGML_CANN_ASYNC_MODE=yEs`.
290-
291-
289+
Enables asynchronous operator submission. Disabled by default.
292290

293291
### GGML_CANN_MEM_POOL
294292

295-
three cases here:
293+
Specifies the memory pool management strategy:
296294

297-
- By setting `export GGML_CANN_MEM_POOL=pRio` (the value is case-insensitive), you specify the use of a priority queue-based memory pool.
295+
- vmm: Utilizes a virtual memory manager pool. If hardware support for VMM is unavailable, falls back to the legacy (leg) memory pool.
298296

299-
- Legacy memory pools are enabled when VMM is not available or when `export GGML_CANN_MEM_POOL=leg` is set.
300-
301-
- default VMM
297+
- prio: Employs a priority queue-based memory pool management.
298+
- leg: Uses a fixed-size buffer pool.
302299

303300
### GGML_CANN_DISABLE_BUF_POOL_CLEAN
304301

305-
`GGML_CANN_DISABLE_BUF_POOL_CLEAN` is used to disable the buffer pool cleaning feature.
306-
The values **yes**, **enable**, **y**, **1**, **on**, and **true** (case-insensitive) are all valid to enable `GGML_CANN_DISABLE_BUF_POOL_CLEAN`. such as `export GGML_CANN_DISABLE_BUF_POOL_CLEAN=yEs`.
307-
302+
Controls automatic cleanup of the memory pool. This option is only effective when using the prio or leg memory pool strategies.
308303

309304
## TODO
310305
- Support more models and data types.

0 commit comments

Comments
 (0)