We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 5002175 commit 8eadcf0Copy full SHA for 8eadcf0
vllm/block.py
@@ -13,7 +13,7 @@
13
14
15
class BlockPool:
16
- """A pool of physical blocks.
+ """A pool of logical blocks.
17
When requests come, we create a lot of logical blocks;
18
when requests are done, we destroy a lot of logical blocks.
19
It turns out that creating and destroying logical blocks can be expensive,
0 commit comments