Skip to content

Commit d98edcd

Browse files
committed
Skip device validation to make plugin device work
Signed-off-by: Yikun Jiang <[email protected]>
1 parent 6e4cea1 commit d98edcd

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/config.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2231,7 +2231,7 @@ def is_multi_step(self) -> bool:
22312231
class DeviceConfig:
22322232
"""Configuration for the device to use for vLLM execution."""
22332233

2234-
device: Union[Device, torch.device] = "auto"
2234+
device: SkipValidation[Union[Device, torch.device]] = "auto"
22352235
"""Device type for vLLM execution.
22362236
This parameter is deprecated and will be
22372237
removed in a future release.

0 commit comments

Comments
 (0)