Skip to content

Commit 1f7e05c

Browse files
committed
fix infer device_map (#2105)
1 parent 3b82b5d commit 1f7e05c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

swift/llm/infer.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -141,7 +141,7 @@ def prepare_model_template(args: InferArguments,
141141
else:
142142
print(f'device_count: {torch.cuda.device_count()}')
143143
model_kwargs = {}
144-
if device_map is not None:
144+
if device_map is None:
145145
device_map = get_default_device_map()
146146
model_kwargs['device_map'] = device_map
147147
if device_map == 'auto':

0 commit comments

Comments
 (0)