-
-
Notifications
You must be signed in to change notification settings - Fork 10.6k
Closed
Labels
documentationImprovements or additions to documentationImprovements or additions to documentation
Description
📚 The doc issue
This code snippiet doesn't work - tensorizer_uri doesn't exist as a parameter
llm = LLM(model="facebook/opt-125m",
load_format="tensorizer",
tensorizer_uri=path_to_opt_tensors,
num_readers=3,
vllm_tensorized=True)
vllm/examples/tensorize_vllm_model.py
Line 91 in 702bee4
tensorizer_uri=path_to_opt_tensors, |
Suggest a potential alternative/fix
No response
Metadata
Metadata
Assignees
Labels
documentationImprovements or additions to documentationImprovements or additions to documentation