Skip to content

Commit bc9d3e3

Browse files
leedrake5slaren
andauthored
Update README.md (#3289)
* Update README.md * Update README.md Co-authored-by: slaren <[email protected]> --------- Co-authored-by: slaren <[email protected]>
1 parent 36b904e commit bc9d3e3

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

README.md

+4
Original file line numberDiff line numberDiff line change
@@ -557,6 +557,10 @@ python3 convert.py models/7B/
557557
# quantize the model to 4-bits (using q4_0 method)
558558
./quantize ./models/7B/ggml-model-f16.gguf ./models/7B/ggml-model-q4_0.gguf q4_0
559559

560+
# update the gguf filetype to current if older version is unsupported by another application
561+
./quantize ./models/7B/ggml-model-q4_0.gguf ./models/7B/ggml-model-q4_0-v2.gguf COPY
562+
563+
560564
# run the inference
561565
./main -m ./models/7B/ggml-model-q4_0.gguf -n 128
562566
```

0 commit comments

Comments
 (0)