Skip to content
This repository was archived by the owner on Jun 24, 2024. It is now read-only.

Support new quantization formats #321

Closed
philpax opened this issue Jun 19, 2023 · 2 comments
Closed

Support new quantization formats #321

philpax opened this issue Jun 19, 2023 · 2 comments
Labels
issue:enhancement New feature or request

Comments

@philpax
Copy link
Collaborator

philpax commented Jun 19, 2023

llama.cpp appears to have developed new quantization formats (K_S, K_M, K_L). We should investigate these and figure out what's required to support them.
@philpax philpax added the issue:enhancement New feature or request label Jun 19, 2023
@LLukas22
Copy link
Contributor

Already opened another issue for this #301 😬

@philpax
Copy link
Collaborator Author

philpax commented Jun 19, 2023

derp

@philpax philpax closed this as not planned Won't fix, can't repro, duplicate, stale Jun 19, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
issue:enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@philpax @LLukas22