Skip to content

Classifier-free guidance #506

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
abb128 opened this issue Jul 19, 2023 · 2 comments
Open

Classifier-free guidance #506

abb128 opened this issue Jul 19, 2023 · 2 comments
Labels
enhancement New feature or request quality Quality of model output

Comments

@abb128
Copy link

abb128 commented Jul 19, 2023

Classifier-free guidance was implemented in llama.cpp in ggml-org/llama.cpp#2135, but it doesn't look like there's a way to use it with these bindings. It seems like a useful feature, so it'd be nice to have this

@abetlen
Copy link
Owner

abetlen commented Jul 20, 2023

@abb128 totally, the low-level api is implemented for this but not the high-level api, I'll add it to the v0.2 roadmap

@gjmulder gjmulder added enhancement New feature or request quality Quality of model output labels Jul 30, 2023
@apolinario
Copy link

Gentle bump feature suggestion for the high level API as the text-to-music model YuE uses CFG https://github.com/multimodal-art-projection/YuE

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request quality Quality of model output
Projects
None yet
Development

No branches or pull requests

4 participants