Support for xgen and codegen models from Salesforce #2137
RahulVivekNair
started this conversation in
Ideas
Replies: 2 comments
-
I'd second this, finding that fine-tunes of the codegen 2.5 7B model are getting better results than Llama V2 13B on the same dataset. |
Beta Was this translation helpful? Give feedback.
0 replies
-
Hey!!!! Any luck with this? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Salesforce has released weights for xgen and well as codegen which shows some impressive human eval numbers and the best part is that they are based on the llama architecture and are pre trained on upto 8k context length. Any chance that it can be run by llama.cpp considering it is the same architecture?
Beta Was this translation helpful? Give feedback.
All reactions