Skip to content

Fix aya-23 conversion script #7539

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
May 26, 2024
Merged

Fix aya-23 conversion script #7539

merged 1 commit into from
May 26, 2024

Conversation

Galunid
Copy link
Contributor

@Galunid Galunid commented May 25, 2024

model_max_length is not present in aya-23 models' config, so we keep original max_position_embeddings. For command-r models we still overwrite it with model_max_length

@Galunid Galunid changed the title Fix aya-23 conversion scripts Fix aya-23 conversion script May 25, 2024
@github-actions github-actions bot added the python python script changes label May 25, 2024
@Galunid Galunid merged commit 32a2821 into ggml-org:master May 26, 2024
@Galunid Galunid deleted the aya-23-8b-fix branch May 26, 2024 14:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ggerganov ggerganov ggerganov approved these changes

Assignees
No one assigned
Labels
python python script changes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Galunid @ggerganov