Skip to content

Fix llama cpp model switching #115

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Dec 17, 2024
Merged

Fix llama cpp model switching #115

merged 1 commit into from
Dec 17, 2024

Conversation

mschuettlerTNG
Copy link
Contributor

Description:

Llama.cpp backend did not load a new model after the first model was loaded.

Changes Made:

  • correctly load new model after model switch

Testing Done:

Tested locally on BMG.

Checklist:

  • I have tested the changes locally.
  • I have self-reviewed the code changes.

@mschuettlerTNG mschuettlerTNG changed the base branch from main to dev December 16, 2024 21:44
@Nuullll Nuullll merged commit c2d83f1 into intel:dev Dec 17, 2024
6 checks passed
@mschuettlerTNG mschuettlerTNG deleted the fix_llama_cpp_model_switching branch January 29, 2025 08:39
EffortlessSteven pushed a commit to zimm0140/AI-Playground that referenced this pull request Mar 27, 2025
@Nuullll
Merge pull request intel#115 from TNG/fix_llama_cpp_model_switching
1717891 
Fix llama cpp model switching
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Nuullll Nuullll Nuullll approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@mschuettlerTNG @Nuullll