You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In the latest version an important support in vLLM V1 was added for mamba1 and Jamba and I think its worth mentioning.
Suggest a potential alternative/fix
I think adding a bullet to the highlights under Model Support saying -
vLLM v1 now supports models Mamba1 models and Jamba
is important
Before submitting a new issue...
Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.