Skip to content

Phi 3.5 doesn't work #58

@theawless

Description

@theawless

Describe the bug

I was trying phi 3.5 with this tool but it throws unknown error

To Reproduce

Steps to reproduce the behavior:

  1. Add phi 3.5 to the llm models folder
  2. In the Answer tab, select phi 3.5 under models
  3. Write a message and click generate

Expected behavior

Expect the model to respond just like how phi 3 does

Screenshots

image

Environment (please complete the following information):

  • OS: Windows11
  • GPU: Intel Arc A770 16G
  • CPU: Ultra 7 155H
  • Version: v1.01b-MTL-H

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions