Skip to content

replace AsyncOpenAI with llama_index (WIP) #7

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

jlzhou
Copy link
Contributor

@jlzhou jlzhou commented Feb 4, 2025

I haven't done complete tests on models apart from Ollama local models.

TODO:

  1. Complete tests on openai and other remote LLM service(Need help)
  2. Add llama_index dependencies into requirements.txt
  3. Add extra model config params in settings
  4. Update README.md to fit in with these changes(Need help)
  5. You need to set OPENAI_API_KEY in environment with openai API

Suggestions and improvements are super welcome!

@jlzhou jlzhou changed the title replace AsyncOpenAI by llama_index replace AsyncOpenAI by llama_index (WIP) Feb 4, 2025
@jlzhou
Copy link
Contributor Author

jlzhou commented Feb 4, 2025

Also, if you're running ollama local embeddings model like nomic-embed-text, you'll need to change 'vector(1536)' to 'vector(768)' in two spots in the init.sql file, then execute it to create/re-create the db table.

@jlzhou jlzhou changed the title replace AsyncOpenAI by llama_index (WIP) replace AsyncOpenAI with llama_index (WIP) Feb 4, 2025
@MFYDev
Copy link
Owner

MFYDev commented Feb 5, 2025

Thank you for the commit, I will review this later this week and will keep you updated!

@MFYDev MFYDev self-requested a review February 5, 2025 16:05
@MFYDev MFYDev added the enhancement New feature or request label Feb 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants