Skip to content

Implement LLaMA #9

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 16 commits into from
Mar 30, 2023
Merged

Implement LLaMA #9

merged 16 commits into from
Mar 30, 2023

Conversation

WoosukKwon
Copy link
Collaborator

@WoosukKwon WoosukKwon commented Mar 26, 2023 •
edited by zhuohan123
Loading

TODO:

  • Test against HF implementation
  • Add TP support (@zhuohan123)

@WoosukKwon
Copy link
Collaborator Author

@zhuohan123 Please feel free to approve and merge this PR once you think it's ready.

@zhuohan123 zhuohan123 self-requested a review March 29, 2023 06:37
@zhuohan123 zhuohan123 merged commit 80a2f81 into main Mar 30, 2023
@WoosukKwon WoosukKwon deleted the llama branch April 12, 2023 03:12
@TheBloke TheBloke mentioned this pull request Jul 20, 2023
Closed
v1nc3nt27 pushed a commit to v1nc3nt27/vllm that referenced this pull request Sep 12, 2023
@ri938
Merge pull request vllm-project#9 from ri938/organise
010b5bc 
dont error if user doesnt have kernels installed
@shanshanpt shanshanpt mentioned this pull request Nov 17, 2023
Closed
@junior-zsy junior-zsy mentioned this pull request Nov 20, 2023
Closed
bigPYJ1151 pushed a commit to bigPYJ1151/vllm that referenced this pull request Dec 29, 2023
@maktukmak @bigPYJ1151
CPU only build (vllm-project#9)
62936e3
This was referenced Jul 5, 2024
Merged
Closed
@xinzaifeixiang1992 xinzaifeixiang1992 mentioned this pull request Jul 24, 2024
Closed
@alixiaodi alixiaodi mentioned this pull request Aug 2, 2024
Closed
@Minami-su Minami-su mentioned this pull request Aug 11, 2024
Closed
zeroorhero pushed a commit to zeroorhero/vllm that referenced this pull request Sep 23, 2024
@KuntaiDu
Merge pull request vllm-project#9 from KuntaiDu/kuntai-disagg-refactor
f101b40 
Kuntai disagg refactor
@liulisi16323 liulisi16323 mentioned this pull request Sep 24, 2024
Closed
1 task
@SpaceHunterInf SpaceHunterInf mentioned this pull request Sep 30, 2024
Closed
1 task
This was referenced Oct 12, 2024
Closed
Closed
Open
@HelenaSak HelenaSak mentioned this pull request Feb 19, 2025
Open
1 task
@alokkrsahu alokkrsahu mentioned this pull request Apr 9, 2025
Closed
1 task
@jifa513 jifa513 mentioned this pull request Apr 10, 2025
Closed
1 task
@QuanhuiGuan QuanhuiGuan mentioned this pull request Apr 14, 2025
Closed
1 task
@sgsdxzy sgsdxzy mentioned this pull request May 4, 2025
Open
1 task
juncgu pushed a commit to juncgu/vllm that referenced this pull request May 8, 2025
@robertgshaw2-redhat
Merge pull request vllm-project#9 from njhill/abstract-async-load
bb58f7c 
Suggestion: Generalize/streamline async loading (remote prefill) side
@hao-cold hao-cold mentioned this pull request May 13, 2025
Closed
1 task
@markmc markmc mentioned this pull request May 21, 2025
Closed
1 task
@zerosurplus zerosurplus mentioned this pull request Jun 16, 2025
Open
1 task
@xiaocode337317439 xiaocode337317439 mentioned this pull request Jun 27, 2025
Open
1 task
@xiaomofang xiaomofang mentioned this pull request Jul 31, 2025
Open
1 task
@devops724 devops724 mentioned this pull request Aug 3, 2025
Open
1 task
zyongye pushed a commit to zyongye/vllm that referenced this pull request Aug 5, 2025
@WoosukKwon
Basic Harmony Integration (vllm-project#9)
c652a92
zyongye pushed a commit to zyongye/vllm that referenced this pull request Aug 6, 2025
@WoosukKwon @simon-mo
Basic Harmony Integration (vllm-project#9)
28f8596
zyongye pushed a commit to zyongye/vllm that referenced this pull request Aug 7, 2025
@WoosukKwon @djmmoss
Basic Harmony Integration (vllm-project#9)
c94b2d3
@fernandaspets fernandaspets mentioned this pull request Aug 8, 2025
Open
@crischeng crischeng mentioned this pull request Aug 12, 2025
Closed
1 task
@shaamil101-etched shaamil101-etched mentioned this pull request Aug 25, 2025
Open
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@zhuohan123 zhuohan123 zhuohan123 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@WoosukKwon @zhuohan123