Skip to content

Conversation

afierka-intel
Copy link

As conclusion of this review vllm-project#12156 and further, comprehensive performance analysis we decided to bring back an original top-p/top-k implementation.

@afierka-intel
Copy link
Author

/run-gaudi-tests

@afierka-intel
Copy link
Author

/run-gaudi-tests

Copy link

@madamczyk-intel madamczyk-intel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+3 -187 🥰

@madamczyk-intel madamczyk-intel merged commit 13a2b73 into habana_main May 15, 2025
45 checks passed
@madamczyk-intel madamczyk-intel deleted the dev/afierka/sampler-v0-default branch May 15, 2025 07:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants