Skip to content

[Perf] Improve/Fix-regression for FA3 in High QPS regimes #19463

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jun 24, 2025
Merged

[Perf] Improve/Fix-regression for FA3 in High QPS regimes #19463

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
55b8066
update FA
LucasWilkinson Jun 11, 2025
9e4f456
update FA
LucasWilkinson Jun 11, 2025
b453f73
update FA
LucasWilkinson Jun 11, 2025
abb7d0f
update FA
LucasWilkinson Jun 16, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion cmake/external_projects/vllm_flash_attn.cmake
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ else()
FetchContent_Declare(
vllm-flash-attn
GIT_REPOSITORY https://github.com/vllm-project/flash-attention.git
GIT_TAG 763ad155a1c826f71ff318f41edb1e4e5e376ddb
GIT_TAG 2c6bcfc0feb3d9d4a57b243fc159a68aa9933f5b
GIT_PROGRESS TRUE
# Don't share the vllm-flash-attn build between build types
BINARY_DIR ${CMAKE_BINARY_DIR}/vllm-flash-attn
Expand Down
1 change: 1 addition & 0 deletions test-qwen
Open in desktop
Submodule test-qwen added at 34c31c
Loading