Commit 912a6aa

JohannesGaessler

committed

CUDA: faster FlashAttention, kernel for bs == 1

1 parent 08e69c5 commit 912a6aaCopy full SHA for 912a6aa

1 file changed

+906

-451

lines changed

ggml-cuda
- fattn.cu

1 file changed

+906

-451

lines changed

Comments

(0)