Skip to content

Commit 2f2b44b

Browse files
snadampalEC2 Default User
authored andcommitted
fix q4_0_8_8 format for corrupted tokens issue (ggml-org#10198)
Co-authored-by: EC2 Default User <[email protected]>
1 parent 4dc1e6c commit 2f2b44b

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

ggml/src/ggml-cpu.c

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -409,6 +409,8 @@ static const struct ggml_type_traits_cpu type_traits_cpu[GGML_TYPE_COUNT] = {
409409
.gemm = ggml_gemm_q4_0_4x8_q8_0,
410410
},
411411
[GGML_TYPE_Q4_0_8_8] = {
412+
.vec_dot = NULL,
413+
.vec_dot_type = GGML_TYPE_Q8_0,
412414
.nrows = 1,
413415
.ncols = 8,
414416
.gemv = ggml_gemv_q4_0_8x8_q8_0,

0 commit comments

Comments
 (0)