Skip to content

Commit 202a6e4

Browse files
committed
fix ci
Signed-off-by: qizixi <[email protected]>
1 parent 10e78bd commit 202a6e4

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

tests/v1/spec_decode/test_eagle.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -246,6 +246,9 @@ def create_deterministic_logits(token_ids):
246246
# Assign the mock to the proposer
247247
proposer.model = model_mock
248248

249+
# Assign draft attn_layer_names since load_model is not invoked
250+
proposer.attn_layer_names = ["layer.0"]
251+
249252
# Create input tensors
250253
cu_num_tokens = torch.tensor([0, seq_len_1, total_tokens],
251254
dtype=torch.int32,

0 commit comments

Comments
 (0)