Skip to content

Commit 11bd865

Browse files
committed
fix by Joyjit suggestions
Signed-off-by: wili-65535 <[email protected]>
1 parent 38db5b2 commit 11bd865

File tree

1 file changed

+3
-6
lines changed

1 file changed

+3
-6
lines changed

tensorrt_llm/_torch/speculative/ngram.py

Lines changed: 3 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -269,12 +269,9 @@ def _update_ngram_iter_stats(
269269
total_num_accepted_tokens = 0
270270
num_requests_with_draft_tokens = 0
271271
for request in scheduled_requests.generation_requests:
272-
num_draft_tokens = 0 if request.py_last_draft_tokens is None else len(
273-
request.py_last_draft_tokens)
274-
num_accepted_tokens = request.py_num_accepted_draft_tokens
275-
if num_draft_tokens > 0:
276-
total_num_draft_tokens += num_draft_tokens
277-
total_num_accepted_tokens += num_accepted_tokens
272+
if request.py_last_draft_tokens is not None:
273+
total_num_draft_tokens += len(request.py_last_draft_tokens)
274+
total_num_accepted_tokens += request.py_num_accepted_draft_tokens
278275
num_requests_with_draft_tokens += 1
279276

280277
if num_requests_with_draft_tokens > 0:

0 commit comments

Comments
 (0)