[Misc]: BlockHashType hash collision in v1 #11829
Description
Anything you want to discuss about vllm.
vllm/vllm/v1/core/kv_cache_utils.py
Line 13 in 4d29e91
I think this still has the potential for hash collisions. Using token IDs merely reduces the likelihood of such collisions. For example, in two sequences, if their previous block hashes are the same and the current block token IDs are also identical, a collision can still occur, albeit with a low probability.
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.