Skip to content

[Bug]: Should upgrade to PyTorch's MultiOutputMatch #24125

@zou3519

Description

@zou3519

Your current environment

n/a

🐛 Describe the bug

"""
This class provides utilities to process multi-output matches and
manually insert replacements.
This is necessary because the automatic replacement for multi-output
matches is broken: https://github.com/pytorch/pytorch/issues/137280

This should be supported in torch >= 2.6 now, so we should be able to delete the code in vLLM (or at least add a guard to only use said code in older versions of pytorch

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions