[CI] Split pooling from entrypoints Test #24632
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Purpose
refactoring following #22992
Split pooling from entrypoints Test to Entrypoints Integration Test (Pooling) ~19 minutes
cc @DarkLight1337 @maxdebayser
Test Plan
pytest -v -s entrypoints/pooling
Test Result
keep ci green
Known Issues
entrypoints-integration-test-api-server still takes a long time ~1 hour, 49 minutes, we may need to split it further
Essential Elements of an Effective PR Description Checklist
supported_models.md
andexamples
for a new model.