Skip to content

[release-4.16] CNTRLPLANE-1612: Backport StreamingCollectionEncoding for JSON and protobuf #2485

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 7 commits into
base: release-4.16
Choose a base branch
from
Open

[release-4.16] CNTRLPLANE-1612: Backport StreamingCollectionEncoding for JSON and protobuf #2485

wants to merge 7 commits into from

Conversation

rh-roman
Copy link

@rh-roman rh-roman commented Oct 6, 2025 •
edited
Loading

Due to significant customer need for performance improvements related to API server pressure from large LIST requests, backporting the API streaming features that have been introduced in 1.33/1.34 related to kubernetes/enhancements#3157

@openshift-ci-robot openshift-ci-robot added the backports/unvalidated-commits Indicates that not all commits come to merged upstream PRs. label Oct 6, 2025
@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Oct 6, 2025
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Oct 6, 2025

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@openshift-ci-robot
Copy link

@rh-roman: the contents of this pull request could not be automatically validated.

The following commits could not be validated and must be approved by a top-level approver:

Comment /validate-backports to re-evaluate validity of the upstream PRs, for example when they are merged upstream.

@openshift-ci openshift-ci bot added the vendor-update Touching vendor dir or related files label Oct 6, 2025
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Oct 6, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: rh-roman
Once this PR has been reviewed and has the lgtm label, please assign deads2k for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@rh-roman
Copy link
Author

rh-roman commented Oct 6, 2025

/test all

@rh-roman rh-roman changed the title [release-4.16] Backport StreamingCollectionEncoding for JSON and protobuf [release-4.16] CNTRLPLANE-1612: Backport StreamingCollectionEncoding for JSON and protobuf Oct 8, 2025
@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Oct 8, 2025
@openshift-ci-robot
Copy link

openshift-ci-robot commented Oct 8, 2025 •
edited by openshift-ci bot
Loading

@rh-roman: This pull request references CNTRLPLANE-1612 which is a valid jira issue.

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

nkeert and others added 7 commits October 9, 2025 08:54
@nkeert @rh-roman
UPSTREAM: 130190: Add a test to validate deferredResponseWriteron mul…
d1e0d01 
…tiple write calls

Signed-off-by: nkeert <[email protected]>
@z1cheng @rh-roman
UPSTREAM: 130281: Implement chunking for gzip encoder in deferredResp…
9812c8f 
…onseWriter

Signed-off-by: z1cheng <[email protected]>
@serathius @rh-roman
UPSTREAM: 130220: Add tests for encoding collections in JSON for KEP-…
0d49aa9 
…5116

Used test cases from:
* Original PR kubernetes#129334
* KEP https://github.com/kubernetes/enhancements/tree/master/keps/sig-api-machinery/5116-streaming-response-encoding#unit-tests

For now testing current serializer implementation to show encoder
behavior and agree on set of tests. Having a separate PR should make review easier.
In separate PR will add the implementation for streaming that should
provide same response byte-to-byte.
@serathius @rh-roman
UPSTREAM: 129334: Streaming JSON encoder for List
951b9d6
@z1cheng @rh-roman
UPSTREAM: 130511: Implement tests for encoding collections in Proto
dc17131 
Signed-off-by: z1cheng <[email protected]>
@serathius @rh-roman
UPSTREAM: 129407: Implement streaming proto encoding
b852d79
@rh-roman
UPSTREAM: <carry>: Use switch test to gofuzz
3f853ef 
randfill isn't available in 4.16
@rh-roman rh-roman force-pushed the backport-api-stream-416 branch from b1ea588 to 3f853ef Compare October 9, 2025 15:57
@openshift-ci-robot
Copy link

@rh-roman: the contents of this pull request could not be automatically validated.

The following commits are valid:

The following commits could not be validated and must be approved by a top-level approver:

Comment /validate-backports to re-evaluate validity of the upstream PRs, for example when they are merged upstream.

@openshift-ci-robot
Copy link

openshift-ci-robot commented Oct 9, 2025 •
edited by openshift-ci bot
Loading

@rh-roman: This pull request references CNTRLPLANE-1612 which is a valid jira issue.

In response to this:

Due to significant customer need for performance improvements related to API server pressure from large LIST requests, backporting the API streaming features that have been introduced in 1.33/1.34 related to kubernetes/enhancements#3157

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@rh-roman rh-roman marked this pull request as ready for review October 9, 2025 16:00
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Oct 9, 2025
@openshift-ci openshift-ci bot requested review from bertinatto and deads2k October 9, 2025 16:02
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Oct 9, 2025

@rh-roman: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/k8s-e2e-aws-ovn-serial b1ea588 link false /test k8s-e2e-aws-ovn-serial
ci/prow/e2e-agnostic-ovn-cmd b1ea588 link false /test e2e-agnostic-ovn-cmd
ci/prow/e2e-aws-csi b1ea588 link false /test e2e-aws-csi
ci/prow/okd-scos-images 3f853ef link true /test okd-scos-images
ci/prow/unit 3f853ef link true /test unit
ci/prow/k8s-e2e-gcp-serial 3f853ef link true /test k8s-e2e-gcp-serial
ci/prow/k8s-e2e-conformance-aws 3f853ef link true /test k8s-e2e-conformance-aws
ci/prow/e2e-aws-ovn-cgroupsv2 3f853ef link true /test e2e-aws-ovn-cgroupsv2
ci/prow/integration 3f853ef link true /test integration
ci/prow/k8s-e2e-gcp-ovn 3f853ef link true /test k8s-e2e-gcp-ovn
ci/prow/e2e-gcp-ovn-upgrade 3f853ef link true /test e2e-gcp-ovn-upgrade
ci/prow/e2e-aws-ovn-crun 3f853ef link true /test e2e-aws-ovn-crun
ci/prow/verify 3f853ef link true /test verify
ci/prow/e2e-aws-ovn-serial 3f853ef link true /test e2e-aws-ovn-serial
ci/prow/e2e-gcp 3f853ef link true /test e2e-gcp
ci/prow/images 3f853ef link true /test images
ci/prow/e2e-aws-crun-wasm 3f853ef link true /test e2e-aws-crun-wasm
ci/prow/e2e-aws-ovn-fips 3f853ef link true /test e2e-aws-ovn-fips

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bertinatto bertinatto Awaiting requested review from bertinatto

@deads2k deads2k Awaiting requested review from deads2k

Assignees
No one assigned
Labels
backports/unvalidated-commits Indicates that not all commits come to merged upstream PRs. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. vendor-update Touching vendor dir or related files
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@rh-roman @openshift-ci-robot @nkeert @z1cheng @serathius