-
Notifications
You must be signed in to change notification settings - Fork 2
kafka: kafka client zstd compression #7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
8af0f81
to
4ca9a84
Compare
4ca9a84
to
150c8b3
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM for the zstd parts, someone with better Kafka protocol knowledge should also review.
@ivanyu Could you review too?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A couple of minor things, but overall LGTM 👍
…ependency file, readme and codec checks add 2.1.0 to possible releases being tested / downloadable, skip zstd tests when version is too old add zstd tests to producer tests, add zstandard to tox dep list add New produce request/response classes to support up to V8 produce,(V7 is required for zstd compression) add ProduceResponse fields in use after V5 force broker version onto producers on ver 2.4.0 in unittests, due to inconsitencies with the env var for it produce response api V2 included in the same logic branch as 3 and 5 add proper docstrings to produce request / response classes impose limit on decompress output size on a failed decompress attemtp update producer tests to be more idiomatic with the testing framework
150c8b3
to
cc3c3fd
Compare
hi, guys in aiven. There is an |
For internal review
Add zstd compression, tests for it, and update the API objects for the produce req/resp and fetch req/resp , since the minimal version required for handling zstd compressed requests uses a different api.