Release arrow-rs / parquet minor version 53.4.0 (Jan 2025)

[alamb]

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

Our release schedule is here https://github.com/apache/arrow-rs?tab=readme-ov-file#release-versioning-and-schedule

• We plan Release arrow-rs / parquet major version 54.0.0 (December 2024) arrow-rs#6342 in Dec

However, upstream in DataFusion we are planning to release without picking up arrow 54 until after DataFusion 44

• Release DataFusion 44.0.0 datafusion#13334
  To minimize downstream disruptions

However, there are several fixes / features (related to Utf8View support for example) that we would like to make available downstream before we release DataFusion 45 and thus I would like to propose another release from the 44 branch

Describe the solution you'd like

Create a 53.4.0 release:

• Release notes and bump version: [53.0.0_maintance] Prepare for 53.4.0 release -- version and changelog arrow-rs#6982
• Vote thread: https://lists.apache.org/thread/s6tqn3fw3dykb6d6glwxq9nyqzv0ggt6
• Release to crates.io / approval: https://lists.apache.org/thread/5nf1wnnxwsl85w1t9201fj6z8pk19043

Describe alternatives you've considered

I think @andygrove would like to make

apache/datafusion#13334 (comment)

I am +1 for releasing DF 44 without the next major version of Arrow. However, there are some bug fixes and performance improvements in Arrow that I would like to use so would like to see a new minor release (and am happy to help with this if needed).

Process:

I will create the release from the https://github.com/apache/arrow-rs/tree/53.0.0_maintenance branch

To include patches in this release, please create PRs targeting the 53.0.0_maintenance branch. Once that branch has the desired content we can cut the release

Additional context

Planned content (please add more if necessary)

• perf: Use Cow in get_format_string in FFI_ArrowSchema arrow-rs#6853
• fix: decimal conversion looses value on lower precision arrow-rs#6836
• fix: Encoding of List offsets was incorrect when slice offsets begin with zero arrow-rs#6805
• [arrow-cast] Support cast numeric to string view (alternate) arrow-rs#6816
• Enable matching temporal as from_type to Utf8View arrow-rs#6872
• [arrow-cast] Support cast boolean from/to string view arrow-rs#6822

Possibly (if someone makes backport PRs):

• add buffered data_pages to parquet column writer total bytes estimation arrow-rs#6862
• Handling nullable DictionaryArray in CSV parser arrow-rs#6830
• Add Array::shrink_to_fit(&mut self) arrow-rs#6790
• Support shrink to empty arrow-rs#6817
• fix: make GetCatalogsBuilder sort catalog names  arrow-rs#6864

here is the complete list of commits in 53.3.3 --> 54.0.0 for consideration:

• apache/arrow-rs@53.3.0...54.0.0

[andygrove]

@himadripal I added apache/arrow-rs#6836 for consideration for this point release

[alamb]

Update:

• There is now a maintenance branch where we will make the release from: https://github.com/apache/arrow-rs/tree/53.0.0_maintenance
• I added a process section above

Next steps are to start creating PRs (one or many) with the desired changes cherry-picked / backported targeting the 53.0.0_maintenance branch