Closed
Description
Is your feature request related to a problem or challenge?
Tracking ticket for next release, also a place to track desired inclusions
Previous release will be https://crates.io/crates/datafusion/45.0.0 (likely Feb 1, 2025) December 31, 2024 so next major release would be around March 1, 2025
Steps:
- Update version and changelog
- Test with DataFusion Python:
- Test with DataFusion Comet: feat: Upgrade to DataFusion 46.0.0-rc2 datafusion-comet#1423
- Test with delta.rs: chore: upgrade to DataFusion 46.0.0 delta-io/delta-rs#3261
- Test with SailHQ:
- Test with InfluxData
- Voting Thread 1: https://lists.apache.org/thread/zh7s3n2h089fbhrh64y9pcx7bdw7ptv4
- Create ticket for next release: Release DataFusion
47.0.0
(April 2025) #15072
Prior release tickets:
Bugs that would be good to fix
- datafusion-cli regression: explain plan output looks bad (error rendering multi-lines) #14947
- index out of bounds: the len is 2 but the index is 2 in some data sources #14957
- Add Upgrade Guide for DataFusion 46.0.0 #14891
- bug: Physical plan round trip fails in some cases after datasource refactor #14679
- Incorrect backslash treatment in string literals in DataFusion CLI #13286
- Error projecting statistics in
DataSourceExec
#14905 -
fix: fetch is missed during EnforceDistribution #14207 - fix: EnforceSorting should not remove a needed coalesces #14637
- New Datafusion-cli streaming printing way should handle corner case for only one small batch which lines are less than max_rows #14920
- Fix failing UNION [ALL] BY NAME tests due to sanity checker #14806
- Regression since 45.0.0:
select count(), count(*)
does not work #14855 - Extended sqllite tests are failing on main #14853
- DataSink::write_all given invalid RecordBatchStream #14394
- Querying Parquet file specifically with a predicate returns invalid data error but works in other situations #14281
- Fix: limit is missing after removing SPM #14569
- bug: improve schema checking for
insert into
cases #14572
Nice to have but non blockers
- Allow
FileSource
-specific repartitioning #14754 - Change in 46:
count_all()
expr_fn function now displayed ascount(1)
rather thancount(*)
#14894
Needs some traige (should it be a blocker?)
TODO
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response