-
Notifications
You must be signed in to change notification settings - Fork 357
Closed
Description
Feature Request / Improvement
iceberg-python/pyiceberg/io/pyarrow.py
Lines 1225 to 1231 in f05b1ae
# With PyArrow 16.0.0 there is an issue with casting record-batches: | |
# https://github.com/apache/arrow/issues/41884 | |
# https://github.com/apache/arrow/issues/43183 | |
# Would be good to remove this later on | |
schema=_pyarrow_schema_ensure_large_types(physical_schema) | |
if use_large_types | |
else (_pyarrow_schema_ensure_small_types(physical_schema)), |
Related to #929
Requires Arrow 17 (possibly 18?)
Metadata
Metadata
Assignees
Labels
No labels