Skip to content

Commit 6cf617d

Browse files
committed
configure PackingIterator
1 parent 5ebbe19 commit 6cf617d

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

pyiceberg/io/pyarrow.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1777,9 +1777,9 @@ def bin_pack_arrow_table(tbl: pa.Table, target_file_size: int) -> Iterator[List[
17771777
bin_packed_record_batches = PackingIterator(
17781778
items=batches,
17791779
target_weight=target_file_size,
1780-
lookback=2,
1780+
lookback=len(batches), # ignore lookback
17811781
weight_func=lambda x: x.nbytes,
1782-
largest_bin_first=True,
1782+
largest_bin_first=False,
17831783
)
17841784
return bin_packed_record_batches
17851785

0 commit comments

Comments
 (0)