GH-47438: [Python][Packaging] Set up wheel building for Python 3.14 #47616

AlenkaF · 2025-09-22T09:57:47Z

Rationale for this change

Python 3.14 is currently in a prerelease status and is expected to have a final release in October this year (https://peps.python.org/pep-0745/).

We should ensure we are fully ready to support Python 3.14 for the PyArrow 22 release.

What changes are included in this PR?

This PR updates wheels for Python 3.14.

Are these changes tested?

Tested in the CI and with extended builds.

Are there any user-facing changes?

No, but users will be able to use PyArrow with Python 3.14.

GitHub Issue: [Python][Packaging] Support Python 3.14 and upload wheels #47438

Todo:

Update the image revision name in .env
Add 3.14 conda build (arrow/dev/tasks/tasks.yml) when Rebuild for python 3.14 conda-forge/pyarrow-feedstock#156 is merged

Follow-ups:

[CI][Python] Update win wheels and free-threaded build for Python 3.14 #47437

AlenkaF · 2025-09-22T10:16:54Z

@github-actions crossbow submit cp314

github-actions · 2025-09-22T10:18:10Z

Unable to match any tasks for `cp314`
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/17912140076

AlenkaF · 2025-09-22T10:23:31Z

@github-actions crossbow submit -g wheel

github-actions · 2025-09-22T10:26:45Z

Revision: 4d579d3f87c8b32b8c8d5c2c6e6b34b8cfa9ad1d

Submitted crossbow builds: ursacomputing/crossbow @ actions-7c2f27054b

Task	Status
python-sdist
wheel-macos-monterey-cp310-cp310-amd64
wheel-macos-monterey-cp310-cp310-arm64
wheel-macos-monterey-cp311-cp311-amd64
wheel-macos-monterey-cp311-cp311-arm64
wheel-macos-monterey-cp312-cp312-amd64
wheel-macos-monterey-cp312-cp312-arm64
wheel-macos-monterey-cp313-cp313-amd64
wheel-macos-monterey-cp313-cp313-arm64
wheel-macos-monterey-cp313-cp313t-amd64
wheel-macos-monterey-cp313-cp313t-arm64
wheel-macos-monterey-cp314-cp314-amd64
wheel-macos-monterey-cp314-cp314-arm64
wheel-macos-monterey-cp314-cp314t-amd64
wheel-macos-monterey-cp314-cp314t-arm64
wheel-manylinux-2-28-cp310-cp310-amd64
wheel-manylinux-2-28-cp310-cp310-arm64
wheel-manylinux-2-28-cp311-cp311-amd64
wheel-manylinux-2-28-cp311-cp311-arm64
wheel-manylinux-2-28-cp312-cp312-amd64
wheel-manylinux-2-28-cp312-cp312-arm64
wheel-manylinux-2-28-cp313-cp313-amd64
wheel-manylinux-2-28-cp313-cp313-arm64
wheel-manylinux-2-28-cp313-cp313t-amd64
wheel-manylinux-2-28-cp313-cp313t-arm64
wheel-manylinux-2-28-cp314-cp314-amd64
wheel-manylinux-2-28-cp314-cp314-arm64
wheel-manylinux-2-28-cp314-cp314t-amd64
wheel-manylinux-2-28-cp314-cp314t-arm64
wheel-musllinux-1-2-cp310-cp310-amd64
wheel-musllinux-1-2-cp310-cp310-arm64
wheel-musllinux-1-2-cp311-cp311-amd64
wheel-musllinux-1-2-cp311-cp311-arm64
wheel-musllinux-1-2-cp312-cp312-amd64
wheel-musllinux-1-2-cp312-cp312-arm64
wheel-musllinux-1-2-cp313-cp313-amd64
wheel-musllinux-1-2-cp313-cp313-arm64
wheel-musllinux-1-2-cp313-cp313t-amd64
wheel-musllinux-1-2-cp313-cp313t-arm64
wheel-musllinux-1-2-cp314-cp314-amd64
wheel-musllinux-1-2-cp314-cp314-arm64
wheel-musllinux-1-2-cp314-cp314t-amd64
wheel-musllinux-1-2-cp314-cp314t-arm64
wheel-windows-cp310-cp310-amd64
wheel-windows-cp311-cp311-amd64
wheel-windows-cp312-cp312-amd64
wheel-windows-cp313-cp313-amd64
wheel-windows-cp313-cp313t-amd64
wheel-windows-cp314-cp314-amd64
wheel-windows-cp314-cp314t-amd64

AlenkaF · 2025-09-23T08:36:59Z

@github-actions crossbow submit cp314

github-actions · 2025-09-23T08:39:27Z

Revision: b610f02b4cfd11c08a29804689a2c3f80434bd24

Submitted crossbow builds: ursacomputing/crossbow @ actions-254712ded5

Task	Status
wheel-macos-monterey-cp314-cp314-amd64
wheel-macos-monterey-cp314-cp314-arm64
wheel-manylinux-2-28-cp314-cp314-amd64
wheel-manylinux-2-28-cp314-cp314-arm64
wheel-musllinux-1-2-cp314-cp314-amd64
wheel-musllinux-1-2-cp314-cp314-arm64
wheel-windows-cp314-cp314-amd64

AlenkaF · 2025-09-25T09:42:34Z

@github-actions crossbow submit wheel-manylinux-2-28-cp314-cp314-arm64

github-actions · 2025-09-25T09:45:11Z

Revision: ba5bb8a49c6d8989a8bfa9870810ef5f43ba130f

Submitted crossbow builds: ursacomputing/crossbow @ actions-1fc62abec5

Task	Status
wheel-manylinux-2-28-cp314-cp314-arm64

AlenkaF · 2025-09-26T05:53:57Z

@github-actions crossbow submit wheel-manylinux-2-28-cp314-cp314-arm64

github-actions · 2025-09-26T05:56:06Z

Revision: caa904ab722c70ca5c7c8f6b9366babec0782d9a

Submitted crossbow builds: ursacomputing/crossbow @ actions-ee8c32d46b

Task	Status
wheel-manylinux-2-28-cp314-cp314-arm64

AlenkaF · 2025-09-26T07:40:38Z

@github-actions crossbow submit wheel-manylinux-2-28-cp314-cp314-arm64

github-actions · 2025-09-26T07:42:52Z

Revision: 5c4330d6497d54257988b19cd69a444cc957d236

Submitted crossbow builds: ursacomputing/crossbow @ actions-a34b2c22d4

Task	Status
wheel-manylinux-2-28-cp314-cp314-arm64

EwoutH · 2025-10-02T11:09:42Z

conda-forge/pyarrow-feedstock#156 is merged!

…_GIL_DISABLED)

AlenkaF · 2025-10-03T09:00:16Z

@github-actions crossbow submit cp314-cp314

github-actions · 2025-10-03T09:02:33Z

Revision: 767e2c4

Submitted crossbow builds: ursacomputing/crossbow @ actions-1d7807353f

Task	Status
wheel-macos-monterey-cp314-cp314-amd64
wheel-macos-monterey-cp314-cp314-arm64
wheel-manylinux-2-28-cp314-cp314-amd64
wheel-manylinux-2-28-cp314-cp314-arm64
wheel-musllinux-1-2-cp314-cp314-amd64
wheel-musllinux-1-2-cp314-cp314-arm64
wheel-windows-cp314-cp314-amd64

AlenkaF · 2025-10-03T13:36:58Z

@github-actions crossbow submit wheel-macos-monterey-cp314-cp314-amd64

pitrou

Looks fine in general to me, I posted a few comments.

AlenkaF · 2025-10-13T09:26:49Z

@github-actions crossbow submit -g wheel

github-actions · 2025-10-13T09:34:34Z

Revision: ed83b6e

Submitted crossbow builds: ursacomputing/crossbow @ actions-929a4e6e1f

Task	Status
python-sdist
wheel-macos-monterey-cp310-cp310-amd64
wheel-macos-monterey-cp310-cp310-arm64
wheel-macos-monterey-cp311-cp311-amd64
wheel-macos-monterey-cp311-cp311-arm64
wheel-macos-monterey-cp312-cp312-amd64
wheel-macos-monterey-cp312-cp312-arm64
wheel-macos-monterey-cp313-cp313-amd64
wheel-macos-monterey-cp313-cp313-arm64
wheel-macos-monterey-cp313-cp313t-amd64
wheel-macos-monterey-cp313-cp313t-arm64
wheel-macos-monterey-cp314-cp314-amd64
wheel-macos-monterey-cp314-cp314-arm64
wheel-macos-monterey-cp314-cp314t-amd64
wheel-macos-monterey-cp314-cp314t-arm64
wheel-manylinux-2-28-cp310-cp310-amd64
wheel-manylinux-2-28-cp310-cp310-arm64
wheel-manylinux-2-28-cp311-cp311-amd64
wheel-manylinux-2-28-cp311-cp311-arm64
wheel-manylinux-2-28-cp312-cp312-amd64
wheel-manylinux-2-28-cp312-cp312-arm64
wheel-manylinux-2-28-cp313-cp313-amd64
wheel-manylinux-2-28-cp313-cp313-arm64
wheel-manylinux-2-28-cp313-cp313t-amd64
wheel-manylinux-2-28-cp313-cp313t-arm64
wheel-manylinux-2-28-cp314-cp314-amd64
wheel-manylinux-2-28-cp314-cp314-arm64
wheel-manylinux-2-28-cp314-cp314t-amd64
wheel-manylinux-2-28-cp314-cp314t-arm64
wheel-musllinux-1-2-cp310-cp310-amd64
wheel-musllinux-1-2-cp310-cp310-arm64
wheel-musllinux-1-2-cp311-cp311-amd64
wheel-musllinux-1-2-cp311-cp311-arm64
wheel-musllinux-1-2-cp312-cp312-amd64
wheel-musllinux-1-2-cp312-cp312-arm64
wheel-musllinux-1-2-cp313-cp313-amd64
wheel-musllinux-1-2-cp313-cp313-arm64
wheel-musllinux-1-2-cp313-cp313t-amd64
wheel-musllinux-1-2-cp313-cp313t-arm64
wheel-musllinux-1-2-cp314-cp314-amd64
wheel-musllinux-1-2-cp314-cp314-arm64
wheel-musllinux-1-2-cp314-cp314t-amd64
wheel-musllinux-1-2-cp314-cp314t-arm64
wheel-windows-cp310-cp310-amd64
wheel-windows-cp311-cp311-amd64
wheel-windows-cp312-cp312-amd64
wheel-windows-cp313-cp313-amd64
wheel-windows-cp313-cp313t-amd64
wheel-windows-cp314-cp314-amd64
wheel-windows-cp314-cp314t-amd64

raulcd

This is great! Thanks @AlenkaF ! Happy to merge this once CI finishes and all wheels are green.

ci/docker/python-wheel-musllinux.dockerfile

AlenkaF · 2025-10-13T12:59:23Z

I need to add back the (COPY) line that has been removed: https://github.com/ursacomputing/crossbow/actions/runs/18461390652/job/52593469380#step:9:559

pitrou · 2025-10-13T13:07:39Z

I need to add back the (COPY) line that has been removed: https://github.com/ursacomputing/crossbow/actions/runs/18461390652/job/52593469380#step:9:559

Ah, sorry! I'm surprised because the filename doesn't always match the one being used in the pip install command that follows. Do you know why that works?

raulcd · 2025-10-13T13:21:10Z

Ah, sorry! I'm surprised because the filename doesn't always match the one being used in the pip install command that follows. Do you know why that works?

From what I understand we always copy both and then pip installing C:/arrow/python/%REQUIREMENTS_FILE% based on:

    if "%python%"=="3.13" ( \
        setx REQUIREMENTS_FILE "requirements-wheel-test-3.13t.txt" \
    ) else ( \
        setx REQUIREMENTS_FILE "requirements-wheel-test.txt" \
    )

AlenkaF · 2025-10-13T13:22:37Z

Ah, sorry! I'm surprised because the filename doesn't always match the one being used in the pip install command that follows. Do you know why that works?

No problem! I wanted to try, in case we do not need to copy, anyways :)

pitrou · 2025-10-13T14:10:40Z

From what I understand we always copy both

Oh, yes, you're right. My bad 🤦

AlenkaF · 2025-10-13T14:14:10Z

@github-actions crossbow submit -g wheel

github-actions · 2025-10-13T14:17:37Z

Revision: 26a7f72

Submitted crossbow builds: ursacomputing/crossbow @ actions-c310d57cb6

Task	Status
python-sdist
wheel-macos-monterey-cp310-cp310-amd64
wheel-macos-monterey-cp310-cp310-arm64
wheel-macos-monterey-cp311-cp311-amd64
wheel-macos-monterey-cp311-cp311-arm64
wheel-macos-monterey-cp312-cp312-amd64
wheel-macos-monterey-cp312-cp312-arm64
wheel-macos-monterey-cp313-cp313-amd64
wheel-macos-monterey-cp313-cp313-arm64
wheel-macos-monterey-cp313-cp313t-amd64
wheel-macos-monterey-cp313-cp313t-arm64
wheel-macos-monterey-cp314-cp314-amd64
wheel-macos-monterey-cp314-cp314-arm64
wheel-macos-monterey-cp314-cp314t-amd64
wheel-macos-monterey-cp314-cp314t-arm64
wheel-manylinux-2-28-cp310-cp310-amd64
wheel-manylinux-2-28-cp310-cp310-arm64
wheel-manylinux-2-28-cp311-cp311-amd64
wheel-manylinux-2-28-cp311-cp311-arm64
wheel-manylinux-2-28-cp312-cp312-amd64
wheel-manylinux-2-28-cp312-cp312-arm64
wheel-manylinux-2-28-cp313-cp313-amd64
wheel-manylinux-2-28-cp313-cp313-arm64
wheel-manylinux-2-28-cp313-cp313t-amd64
wheel-manylinux-2-28-cp313-cp313t-arm64
wheel-manylinux-2-28-cp314-cp314-amd64
wheel-manylinux-2-28-cp314-cp314-arm64
wheel-manylinux-2-28-cp314-cp314t-amd64
wheel-manylinux-2-28-cp314-cp314t-arm64
wheel-musllinux-1-2-cp310-cp310-amd64
wheel-musllinux-1-2-cp310-cp310-arm64
wheel-musllinux-1-2-cp311-cp311-amd64
wheel-musllinux-1-2-cp311-cp311-arm64
wheel-musllinux-1-2-cp312-cp312-amd64
wheel-musllinux-1-2-cp312-cp312-arm64
wheel-musllinux-1-2-cp313-cp313-amd64
wheel-musllinux-1-2-cp313-cp313-arm64
wheel-musllinux-1-2-cp313-cp313t-amd64
wheel-musllinux-1-2-cp313-cp313t-arm64
wheel-musllinux-1-2-cp314-cp314-amd64
wheel-musllinux-1-2-cp314-cp314-arm64
wheel-musllinux-1-2-cp314-cp314t-amd64
wheel-musllinux-1-2-cp314-cp314t-arm64
wheel-windows-cp310-cp310-amd64
wheel-windows-cp311-cp311-amd64
wheel-windows-cp312-cp312-amd64
wheel-windows-cp313-cp313-amd64
wheel-windows-cp313-cp313t-amd64
wheel-windows-cp314-cp314-amd64
wheel-windows-cp314-cp314t-amd64

AlenkaF · 2025-10-14T04:05:16Z

Everything green, yay.
There is one approval so I will go ahead and merge, @raulcd can then continue with the release.

AlenkaF · 2025-10-14T04:11:33Z

From what I understand we always copy both

I have put back as it was though it would be nicer to just copy one file, as per REQUIREMENTS_FILE. Will correct in the follow-up PR just so we do not need to wait for the builds again.

EwoutH · 2025-10-14T05:05:23Z

Awesome!

What’s now the plan and timeline to get wheels on PyPI?

…47616) ### Rationale for this change Python 3.14 is currently in a prerelease status and is expected to have a final release in October this year (https://peps.python.org/pep-0745/). We should ensure we are fully ready to support Python 3.14 for the PyArrow 22 release. ### What changes are included in this PR? This PR updates wheels for Python 3.14. ### Are these changes tested? Tested in the CI and with extended builds. ### Are there any user-facing changes? No, but users will be able to use PyArrow with Python 3.14. * GitHub Issue: #47438 --- Todo: - Update the image revision name in `.env` - Add 3.14 conda build ([arrow/dev/tasks/tasks.yml](https://github.com/apache/arrow/blob/d803afcc43f5d132506318fd9e162d33b2c3d4cd/dev/tasks/tasks.yml#L809)) when conda-forge/pyarrow-feedstock#156 is merged Follow-ups: - #47437 Authored-by: AlenkaF <[email protected]> Signed-off-by: AlenkaF <[email protected]>

conbench-apache-arrow · 2025-10-14T09:49:07Z

After merging your PR, Conbench analyzed the 3 benchmarking runs that have been run so far on merge-commit f268c43.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 1 possible false positive for unstable benchmarks that are known to sometimes produce them.

…3.14 (apache#47616) ### Rationale for this change Python 3.14 is currently in a prerelease status and is expected to have a final release in October this year (https://peps.python.org/pep-0745/). We should ensure we are fully ready to support Python 3.14 for the PyArrow 22 release. ### What changes are included in this PR? This PR updates wheels for Python 3.14. ### Are these changes tested? Tested in the CI and with extended builds. ### Are there any user-facing changes? No, but users will be able to use PyArrow with Python 3.14. * GitHub Issue: apache#47438 --- Todo: - Update the image revision name in `.env` - Add 3.14 conda build ([arrow/dev/tasks/tasks.yml](https://github.com/apache/arrow/blob/d803afcc43f5d132506318fd9e162d33b2c3d4cd/dev/tasks/tasks.yml#L809)) when conda-forge/pyarrow-feedstock#156 is merged Follow-ups: - apache#47437 Authored-by: AlenkaF <[email protected]> Signed-off-by: AlenkaF <[email protected]>

github-actions bot added Component: Python awaiting review Awaiting review labels Sep 22, 2025

weiji14 mentioned this pull request Oct 1, 2025

Rebuild for python 3.14 conda-forge/pyarrow-feedstock#156

Merged

AlenkaF added 8 commits October 3, 2025 10:58

Initial changes

016d4f8

Wait for conda-forge support

55516c7

Fix musllinux issue

0da81ee

Update test due to getrefcount changes

700896d

Remove 3.14t for now

522bd9c

Get the rc image tag from docker hub, use sysconfig.get_config_var(Py…

20770df

…_GIL_DISABLED)

Use different image tag

d46b035

Revert PYTHON_ABI_TAG removal

767e2c4

AlenkaF force-pushed the gh-47438-python-314 branch from 5c4330d to 767e2c4 Compare October 3, 2025 08:59

AlenkaF added 2 commits October 3, 2025 15:28

Fix macos Python 3.14 install

4e6706a

Add missing fi

c3f4e0c

pitrou reviewed Oct 13, 2025

View reviewed changes

kou changed the title ~~GH-47438: Set up wheel building for Python 3.14~~ GH-47438: [Python][Packaging] Set up wheel building for Python 3.14 Oct 13, 2025

AlenkaF added 2 commits October 13, 2025 11:21

Remove COPY of the req file in win dockerfile

a92a23f

Add free-threaded project classifier (Beta)

ed83b6e

AlenkaF mentioned this pull request Oct 13, 2025

[CI][Python] Update Python installs for free-threaded wheels #47797

Open

Fix failing linter

e59f093

raulcd approved these changes Oct 13, 2025

View reviewed changes

ci/docker/python-wheel-musllinux.dockerfile Show resolved Hide resolved

github-actions bot added awaiting merge Awaiting merge and removed awaiting committer review Awaiting committer review labels Oct 13, 2025

Revert COPY changes

26a7f72

AlenkaF mentioned this pull request Oct 13, 2025

[Python][CI] Remove use of CMAKE_POLICY_VERSION_MINIMUM on musllinux #47801

Open

AlenkaF merged commit f268c43 into apache:main Oct 14, 2025
39 checks passed

AlenkaF removed the awaiting merge Awaiting merge label Oct 14, 2025

AlenkaF deleted the gh-47438-python-314 branch October 14, 2025 04:17

AlenkaF mentioned this pull request Oct 14, 2025

[Python][Packaging] Support Python 3.14 and upload wheels #47438

Open

2 tasks

GH-47438: [Python][Packaging] Set up wheel building for Python 3.14 #47616

GH-47438: [Python][Packaging] Set up wheel building for Python 3.14 #47616

Conversation

AlenkaF commented Sep 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Uh oh!

AlenkaF commented Sep 22, 2025

Uh oh!

github-actions bot commented Sep 22, 2025

Uh oh!

AlenkaF commented Sep 22, 2025

Uh oh!

github-actions bot commented Sep 22, 2025

Uh oh!

AlenkaF commented Sep 23, 2025

Uh oh!

github-actions bot commented Sep 23, 2025

Uh oh!

AlenkaF commented Sep 25, 2025

Uh oh!

github-actions bot commented Sep 25, 2025

Uh oh!

AlenkaF commented Sep 26, 2025

Uh oh!

github-actions bot commented Sep 26, 2025

Uh oh!

AlenkaF commented Sep 26, 2025

Uh oh!

github-actions bot commented Sep 26, 2025

Uh oh!

EwoutH commented Oct 2, 2025

Uh oh!

AlenkaF commented Oct 3, 2025

Uh oh!

github-actions bot commented Oct 3, 2025

Uh oh!

AlenkaF commented Oct 3, 2025

Uh oh!

pitrou left a comment

Choose a reason for hiding this comment

Uh oh!

AlenkaF commented Oct 13, 2025

Uh oh!

github-actions bot commented Oct 13, 2025

Uh oh!

raulcd left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

AlenkaF commented Oct 13, 2025

Uh oh!

pitrou commented Oct 13, 2025

Uh oh!

raulcd commented Oct 13, 2025

Uh oh!

AlenkaF commented Oct 13, 2025

Uh oh!

pitrou commented Oct 13, 2025

Uh oh!

AlenkaF commented Oct 13, 2025

Uh oh!

github-actions bot commented Oct 13, 2025

Uh oh!

AlenkaF commented Oct 14, 2025

Uh oh!

AlenkaF commented Oct 14, 2025

Uh oh!

Uh oh!

EwoutH commented Oct 14, 2025

Uh oh!

conbench-apache-arrow bot commented Oct 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

AlenkaF commented Sep 22, 2025 •

edited

Loading