Skip to content

dataflow: downgrade to python 3.10 #9830

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 24 commits into from
May 2, 2023

Conversation

davidcavazos
Copy link
Contributor

Description

Apache Beam cannot be currently installed on Python 3.11, so downgrading to Python 3.10 fixes tests.

See apache/beam#26458

Note: Before submitting a pull request, please open an issue for discussion if you are not associated with Google.

Checklist

@davidcavazos davidcavazos requested review from a team as code owners April 27, 2023 21:13
@product-auto-label product-auto-label bot added api: dataflow Issues related to the Dataflow API. samples Issues that are directly related to samples. api: people-and-planet-ai labels Apr 27, 2023
@davidcavazos
Copy link
Contributor Author

Starting with Beam 2.47, this won't be an issue and we can upgrade to Python 3.11

@davidcavazos davidcavazos added the kokoro:force-run Add this label to force Kokoro to re-run the tests. label May 1, 2023
@kokoro-team kokoro-team removed the kokoro:force-run Add this label to force Kokoro to re-run the tests. label May 1, 2023
@engelke engelke added the kokoro:force-run Add this label to force Kokoro to re-run the tests. label May 1, 2023
@kokoro-team kokoro-team removed the kokoro:force-run Add this label to force Kokoro to re-run the tests. label May 1, 2023
@davidcavazos
Copy link
Contributor Author

Vertex AI is really not happy with that Dockerfile. I'll go ahead and use a prebuilt container for Vertex AI, that will also make the image smaller for the rest of the sample since it doesn't need GPU support.

Copy link
Contributor

@engelke engelke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@engelke engelke merged commit c8511bc into GoogleCloudPlatform:main May 2, 2023
@davidcavazos davidcavazos deleted the dataflow branch May 2, 2023 20:57
@davidcavazos davidcavazos mentioned this pull request May 3, 2023
9 tasks
gcf-merge-on-green bot pushed a commit that referenced this pull request May 3, 2023
## Description

Related to #9830

Fix the python version used to run the tests and simplify the Dataflow pipeline flags to not use a custom container.

Note: Before submitting a pull request, please open an issue for discussion if you are not associated with Google.

## Checklist
- [ ] I have followed [Sample Guidelines from AUTHORING_GUIDE.MD](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/AUTHORING_GUIDE.md)
- [ ] README is updated to include [all relevant information](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/AUTHORING_GUIDE.md#readme-file)
- [ ] **Tests** pass:   `nox -s py-3.9` (see [Test Environment Setup](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/AUTHORING_GUIDE.md#test-environment-setup))
- [ ] **Lint** pass:   `nox -s lint` (see [Test Environment Setup](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/AUTHORING_GUIDE.md#test-environment-setup))
- [ ] These samples need a new **API enabled** in testing projects to pass (let us know which ones)
- [ ] These samples need a new/updated **env vars** in testing projects set to pass (let us know which ones)
- [ ] This sample adds a new sample directory, and I updated the [CODEOWNERS file](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/.github/CODEOWNERS) with the codeowners for this sample
- [ ] This sample adds a new **Product API**, and I updated the [Blunderbuss issue/PR auto-assigner](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/.github/blunderbuss.yml) with the codeowners for this sample
- [ ] Please **merge** this PR for me once it is approved
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: dataflow Issues related to the Dataflow API. samples Issues that are directly related to samples.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants