dataflow: update dataflow flags (GoogleCloudPlatform#9887)

## Description

Related to GoogleCloudPlatform#9830

Fix the python version used to run the tests and simplify the Dataflow pipeline flags to not use a custom container.

Note: Before submitting a pull request, please open an issue for discussion if you are not associated with Google.

## Checklist
- [ ] I have followed [Sample Guidelines from AUTHORING_GUIDE.MD](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/AUTHORING_GUIDE.md)
- [ ] README is updated to include [all relevant information](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/AUTHORING_GUIDE.md#readme-file)
- [ ] **Tests** pass:   `nox -s py-3.9` (see [Test Environment Setup](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/AUTHORING_GUIDE.md#test-environment-setup))
- [ ] **Lint** pass:   `nox -s lint` (see [Test Environment Setup](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/AUTHORING_GUIDE.md#test-environment-setup))
- [ ] These samples need a new **API enabled** in testing projects to pass (let us know which ones)
- [ ] These samples need a new/updated **env vars** in testing projects set to pass (let us know which ones)
- [ ] This sample adds a new sample directory, and I updated the [CODEOWNERS file](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/.github/CODEOWNERS) with the codeowners for this sample
- [ ] This sample adds a new **Product API**, and I updated the [Blunderbuss issue/PR auto-assigner](https://togithub.com/GoogleCloudPlatform/python-docs-samples/blob/main/.github/blunderbuss.yml) with the codeowners for this sample
- [ ] Please **merge** this PR for me once it is approved

Author: davidcavazos

people-and-planet-ai/timeseries-classification/create_datasets.py

@@ -41,7 +41,12 @@ def run(
         ]
     ).sort_values(by="start_time")
 
-    beam_options = PipelineOptions(flags=[], **beam_args)
+    beam_options = PipelineOptions(
+        flags=[],
+        save_main_session=True,
+        requirements_file="requirements.txt",
+        **beam_args,
+    )
     pipeline = beam.Pipeline(options=beam_options)
 
     training_data, evaluation_data = (

people-and-planet-ai/timeseries-classification/main.py

@@ -64,12 +64,9 @@ def run_create_datasets() -> dict:
         runner_params = {
             "runner": "DataflowRunner",
             "job_name": f"global-fishing-watch-create-datasets-{datetime.now().strftime('%Y%m%d-%H%M%S')}",
-            "save_main_session": args.get("save_main_session", True),
-            "sdk_container_image": args.get("container_image", CONTAINER_IMAGE),
             "project": args.get("project", PROJECT),
             "region": args.get("region", REGION),
             "temp_location": args.get("temp_location", TEMP_DIR),
-            "experiments": ["use_runner_v2"],
         }
         params = {
             "raw_data_dir": args.get("raw_data_dir", RAW_DATA_DIR),

people-and-planet-ai/timeseries-classification/noxfile_config.py

@@ -22,10 +22,10 @@
 
 TEST_CONFIG_OVERRIDE = {
     # You can opt out from the test for specific Python versions.
-    # > ℹ️ Test only on Python 3.9.
+    # > ℹ️ Test only on Python 3.10.
     # > The Python version used is defined by the Dockerfile, so it's redundant
     # > to run multiple tests since they would all be running the same Dockerfile.
-    "ignored_versions": ["2.7", "3.6", "3.7", "3.8", "3.10", "3.11"],
+    "ignored_versions": ["2.7", "3.6", "3.7", "3.8", "3.9", "3.11"],
     # Old samples are opted out of enforcing Python type hints
     # All new samples should feature them
     "enforce_type_hints": True,