Skip to content

dataproc.snippets.quickstart.quickstart_test: test_quickstart failed #9461

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
flaky-bot bot opened this issue Apr 2, 2023 · 8 comments · Fixed by #9523, #9666, #9764, #9784 or #9892
Closed

dataproc.snippets.quickstart.quickstart_test: test_quickstart failed #9461

flaky-bot bot opened this issue Apr 2, 2023 · 8 comments · Fixed by #9523, #9666, #9764, #9784 or #9892
Assignees
@nicain
Labels
api: dataproc Issues related to the Dataproc API. flakybot: flaky Tells the Flaky Bot not to close or comment on this issue. flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. samples Issues that are directly related to samples. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

Comments

@flaky-bot
Copy link

flaky-bot bot commented Apr 2, 2023

Note: #8895 was also for this test, but it was closed more than 10 days ago. So, I didn't mark it flaky.

commit: 796eac7
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/dataproc/snippets/quickstart/quickstart_test.py", line 85, in test_quickstart
    quickstart.quickstart(PROJECT_ID, REGION, CLUSTER_NAME, JOB_FILE_PATH)
  File "/workspace/dataproc/snippets/quickstart/quickstart.py", line 56, in quickstart
    result = operation.result()
  File "/workspace/dataproc/snippets/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/future/polling.py", line 261, in result
    raise self._exception
google.api_core.exceptions.InvalidArgument: 400 The resource 'projects/python-docs-samples-tests/regions/us-central1/subnetworks/default' is not ready
@flaky-bot flaky-bot bot added flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. labels Apr 2, 2023
@product-auto-label product-auto-label bot added api: dataproc Issues related to the Dataproc API. samples Issues that are directly related to samples. labels Apr 2, 2023
@rsamborski
Copy link
Member

@balajismaniam I believe Dataproc is part of your team's coverage. Can you reassign to correct person? We should also consider updating the CODEOWNERS file to reflect it (if I am not mistaken).

@flaky-bot
Copy link
Author

flaky-bot bot commented Apr 3, 2023

Test passed for commit 61d612e (Build Status, Sponge)! Closing this issue.

@flaky-bot flaky-bot bot closed this as completed Apr 3, 2023
@flaky-bot flaky-bot bot reopened this Apr 6, 2023
@flaky-bot flaky-bot bot added the flakybot: flaky Tells the Flaky Bot not to close or comment on this issue. label Apr 6, 2023
@flaky-bot
Copy link
Author

flaky-bot bot commented Apr 6, 2023

Looks like this issue is flaky. 😟

I'm going to leave this open and stop commenting.

A human should fix and close this.

commit: a026c9a
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/dataproc/snippets/quickstart/quickstart_test.py", line 85, in test_quickstart
    quickstart.quickstart(PROJECT_ID, REGION, CLUSTER_NAME, JOB_FILE_PATH)
  File "/workspace/dataproc/snippets/quickstart/quickstart.py", line 56, in quickstart
    result = operation.result()
  File "/workspace/dataproc/snippets/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/future/polling.py", line 261, in result
    raise self._exception
google.api_core.exceptions.InvalidArgument: 400 The resource 'projects/python-docs-samples-tests/regions/us-central1/subnetworks/default' is not ready

@engelke engelke closed this as completed Apr 6, 2023
@flaky-bot
Copy link
Author

flaky-bot bot commented Apr 6, 2023

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.

commit: 161f9cb
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/dataproc/snippets/.nox/py-3-9/lib/python3.9/site-packages/google/api_core/grpc_helpers.py", line 65, in error_remapped_callable
    return callable_(*args, **kwargs)
  File "/workspace/dataproc/snippets/.nox/py-3-9/lib/python3.9/site-packages/grpc/_channel.py", line 946, in __call__
    return _end_unary_response_blocking(state, call, False, None)
  File "/workspace/dataproc/snippets/.nox/py-3-9/lib/python3.9/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.ALREADY_EXISTS
	details = "Already exists: Failed to create cluster: Cluster projects/python-docs-samples-tests/regions/us-central1/clusters/py-qs-test-7bf13929-ef56-4ffb-ba5f-a7ceb6b78051"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:74.125.201.95:443 {grpc_message:"Already exists: Failed to create cluster: Cluster projects/python-docs-samples-tests/regions/us-central1/clusters/py-qs-test-7bf13929-ef56-4ffb-ba5f-a7ceb6b78051", grpc_status:6, created_time:"2023-04-06T23:08:56.265255476+00:00"}"
>

The above exception was the direct cause of the following exception:


Traceback (most recent call last):

File "/workspace/dataproc/snippets/quickstart/quickstart_test.py", line 86, in test_quickstart

quickstart.quickstart(PROJECT_ID, REGION, CLUSTER_NAME, JOB_FILE_PATH)

File "/workspace/dataproc/snippets/quickstart/quickstart.py", line 53, in quickstart

operation = cluster_client.create_cluster(

File "/workspace/dataproc/snippets/.nox/py-3-9/lib/python3.9/site-packages/google/cloud/dataproc_v1/services/cluster_controller/client.py", line 631, in create_cluster

response = rpc(

File "/workspace/dataproc/snippets/.nox/py-3-9/lib/python3.9/site-packages/google/api_core/gapic_v1/method.py", line 113, in call

return wrapped_func(*args, **kwargs)

File "/workspace/dataproc/snippets/.nox/py-3-9/lib/python3.9/site-packages/google/api_core/retry.py", line 349, in retry_wrapped_func

return retry_target(

File "/workspace/dataproc/snippets/.nox/py-3-9/lib/python3.9/site-packages/google/api_core/retry.py", line 191, in retry_target

return target()

File "/workspace/dataproc/snippets/.nox/py-3-9/lib/python3.9/site-packages/google/api_core/timeout.py", line 120, in func_with_timeout

return func(*args, **kwargs)

File "/workspace/dataproc/snippets/.nox/py-3-9/lib/python3.9/site-packages/google/api_core/grpc_helpers.py", line 67, in error_remapped_callable

raise exceptions.from_grpc_error(exc) from exc

google.api_core.exceptions.AlreadyExists: 409 Already exists: Failed to create cluster: Cluster projects/python-docs-samples-tests/regions/us-central1/clusters/py-qs-test-7bf13929-ef56-4ffb-ba5f-a7ceb6b78051

@flaky-bot flaky-bot bot reopened this Apr 6, 2023
@leahecole leahecole assigned leahecole and unassigned balajismaniam Apr 7, 2023
@leahecole leahecole mentioned this issue Apr 7, 2023
Merged
8 tasks
@flaky-bot flaky-bot bot reopened this Apr 12, 2023
@flaky-bot
Copy link
Author

flaky-bot bot commented Apr 12, 2023

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.

commit: 0bf03c7
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/dataproc/snippets/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/grpc_helpers.py", line 65, in error_remapped_callable
    return callable_(*args, **kwargs)
  File "/workspace/dataproc/snippets/.nox/py-3-10/lib/python3.10/site-packages/grpc/_channel.py", line 946, in __call__
    return _end_unary_response_blocking(state, call, False, None)
  File "/workspace/dataproc/snippets/.nox/py-3-10/lib/python3.10/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.ALREADY_EXISTS
	details = "Already exists: Failed to create cluster: Cluster projects/python-docs-samples-tests/regions/us-central1/clusters/py-qs-test-fdbd26a6-4a22-43f0-a17c-46bad6b56bfb"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:108.177.98.95:443 {grpc_message:"Already exists: Failed to create cluster: Cluster projects/python-docs-samples-tests/regions/us-central1/clusters/py-qs-test-fdbd26a6-4a22-43f0-a17c-46bad6b56bfb", grpc_status:6, created_time:"2023-04-12T13:19:03.80839453+00:00"}"
>

The above exception was the direct cause of the following exception:


Traceback (most recent call last):

File "/workspace/dataproc/snippets/quickstart/quickstart_test.py", line 86, in test_quickstart

quickstart.quickstart(PROJECT_ID, REGION, CLUSTER_NAME, JOB_FILE_PATH)

File "/workspace/dataproc/snippets/quickstart/quickstart.py", line 53, in quickstart

operation = cluster_client.create_cluster(

File "/workspace/dataproc/snippets/.nox/py-3-10/lib/python3.10/site-packages/google/cloud/dataproc_v1/services/cluster_controller/client.py", line 631, in create_cluster

response = rpc(

File "/workspace/dataproc/snippets/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/gapic_v1/method.py", line 113, in call

return wrapped_func(*args, **kwargs)

File "/workspace/dataproc/snippets/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/retry.py", line 349, in retry_wrapped_func

return retry_target(

File "/workspace/dataproc/snippets/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/retry.py", line 191, in retry_target

return target()

File "/workspace/dataproc/snippets/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/timeout.py", line 120, in func_with_timeout

return func(*args, **kwargs)

File "/workspace/dataproc/snippets/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/grpc_helpers.py", line 67, in error_remapped_callable

raise exceptions.from_grpc_error(exc) from exc

google.api_core.exceptions.AlreadyExists: 409 Already exists: Failed to create cluster: Cluster projects/python-docs-samples-tests/regions/us-central1/clusters/py-qs-test-fdbd26a6-4a22-43f0-a17c-46bad6b56bfb

@nicain nicain assigned nicain and unassigned leahecole Apr 17, 2023
@nicain nicain mentioned this issue Apr 17, 2023
Merged
@flaky-bot flaky-bot bot reopened this Apr 18, 2023
@flaky-bot
Copy link
Author

flaky-bot bot commented Apr 18, 2023

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.

commit: 9bbe41d
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/dataproc/snippets/quickstart/quickstart_test.py", line 104, in test_quickstart
    "gs://{}/{}".format(staging_bucket_name, JOB_FILE_NAME)
  File "/workspace/dataproc/snippets/quickstart/quickstart.py", line 56, in quickstart
    result = operation.result()
  File "/workspace/dataproc/snippets/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/future/polling.py", line 261, in result
    raise self._exception
google.api_core.exceptions.InvalidArgument: 400 The resource 'projects/python-docs-samples-tests/regions/us-central1/subnetworks/default' is not ready

@nicain nicain mentioned this issue Apr 21, 2023
Closed
@nicain nicain mentioned this issue Apr 21, 2023
Merged
@flaky-bot flaky-bot bot reopened this Apr 24, 2023
@flaky-bot
Copy link
Author

flaky-bot bot commented Apr 24, 2023

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.

commit: 6681669
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/dataproc/snippets/quickstart/quickstart_test.py", line 104, in test_quickstart
    "gs://{}/{}".format(staging_bucket_name, JOB_FILE_NAME)
  File "/workspace/dataproc/snippets/quickstart/quickstart.py", line 56, in quickstart
    result = operation.result()
  File "/workspace/dataproc/snippets/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/future/polling.py", line 261, in result
    raise self._exception
google.api_core.exceptions.InvalidArgument: 400 The resource 'projects/python-docs-samples-tests/regions/us-central1/subnetworks/default' is not ready

@leahecole leahecole linked a pull request Apr 28, 2023 that will close this issue
add check for existing cluster #9784
Merged
9 tasks
@flaky-bot
Copy link
Author

flaky-bot bot commented May 2, 2023

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.

commit: 6286564
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/dataproc/snippets/quickstart/quickstart_test.py", line 100, in test_quickstart
    quickstart.quickstart(
  File "/workspace/dataproc/snippets/quickstart/quickstart.py", line 56, in quickstart
    result = operation.result()
             ^^^^^^^^^^^^^^^^^^
  File "/workspace/dataproc/snippets/.nox/py-3-11/lib/python3.11/site-packages/google/api_core/future/polling.py", line 261, in result
    raise self._exception
google.api_core.exceptions.InvalidArgument: 400 The resource 'projects/python-docs-samples-tests/regions/us-central1/subnetworks/default' is not ready

@flaky-bot flaky-bot bot reopened this May 2, 2023
@nicain nicain mentioned this issue May 4, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nicain nicain

Labels
api: dataproc Issues related to the Dataproc API. flakybot: flaky Tells the Flaky Bot not to close or comment on this issue. flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. samples Issues that are directly related to samples. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Projects
None yet
Milestone
No milestone
5 participants
@engelke @nicain @rsamborski @balajismaniam @leahecole