Workspace nightly integration test hits too many requests when creating the workspace

[jenting]

Bug description

=== RUN   TestGitHubContexts
=== RUN   TestGitHubContexts/context
=== RUN   TestGitHubContexts/context/should_run_context_tests
=== RUN   TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod
=== PAUSE TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod
=== RUN   TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/tree/integration-test-1
=== PAUSE TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/tree/integration-test-1
=== RUN   TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/issues/88
=== PAUSE TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/issues/88
=== RUN   TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/tree/integration-test-context-tag
=== PAUSE TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/tree/integration-test-context-tag
=== CONT  TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod
=== CONT  TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/issues/88
=== CONT  TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/tree/integration-test-context-tag
=== CONT  TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/tree/integration-test-1
=== CONT  TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/tree/integration-test-context-tag
    contexts_test.go:128: cannot start workspace: "jsonrpc2: code 429 message: too many requests"
--- FAIL: TestGitHubContexts (25.07s)
    --- FAIL: TestGitHubContexts/context (25.07s)
        --- FAIL: TestGitHubContexts/context/should_run_context_tests (0.00s)
            --- FAIL: TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/tree/integration-test-context-tag (11.70s)
            --- PASS: TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod (23.30s)
            --- PASS: TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/issues/88 (23.58s)
            --- PASS: TestGitHubContexts/context/should_run_context_tests/github.com/gitpod-io/gitpod-test-repo/tree/integration-test-1 (25.07s)

Steps to reproduce

https://werft.gitpod-dev.com/job/gitpod-workspace-run-integration-tests-main.24/logs

Workspace affected

No response

Expected behavior

No response

Example repository

No response

Anything else?

No response

[svenefftinge]

I've seen the same error in a preview env when starting 4 workspaces.