Skip to content

[Nova] Migrate Linux CPU job to Generic Job #6797

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 13 commits into from
Oct 20, 2022

Conversation

osalpekar
Copy link
Member

@osalpekar osalpekar commented Oct 19, 2022

Migrating the Linux CPU Testing job to the Generic Linux Job format that will be used long-term for CI jobs.

@osalpekar osalpekar marked this pull request as ready for review October 20, 2022 15:13
Copy link
Member

@seemethere seemethere left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks mostly good, just a few optimizations to make, and to clean up some un-needed jobs

@@ -13,58 +13,50 @@ env:
CHANNEL: "nightly"

jobs:
setup:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we still need this setup job?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh I didn't see the repository input for the generic job. Yeah we can use that instead.

export CUDATOOLKIT="cpuonly"

# Set CHANNEL
if [[${{ (github.event_name == 'pull_request' && startsWith(github.base_ref, 'release')) || startsWith(github.ref, 'refs/heads/release') }} ]]; then
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These should actually be available as regular environment variables so it might be better to use those instead, see: https://docs.github.com/en/actions/learn-github-actions/environment-variables


# Create Conda Env
conda create -yp "${ENV_NAME}" python="${PYTHON_VERSION}" numpy libpng jpeg scipy
export CONDA_RUN="conda run -p ${ENV_NAME}"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You actually don't necessarily need to do this, you can just do a conda activate and run regular conda commands in this

Copy link
Contributor

@atalman atalman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@osalpekar osalpekar merged commit 246de07 into pytorch:main Oct 20, 2022
@github-actions
Copy link

Hey @osalpekar!

You merged this PR, but no labels were added. The list of valid labels is available at https://github.com/pytorch/vision/blob/main/.github/process_commit.py

facebook-github-bot pushed a commit that referenced this pull request Oct 21, 2022
Summary:
* [Nova] Migrate Linux CPU job to Generic Job

* branch ref for composite action job

* move checkout step to separate job

* added runs-on

* nit fixes

* no need to run conda sheel script thing

* Channel is set inside the script

* add remaining env vars

* nit env var fix

* cleanup

* simplify unneeded jobs

* name of the conda env should be the path

* remove main ref to use PR

Reviewed By: YosuaMichael

Differential Revision: D40588164

fbshipit-source-id: 45aad3577f19edc8296bc0b97435ad510d46a436
@pmeier pmeier mentioned this pull request Mar 9, 2023
21 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants