[DataPipe] Refactor 'mux' to have buffer as an instance variable

[NivekT]

Stack from ghstack:

• [DataPipe] Snapshotting prototype #70216
• [DataPipe] Basic snapshotting with IterableWrapper #70373
• -> [DataPipe] Refactor 'mux' to have buffer as an instance variable #77775
• [DataPipe] Preventing automatic reset call after state is restored #77774

This allows the buffer to be saved by snapshotting if needed.

Differential Revision: D36521038

[facebook-github-bot]

🔗 Helpful links

• 🧪  See artifacts and rendered test results at hud.pytorch.org/pr/77775
• 📄  Preview Python docs built from this PR
• 📄  Preview C++ docs built from this PR
• ❓Need help or want to give feedback on the CI? Visit our office hours
• ↩️  [fb-only] Re-run with SSH instructions

❌ 1 New Failures, 1 Pending

As of commit 74964b2 (more details on the Dr. CI page):

Expand to see more

---

• 1/1 failures introduced in this PR

---

🕵️ 1 new failure recognized by patterns

The following CI failures do not appear to be due to upstream breakages

pull / linux-bionic-rocm5.1-py3.7 / test (default, 1, 2, linux.rocm.gpu) (1/1)

Step: "Download build artifacts" (full log | diagnosis details | 🔁 rerun)

2022-05-19T20:43:03.6685879Z ##[error]No files ...ath: test/**/*.xml. No artifacts will be uploaded.

2022-05-19T20:43:03.4652588Z   retention-days: 14
2022-05-19T20:43:03.4653067Z   if-no-files-found: error
2022-05-19T20:43:03.4653546Z   path: test/**/*.xml
2022-05-19T20:43:03.4653954Z env:
2022-05-19T20:43:03.4654327Z   IN_CI: 1
2022-05-19T20:43:03.4654707Z   IS_GHA: 1
2022-05-19T20:43:03.4655148Z   GIT_DEFAULT_BRANCH: master
2022-05-19T20:43:03.4655886Z   DOCKER_HOST: unix:///run/user/1502/docker.sock
2022-05-19T20:43:03.4656757Z   GPU_FLAG: --device=/dev/mem --device=/dev/kfd --device=/dev/dri/renderD128 --device=/dev/dri/renderD129 --group-add video --group-add daemon
2022-05-19T20:43:03.4657667Z ##[endgroup]
2022-05-19T20:43:03.6685879Z ##[error]No files were found with the provided path: test/**/*.xml. No artifacts will be uploaded.
2022-05-19T20:43:03.6749794Z ##[group]Run set -x
2022-05-19T20:43:03.6750305Z �[36;1mset -x�[0m
2022-05-19T20:43:03.6750869Z �[36;1mpython3 -m pip install -r requirements.txt�[0m
2022-05-19T20:43:03.6751528Z �[36;1mpython3 -m pip install boto3==1.19.12�[0m
2022-05-19T20:43:03.6752289Z �[36;1mpython3 -m tools.stats.print_test_stats --upload-to-s3 --compare-with-s3 test�[0m
2022-05-19T20:43:03.6791468Z shell: /bin/bash --noprofile --norc -e -o pipefail {0}
2022-05-19T20:43:03.6792018Z env:
2022-05-19T20:43:03.6792425Z   IN_CI: 1
2022-05-19T20:43:03.6792847Z   IS_GHA: 1
2022-05-19T20:43:03.6793320Z   GIT_DEFAULT_BRANCH: master

---

This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

[ejguan]

Thank you.
Could you please import it into Phabricator to verify nothing breaks in TorchData? You can still land PR from OSS.

[NivekT]

@NivekT has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

[NivekT]

@pytorchbot merge