Skip to content

[DatePipe] add deprecation warnings for DataPipes that will solely exist in TorchData #65827

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 4 commits into from

Conversation

NivekT
Copy link
Contributor

@NivekT NivekT commented Sep 29, 2021

@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Sep 29, 2021

🔗 Helpful links

💊 CI failures summary and remediations

As of commit e7b9283 (more details on the Dr. CI page):


  • 1/1 failures introduced in this PR

1 failure not recognized by patterns:

Job Step Action
CircleCI pytorch_macos_10_13_py3_test Test 🔁 rerun

This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

@NivekT NivekT requested a review from ejguan September 29, 2021 16:50
…l solely exist in TorchData"

[ghstack-poisoned]
@NivekT
Copy link
Contributor Author

NivekT commented Sep 29, 2021

@NivekT has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@NivekT NivekT added the module: data torch.utils.data label Sep 29, 2021
…l solely exist in TorchData"

Differential Revision: [D31272794](https://our.internmc.facebook.com/intern/diff/D31272794)

cc @VitalyFedyunin ejguan @NivekT

[ghstack-poisoned]
@NivekT
Copy link
Contributor Author

NivekT commented Sep 29, 2021

@NivekT has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

Copy link
Contributor

@ejguan ejguan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

…l solely exist in TorchData"

Differential Revision: [D31272794](https://our.internmc.facebook.com/intern/diff/D31272794)

cc @VitalyFedyunin ejguan @NivekT

[ghstack-poisoned]
NivekT added a commit that referenced this pull request Sep 29, 2021
…ist in TorchData

ghstack-source-id: a051899
Pull Request resolved: #65827
@NivekT
Copy link
Contributor Author

NivekT commented Sep 29, 2021

@NivekT has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@ejguan
Copy link
Contributor

ejguan commented Sep 30, 2021

Same as the another PR. Could we add this PR to release 1.10?

NivekT added a commit that referenced this pull request Sep 30, 2021
…ist in TorchData (#65827)

Summary: Pull Request resolved: #65827

Test Plan: Imported from OSS

Reviewed By: ejguan

Differential Revision: D31272794

Pulled By: NivekT

fbshipit-source-id: 8da8266184b4df050422904cbc5fca6d7c3d2e02
@NivekT NivekT deleted the gh/NivekT/1/head branch October 1, 2021 22:21
malfet pushed a commit that referenced this pull request Oct 6, 2021
…5932)

* Unify the output pathname of archive reader and extractor (#65424)

Summary:
Pull Request resolved: #65424

This PR is re-implementation for https://github.com/facebookexternal/torchdata/pull/93
Same PR has landed into torchdata https://github.com/facebookexternal/torchdata/pull/157

Test Plan: Imported from OSS

Reviewed By: soulitzer

Differential Revision: D31090447

Pulled By: ejguan

fbshipit-source-id: 45af1ad9b24310bebfd6e010f41cff398946ba65

* [DatePipe] add deprecation warnings for DataPipes that will solely exist in TorchData (#65827)

Summary: Pull Request resolved: #65827

Test Plan: Imported from OSS

Reviewed By: ejguan

Differential Revision: D31272794

Pulled By: NivekT

fbshipit-source-id: 8da8266184b4df050422904cbc5fca6d7c3d2e02

* [DataPipe] Fixes an issue where TarArchiveReader closes stream when read into a buffer (#65877)

Summary:
Pull Request resolved: #65877

Fixes #65808

Test Plan: Imported from OSS

Reviewed By: ejguan

Differential Revision: D31296041

Pulled By: NivekT

fbshipit-source-id: cdcad3a333ae9781d6063678a122a128955b0ff4

Co-authored-by: Erjia Guan <[email protected]>
NivekT added a commit that referenced this pull request Jan 11, 2022
We labeled these DataPipes as deprecated on Sep 30th, 2021 (#65827). Users should import these DataPipes from [TorchData](https://github.com/pytorch/data) to continue using them. We will be checking for any downstream library usage before landing this PR.

All deprecation related to DataPipes are tracked in pytorch/data#163

DataPipes impacted by this PR:

| Name | Functional API  | Deprecation Date | What Happens Now 
| ------------- | ------------- | ------------- | ------------- |
| BucketBatcher | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| HTTPReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| LineReader | NA  | Sep 30th, 2021 | Remove (moved to TorchData)
| TarArchiveReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| ZipArchiveReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)

Lastly, tests related to those DataPipes will also be removed or migrated to TorchData (if they do not already exist there).


Differential Revision: [D33532272](https://our.internmc.facebook.com/intern/diff/D33532272)

cc ezyang gchanan @VitalyFedyunin ejguan @NivekT

[ghstack-poisoned]
NivekT added a commit that referenced this pull request Jan 11, 2022
We labeled these DataPipes as deprecated on Sep 30th, 2021 (#65827). Users should import these DataPipes from [TorchData](https://github.com/pytorch/data) to continue using them. We will be checking for any downstream library usage before landing this PR.

All deprecation related to DataPipes are tracked in pytorch/data#163

DataPipes impacted by this PR:

| Name | Functional API  | Deprecation Date | What Happens Now 
| ------------- | ------------- | ------------- | ------------- |
| BucketBatcher | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| HTTPReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| LineReader | NA  | Sep 30th, 2021 | Remove (moved to TorchData)
| TarArchiveReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| ZipArchiveReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)

Lastly, tests related to those DataPipes will also be removed or migrated to TorchData (if they do not already exist there).


Differential Revision: [D33532272](https://our.internmc.facebook.com/intern/diff/D33532272)

cc ezyang gchanan @VitalyFedyunin ejguan @NivekT

[ghstack-poisoned]
NivekT added a commit that referenced this pull request Jan 11, 2022
We labeled these DataPipes as deprecated on Sep 30th, 2021 (#65827). Users should import these DataPipes from [TorchData](https://github.com/pytorch/data) to continue using them. We will be checking for any downstream library usage before landing this PR.

All deprecation related to DataPipes are tracked in pytorch/data#163

DataPipes impacted by this PR:

| Name | Functional API  | Deprecation Date | What Happens Now 
| ------------- | ------------- | ------------- | ------------- |
| BucketBatcher | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| HTTPReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| LineReader | NA  | Sep 30th, 2021 | Remove (moved to TorchData)
| TarArchiveReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| ZipArchiveReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)

Lastly, tests related to those DataPipes will also be removed or migrated to TorchData (if they do not already exist there).


Differential Revision: [D33532272](https://our.internmc.facebook.com/intern/diff/D33532272)

cc ezyang gchanan @VitalyFedyunin ejguan @NivekT

[ghstack-poisoned]
NivekT added a commit that referenced this pull request Jan 12, 2022
We labeled these DataPipes as deprecated on Sep 30th, 2021 (#65827). Users should import these DataPipes from [TorchData](https://github.com/pytorch/data) to continue using them. We will be checking for any downstream library usage before landing this PR.

All deprecation related to DataPipes are tracked in pytorch/data#163

DataPipes impacted by this PR:

| Name | Functional API  | Deprecation Date | What Happens Now 
| ------------- | ------------- | ------------- | ------------- |
| BucketBatcher | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| HTTPReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| LineReader | NA  | Sep 30th, 2021 | Remove (moved to TorchData)
| TarArchiveReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| ZipArchiveReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)

Lastly, tests related to those DataPipes will also be removed or migrated to TorchData (if they do not already exist there).


Differential Revision: [D33532272](https://our.internmc.facebook.com/intern/diff/D33532272)

cc ezyang gchanan @VitalyFedyunin ejguan @NivekT

[ghstack-poisoned]
NivekT added a commit that referenced this pull request Jan 12, 2022
We labeled these DataPipes as deprecated on Sep 30th, 2021 (#65827). Users should import these DataPipes from [TorchData](https://github.com/pytorch/data) to continue using them. We will be checking for any downstream library usage before landing this PR.

All deprecation related to DataPipes are tracked in pytorch/data#163

DataPipes impacted by this PR:

| Name | Functional API  | Deprecation Date | What Happens Now 
| ------------- | ------------- | ------------- | ------------- |
| BucketBatcher | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| HTTPReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| LineReader | NA  | Sep 30th, 2021 | Remove (moved to TorchData)
| TarArchiveReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)
| ZipArchiveReader | NA | Sep 30th, 2021 | Remove (moved to TorchData)

Lastly, tests related to those DataPipes will also be removed or migrated to TorchData (if they do not already exist there).


Differential Revision: [D33532272](https://our.internmc.facebook.com/intern/diff/D33532272)

cc ezyang gchanan @VitalyFedyunin ejguan @NivekT

[ghstack-poisoned]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants