Skip to content

add metadata to video dataset classes. bug fix. more robustness #1376

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Oct 3, 2019

Conversation

stephenyan1231
Copy link
Contributor

Make a few changes to to dataset classes, including ucf101, hmdb51 and kinetics, as well as VideoClips class

  • expose property metadata
  • being able to choose video backend according to global setting
  • Make class VideoClips more robust when video decoding fail for some videos
  • fix bugs

@stephenyan1231 stephenyan1231 force-pushed the metadata_in_dataset_classes branch from f35c559 to 7d687d2 Compare October 2, 2019 22:37
@codecov-io
Copy link

codecov-io commented Oct 2, 2019

Codecov Report

Merging #1376 into master will decrease coverage by 0.09%.
The diff coverage is 17.64%.

Impacted file tree graph

@@            Coverage Diff            @@
##           master    #1376     +/-   ##
=========================================
- Coverage   64.04%   63.95%   -0.1%     
=========================================
  Files          78       78             
  Lines        6189     6203     +14     
  Branches      948      949      +1     
=========================================
+ Hits         3964     3967      +3     
- Misses       1946     1957     +11     
  Partials      279      279
Impacted Files Coverage Δ
torchvision/datasets/video_utils.py 62.19% <0%> (-1.56%) ⬇️
torchvision/datasets/hmdb51.py 27.45% <25%> (-0.21%) ⬇️
torchvision/datasets/kinetics.py 34.61% <33.33%> (-0.17%) ⬇️
torchvision/datasets/ucf101.py 25.53% <33.33%> (+0.53%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bf85957...a0b41d2. Read the comment docs.

Copy link
Member

@fmassa fmassa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks a lot Zhicheng!

@fmassa fmassa merged commit 49b01e3 into pytorch:master Oct 3, 2019
facebook-github-bot pushed a commit to facebookresearch/ClassyVision that referenced this pull request Oct 16, 2019
Summary:
Pull Request resolved: #62

Current dependency torchvision 0.4.0 was released in August.
It missed quite a few PRs that are merged after that, and that are needed for video classification, such as

- pytorch/vision#1437
- pytorch/vision#1431
- pytorch/vision#1423
- pytorch/vision#1418
- pytorch/vision#1408
- pytorch/vision#1376
- pytorch/vision#1363
- pytorch/vision#1353
- pytorch/vision#1303

This will fail the CI test when a diff uses changes made in those PRs.
Before a new official version of TorchVision is released, we can temporarily use the nightly torchvision to get all the recent PRs, and unblock the PR merging.
We plan to use a fixed version of TorchVision later.

Reviewed By: vreis

Differential Revision: D17944239

fbshipit-source-id: 86ff540e3fc4f08ef767e84ef103525db5158201
@fmassa fmassa mentioned this pull request Oct 31, 2019
fmassa pushed a commit that referenced this pull request Oct 31, 2019
* add metadata to video dataset classes. bug fix. more robustness

* query video backend within VideoClips class

* Fix tests

* Fix lint
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants