[NOMERGE] Multi-weight support for Classification #5603

datumbox · 2022-03-14T08:42:27Z

Related to #4679

…Densenet and EfficientNet.

facebook-github-bot · 2022-03-14T08:42:36Z

💊 CI failures summary and remediations

As of commit 5ce348d (more details on the Dr. CI page):

6/6 failures introduced in this PR

🕵️ 4 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

unittest_linux_cpu_py3.9 (1/4)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

/root/project/torchvision/io/video.py:406: Runt...log: [mov,mp4,m4a,3gp,3g2,mj2] moov atom not found

test/test_datasets_video_utils.py::TestVideo::test_video_clips_custom_fps
  /root/project/torchvision/datasets/video_utils.py:217: UserWarning: There aren't enough frames in the current video to get a clip for the given clip length and frames between clips. The video (and potentially others) will be skipped.
    warnings.warn(

test/test_image.py::test_decode_png[L-ImageReadMode.GRAY-palette_pytorch.png]
test/test_image.py::test_decode_png[RGB-ImageReadMode.RGB-palette_pytorch.png]
  /root/project/env/lib/python3.9/site-packages/PIL/Image.py:945: UserWarning: Palette images with Transparency expressed in bytes should be converted to RGBA images
    warnings.warn(

test/test_io.py::TestVideo::test_read_video_timestamps_corrupted_file
  /root/project/torchvision/io/video.py:406: RuntimeWarning: Failed to open container for /tmp/tmptkj15bkg.mp4; Caught error: [Errno 1094995529] Invalid data found when processing input: '/tmp/tmptkj15bkg.mp4'; last error log: [mov,mp4,m4a,3gp,3g2,mj2] moov atom not found
    warnings.warn(msg, RuntimeWarning)

test/test_models.py::test_memory_efficient_densenet[densenet121]
test/test_models.py::test_memory_efficient_densenet[densenet169]
test/test_models.py::test_memory_efficient_densenet[densenet201]
test/test_models.py::test_memory_efficient_densenet[densenet161]
  /root/project/env/lib/python3.9/site-packages/torch/nn/modules/module.py:1385: UserWarning: positional arguments and argument "destination" are deprecated. nn.Module.state_dict will not accept them in the future. Refer to https://pytorch.org/docs/master/generated/torch.nn.Module.html#torch.nn.Module.state_dict for details.
    warnings.warn(

test/test_models.py::test_memory_efficient_densenet[densenet121]

unittest_linux_cpu_py3.8 (2/4)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

/root/project/torchvision/io/video.py:406: Runt...log: [mov,mp4,m4a,3gp,3g2,mj2] moov atom not found

test/test_image.py::test_decode_png[L-ImageReadMode.GRAY-palette_pytorch.png]
test/test_image.py::test_decode_png[RGB-ImageReadMode.RGB-palette_pytorch.png]
  /root/project/env/lib/python3.8/site-packages/PIL/Image.py:945: UserWarning: Palette images with Transparency expressed in bytes should be converted to RGBA images
    warnings.warn(

test/test_io.py::TestVideo::test_probe_video_from_memory
  /root/project/torchvision/io/_video_opt.py:423: UserWarning: The given buffer is not writable, and PyTorch does not support non-writable tensors. This means you can write to the underlying (supposedly non-writable) buffer using the tensor. You may want to copy the buffer to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at  /opt/conda/conda-bld/pytorch_1647241729809/work/torch/csrc/utils/tensor_new.cpp:954.)
    video_data = torch.frombuffer(video_data, dtype=torch.uint8)

test/test_io.py::TestVideo::test_read_video_timestamps_corrupted_file
  /root/project/torchvision/io/video.py:406: RuntimeWarning: Failed to open container for /tmp/tmp2jpu83hi.mp4; Caught error: [Errno 1094995529] Invalid data found when processing input: '/tmp/tmp2jpu83hi.mp4'; last error log: [mov,mp4,m4a,3gp,3g2,mj2] moov atom not found
    warnings.warn(msg, RuntimeWarning)

test/test_models.py::test_memory_efficient_densenet[densenet121]
test/test_models.py::test_memory_efficient_densenet[densenet169]
test/test_models.py::test_memory_efficient_densenet[densenet201]
test/test_models.py::test_memory_efficient_densenet[densenet161]
  /root/project/env/lib/python3.8/site-packages/torch/nn/modules/module.py:1385: UserWarning: positional arguments and argument "destination" are deprecated. nn.Module.state_dict will not accept them in the future. Refer to https://pytorch.org/docs/master/generated/torch.nn.Module.html#torch.nn.Module.state_dict for details.
    warnings.warn(

test/test_models.py::test_memory_efficient_densenet[densenet121]

unittest_linux_cpu_py3.10 (3/4)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

/root/project/torchvision/io/video.py:406: Runt...log: [mov,mp4,m4a,3gp,3g2,mj2] moov atom not found

test/test_image.py::test_decode_png[L-ImageReadMode.GRAY-palette_pytorch.png]
test/test_image.py::test_decode_png[RGB-ImageReadMode.RGB-palette_pytorch.png]
  /root/project/env/lib/python3.10/site-packages/PIL/Image.py:945: UserWarning: Palette images with Transparency expressed in bytes should be converted to RGBA images
    warnings.warn(

test/test_io.py::TestVideo::test_probe_video_from_memory
  /root/project/torchvision/io/_video_opt.py:423: UserWarning: The given buffer is not writable, and PyTorch does not support non-writable tensors. This means you can write to the underlying (supposedly non-writable) buffer using the tensor. You may want to copy the buffer to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at  /opt/conda/conda-bld/pytorch_1647241729337/work/torch/csrc/utils/tensor_new.cpp:954.)
    video_data = torch.frombuffer(video_data, dtype=torch.uint8)

test/test_io.py::TestVideo::test_read_video_timestamps_corrupted_file
  /root/project/torchvision/io/video.py:406: RuntimeWarning: Failed to open container for /tmp/tmpe6azhyps.mp4; Caught error: [Errno 1094995529] Invalid data found when processing input: '/tmp/tmpe6azhyps.mp4'; last error log: [mov,mp4,m4a,3gp,3g2,mj2] moov atom not found
    warnings.warn(msg, RuntimeWarning)

test/test_models.py::test_memory_efficient_densenet[densenet121]
test/test_models.py::test_memory_efficient_densenet[densenet169]
test/test_models.py::test_memory_efficient_densenet[densenet201]
test/test_models.py::test_memory_efficient_densenet[densenet161]
  /root/project/env/lib/python3.10/site-packages/torch/nn/modules/module.py:1385: UserWarning: positional arguments and argument "destination" are deprecated. nn.Module.state_dict will not accept them in the future. Refer to https://pytorch.org/docs/master/generated/torch.nn.Module.html#torch.nn.Module.state_dict for details.
    warnings.warn(

test/test_models.py::test_memory_efficient_densenet[densenet121]

unittest_linux_cpu_py3.7 (4/4)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

/root/project/torchvision/io/video.py:406: Runt...log: [mov,mp4,m4a,3gp,3g2,mj2] moov atom not found

test/test_image.py::test_decode_png[L-ImageReadMode.GRAY-palette_pytorch.png]
test/test_image.py::test_decode_png[RGB-ImageReadMode.RGB-palette_pytorch.png]
  /root/project/env/lib/python3.7/site-packages/PIL/Image.py:946: UserWarning: Palette images with Transparency expressed in bytes should be converted to RGBA images
    "Palette images with Transparency expressed in bytes should be "

test/test_io.py::TestVideo::test_probe_video_from_memory
  /root/project/torchvision/io/_video_opt.py:423: UserWarning: The given buffer is not writable, and PyTorch does not support non-writable tensors. This means you can write to the underlying (supposedly non-writable) buffer using the tensor. You may want to copy the buffer to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at  /opt/conda/conda-bld/pytorch_1647241701695/work/torch/csrc/utils/tensor_new.cpp:954.)
    video_data = torch.frombuffer(video_data, dtype=torch.uint8)

test/test_io.py::TestVideo::test_read_video_timestamps_corrupted_file
  /root/project/torchvision/io/video.py:406: RuntimeWarning: Failed to open container for /tmp/tmp5ianv7ab.mp4; Caught error: [Errno 1094995529] Invalid data found when processing input: '/tmp/tmp5ianv7ab.mp4'; last error log: [mov,mp4,m4a,3gp,3g2,mj2] moov atom not found
    warnings.warn(msg, RuntimeWarning)

test/test_models.py::test_memory_efficient_densenet[densenet121]
test/test_models.py::test_memory_efficient_densenet[densenet169]
test/test_models.py::test_memory_efficient_densenet[densenet201]
test/test_models.py::test_memory_efficient_densenet[densenet161]
  /root/project/env/lib/python3.7/site-packages/torch/nn/modules/module.py:1386: UserWarning: positional arguments and argument "destination" are deprecated. nn.Module.state_dict will not accept them in the future. Refer to https://pytorch.org/docs/master/generated/torch.nn.Module.html#torch.nn.Module.state_dict for details.
    " and ".join(warn_msg) + " are deprecated. nn.Module.state_dict will not accept them in the future. "

test/test_models.py::test_memory_efficient_densenet[densenet121]

2 failures not recognized by patterns:

Job	Step	Action
^{unittest_prototype}	^{Run tests}	🔁 rerun
^{cmake_macos_cpu}	^{curl -o conda.sh https://repo.anaconda.com/miniconda/Miniconda3-latest-MacOSX-x86_64.sh}
sh conda.sh -b
source $HOME/miniconda3/bin/activate
conda install -yq conda-build cmake
packaging/build_cmake.sh
	🔁 rerun

This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

pmeier

I haven't checked the whole PR. If there are more cases like the one I highlighted below, we need to handle all of them.

torchvision/models/_utils.py

datumbox added 9 commits March 11, 2022 15:16

Moving basefiles outside of prototype and porting Alexnet, ConvNext, …

d44e44d

…Densenet and EfficientNet.

Porting googlenet

78f90ce

Porting inception

548d9ca

Porting mnasnet

46ff348

Porting mobilenetv2

58be05b

Porting mobilenetv3

99930d5

Porting regnet

9b4a3ef

Porting resnet

3788fb8

Porting shufflenetv2

0eabb0c

pytorch-bot bot added the ciflow/default label Mar 14, 2022

facebook-github-bot added the cla signed label Mar 14, 2022

datumbox marked this pull request as draft March 14, 2022 08:42

datumbox added 4 commits March 14, 2022 10:10

Porting squeezenet

8c45c1a

Porting vgg

b7916d3

Porting vit

a7fabb3

Fix docstrings

76f017c

pmeier requested changes Mar 14, 2022

View reviewed changes

torchvision/models/_utils.py Outdated Show resolved Hide resolved

Fixing imports

eb5254d

datumbox force-pushed the multiweight/full branch from 14f0fa0 to eb5254d Compare March 14, 2022 12:48

Adding missing import

56e0e01

datumbox mentioned this pull request Mar 14, 2022

Moving sequence_to_str to torchvision._utils #5604

Merged

Merge branch 'main' into multiweight/full

2a42fd2

datumbox changed the base branch from multiweight/full to main March 14, 2022 15:12

datumbox changed the title ~~Multi-weight support to Branch~~ [NOMERGE] Multi-weight support to Branch Mar 14, 2022

datumbox added 2 commits March 14, 2022 15:30

Fix mobilenet imports

34f45d0

Fix tests

7cd616c

datumbox changed the title ~~[NOMERGE] Multi-weight support to Branch~~ [NOMERGE] Multi-weight support for Classification Mar 14, 2022

Fix prototype tests

5ce348d

datumbox requested a review from pmeier March 14, 2022 15:56

datumbox requested review from jdsgomes and NicolasHug March 14, 2022 15:56

datumbox closed this Mar 14, 2022

datumbox deleted the multiweight/full branch March 14, 2022 16:09

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[NOMERGE] Multi-weight support for Classification #5603

[NOMERGE] Multi-weight support for Classification #5603

datumbox commented Mar 14, 2022 •

edited

Loading

facebook-github-bot commented Mar 14, 2022 •

edited

Loading

pmeier left a comment

[NOMERGE] Multi-weight support for Classification #5603

[NOMERGE] Multi-weight support for Classification #5603

Conversation

datumbox commented Mar 14, 2022 • edited Loading

facebook-github-bot commented Mar 14, 2022 • edited Loading

💊 CI failures summary and remediations

🕵️ 4 new failures recognized by patterns

unittest_linux_cpu_py3.9 (1/4)

unittest_linux_cpu_py3.8 (2/4)

unittest_linux_cpu_py3.10 (3/4)

unittest_linux_cpu_py3.7 (4/4)

2 failures not recognized by patterns:

pmeier left a comment

Choose a reason for hiding this comment

datumbox commented Mar 14, 2022 •

edited

Loading

facebook-github-bot commented Mar 14, 2022 •

edited

Loading