Skip to content

Conversation

NicolasHug
Copy link
Member

Closes #5973

This PR:

  • renames the "metrics" key into "_metrics"
  • Adds the dataset to the "_metrics" dict
  • Documents the datasets associated with each metric

Copy link
Contributor

@datumbox datumbox left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks good. Some initial comments:

"box_map": 50.6,
"kp_map": 61.1,
"_metrics": {
"COCO-val2017": {
Copy link
Contributor

@datumbox datumbox May 18, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Non blocking question. @fmassa Any thoughts on the name of keypoints dataset here?

Copy link
Contributor

@datumbox datumbox left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should be able to merge after fixing the nits. Stamping to unblock. Thanks for the work @NicolasHug.

@NicolasHug NicolasHug merged commit 2ec0e84 into pytorch:main May 18, 2022
@NicolasHug
Copy link
Member Author

CI is completely toasted (didn't even start some jobs) so I'll merge now. Everything was fine locally, hopefully this doesn't add any additional problems.

facebook-github-bot pushed a commit that referenced this pull request Jun 1, 2022
Summary:
* Classif models

* Detection

* Segmentation

* quantization

* Video

* optical flow

* tests

* Fix docs

* Fix Video dataset

* Consistency for RAFT dataset names

* use ImageNet-1K

* Use COCO-val2017-VOC-labels for segmentation

* formatting

Reviewed By: NicolasHug

Differential Revision: D36760921

fbshipit-source-id: 6efc259c6b8b922510a35be0ed1ca071e2a53a6f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

RFC on schema for the metrics field of weights meta-data
3 participants