-
-
Notifications
You must be signed in to change notification settings - Fork 7
Issue/138 validate prepared ml data #151
Conversation
# Conflicts: # nowcasting_dataset/config/model.py # nowcasting_dataset/consts.py # nowcasting_dataset/dataset/datasets.py
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! I like all the simplification done, and refactoring, looks good!
"WV_073", | ||
) | ||
|
||
DEFAULT_REQUIRED_KEYS = [ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice!
@JackKelly gona merge this, so that this PR can use some of this stuff. Please do add comments |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great to me! Awesome work! (And sorry for taking so long to review this!)
Just one tiny comment (and it's not important!)
assert data[OBJECT_AT_CENTER] == "gsp" | ||
|
||
if not batch: | ||
# add an extract dimension so that its similar to batch data |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Two tiny typos (sorry for being such a pedant... and sorry if I've misunderstood!)
- extract -> extra
- its -> it's
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
you are definitely right! my bad
Pull Request
Description
Main:
Extras:
Fixes issue #138
How Has This Been Tested?
Unittests + extra unittest
ran the validation script for a few batches - but need to run this on remote server/gcp
Checklist: