-
Notifications
You must be signed in to change notification settings - Fork 309
NVFuser microbenchmarks and filtering tool #793
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
import time | ||
|
||
|
||
# TODO - a lot of this was copied from pytorch/jit/scripts/log_extract.py, should we put it somewhere in torch? (and where?) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why cant we just use that directly ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@eellison is there a way to import from pytorch/scripts/jit/log_extract.py? I was planning to move move some of the functions from log_extract.py into somewhere like torch.testing so we could import it
return graph | ||
|
||
|
||
def compress_graph(graph): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@eellison this is the script which can be used to reduce the number of fusion groups
import time | ||
|
||
|
||
# TODO - a lot of this was copied from pytorch/jit/scripts/log_extract.py, should we put it somewhere in torch? (and where?) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@eellison is there a way to import from pytorch/scripts/jit/log_extract.py? I was planning to move move some of the functions from log_extract.py into somewhere like torch.testing so we could import it
run_microbenchmarks.py
Outdated
def run(): | ||
parser = argparse.ArgumentParser(description="Run nvfuser microbenchmarks") | ||
parser.add_argument("--filter", nargs="*", default=[], help='List of benchmarks to test') | ||
parser.add_argument("--fusers", nargs="*", default=[], help='List of fusers to run tests on (options include "no_fuser", "fuser0", "fuser1", "fuser2")') |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You can use choices=['no_fuser', 'fuser0', 'fuser1', 'fuser2']
to enumerate possible options.
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
@davidberard98 has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. I will make some changes after merging this to make it work better for other customers.
Differential Revision: [D34914221](https://our.internmc.facebook.com/intern/diff/D34914221) [ghstack-poisoned]
@davidberard98 has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator. |
Stack from ghstack:
Differential Revision: D34914221