dvc experiments checkout: option to select the best experiment regarding one metric #4283
Labels
A: experiments
Related to dvc exp
p3-nice-to-have
It should be done this or next sprint
ui
user interface / interaction
I had an idea while trying the new experiment feature. For the use case of grid-search or hyper-parameter optimization, could we imagine an option for
dvc experiments checkout
to checkout the best experiment regarding one of the metrics? Something likedvc experiments checkout --best metrics.json:accuracy
. With an option like this, you can run (manually or automatically) a lot of experiments and ask dvc to return the best experiment, which can be then commited to git. Or instead of--best
, it could be--lowest
or--highest
to take into account that some metrics should be minimized and some others maximized.The text was updated successfully, but these errors were encountered: