Create functional tests for all V1 Evaluation scenarios #2621

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Closed

rogancarr opened this issue Feb 19, 2019 · 0 comments

Contributor

rogancarr commented Feb 19, 2019 •

edited

Loading

As laid out in #2498 , we need scenarios to cover the Evaluation functionality we want fully supported in V1.

I can evaluate a model trained for any of my tasks on test data. The evaluation outputs metrics that are relevant to the task (e.g. AUC, accuracy, P/R, and F1 for binary classification)
I can get the data that will allow me to plot PR curves

rogancarr mentioned this issue

Adding functional tests for all training and evaluation tasks #2646

Merged

rogancarr closed this as completed in #2646

ghost locked as resolved and limited conversation to collaborators

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.