-
Notifications
You must be signed in to change notification settings - Fork 1.9k
How to get training progress info? #3752
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
Hi, I have opened 2 issue on this topic that are currently under review #3685 and #3358. You will find some comments in these threads that perhaps can be used for some sort of activity monitoring. The short answer however is no, even though there are some ways to get feed back, none are really helping determine what's going on. You have
2.a You can, if the network you choose use early stopping to help mitigate wasting resources (doesn't tell you your progress though) 2.b Stop a training session periodically, test the current metrics and continue as shown here. Again not really progress reporting
|
also have a look at the answers in #3749 |
As mentioned in #3235, If a verbosity argument is added to I believe it's still hidden within the firehose of output and once the verbosity is scaled down, you should see messages like:
And naively extrapolating, there's around 2.7 hours left in the LightGBM training. |
I tried the MLContext.Log event but found that I could not filter out the information I wanted. |
I found a way to use CustomMapping: write a CustomMappingFactory subclass, input arbitrary, output as a fixed value such as 1.0f, and input it as a feature, then the Action method of the class will be called, you can write debugging code in this method. |
Hi,Suppose I have 10,000 training data. When I run Fit method, it takes a long time. During this period, how can I get real-time training progress information?
Thank You!
The text was updated successfully, but these errors were encountered: