I had a model trained for a few hours but my program encountered some problem at the end of the training. I had the program save the best model during training so I was hoping to retrieve the best model even though the program failed in the end. But when I went to my dashboard, I saw only a log file but no model state file.
Can this be changed? It will save us hours of training. Thanks!
Created by Li Shen thefaculty Yes, that's a good idea. The only downside is that if one had many aborted training runs in a single day, one would consume ones data download limit with model-state archives that might not be useful. My guess is that this is a minor concern compared to the situation you describe, so we'll make the change (and see how it goes).
Drop files to upload
Does a model state file have to be obtained after a successful run? page is loading…