I am wondering, form the wiki, it is said that we are allowed to three submissions in round. Does that literally mean the number of time we can submit a model to be trained and tested or the final model that we choose to submit can be at maximum 3 types of models? Also, if we stop a running job, will that be counted as a submission? The specific line says: Scoring You are allowed three submissions to each of the sub-challenge scoring queues in each round. There is no explicit time quota, but we reserve the right to terminate submissions that take excessive time to be scored.

Created by Lintang Adyuta Sutawika lintangsutawika
> Does that literally mean the number of time we can submit a model to be trained and tested or the final model You can train as many times as you want on the training set (assuming that you have free time quota left) and generate N trained models, but in a given Round, you can submit only up to three trained models. We then conserve the one with the highest score. > Also, if we stop a running job, will that be counted as a submission? You can always stop a training job based on the feedback returned by the log files. Scoring jobs that have already started can not be stopped. No log files are returned during scoring.

Limit of submission during the challenge phases page is loading…