Apologies if this has been answered already somewhere on here, but I wasn't able to make a submission for Phase 1 and was wondering how the scoring process works. Specifically, when we make an official submission, is it scored right away and then we receive the score, or are all scoring submissions run after the training period is over and then we get scores when the leaderboard is posted? Was just hoping to get a score before the period is over so I can make adjustments if necessary.
Created by Bill Lotter bill_lotter Thanks @tschaffter ! Hi Bill,
> Specifically, when we make an official submission, is it scored right away and then we receive the score, or are all scoring submissions run after the training period is over and then we get scores when the leaderboard is posted?
It is the former. The submission may not start right away but may instead be placed in the queue. We are currently adding more machines for both training and scoring in prevision for a peak of submissions next week.
Thanks!
Thomas