Hi,
It seems we are still waiting for the scoring code fixes to get merged into your mainline. As we head toward the updated end of round 3 we're wondering:
- will scoring submissions made now be scored with the updated code?
- will the round two leaderboard scores be annotated to show how they would have scored with the updated scorer?
Thanks,
Tony
Created by tconfrey I have been told by the Synapse team that the scoring algorithms are fixed. Final submissions for Round 3 are due today :-) Hi @tconfrey ,
Great questions.
> will scoring submissions made now be scored with the updated code?
Yes, submissions will be scored using the updated code (and the file changes mentioned in the [changelog](https://www.synapse.org/#!Synapse:syn18065891/discussion/threadId=6951)), including the Validation phase submissions. All Round 3 submissions that are submitted before the scoring fixes are applied with be re-scored accordingly, which is set to happen later today.
> will the round two leaderboard scores be annotated to show how they would have scored with the updated scorer?
Yes, for transparency, we will be re-scoring Round 2 submissions as well, however, they will not be the official scores for that round.
Drop files to upload
Scoring updates for round 3 submissions? page is loading…