Hello @CTDsquaredBeatAMLDREAMChallengeParticipants,
We were made aware that troubleshooting without logs have been difficult for some teams (especially when the models work successfully with the leaderboard dataset), so we have replaced the **Leaderboard Phase queues** with two **Express queues**. These express queues will be using synthetic data, and will allow you to check whether your model's generated predictions will match the format expected with the validation dataset. Unlike the Validation Phase queues, log files are available if an error does arise.
Please note that using the Express queues will NOT return any scores; they will only provide information on whether the model will produce valid predictions.
If you have any questions, please let us know in the Discussion forum.
Best,
CTD^2^ BeatAML Dream Challenge Team
Created by Verena Chung vchung Hi @fuhrmanj ,
The Challenge Organizers have approved the request to re-open the Leaderboard queues, with the caveat that only one successful submission may be accepted per day.
If needed, you may also locally score your models by utilizing the scoring code shared [here](https://www.synapse.org/#!Synapse:syn20940518/discussion/threadId=6843&replyId=21621) (SC1), [here](https://www.synapse.org/#!Synapse:syn20940518/discussion/threadId=6843&replyId=21645) (SC2 concordance index), and [here](https://www.synapse.org/#!Synapse:syn20940518/discussion/threadId=6886&replyId=21924) (SC2 AUC).
Best,
Verena Would you be so kind and open up leaderboard queues as well? Otherwise one has no feedback on the scores.
Best,
Joshua