Dear Organizers, In the webinar Q&A wiki, the following two rules seem to contradict each other. Submissions **Which of the 5 submissions will be considered for final ranking?** **We will take the latest submission as the final one.** Results **How is a "top performer" determined? Is it defined by one overall best submission or an average?** **We will be looking for one best overall submission.** Would you mind explaining the concerns of not using the best submission of the five submissions as the final ranking? It seems that using the latest submission as the final ranking will force some teams specially top-ranking teams to take a conservative strategy such as resubmitting the best one of the first four submissions as their final submission. Best, Guanhua

Created by Guanhua Chen guanhuac
What is / are the metrics considered in the ranking system? We did a second submission with better bootstrapped roc auc and ranked worse than the first one. Regards, Manuel
Hello @guanhuac We have clarified the response to the below question in the webinar Q&A section Which of the 5 submissions will be considered for final ranking? **We will take the overall best submission as the final one.** Tomiko on behalf of the DREAM challenge Preterm Birth Microbiome team

question about submission and ranking page is loading…