Hello @EHRChallengeParticipants, The [Round 1 Leaderboard](https://www.synapse.org/#!Synapse:syn18405991/wiki/595487) as been published! We had a strong showing in the first round with some impressive scores. We had to delay publishing the leaderboard because we found a bug in the area under the precision-recall curve code and had to change the scoring script after the end of Round 1. The statistics package we were using (sklearn.metrics) was incorrectly calculating the precision-recall curve for certain edge cases. We have changed the scoring script and are now using the R package PRROC to calculate both the AUROC and the AUPR. This change is reflected in the leaderboard for Round 1. We re-scored all the validated and scored submissions using the new package but included the old scores to show the differences. The values in the columns old_AUROC, old_AUPR, delta_AUROC and delta_AUPR have been calculated and rounded using 6 digits and represent the old scores calculated using sklearn.metrics and the change between the new scores using PRROC and the old scores. Going forward, all submissions will be scored using the PRROC R package. Thank you and we look forward to seeing your submissions for Round 2, The EHR DREAM Admin Team

Created by Timothy Bergquist trberg

Round 1 Leaderboard page is loading…