Dear BraTS team,
Our submission (ID 9716258) seems to have passed the technical validation.
However, the returned scores were only evaluated on one case (#BraTS2021_00001).
We suppose that at this stage the container is just run against a small set of images from the validation dataset.
Can you please confirm that later our submission will be run against the whole unseen testing dataset?
Thank you for your support!
Best,
Zjiang
Created by Zhifan Jiang zjiang Thank you for your reply!
I understand the docker image is tested firstly on 5 cases according to your update.
But, what I am not sure about is according to log files, our container was only run against one case (the first one).
Is there an issue? Thanks.
Best,
Zjiang Dear @zjiang ,
Apologies for the confusion. An update was sent out last month with respect to this phase, specifically:
> When you submit your docker image, we will run them against 5 cases from the validation data to make sure your containers run, then we will run them against the unseen test set.
Information pertaining to the test data is to not be shared with the participants, which is why we are using the validation data to help with debugging at this time.
Hope this helps clarify things!
Drop files to upload
Submission scored only on one case page is loading…