Hi, When i use the toy data set locally with the test_docker.py, the results differ from the results I get from the submitted docker. Is that expected? If not, what might be possible reasons for the significant deviations? Best Regards

Created by anonoymous3141
https://www.synapse.org/Synapse:syn21343101/discussion/threadId=10485
Hi, did you use the new metric posted here in the Discussion forum ? I can give you more details (as far as I can see), for your submission mood_final_v1 (name: v1): Brain: Metric: F1 (tp, fp, fn) Thres: 0.628243257340632 Eval: /ssd/zimmerer/29539132/moody/brain_toy/toy_0.nii.gz F1 calc per round 0 2 0 Eval: /ssd/zimmerer/29539132/moody/brain_toy/toy_1.nii.gz F1 calc per round 1 2 0 Eval: /ssd/zimmerer/29539132/moody/brain_toy/toy_2.nii.gz F1 calc per round 0 4 1 Eval: /ssd/zimmerer/29539132/moody/brain_toy/toy_3.nii.gz F1 calc per round 0 3 1 Toy brain: Score: 0.13333, Time: 980.96 Abdominal: Metric: F1 (tp, fp, fn) Thres: 0.8805608060112908 Eval: /ssd/zimmerer/29539132/moody/colon_toy/toy_0.nii.gz F1 calc per round 0 0 0 Eval: /ssd/zimmerer/29539132/moody/colon_toy/toy_1.nii.gz F1 calc per round 1 0 0 Eval: /ssd/zimmerer/29539132/moody/colon_toy/toy_2.nii.gz F1 calc per round 0 2 1 Eval: /ssd/zimmerer/29539132/moody/colon_toy/toy_3.nii.gz F1 calc per round 1 0 0 Toy colon: Score: 0.57143, Time: 1232.48

Different Results when submitting the Docker page is loading…