Dear Organizers,
It seems I spammed the leaderboard for ATF2 with several identical submissions.
The first submission was OK (ID 7152327).
Then I've updated the predictions file on Synapse and got "please slow down" error while submitting (via web-interface, Google Chrome).
This resulted in two duplicate identical submissions (ID 7152436 and 7152437)
I deleted the file, reuploaded, double-checked the updated md5 sum (a4d38231916e863ff597abe0ec73b0d2).
This time I've also got "please slow down" error, the submission was also duplicated (ID 7152443 and 7152444).
The leaderboard rating is exactly the same for all the submissions (which is unlikely, but can be true).
Can you kindly share a proper way to update the predictions for a selected TF in ladder?
Is it possible (for any strange reason) that the scoring reuses the originally submitted file and not the updated file?
I am sorry for the mess,
Best Regards,
Ivan
Created by Ivan Kulakovskiy ivan.kulakovskiy > might be duplicate files on Synapse side that are renamed with parentheses when submitting to challange. Deleting the old submitted file doesn't seem to help.
Yes, I believe you are right! I have contacted the challenge organizer who manages the submission processing software, asking him to look into this. Thank you Bruce. Files on my server or laptop are properly named - no parentheses. Uploaded files also show correct names In my project folder. But the error message indicate that there might be duplicate files on Synapse side that are renamed with parentheses when submitting to challange. Deleting the old submitted file doesn't seem to help. This last issue sounds like something different. Something about the file name is objectional. Could it be the parentheses? Dear Bruce and James,
I've come up with a similar issue today when submitting with R code. Everything goes well when submitting. But later I got emails saying:
submission name: L.MAFK.K562.tab.gz
submission ID: **7238821**
The submitted filename (L.MAFK.K562.tab(1).gz) does not match expected naming pattern '[0-9\.]*([LFB])\.(.+?)\.(.+?).tab.gz$'
Then I delete the file and tried again, this time it shows:
submission name: L.MAFK.K562.tab.gz
submission ID: **7239083**
The submitted filename (L.MAFK.K562.tab(1).gz) does not match expected naming pattern '[0-9\.]*([LFB])\.(.+?)\.(.+?).tab.gz$'
I tried to update a new version of this file via website, the error becomes:
submission name: L.MAFK.K562.tab.gz
submission ID: **7239117**
The submitted filename (L.MAFK.K562.tab(2).gz) does not match expected naming pattern '[0-9\.]*([LFB])\.(.+?)\.(.+?).tab.gz$'
Would you help me to fix this MAFK-K562 submission? Much appreciated!!
Hi Yichao,
We have invalidated submission 7223897
Thanks
Jim
Hi,
I have this issue again. I didn't click the submit button twice but I got two identical submissions. Could you remove 7223897 for TCF12?
Thank you,
Yichao, Bobcat Bioinformaticians Dear Organizers
I accidentally submitted MAX to leaderboard as an individual rather than as TeamKE. Could you please nullify it.
Thank you OK Yichao, all of the submissions have been marked INVALID. good luck with the Challenge!! Dear Bruce,
Sorry, same problems for these submissions. Next time, when I click submit, I'll wait.
Could you remove:
7201896 7201897 7201898 7201899 7201900 7201901 7201902 7201903 7201904 for SPI1
7201906 7201907 7201908 7201909 7201910 7201911 7201912 7201913 7201914 for TCF12
Thanks!
Yichao, Bobcat Bioinformaticians Yichao: This has now been done. Dear Bruce,
We also got some duplicate submissions. The website just froze, so I clicked the submit button multiple times.
Could you remove:
7201879 7201880 7201881 7201882 7201883 7201884 7201885 7201886 7201889 for REST
Thanks!
Bobcat Bioinformaticians Thanks!
Philipp Phillip, we removed the duplicates 7196654 and 7196665. Dear Philipp,
In my case multiple duplicates were arising from slow web-interface,
I was clicking the button several times thinking it did not work for the first time
(actually it takes several seconds to record the submission after pressing the 'submit' button).
Cannot comment on the submission through API.
Best Regards,
Ivan We also got some duplicate submissions for unknown reasons:
- 7196653 7196654 for REST
- 7196664 7196665 for SRF
Could you remove one of the duplicates of each pair.
Thanks!
Philipp Dear Bruce,
Thank you so much.
I'll do my best to avoid "rapid double-clicking" with the further submissions. Dear Ivan:
We removed (marked as "INVALID") 7152463, but left 7152464.
We did the same for 7152436, 7152437, 7152443, but left 7152444.
If you need further assistance, please ask. Dear Organizers,
My bad, I am terribly sorry for raising the issue: we have tracked our bug with the submission files.
Furthermore, I understood what caused "double-submissions" from our side accompanied by the "please slow down" error.
It seems the web-interface is not very responsive and my touchpad is laggy -
indeed I was pressing the final "submit" button several times (and it caused multiple submissions in a row).
Again, I am very sorry and would be grateful if it is possible to clean our mess
(one of two duplicated submissions for GABPA: 7152463 and 7152464;
and three of four duplicated submissions for ATF2: 7152436, 7152437, 7152443 and 7152444).
We are fully OK if it will not reset the submission limit for each TF (it's clearly my fault and we have enough attempts to test everything),
but the leaderboard will be more beautiful w/o dupes.
Thank you in any case,
Best Regards,
Ivan