Hello,
I am looking for a way to simply download the complete dataset which root is displayed at the following link:
https://www.synapse.org/#!Synapse:syn21903917/files/
I am able to navigate in the directories and to download one file after the other, but given the enormous number of files, this is a really cumbersome task.
I am registered as a member of the EndoVis challenge, so is there a simple way to download a .ZIP file containing the whole dataset ?
Thanks for your help,
Arthur Derathé
Created by Arthur Derathe derathea Hi,
How can I get access to this dataset?
Thanks,
Jose Due to the feedback of some users, synapse was able to fix the download speed issue. If you want to download our data, we strongly recommend you to update your synapse version and use our download script as usual.
pip install --upgrade synapseclient
> the dataset is about 400GB, so it definitely takes some time to download everything.
Yes, but even at just 10 MBytes/sec it would be done in 11 hours. Have you heard how long the whole download takes for any other collaborators?
> Does it help to split the downloading process into smaller subsets rather than downloading everything at once?
I don't think so, but it does help to use the latest version of the Synapse Python client. I would like to see Arthur's answer to the question I asked him, above. Dear Bruce,
the dataset is about 400GB, so it definitely takes some time to download everything. Does it help to split the downloading process into smaller subsets rather than downloading everything at once?
Best,
Annika Arthur, Can you check the *version* of the Synapse Python client you are using? The current version, 2.0, has some changes to speed-up download.
Annika, Do you know how *large* the data set is that Arthur is trying to download? Do you know how long the transfer typically takes (i.e. for other collaborators)? @brucehoff Can you help out here as well?
Arthur, have you tried to download the data set in smaller pieces? Perhaps this helps you to speed up the download rate. Dear Organizers,
I followed the procedure and started the download correctly, but after 5 days of non-stop download, I had to reboot my computer so I stopped the download. As I tried to restart the download (hoping it would carry on where it had stopped), it failed.
Is this normal that it took me so long too perform the downloading or did I performed something wrong that prevented a faster downloading ?
Is there a way to easily continue an interrupted downloading ?
Thanks for your help,
Arthur Derathé Dear Arthur,
please try to use the scripts suggested in the data paper (https://arxiv.org/abs/2005.03501). You would have to update the synapse IDs: https://phabricator.mitk.org/source/rmis2019/browse/master/synapse/download_data.py
Kind regards,
the ROBUST-MIS organizers