Do participants need to submit all rounds in order to qualify for final evaluation?
Created by cndgf By final round, I meant 'round 4' or when then collected methods are run against the spiked-in data. Dear Kyle,
Sorry, I am a bit confused here. Did you mean there is a "final round" besides the four rounds listed in https://www.synapse.org/#!Synapse:syn2813589/wiki/401443 ? And the final evaluation will be based on the tools' performance in the final round ? Thanks. Groups do not have to participate in each evaluation to submit to the final evaluation. The preliminary evaluations give you an opportunity to make sure your code works well when deployed in the evaluation framework, and see how it behaves against previously unseen data.