If I understand correctly you plan to evaluate subchallenge 1 with AUC or PR which are classification metrics. But subchallenge 1 looks like a regression problem to me. Am I missing something? Thanks

Created by Olivier Labayle olabayle
Thanks for pointing this out. Yes, subchallenge 1 is a regression problem. We apologize for not specifying the scoring metric for Subchallenge 1 specifically and have rectified this in the wiki. We will use spearman rank correlation for Subchallenge 1 and consider other alternatives based on the submissions.

Evaluation metrics subchallenge 1 page is loading…