Evaluation

Submitted segmentation results will be compared to the manually obtained reference standard. For each tissue type (gray matter, white matter and cerebrospinal fluid), the Dice coefficient (DC), the 95th-percentile of the Hausdorff distance (HD-95) and the absolute volume difference (AVD) will be calculated.

The final ranking is based on the evaluation results of all 15 test datasets and is determined as follows: For each evaluation measure (DC, HD-95, AVD), the mean value over all 15 datasets is determined for white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF). Each team receives a rank (1=best) for each tissue type (GM, WM, CSF) and each evaluation measure (DC, HD-95, AVD) based on the mean value of the evaluation measures over all 15 datasets. The final score is determined by adding the ranks of all tissue types and evaluation measures for each team. The team with the lowest score will be ranked number 1. In case two teams would have an equal score, the team with the lowest standard deviation over the tissue types will be ranked number 1. Results will be presented on the results page.