Home    Details    Workshop    Register    Download    Submit    Results    Organizers 

Results

When teams submit their segmentation results, the evaluation results will be sent to the team contact person by e-mail and will be listed below.

Rank Team name Submission name Date Sum Scores Sequences used Speed Doc
1CU_DL 3D Deep Learning; voxnet13 16-06-16 39 T1; T1_IR; FLAIR ~2 min pdf
2CU_DL2 3D Deep Learning; voxnet2 28-06-16 39 T1; T1_IR; FLAIR ~2 min pdf
3MDGRU Multi-Dimensional Gated Recurrent Units3 27-07-16 57 T1; T1_IR; FLAIR ~2 min pdf
4PyraMiD-LSTM2 NOCC with rounds3 23-05-16 59 T1; T1-IR; FLAIR ~2 min pdf
5FBI/LMB Freiburg U-Net (3D) 01-05-16 61 T1-1mm;T1-IR;F ~2 min pdf
6IDSIA PyraMiD-LSTM 05-06-15 77 T1; T1_IR; FLAIR ~2 min pdf
7STH Hybrid ANN-based Auto-context method2 03-06-16 86 T1; T1-IR; FLAIR ~ 5 min pdf
8ISI-Neonatology Multi-stage voxel classification 31-05-14 87 T1 ~1.5 hours pdf
9UNC-IDEA LINKS:Learning-based multi-source integration 09-02-15 90 T1; T1_IR; FLAIR ~3 min pdf
10MNAB2 Random Forests 21-02-14 109 T1; T1_IR; FLAIR ~25 min pdf
11KSOM GHMF ASeTs: MAP-Based with Manifold learning 13-05-14 112 T1; T1_IR; FLAIR ~23 min pdf
12vicorob UdG T1+F MSSEG using T1 + FLAIR (T1-IR skull) 14-01-16 128 T1; IR; FLAIR ~2 min pdf
13BIGR2 Multi-Feature SVM Classification 26-09-13 128 T1; T1_IR; FLAIR ~35 min pdf
14VBM12 VBM12_r738 with WMHC=2 07-10-15 129 T1 ~6 min pdf
15UofL BioImaging MAP–Based Framework 26-09-13 143 T1 ~6 sec pdf
16vicorob UdG T1 MSSEG using only T1 (T1-IR skull) 21-01-16 144 T1; IR ~2 min pdf
17CMIV Model-guided Level Sets and Skeletons 26-09-13 161 T1; FLAIR ~3 min pdf
18UB VPML Med Multi-Atlas with Multiway Cut 26-09-13 162 T1; T1_IR; FLAIR ~30 min pdf
19Narsil Segmentation using Ensemble Trees 26-09-13 173 T1; FLAIR < 2 min pdf
20S2_QM2 Atlas-based segmentation and AdaBoost 28-07-14 180 T1; T1-IR; FLAIR ~45 min pdf
21bigr_neuro Automatically Trained kNN Classifier 26-09-13 181 T1; FLAIR ~2 hours pdf
22Robarts Multi-Atlas with Hierarchical Max-Flow 26-09-13 188 T1-1mm; T1-IR ~16 min pdf
23SPM12_T1_F* SPM12 with T1 and FLAIR sequence 31-08-15 194 T1; FLAIR ~3 min pdf
24SPM12_T1_IR* SPM12 with T1 and IR sequence 31-08-15 206 T1; IR ~3 min pdf
25MNAB Random Decision Forests 26-09-13 212 T1; T1-IR; FLAIR ~15 min pdf
26SPM12_T1* SPM12 with T1 sequence 31-08-15 213 T1 ~3 min pdf
27FSL-Seg* FSL (v5.0) seg file 31-08-15 241 T1 ~10 min pdf
28SPM12_T1_IR_F* SPM12 with T1; IR and FLAIR sequence 31-08-15 242 T1; IR; FLAIR ~4 min pdf
29LUH-TNT Level-sets with dictionary learning 27-10-14 248 T1 < 1 min pdf
30FSL-PVSeg* FSL (v5.0) PVSeg file 31-08-15 252 T1 ~10 min pdf
31FreeSurfer* FreeSurfer (v5.3.0) 31-08-15 255 T1-1mm ~1 hour pdf
32Jedi Mind Meld Automated Walks using Machine Learning 26-09-13 261 T1; T1-IR; FLAIR ~27 sec pdf
33mlmi2014ss AdaBoostM2 28-07-14 266 T1; T1-IR; FLAIR ~5 min pdf
34S2_QM Bayesian-based Adaptive Mean-Shift 26-09-13 278 T1; T1-IR; FLAIR ~1.5 hours pdf
35ISTB UniBe Decision Forests with spatial regularization 04-06-14 297 T1; T1-IR; FLAIR ~3 min pdf
36LNMBrains Gaussian Intensity Model 26-09-13 297 T1; T1-IR; FLAIR ~5 min pdf
37ECOESH Modified Expectation Maximization 06-01-14 332 T1 ~5 min pdf
*These methods (SPM, FSL and FreeSurfer) were applied by the MRBrainS organizers as described in the MRBrainS journal paper.
2,3At the end of the submission name indicates that this is the 2nd or 3rd submission (max 3 resubmissions allowed).

Note: As described below, when teams have equal scores, the standard deviations of the three tissue types and the three evaluation measures over all patients are taken into account.

How is the ranking determined?

Ranking is based on the evaluation results of all 15 test datasets and determined as follows: For each evaluation measure (Dice Coefficient (DC), Modified Hausdorff Distance (HD) and Absolute Volume Difference(AVD)), the mean value over all 15 datasets is determined for white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF). Each team receives a rank (1=best) for each tissue type (GM, WM, CSF) and each evaluation measure (DC, HD-95, AVD) based on the mean value of the evaluation measures over all 15 datasets. The final score is determined by adding the ranks of all tissue types and evaluation measures for each team. The team with the lowest score is ranked number 1. In case two teams would have an equal score, the team with the lowest standard deviation over the tissue types will be ranked first.

Per tissue rankings and per measure rankings are presented below.

Overall Segmentation Results

GM Score WM Score CSF Score Rank Sum
1 CU_DL2 15 1 CU_DL 6 1 IDSIA 8 1 CU_DL 39
2 CU_DL 16 2 CU_DL2 11 2 MDGRU 11 2 CU_DL2 39
3 MDGRU 16 3 PyraMiD-LSTM2 18 3 CU_DL2 13 3 MDGRU 57
4 FBI/LMB Freiburg 22 4 FBI/LMB Freiburg 20 4 CU_DL 17 4 PyraMiD-LSTM2 59
5 PyraMiD-LSTM2 24 5 UNC-IDEA 22 5 PyraMiD-LSTM2 17 5 FBI/LMB Freiburg 61
6 ISI-Neonatology 24 6 ISI-Neonatology 28 6 STH 17 6 IDSIA 77
7 KSOM GHMF 26 7 BIGR2 30 7 FBI/LMB Freiburg 19 7 STH 86
8 STH 26 8 MDGRU 30 8 MNAB2 25 8 ISI-Neonatology 87
9 BIGR2 30 9 IDSIA 35 9 vicorob UdG T1 33 9 UNC-IDEA 90
10 Narsil 32 10 VBM12 35 10 UNC-IDEA 33 10 MNAB2 109
11 IDSIA 34 11 vicorob UdG T1+F 41 11 vicorob UdG T1+F 34 11 KSOM GHMF 112
12 UB VPML Med 34 12 UB VPML Med 42 12 ISI-Neonatology 35 12 vicorob UdG T1+F 128
13 UNC-IDEA 35 13 KSOM GHMF 42 13 UofL BioImaging 40 13 BIGR2 128
14 MNAB2 39 14 STH 43 14 VBM12 42 14 VBM12 129
15 UofL BioImaging 49 15 MNAB2 45 15 KSOM GHMF 44 15 UofL BioImaging 143
16 VBM12 52 16 SPM12_T1_F* 48 16 S2_QM2 50 16 vicorob UdG T1 144
17 vicorob UdG T1+F 53 17 Narsil 50 17 Robarts 52 17 CMIV 161
18 CMIV 54 18 vicorob UdG T1 51 18 CMIV 55 18 UB VPML Med 162
19 S2_QM2 54 19 CMIV 52 19 SPM12_T1_IR* 60 19 Narsil 173
20 bigr_neuro 56 20 UofL BioImaging 54 20 bigr_neuro 63 20 S2_QM2 180
21 vicorob UdG T1 60 21 MNAB 55 21 FSL-Seg* 68 21 bigr_neuro 181
22 MNAB 61 22 SPM12_T1* 57 22 BIGR2 68 22 Robarts 188
23 SPM12_T1* 65 23 bigr_neuro 62 23 FSL-PVSeg* 69 23 SPM12_T1_F* 194
24 Robarts 70 24 Robarts 66 24 SPM12_T1_IR_F* 69 24 SPM12_T1_IR* 206
25 SPM12_T1_IR* 74 25 SPM12_T1_IR* 72 25 SPM12_T1_F* 70 25 MNAB 212
26 SPM12_T1_F* 76 26 FreeSurfer* 73 26 Jedi Mind Meld 74 26 SPM12_T1* 213
27 FreeSurfer* 81 27 S2_QM2 76 27 S2_QM 81 27 FSL-Seg* 241
28 LUH-TNT 81 28 LUH-TNT 76 28 mlmi2014ss 86 28 SPM12_T1_IR_F* 242
29 SPM12_T1_IR_F* 84 29 FSL-Seg* 85 29 UB VPML Med 86 29 LUH-TNT 248
30 FSL-PVSeg* 87 30 mlmi2014ss 85 30 Narsil 91 30 FSL-PVSeg* 252
31 FSL-Seg* 88 31 SPM12_T1_IR_F* 89 31 LUH-TNT 91 31 FreeSurfer* 255
32 Jedi Mind Meld 88 32 FSL-PVSeg* 96 32 SPM12_T1* 91 32 Jedi Mind Meld 261
33 mlmi2014ss 95 33 ISTB UniBe 97 33 LNMBrains 92 33 mlmi2014ss 266
34 S2_QM 96 34 Jedi Mind Meld 99 34 MNAB 96 34 S2_QM 278
35 LNMBrains 99 35 S2_QM 101 35 ISTB UniBe 98 35 ISTB UniBe 297
36 ISTB UniBe 102 36 LNMBrains 106 36 FreeSurfer* 101 36 LNMBrains 297
37 ECOESH 111 37 ECOESH 111 37 ECOESH 110 37 ECOESH 332

GM = Gray matter, WM = White matter, CSF = Cerebrospinal fluid
Sum = Score GM + Score WM + Score CSF
Score = Rank DC + Rank HD + Rank AVD

Gray Matter Segmentation Results

Rank DC Rank HD Rank AVD GM Score
1 CU_DL2 86.15 1 CU_DL2 1.45 1 KSOM GHMF 5.44 1 CU_DL2 15
2 CU_DL 86.12 2 CU_DL 1.47 2 Narsil 5.52 2 CU_DL 16
3 ISI-Neonatology 85.77 3 MDGRU 1.55 3 UB VPML Med 5.87 3 MDGRU 16
4 FBI/LMB Freiburg 85.44 4 FBI/LMB Freiburg 1.58 4 bigr_neuro 5.9 4 FBI/LMB Freiburg 22
5 MDGRU 85.4 5 UNC-IDEA 1.62 5 VBM12 5.91 5 PyraMiD-LSTM2 24
6 PyraMiD-LSTM2 84.89 6 ISI-Neonatology 1.62 6 vicorob UdG T1+F 5.98 6 ISI-Neonatology 24
7 IDSIA 84.82 7 PyraMiD-LSTM2 1.67 7 STH 6.02 7 KSOM GHMF 26
8 STH 84.77 8 UofL BioImaging 1.7 8 MDGRU 6.09 8 STH 26
9 BIGR2 84.65 9 MNAB2 1.7 9 BIGR2 6.13 9 BIGR2 30
10 MNAB2 84.5 10 IDSIA 1.7 10 vicorob UdG T1 6.15 10 Narsil 32
11 UNC-IDEA 84.36 11 STH 1.71 11 PyraMiD-LSTM2 6.35 11 IDSIA 34
12 KSOM GHMF 84.13 12 BIGR2 1.89 12 CU_DL 6.42 12 UB VPML Med 34
13 MNAB 83.86 13 KSOM GHMF 1.92 13 CU_DL2 6.6 13 UNC-IDEA 35
14 Narsil 83.47 14 Robarts 1.95 14 FBI/LMB Freiburg 6.6 14 MNAB2 39
15 S2_QM2 83.35 15 UB VPML Med 2.09 15 ISI-Neonatology 6.62 15 UofL BioImaging 49
16 UB VPML Med 83.31 16 Narsil 2.27 16 CMIV 6.76 16 VBM12 52
17 UofL BioImaging 82.96 17 FreeSurfer* 2.31 17 IDSIA 6.77 17 vicorob UdG T1+F 53
18 CMIV 82.43 18 S2_QM2 2.36 18 SPM12_T1* 6.95 18 CMIV 54
19 VBM12 82.29 19 LUH-TNT 2.62 19 UNC-IDEA 7.04 19 S2_QM2 54
20 vicorob UdG T1+F 82.19 20 CMIV 2.69 20 MNAB2 7.1 20 bigr_neuro 56
21 vicorob UdG T1 82.07 21 MNAB 2.79 21 S2_QM2 7.23 21 vicorob UdG T1 60
22 bigr_neuro 81.46 22 SPM12_T1_F* 2.9 22 SPM12_T1_IR* 7.23 22 MNAB 61
23 SPM12_T1_F* 81.17 23 SPM12_T1* 2.93 23 FSL-PVSeg* 8.4 23 SPM12_T1* 65
24 SPM12_T1* 80.34 24 mlmi2014ss 2.96 24 UofL BioImaging 8.61 24 Robarts 70
25 SPM12_T1_IR_F* 80.15 25 SPM12_T1_IR* 3.01 25 FSL-Seg* 8.65 25 SPM12_T1_IR* 74
26 Robarts 79.7 26 SPM12_T1_IR_F* 3.03 26 Jedi Mind Meld 8.94 26 SPM12_T1_F* 76
27 SPM12_T1_IR* 79.41 27 vicorob UdG T1+F 3.17 27 MNAB 9.11 27 FreeSurfer* 81
28 LUH-TNT 79.35 28 VBM12 3.2 28 S2_QM 9.28 28 LUH-TNT 81
29 FSL-Seg* 78.66 29 vicorob UdG T1 3.31 29 LNMBrains 9.47 29 SPM12_T1_IR_F* 84
30 Jedi Mind Meld 77.84 30 bigr_neuro 3.67 30 Robarts 9.77 30 FSL-PVSeg* 87
31 FSL-PVSeg* 77.66 31 ISTB UniBe 3.86 31 SPM12_T1_F* 10.59 31 FSL-Seg* 88
32 FreeSurfer* 77.41 32 Jedi Mind Meld 3.9 32 FreeSurfer* 12.15 32 Jedi Mind Meld 88
33 S2_QM 76.41 33 FSL-PVSeg* 4.29 33 SPM12_T1_IR_F* 13.92 33 mlmi2014ss 95
34 LNMBrains 72.75 34 FSL-Seg* 4.35 34 LUH-TNT 15.52 34 S2_QM 96
35 mlmi2014ss 71.7 35 S2_QM 5.51 35 ISTB UniBe 19.11 35 LNMBrains 99
36 ISTB UniBe 68.62 36 LNMBrains 6.8 36 mlmi2014ss 24.56 36 ISTB UniBe 102
37 ECOESH 63.36 37 ECOESH 34.07 37 ECOESH 38.34 37 ECOESH 111

White Matter Segmentation Results

Rank DC Rank HD Rank AVD WM Score
1 CU_DL2 89.46 1 CU_DL 1.94 1 SPM12_T1_F* 5.21 1 CU_DL 6
2 CU_DL 89.39 2 CU_DL2 1.94 2 Narsil 5.78 2 CU_DL2 11
3 MDGRU 88.98 3 FBI/LMB Freiburg 1.95 3 CU_DL 5.84 3 PyraMiD-LSTM2 18
4 FBI/LMB Freiburg 88.86 4 MDGRU 2.02 4 PyraMiD-LSTM2 5.93 4 FBI/LMB Freiburg 20
5 UNC-IDEA 88.68 5 UNC-IDEA 2.06 5 vicorob UdG T1+F 5.94 5 UNC-IDEA 22
6 ISI-Neonatology 88.66 6 PyraMiD-LSTM2 2.07 6 SPM12_T1* 5.99 6 ISI-Neonatology 28
7 UB VPML Med 88.61 7 ISI-Neonatology 2.07 7 BIGR2 6.02 7 BIGR2 30
8 PyraMiD-LSTM2 88.53 8 IDSIA 2.08 8 CU_DL2 6.05 8 MDGRU 30
9 STH 88.45 9 MNAB2 2.12 9 VBM12 6.06 9 IDSIA 35
10 BIGR2 88.42 10 UofL BioImaging 2.24 10 vicorob UdG T1 6.21 10 VBM12 35
11 IDSIA 88.33 11 VBM12 2.32 11 SPM12_T1_IR* 6.34 11 vicorob UdG T1+F 41
12 MNAB2 88.04 12 STH 2.34 12 UNC-IDEA 6.46 12 UB VPML Med 42
13 KSOM GHMF 87.96 13 BIGR2 2.36 13 FBI/LMB Freiburg 6.47 13 KSOM GHMF 42
14 MNAB 87.95 14 CMIV 2.43 14 KSOM GHMF 6.59 14 STH 43
15 VBM12 87.95 15 KSOM GHMF 2.49 15 ISI-Neonatology 6.96 15 MNAB2 45
16 UofL BioImaging 87.88 16 MNAB 2.65 16 IDSIA 7.05 16 SPM12_T1_F* 48
17 CMIV 87.71 17 UB VPML Med 2.72 17 Robarts 7.06 17 Narsil 50
18 vicorob UdG T1+F 87.34 18 vicorob UdG T1+F 2.88 18 UB VPML Med 7.13 18 vicorob UdG T1 51
19 bigr_neuro 87.31 19 mlmi2014ss 2.89 19 FreeSurfer* 7.18 19 CMIV 52
20 Narsil 87.1 20 vicorob UdG T1 2.91 20 bigr_neuro 7.31 20 UofL BioImaging 54
21 vicorob UdG T1 87.06 21 LUH-TNT 2.96 21 CMIV 7.34 21 MNAB 55
22 LUH-TNT 86.47 22 SPM12_T1_F* 3 22 STH 7.67 22 SPM12_T1* 57
23 S2_QM2 86.34 23 bigr_neuro 3.01 23 MDGRU 7.69 23 bigr_neuro 62
24 Robarts 86.15 24 SPM12_T1* 3.06 24 MNAB2 7.74 24 Robarts 66
25 SPM12_T1_F* 86.03 25 Robarts 3.06 25 MNAB 7.75 25 SPM12_T1_IR* 72
26 FSL-Seg* 85.98 26 FreeSurfer* 3.06 26 S2_QM2 7.91 26 FreeSurfer* 73
27 SPM12_T1* 85.58 27 S2_QM2 3.29 27 SPM12_T1_IR_F* 8.4 27 S2_QM2 76
28 FreeSurfer* 85.25 28 Narsil 3.31 28 UofL BioImaging 8.74 28 LUH-TNT 76
29 FSL-PVSeg* 84.84 29 SPM12_T1_IR* 3.6 29 FSL-Seg* 11.47 29 FSL-Seg* 85
30 S2_QM 83.86 30 FSL-Seg* 3.65 30 Jedi Mind Meld 13.66 30 mlmi2014ss 85
31 SPM12_T1_IR_F* 83.64 31 SPM12_T1_IR_F* 3.84 31 ISTB UniBe 13.71 31 SPM12_T1_IR_F* 89
32 SPM12_T1_IR* 83.54 32 FSL-PVSeg* 3.85 32 mlmi2014ss 14 32 FSL-PVSeg* 96
33 ISTB UniBe 82.5 33 ISTB UniBe 3.98 33 LUH-TNT 14.2 33 ISTB UniBe 97
34 mlmi2014ss 81.98 34 Jedi Mind Meld 4.52 34 LNMBrains 15.34 34 Jedi Mind Meld 99
35 Jedi Mind Meld 80.64 35 S2_QM 4.94 35 FSL-PVSeg* 19.69 35 S2_QM 101
36 LNMBrains 78.32 36 LNMBrains 6.77 36 S2_QM 24.79 36 LNMBrains 106
37 ECOESH 75.82 37 ECOESH 38.46 37 ECOESH 25.27 37 ECOESH 111

Cerebrospinal Fluid Segmentation Results

Rank DC Rank HD Rank AVD CSF Score
1 CU_DL2 84.25 1 IDSIA 2.14 1 STH 6.73 1 IDSIA 8
2 MDGRU 84.13 2 MDGRU 2.17 2 VBM12 6.8 2 MDGRU 11
3 CU_DL 83.96 3 CU_DL2 2.19 3 IDSIA 7.09 3 CU_DL2 13
4 IDSIA 83.72 4 FBI/LMB Freiburg 2.22 4 PyraMiD-LSTM2 7.17 4 CU_DL 17
5 FBI/LMB Freiburg 83.47 5 MNAB2 2.27 5 vicorob UdG T1 7.17 5 PyraMiD-LSTM2 17
6 PyraMiD-LSTM2 83.05 6 CU_DL 2.28 6 vicorob UdG T1+F 7.21 6 STH 17
7 UNC-IDEA 82.81 7 PyraMiD-LSTM2 2.3 7 MDGRU 7.44 7 FBI/LMB Freiburg 19
8 STH 82.77 8 STH 2.31 8 CU_DL 7.44 8 MNAB2 25
9 MNAB2 82.3 9 UNC-IDEA 2.35 9 CU_DL2 7.69 9 vicorob UdG T1 33
10 KSOM GHMF 82.1 10 ISI-Neonatology 2.65 10 FBI/LMB Freiburg 8.63 10 UNC-IDEA 33
11 ISI-Neonatology 81.08 11 Robarts 2.66 11 MNAB2 8.73 11 vicorob UdG T1+F 34
12 Robarts 80.28 12 UofL BioImaging 2.66 12 S2_QM2 9.36 12 ISI-Neonatology 35
13 vicorob UdG T1 80.18 13 KSOM GHMF 2.71 13 UofL BioImaging 9.68 13 UofL BioImaging 40
14 vicorob UdG T1+F 80.17 14 vicorob UdG T1+F 2.81 14 ISI-Neonatology 9.77 14 VBM12 42
15 UofL BioImaging 78.86 15 vicorob UdG T1 2.81 15 SPM12_T1_F* 10.07 15 KSOM GHMF 44
16 CMIV 78.57 16 CMIV 3 16 SPM12_T1_IR* 10.47 16 S2_QM2 50
17 BIGR2 78.31 17 VBM12 3.03 17 UNC-IDEA 10.52 17 Robarts 52
18 SPM12_T1_IR* 78.25 18 S2_QM2 3.05 18 FSL-PVSeg* 10.69 18 CMIV 55
19 bigr_neuro 78.16 19 bigr_neuro 3.15 19 FSL-Seg* 11.83 19 SPM12_T1_IR* 60
20 S2_QM2 77.97 20 BIGR2 3.19 20 SPM12_T1_IR_F* 12.21 20 bigr_neuro 63
21 SPM12_T1_IR_F* 76.87 21 FSL-Seg* 3.41 21 KSOM GHMF 12.78 21 FSL-Seg* 68
22 UB VPML Med 74.82 22 FSL-PVSeg* 3.44 22 Narsil 13.54 22 BIGR2 68
23 VBM12 74.56 23 Jedi Mind Meld 3.67 23 CMIV 14.31 23 FSL-PVSeg* 69
24 SPM12_T1_F* 74.03 24 mlmi2014ss 3.77 24 S2_QM 14.45 24 SPM12_T1_IR_F* 69
25 Jedi Mind Meld 73.33 25 S2_QM 3.79 25 bigr_neuro 16.47 25 SPM12_T1_F* 70
26 SPM12_T1* 70.69 26 SPM12_T1_IR* 4.01 26 Jedi Mind Meld 17.6 26 Jedi Mind Meld 74
27 mlmi2014ss 70.59 27 LUH-TNT 4.07 27 LNMBrains 19.87 27 S2_QM 81
28 FSL-Seg* 69.95 28 SPM12_T1_IR_F* 4.15 28 ISTB UniBe 19.89 28 mlmi2014ss 86
29 FSL-PVSeg* 69.49 29 FreeSurfer* 4.31 29 Robarts 20.36 29 UB VPML Med 86
30 LNMBrains 68.8 30 UB VPML Med 4.31 30 LUH-TNT 20.4 30 Narsil 91
31 MNAB 68.08 31 SPM12_T1_F* 4.59 31 BIGR2 22.76 31 LUH-TNT 91
32 S2_QM 67.87 32 MNAB 4.88 32 SPM12_T1* 23.24 32 SPM12_T1* 91
33 Narsil 66.57 33 SPM12_T1* 5.34 33 MNAB 28.56 33 LNMBrains 92
34 LUH-TNT 66.47 34 ISTB UniBe 6.94 34 UB VPML Med 31.19 34 MNAB 96
35 FreeSurfer* 65.79 35 LNMBrains 7.66 35 mlmi2014ss 33.45 35 ISTB UniBe 98
36 ISTB UniBe 54.69 36 Narsil 13.3 36 ECOESH 36.59 36 FreeSurfer* 101
37 ECOESH 51.48 37 ECOESH 18.75 37 FreeSurfer* 50.27 37 ECOESH 110

Brain (GM and WM segmentations combined) Results

Rank DC Rank HD Rank AVD Brain Score
1 CU_DL2 95.74 1 ISI-Neonatology 2.18 1 UB VPML Med 2.35 1 ISI-Neonatology 12
2 CU_DL 95.7 2 CU_DL 2.19 2 STH 2.51 2 CU_DL 13
3 ISI-Neonatology 95.65 3 CU_DL2 2.24 3 CMIV 2.58 3 CU_DL2 15
4 MDGRU 95.58 4 IDSIA 2.27 4 PyraMiD-LSTM2 2.73 4 STH 15
5 FBI/LMB Freiburg 95.4 5 MDGRU 2.29 5 VBM12 2.77 5 MDGRU 16
6 STH 95.37 6 FBI/LMB Freiburg 2.33 6 S2_QM2 2.78 6 PyraMiD-LSTM2 21
7 PyraMiD-LSTM2 95.3 7 STH 2.38 7 MDGRU 2.79 7 IDSIA 27
8 IDSIA 95.29 8 UofL BioImaging 2.41 8 ISI-Neonatology 2.8 8 FBI/LMB Freiburg 29
9 MNAB2 95.16 9 MNAB2 2.41 9 CU_DL 2.89 9 UB VPML Med 32
10 KSOM GHMF 95.13 10 PyraMiD-LSTM2 2.45 10 Narsil 2.91 10 S2_QM2 32
11 BIGR2 95.13 11 UNC-IDEA 2.48 11 CU_DL2 2.94 11 MNAB2 35
12 UNC-IDEA 95.05 12 S2_QM2 2.73 12 FSL-Seg* 2.95 12 KSOM GHMF 42
13 UofL BioImaging 94.93 13 BIGR2 2.74 13 vicorob UdG T1 2.97 13 VBM12 42
14 S2_QM2 94.9 14 Robarts 2.78 14 vicorob UdG T1+F 2.98 14 Narsil 42
15 Narsil 94.78 15 UB VPML Med 2.8 15 IDSIA 3.1 15 BIGR2 44
16 UB VPML Med 94.59 16 KSOM GHMF 2.86 16 KSOM GHMF 3.15 16 CMIV 45
17 VBM12 94.5 17 Narsil 2.86 17 MNAB2 3.21 17 UofL BioImaging 47
18 CMIV 94.48 18 LUH-TNT 2.9 18 FBI/LMB Freiburg 3.22 18 UNC-IDEA 51
19 MNAB 94.47 19 mlmi2014ss 3.23 19 SPM12_T1* 3.23 19 vicorob UdG T1+F 56
20 vicorob UdG T1+F 94.27 20 VBM12 3.36 20 BIGR2 3.24 20 vicorob UdG T1 57
21 vicorob UdG T1 94.25 21 FreeSurfer* 3.55 21 SPM12_T1_IR* 3.38 21 LUH-TNT 67
22 LUH-TNT 94.17 22 vicorob UdG T1+F 3.73 22 Jedi Mind Meld 3.46 22 SPM12_T1* 71
23 bigr_neuro 93.99 23 vicorob UdG T1 3.74 23 FSL-PVSeg* 3.46 23 MNAB 71
24 SPM12_T1_IR* 93.93 24 CMIV 3.82 24 bigr_neuro 3.57 24 FSL-Seg* 72
25 SPM12_T1_F* 93.87 25 ISTB UniBe 4.39 25 MNAB 3.76 25 SPM12_T1_IR* 74
26 SPM12_T1* 93.85 26 SPM12_T1* 4.45 26 UofL BioImaging 3.88 26 bigr_neuro 75
27 FSL-PVSeg* 93.59 27 MNAB 4.54 27 LUH-TNT 4.11 27 Robarts 80
28 SPM12_T1_IR_F* 93.59 28 bigr_neuro 4.57 28 UNC-IDEA 4.21 28 Jedi Mind Meld 83
29 FSL-Seg* 93.3 29 SPM12_T1_IR* 4.63 29 SPM12_T1_IR_F* 5.11 29 FSL-PVSeg* 84
30 S2_QM 93.27 30 Jedi Mind Meld 5.44 30 SPM12_T1_F* 5.33 30 FreeSurfer* 86
31 Jedi Mind Meld 93.24 31 FSL-Seg* 5.53 31 S2_QM 5.48 31 SPM12_T1_F* 87
32 Robarts 93.13 32 SPM12_T1_F* 5.85 32 FreeSurfer* 6.27 32 mlmi2014ss 88
33 FreeSurfer* 92.32 33 SPM12_T1_IR_F* 5.91 33 LNMBrains 7.37 33 SPM12_T1_IR_F* 90
34 mlmi2014ss 90.75 34 FSL-PVSeg* 6.09 34 Robarts 7.88 34 S2_QM 96
35 LNMBrains 88.51 35 S2_QM 6.98 35 mlmi2014ss 12.05 35 ISTB UniBe 97
36 ISTB UniBe 87.8 36 LNMBrains 8.56 36 ISTB UniBe 17.26 36 LNMBrains 104
37 ECOESH 78.24 37 ECOESH 35.99 37 ECOESH 32.06 37 ECOESH 111

Intracranial cavity (GM, WM, and CSF segmentations combined) Results

Rank DC Rank HD Rank AVD ICV Score
1 IDSIA 98.15 1 MDGRU 2.37 1 UNC-IDEA 0.68 1 MDGRU 7
2 MDGRU 98.15 2 IDSIA 2.44 2 PyraMiD-LSTM2 0.69 2 IDSIA 9
3 CU_DL2 98.1 3 FBI/LMB Freiburg 2.51 3 STH 0.69 3 UNC-IDEA 13
4 PyraMiD-LSTM2 98.04 4 Robarts 2.55 4 MDGRU 0.86 4 PyraMiD-LSTM2 13
5 CU_DL 97.99 5 UNC-IDEA 2.72 5 Robarts 0.91 5 Robarts 17
6 FBI/LMB Freiburg 97.98 6 CU_DL2 2.75 6 IDSIA 0.95 6 FBI/LMB Freiburg 17
7 UNC-IDEA 97.92 7 PyraMiD-LSTM2 2.86 7 SPM12_T1_IR* 0.99 7 CU_DL2 20
8 Robarts 97.92 8 STH 2.92 8 FBI/LMB Freiburg 1.06 8 STH 21
9 SPM12_T1_IR* 97.73 9 MNAB2 2.95 9 SPM12_T1_IR_F* 1.17 9 CU_DL 32
10 STH 97.72 10 CU_DL 3.16 10 SPM12_T1_F* 1.46 10 MNAB2 36
11 SPM12_T1_IR_F* 97.71 11 KSOM GHMF 3.23 11 CU_DL2 1.54 11 vicorob UdG T1 40
12 MNAB2 97.66 12 UofL BioImaging 3.43 12 vicorob UdG T1 1.62 12 SPM12_T1_IR* 40
13 vicorob UdG T1 97.65 13 S2_QM2 3.72 13 vicorob UdG T1+F 1.65 13 vicorob UdG T1+F 43
14 vicorob UdG T1+F 97.64 14 CMIV 3.76 14 ISI-Neonatology 1.74 14 KSOM GHMF 44
15 KSOM GHMF 97.56 15 vicorob UdG T1 3.85 15 MNAB2 1.77 15 UofL BioImaging 46
16 ISI-Neonatology 96.92 16 vicorob UdG T1+F 3.9 16 UofL BioImaging 1.81 16 ISI-Neonatology 49
17 CMIV 96.79 17 bigr_neuro 3.93 17 CU_DL 1.83 17 SPM12_T1_IR_F* 51
18 UofL BioImaging 96.71 18 BIGR2 3.93 18 KSOM GHMF 1.95 18 S2_QM2 53
19 SPM12_T1_F* 96.59 19 ISI-Neonatology 4.29 19 VBM12 2.37 19 CMIV 58
20 S2_QM2 96.44 20 VBM12 4.89 20 S2_QM2 2.38 20 SPM12_T1_F* 59
21 bigr_neuro 96.33 21 FSL-Seg* 5.29 21 FSL-Seg* 3.37 21 bigr_neuro 61
22 BIGR2 96 22 FSL-PVSeg* 5.29 22 FSL-PVSeg* 3.37 22 VBM12 62
23 VBM12 95.95 23 S2_QM 6.49 23 bigr_neuro 3.46 23 BIGR2 68
24 mlmi2014ss 95.84 24 SPM12_T1_IR* 6.51 24 mlmi2014ss 3.6 24 FSL-Seg* 70
25 SPM12_T1* 95.28 25 FreeSurfer* 6.62 25 Narsil 3.69 25 FSL-PVSeg* 73
26 UB VPML Med 94.83 26 UB VPML Med 6.63 26 S2_QM 4.01 26 S2_QM 79
27 Jedi Mind Meld 94.26 27 LUH-TNT 6.85 27 CMIV 4.87 27 mlmi2014ss 80
28 FSL-Seg* 94.24 28 MNAB 7.06 28 BIGR2 5.18 28 SPM12_T1* 83
29 FSL-PVSeg* 94.24 29 SPM12_T1* 8.09 29 SPM12_T1* 5.53 29 UB VPML Med 83
30 S2_QM 93.71 30 SPM12_T1_F* 8.21 30 Jedi Mind Meld 6.82 30 LUH-TNT 91
31 LUH-TNT 93.18 31 SPM12_T1_IR_F* 8.23 31 UB VPML Med 7.67 31 Jedi Mind Meld 91
32 MNAB 92.52 32 mlmi2014ss 8.69 32 LNMBrains 7.88 32 FreeSurfer* 94
33 Narsil 92.49 33 ISTB UniBe 9.84 33 LUH-TNT 9.14 33 MNAB 94
34 FreeSurfer* 92.39 34 Jedi Mind Meld 20.34 34 MNAB 9.71 34 Narsil 95
35 LNMBrains 89.17 35 LNMBrains 20.36 35 FreeSurfer* 10.19 35 LNMBrains 102
36 ISTB UniBe 88.53 36 ECOESH 21.43 36 ISTB UniBe 17.52 36 ISTB UniBe 105
37 ECOESH 78.14 37 Narsil 23.65 37 ECOESH 30.13 37 ECOESH 110

DC = Dice Coefficient, HD = 95th percentile of Hausdorff Distance, AVD = Absolute Volume Difference
Score = Rank DC + Rank HD + Rank AVD





© 2013 Image Sciences Institute.