Home    Details    Workshop    Register    Download    Submit    Results    Organizers 

Results

When teams submit their segmentation results, the evaluation results will be sent to the team contact person by e-mail and will be listed below.

Rank Team name Submission name Date Sum Scores Sequences used Speed Doc
1LIVIA_ETS HyperDenseNet2 06‑02‑18 48 T1; T1_IR; FLAIR ~4 min pdf
2CU_DL2 3D Deep Learning; voxnet2 28‑06‑16 54 T1; T1_IR; FLAIR ~2 min pdf
3CU_DL 3D Deep Learning; voxnet13 16‑06‑16 56 T1; T1_IR; FLAIR ~2 min pdf
4MSL-SKKU Deep Convolutional Neural Network 19‑06‑17 61 T1; T1-IR; FLAIR ~1.5 min pdf
5LRDE Fully Convolutional Network 20‑12‑16 61 T1 ~2 sec pdf
6MDGRU Multi-Dimensional Gated Recurrent Units3 27‑07‑16 80 T1; T1_IR; FLAIR ~2 min pdf
7PyraMiD-LSTM2 NOCC with rounds3 23‑05‑16 83 T1; T1-IR; FLAIR ~2 min pdf
8FBI/LMB Freiburg U-Net (3D) 01‑05‑16 84 T1-1mm;T1-IR;F ~2 min pdf
9IDSIA PyraMiD-LSTM 05‑06‑15 100 T1; T1_IR; FLAIR ~2 min pdf
10STH Hybrid ANN-based Auto-context method2 03‑06‑16 112 T1; T1-IR; FLAIR ~ 5 min pdf
11ISI-Neonatology Multi-stage voxel classification 31‑05‑14 116 T1 ~1.5 hours pdf
12UNC-IDEA LINKS:Learning-based multi-source integration 09‑02‑15 123 T1; T1_IR; FLAIR ~3 min pdf
13MNAB2 Random Forests 21‑02‑14 144 T1; T1_IR; FLAIR ~25 min pdf
14KSOM GHMF ASeTs: MAP-Based with Manifold learning 13‑05‑14 147 T1; T1_IR; FLAIR ~23 min pdf
15vicorob UdG T1_F MSSEG using T1 + FLAIR (T1-IR skull) 14‑01‑16 165 T1; IR; FLAIR ~2 min pdf
16VBM12 VBM12_r738 with WMHC=2 07‑10‑15 166 T1 ~6 min pdf
17BIGR2 Multi-Feature SVM Classification 26‑09‑13 170 T1; T1_IR; FLAIR ~35 min pdf
18WTA 3D Cascade convolutional architecture 06‑02‑18 175 T1; T1_IR; FLAIR ~5 min pdf
19vicorob UdG T1 MSSEG using only T1 (T1-IR skull) 21‑01‑16 184 T1; IR ~2 min pdf
20UofL BioImaging MAP-Based Framework 26‑09‑13 190 T1 ~6 sec pdf
21CMIV Model-guided Level Sets and Skeletons 26‑09‑13 210 T1; FLAIR ~3 min pdf
22UB VPML Med Multi-Atlas with Multiway Cut 26‑09‑13 212 T1; T1_IR; FLAIR ~30 min pdf
23Narsil Segmentation using Ensemble Trees 26‑09‑13 226 T1; FLAIR < 2 min pdf
24CVSS Multi-atlas segmentation based on supervoxels 14‑02‑17 229 T1; T1_IR; FLAIR ~2 min pdf
25VIBOT10 M-T1+F Convolutional Neural Network 27‑02‑17 231 T1; FLAIR ~3 min pdf
26bigr_neuro Automatically Trained kNN Classifier 26‑09‑13 235 T1; FLAIR ~2 hours pdf
27S2_QM2 Atlas-based segmentation and AdaBoost 28‑07‑14 236 T1; T1-IR; FLAIR ~45 min pdf
28drai VGG based Fully Convolutional Neural Network 20‑01‑17 238 T1 ~2 sec pdf
29KM-MRF-MAS MAP on Intensity, and Local and Multi-atlas Priors 28‑10‑16 243 T1 ~10 min pdf
30Robarts Multi-Atlas with Hierarchical Max-Flow 26‑09‑13 247 T1-1mm; T1-IR ~16 min pdf
31SPM12_T1_F* SPM12 with T1 and FLAIR sequence 31‑08‑15 249 T1; FLAIR ~3 min pdf
32SPM12_T1_IR* SPM12 with T1 and IR sequence 31‑08‑15 265 T1; IR ~3 min pdf
33SJCE Fuzzy Clustering 12‑04‑17 269 T1 <1 min pdf
34MNAB Random Decision Forests 26‑09‑13 277 T1; T1-IR; FLAIR ~15 min pdf
35SPM12_T1* SPM12 with T1 sequence 31‑08‑15 280 T1 ~3 min pdf
36SPM12_T1_IR_F* SPM12 with T1; IR and FLAIR sequence 31‑08‑15 312 T1; IR; FLAIR ~4 min pdf
37FSL-Seg* FSL (v5.0) seg file 31‑08‑15 314 T1 ~10 min pdf
38LUH-TNT Level-sets with dictionary learning 27‑10‑14 322 T1 < 1 min pdf
39FreeSurfer* FreeSurfer (v5.3.0) 31‑08‑15 323 T1-1mm ~1 hour pdf
40FSL-PVSeg* FSL (v5.0) PVSeg file 31‑08‑15 326 T1 ~10 min pdf
41Jedi Mind Meld Automated Walks using Machine Learning 26‑09‑13 338 T1; T1-IR; FLAIR ~27 sec pdf
42mlmi2014ss AdaBoostM2 28‑07‑14 344 T1; T1-IR; FLAIR ~5 min pdf
43S2_QM Bayesian-based Adaptive Mean-Shift 26‑09‑13 355 T1; T1-IR; FLAIR ~1.5 hours pdf
44CSIM-Lab Multiple Logistic Classification 24‑10‑17 366 T1 pdf
45ISTB UniBe Decision Forests with spatial regularization 04‑06‑14 382 T1; T1-IR; FLAIR ~3 min pdf
46LNMBrains Gaussian Intensity Model 26‑09‑13 382 T1; T1-IR; FLAIR ~5 min pdf
47ECOESH Modified Expectation Maximization 06‑01‑14 422 T1 ~5 min pdf
*These methods (SPM, FSL and FreeSurfer) were applied by the MRBrainS organizers as described in the MRBrainS journal paper.
2,3At the end of the submission name indicates that this is the 2nd or 3rd submission (max 3 resubmissions allowed).

Note: As described below, when teams have equal scores, the standard deviations of the three tissue types and the three evaluation measures over all patients are taken into account.

How is the ranking determined?

Ranking is based on the evaluation results of all 15 test datasets and determined as follows: For each evaluation measure (Dice Coefficient (DC), Modified Hausdorff Distance (HD) and Absolute Volume Difference(AVD)), the mean value over all 15 datasets is determined for white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF). Each team receives a rank (1=best) for each tissue type (GM, WM, CSF) and each evaluation measure (DC, HD-95, AVD) based on the mean value of the evaluation measures over all 15 datasets. The final score is determined by adding the ranks of all tissue types and evaluation measures for each team. The team with the lowest score is ranked number 1. In case two teams would have an equal score, the team with the lowest standard deviation over the tissue types will be ranked first.

Per tissue rankings and per measure rankings are presented below.

Overall Segmentation Results

GM Score WM Score CSF Score Rank Sum
1 LIVIA_ETS 16 1 LRDE 10 1 IDSIA 10 1 LIVIA_ETS 48
2 LRDE 18 2 CU_DL 12 2 MDGRU 13 2 CU_DL2 54
3 CU_DL2 23 3 LIVIA_ETS 12 3 CU_DL2 15 3 CU_DL 56
4 CU_DL 23 4 CU_DL2 16 4 MSL-SKKU 17 4 MSL-SKKU 61
5 MDGRU 25 5 MSL-SKKU 18 5 LIVIA_ETS 20 5 LRDE 61
6 MSL-SKKU 26 6 PyraMiD-LSTM2 26 6 CU_DL 21 6 MDGRU 80
7 FBI/LMB Freiburg 32 7 FBI/LMB Freiburg 29 7 STH 21 7 PyraMiD-LSTM2 83
8 PyraMiD-LSTM2 35 8 UNC-IDEA 31 8 PyraMiD-LSTM2 22 8 FBI/LMB Freiburg 84
9 STH 35 9 ISI-Neonatology 36 9 FBI/LMB Freiburg 23 9 IDSIA 100
10 ISI-Neonatology 35 10 BIGR2 38 10 MNAB2 32 10 STH 112
11 KSOM GHMF 37 11 MDGRU 42 11 LRDE 33 11 ISI-Neonatology 116
12 BIGR2 42 12 VBM12 44 12 vicorob UdG T1 41 12 UNC-IDEA 123
13 IDSIA 45 13 IDSIA 45 13 vicorob UdG T1_F 42 13 MNAB2 144
14 Narsil 45 14 KSOM GHMF 54 14 UNC-IDEA 42 14 KSOM GHMF 147
15 UB VPML Med 47 15 vicorob UdG T1_F 54 15 ISI-Neonatology 45 15 vicorob UdG T1_F 165
16 UNC-IDEA 50 16 UB VPML Med 55 16 UofL BioImaging 52 16 VBM12 166
17 WTA 54 17 STH 56 17 VBM12 54 17 BIGR2 170
18 MNAB2 54 18 MNAB2 58 18 WTA 56 18 WTA 175
19 VIBOT10 M-T1+F 56 19 SPM12_T1_F* 62 19 KSOM GHMF 56 19 vicorob UdG T1 184
20 UofL BioImaging 68 20 CVSS 64 20 S2_QM2 64 20 UofL BioImaging 190
21 VBM12 68 21 Narsil 64 21 Robarts 69 21 CMIV 210
22 vicorob UdG T1_F 69 22 WTA 65 22 drai 71 22 UB VPML Med 212
23 CVSS 69 23 vicorob UdG T1 66 23 CMIV 72 23 Narsil 226
24 drai 70 24 CMIV 67 24 VIBOT10 M-T1+F 72 24 CVSS 229
25 CMIV 71 25 UofL BioImaging 70 25 KM-MRF-MAS 74 25 VIBOT10 M-T1+F 231
26 SJCE 71 26 MNAB 71 26 SPM12_T1_IR* 77 26 bigr_neuro 235
27 bigr_neuro 72 27 SPM12_T1* 73 27 bigr_neuro 83 27 S2_QM2 236
28 S2_QM2 74 28 bigr_neuro 80 28 SPM12_T1_F* 88 28 drai 238
29 vicorob UdG T1 77 29 SJCE 85 29 SPM12_T1_IR_F* 89 29 KM-MRF-MAS 243
30 KM-MRF-MAS 82 30 Robarts 86 30 FSL-PVSeg* 90 30 Robarts 247
31 MNAB 83 31 KM-MRF-MAS 87 31 FSL-Seg* 90 31 SPM12_T1_F* 249
32 SPM12_T1* 89 32 SPM12_T1_IR* 91 32 BIGR2 90 32 SPM12_T1_IR* 265
33 Robarts 92 33 FreeSurfer* 91 33 CVSS 96 33 SJCE 269
34 SPM12_T1_IR* 97 34 drai 97 34 Jedi Mind Meld 97 34 MNAB 277
35 SPM12_T1_F* 99 35 S2_QM2 98 35 S2_QM 104 35 SPM12_T1* 280
36 FreeSurfer* 104 36 LUH-TNT 99 36 UB VPML Med 110 36 SPM12_T1_IR_F* 312
37 LUH-TNT 105 37 VIBOT10 M-T1+F 103 37 mlmi2014ss 112 37 FSL-Seg* 314
38 SPM12_T1_IR_F* 109 38 mlmi2014ss 109 38 SJCE 113 38 LUH-TNT 322
39 FSL-PVSeg* 113 39 FSL-Seg* 110 39 CSIM-Lab 116 39 FreeSurfer* 323
40 FSL-Seg* 114 40 SPM12_T1_IR_F* 114 40 Narsil 117 40 FSL-PVSeg* 326
41 Jedi Mind Meld 114 41 CSIM-Lab 118 41 LUH-TNT 118 41 Jedi Mind Meld 338
42 S2_QM 122 42 ISTB UniBe 123 42 SPM12_T1* 118 42 mlmi2014ss 344
43 mlmi2014ss 123 43 FSL-PVSeg* 123 43 LNMBrains 120 43 S2_QM 355
44 LNMBrains 127 44 Jedi Mind Meld 127 44 MNAB 123 44 CSIM-Lab 366
45 ISTB UniBe 131 45 S2_QM 129 45 FreeSurfer* 128 45 ISTB UniBe 382
46 CSIM-Lab 132 46 LNMBrains 135 46 ISTB UniBe 128 46 LNMBrains 382
47 ECOESH 141 47 ECOESH 141 47 ECOESH 140 47 ECOESH 422

GM = Gray matter, WM = White matter, CSF = Cerebrospinal fluid
Sum = Score GM + Score WM + Score CSF
Score = Rank DC + Rank HD + Rank AVD

Gray Matter Segmentation Results

Rank DC Rank HD Rank AVD GM Score
1 LIVIA_ETS 86.33 1 LIVIA_ETS 1.34 1 SJCE 5.14 1 LIVIA_ETS 16
2 CU_DL2 86.15 2 CU_DL2 1.44 2 drai 5.29 2 LRDE 18
3 CU_DL 86.12 3 LRDE 1.44 3 KSOM GHMF 5.44 3 CU_DL2 23
4 MSL-SKKU 86.06 4 CU_DL 1.47 4 Narsil 5.52 4 CU_DL 23
5 LRDE 86.03 5 MSL-SKKU 1.52 5 UB VPML Med 5.87 5 MDGRU 25
6 ISI-Neonatology 85.77 6 MDGRU 1.54 6 bigr_neuro 5.90 6 MSL-SKKU 26
7 FBI/LMB Freiburg 85.44 7 FBI/LMB Freiburg 1.58 7 VBM12 5.91 7 FBI/LMB Freiburg 32
8 MDGRU 85.40 8 UNC-IDEA 1.62 8 vicorob UdG T1_F 5.98 8 PyraMiD-LSTM2 35
9 VIBOT10 M-T1+F 85.07 9 ISI-Neonatology 1.62 9 STH 6.02 9 STH 35
10 PyraMiD-LSTM2 84.89 10 PyraMiD-LSTM2 1.67 10 LRDE 6.05 10 ISI-Neonatology 35
11 IDSIA 84.82 11 IDSIA 1.70 11 MDGRU 6.09 11 KSOM GHMF 37
12 STH 84.77 12 MNAB2 1.70 12 BIGR2 6.13 12 BIGR2 42
13 BIGR2 84.65 13 UofL BioImaging 1.70 13 vicorob UdG T1 6.15 13 IDSIA 45
14 MNAB2 84.50 14 STH 1.71 14 LIVIA_ETS 6.19 14 Narsil 45
15 UNC-IDEA 84.36 15 WTA 1.74 15 PyraMiD-LSTM2 6.35 15 UB VPML Med 47
16 KSOM GHMF 84.13 16 VIBOT10 M-T1+F 1.87 16 CU_DL 6.42 16 UNC-IDEA 50
17 WTA 83.92 17 BIGR2 1.89 17 MSL-SKKU 6.60 17 WTA 54
18 MNAB 83.86 18 KSOM GHMF 1.92 18 FBI/LMB Freiburg 6.60 18 MNAB2 54
19 Narsil 83.47 19 Robarts 1.95 19 CU_DL2 6.60 19 VIBOT10 M-T1+F 56
20 S2_QM2 83.35 20 CVSS 1.98 20 ISI-Neonatology 6.62 20 UofL BioImaging 68
21 UB VPML Med 83.31 21 UB VPML Med 2.09 21 CMIV 6.76 21 VBM12 68
22 UofL BioImaging 82.96 22 Narsil 2.27 22 WTA 6.76 22 vicorob UdG T1_F 69
23 CMIV 82.43 23 FreeSurfer* 2.31 23 IDSIA 6.77 23 CVSS 69
24 CVSS 82.35 24 S2_QM2 2.36 24 KM-MRF-MAS 6.79 24 drai 70
25 VBM12 82.29 25 drai 2.48 25 CVSS 6.86 25 CMIV 71
26 vicorob UdG T1_F 82.19 26 LUH-TNT 2.62 26 SPM12_T1* 6.95 26 SJCE 71
27 vicorob UdG T1 82.07 27 CMIV 2.69 27 UNC-IDEA 7.04 27 bigr_neuro 72
28 bigr_neuro 81.46 28 KM-MRF-MAS 2.73 28 MNAB2 7.10 28 S2_QM2 74
29 SPM12_T1_F* 81.17 29 MNAB 2.79 29 SPM12_T1_IR* 7.23 29 vicorob UdG T1 77
30 KM-MRF-MAS 80.85 30 SPM12_T1_F* 2.90 30 S2_QM2 7.23 30 KM-MRF-MAS 82
31 SJCE 80.76 31 SPM12_T1* 2.93 31 VIBOT10 M-T1+F 8.16 31 MNAB 83
32 SPM12_T1* 80.34 32 mlmi2014ss 2.96 32 FSL-PVSeg* 8.40 32 SPM12_T1* 89
33 SPM12_T1_IR_F* 80.15 33 SPM12_T1_IR* 3.01 33 UofL BioImaging 8.61 33 Robarts 92
34 Robarts 79.70 34 SPM12_T1_IR_F* 3.03 34 FSL-Seg* 8.65 34 SPM12_T1_IR* 97
35 SPM12_T1_IR* 79.41 35 vicorob UdG T1_F 3.17 35 Jedi Mind Meld 8.94 35 SPM12_T1_F* 99
36 LUH-TNT 79.35 36 VBM12 3.20 36 MNAB 9.11 36 FreeSurfer* 104
37 FSL-Seg* 78.66 37 vicorob UdG T1 3.31 37 S2_QM 9.28 37 LUH-TNT 105
38 Jedi Mind Meld 77.84 38 bigr_neuro 3.67 38 LNMBrains 9.47 38 SPM12_T1_IR_F* 109
39 FSL-PVSeg* 77.66 39 SJCE 3.71 39 Robarts 9.77 39 FSL-PVSeg* 113
40 FreeSurfer* 77.41 40 ISTB UniBe 3.86 40 SPM12_T1_F* 10.59 40 FSL-Seg* 114
41 S2_QM 76.41 41 Jedi Mind Meld 3.90 41 FreeSurfer* 12.15 41 Jedi Mind Meld 114
42 CSIM-Lab 75.65 42 FSL-PVSeg* 4.29 42 SPM12_T1_IR_F* 13.92 42 S2_QM 122
43 drai 74.53 43 FSL-Seg* 4.35 43 LUH-TNT 15.52 43 mlmi2014ss 123
44 LNMBrains 72.75 44 S2_QM 5.51 44 CSIM-Lab 18.07 44 LNMBrains 127
45 mlmi2014ss 71.70 45 LNMBrains 6.80 45 ISTB UniBe 19.11 45 ISTB UniBe 131
46 ISTB UniBe 68.62 46 CSIM-Lab 7.50 46 mlmi2014ss 24.56 46 CSIM-Lab 132
47 ECOESH 63.36 47 ECOESH 34.07 47 ECOESH 38.34 47 ECOESH 141

White Matter Segmentation Results

Rank DC Rank HD Rank AVD WM Score
1 LIVIA_ETS 89.46 1 LIVIA_ETS 1.78 1 SPM12_T1_F* 5.21 1 LRDE 10
2 CU_DL2 89.46 2 LRDE 1.86 2 MSL-SKKU 5.54 2 CU_DL 12
3 CU_DL 89.39 3 CU_DL2 1.93 3 Narsil 5.78 3 LIVIA_ETS 12
4 LRDE 89.29 4 CU_DL 1.93 4 LRDE 5.83 4 CU_DL2 16
5 MSL-SKKU 89.00 5 FBI/LMB Freiburg 1.95 5 CU_DL 5.84 5 MSL-SKKU 18
6 MDGRU 88.98 6 MDGRU 2.02 6 PyraMiD-LSTM2 5.93 6 PyraMiD-LSTM2 26
7 FBI/LMB Freiburg 88.86 7 UNC-IDEA 2.06 7 vicorob UdG T1_F 5.94 7 FBI/LMB Freiburg 29
8 UNC-IDEA 88.68 8 ISI-Neonatology 2.07 8 SPM12_T1* 5.99 8 UNC-IDEA 31
9 ISI-Neonatology 88.66 9 PyraMiD-LSTM2 2.07 9 BIGR2 6.02 9 ISI-Neonatology 36
10 UB VPML Med 88.61 10 IDSIA 2.08 10 LIVIA_ETS 6.03 10 BIGR2 38
11 PyraMiD-LSTM2 88.53 11 MSL-SKKU 2.11 11 CU_DL2 6.05 11 MDGRU 42
12 STH 88.45 12 MNAB2 2.12 12 VBM12 6.06 12 VBM12 44
13 BIGR2 88.42 13 UofL BioImaging 2.24 13 vicorob UdG T1 6.21 13 IDSIA 45
14 IDSIA 88.33 14 VBM12 2.32 14 SPM12_T1_IR* 6.34 14 KSOM GHMF 54
15 MNAB2 88.04 15 STH 2.34 15 SJCE 6.43 15 vicorob UdG T1_F 54
16 CVSS 88.00 16 BIGR2 2.36 16 UNC-IDEA 6.46 16 UB VPML Med 55
17 KSOM GHMF 87.96 17 WTA 2.39 17 FBI/LMB Freiburg 6.47 17 STH 56
18 VBM12 87.95 18 CMIV 2.43 18 KSOM GHMF 6.59 18 MNAB2 58
19 MNAB 87.95 19 KSOM GHMF 2.49 19 ISI-Neonatology 6.96 19 SPM12_T1_F* 62
20 WTA 87.93 20 MNAB 2.65 20 drai 6.99 20 CVSS 64
21 UofL BioImaging 87.88 21 KM-MRF-MAS 2.70 21 IDSIA 7.05 21 Narsil 64
22 CMIV 87.71 22 UB VPML Med 2.72 22 Robarts 7.06 22 WTA 65
23 vicorob UdG T1_F 87.34 23 CVSS 2.86 23 UB VPML Med 7.13 23 vicorob UdG T1 66
24 VIBOT10 M-T1+F 87.32 24 vicorob UdG T1_F 2.88 24 FreeSurfer* 7.18 24 CMIV 67
25 bigr_neuro 87.31 25 mlmi2014ss 2.89 25 CVSS 7.20 25 UofL BioImaging 70
26 Narsil 87.10 26 vicorob UdG T1 2.91 26 bigr_neuro 7.31 26 MNAB 71
27 vicorob UdG T1 87.06 27 LUH-TNT 2.96 27 CMIV 7.34 27 SPM12_T1* 73
28 SJCE 86.83 28 SPM12_T1_F* 3.00 28 WTA 7.61 28 bigr_neuro 80
29 KM-MRF-MAS 86.73 29 bigr_neuro 3.01 29 STH 7.67 29 SJCE 85
30 LUH-TNT 86.47 30 SPM12_T1* 3.06 30 MDGRU 7.69 30 Robarts 86
31 S2_QM2 86.34 31 FreeSurfer* 3.06 31 MNAB2 7.74 31 KM-MRF-MAS 87
32 Robarts 86.15 32 Robarts 3.06 32 MNAB 7.75 32 SPM12_T1_IR* 91
33 SPM12_T1_F* 86.03 33 drai 3.23 33 S2_QM2 7.91 33 FreeSurfer* 91
34 FSL-Seg* 85.98 34 S2_QM2 3.29 34 VIBOT10 M-T1+F 8.01 34 drai 97
35 SPM12_T1* 85.58 35 Narsil 3.31 35 SPM12_T1_IR_F* 8.40 35 S2_QM2 98
36 FreeSurfer* 85.25 36 SPM12_T1_IR* 3.60 36 UofL BioImaging 8.74 36 LUH-TNT 99
37 CSIM-Lab 85.24 37 CSIM-Lab 3.65 37 KM-MRF-MAS 9.19 37 VIBOT10 M-T1+F 103
38 FSL-PVSeg* 84.84 38 FSL-Seg* 3.65 38 FSL-Seg* 11.47 38 mlmi2014ss 109
39 S2_QM 83.86 39 SPM12_T1_IR_F* 3.84 39 Jedi Mind Meld 13.66 39 FSL-Seg* 110
40 SPM12_T1_IR_F* 83.64 40 FSL-PVSeg* 3.85 40 ISTB UniBe 13.71 40 SPM12_T1_IR_F* 114
41 SPM12_T1_IR* 83.54 41 ISTB UniBe 3.98 41 mlmi2014ss 14.00 41 CSIM-Lab 118
42 ISTB UniBe 82.50 42 SJCE 4.29 42 LUH-TNT 14.20 42 ISTB UniBe 123
43 mlmi2014ss 81.98 43 Jedi Mind Meld 4.52 43 LNMBrains 15.34 43 FSL-PVSeg* 123
44 drai 80.75 44 S2_QM 4.94 44 CSIM-Lab 17.39 44 Jedi Mind Meld 127
45 Jedi Mind Meld 80.64 45 VIBOT10 M-T1+F 6.63 45 FSL-PVSeg* 19.69 45 S2_QM 129
46 LNMBrains 78.32 46 LNMBrains 6.77 46 S2_QM 24.79 46 LNMBrains 135
47 ECOESH 75.82 47 ECOESH 38.46 47 ECOESH 25.27 47 ECOESH 141

Cerebrospinal Fluid Segmentation Results

Rank DC Rank HD Rank AVD CSF Score
1 CU_DL2 84.25 1 IDSIA 2.14 1 STH 6.73 1 IDSIA 10
2 MDGRU 84.13 2 MDGRU 2.17 2 MSL-SKKU 6.77 2 MDGRU 13
3 CU_DL 83.96 3 CU_DL2 2.19 3 VBM12 6.80 3 CU_DL2 15
4 MSL-SKKU 83.76 4 FBI/LMB Freiburg 2.22 4 IDSIA 7.09 4 MSL-SKKU 17
5 IDSIA 83.72 5 LIVIA_ETS 2.26 5 PyraMiD-LSTM2 7.17 5 LIVIA_ETS 20
6 FBI/LMB Freiburg 83.47 6 MNAB2 2.27 6 vicorob UdG T1 7.17 6 CU_DL 21
7 LIVIA_ETS 83.42 7 LRDE 2.28 7 vicorob UdG T1_F 7.21 7 STH 21
8 PyraMiD-LSTM2 83.05 8 CU_DL 2.28 8 LIVIA_ETS 7.31 8 PyraMiD-LSTM2 22
9 UNC-IDEA 82.81 9 PyraMiD-LSTM2 2.30 9 MDGRU 7.44 9 FBI/LMB Freiburg 23
10 STH 82.77 10 STH 2.31 10 CU_DL 7.44 10 MNAB2 32
11 LRDE 82.44 11 MSL-SKKU 2.32 11 CU_DL2 7.69 11 LRDE 33
12 MNAB2 82.30 12 UNC-IDEA 2.35 12 drai 8.14 12 vicorob UdG T1 41
13 KSOM GHMF 82.10 13 ISI-Neonatology 2.65 13 FBI/LMB Freiburg 8.63 13 vicorob UdG T1_F 42
14 ISI-Neonatology 81.08 14 Robarts 2.66 14 MNAB2 8.73 14 UNC-IDEA 42
15 WTA 81.05 15 UofL BioImaging 2.66 15 LRDE 9.03 15 ISI-Neonatology 45
16 Robarts 80.28 16 KSOM GHMF 2.71 16 S2_QM2 9.36 16 UofL BioImaging 52
17 vicorob UdG T1 80.18 17 vicorob UdG T1_F 2.81 17 UofL BioImaging 9.68 17 VBM12 54
18 vicorob UdG T1_F 80.17 18 vicorob UdG T1 2.81 18 ISI-Neonatology 9.77 18 WTA 56
19 VIBOT10 M-T1+F 79.73 19 WTA 2.85 19 SPM12_T1_F* 10.07 19 KSOM GHMF 56
20 UofL BioImaging 78.86 20 VIBOT10 M-T1+F 2.98 20 SPM12_T1_IR* 10.47 20 S2_QM2 64
21 CMIV 78.57 21 CMIV 3.00 21 UNC-IDEA 10.52 21 Robarts 69
22 BIGR2 78.31 22 VBM12 3.03 22 WTA 10.66 22 drai 71
23 SPM12_T1_IR* 78.25 23 S2_QM2 3.05 23 FSL-PVSeg* 10.69 23 CMIV 72
24 bigr_neuro 78.16 24 KM-MRF-MAS 3.08 24 KM-MRF-MAS 10.95 24 VIBOT10 M-T1+F 72
25 S2_QM2 77.97 25 bigr_neuro 3.15 25 FSL-Seg* 11.83 25 KM-MRF-MAS 74
26 KM-MRF-MAS 76.97 26 drai 3.17 26 SPM12_T1_IR_F* 12.21 26 SPM12_T1_IR* 77
27 SPM12_T1_IR_F* 76.87 27 BIGR2 3.19 27 KSOM GHMF 12.78 27 bigr_neuro 83
28 UB VPML Med 74.82 28 CVSS 3.25 28 CSIM-Lab 13.31 28 SPM12_T1_F* 88
29 VBM12 74.56 29 FSL-Seg* 3.41 29 Narsil 13.54 29 SPM12_T1_IR_F* 89
30 SPM12_T1_F* 74.03 30 FSL-PVSeg* 3.44 30 CMIV 14.31 30 FSL-PVSeg* 90
31 Jedi Mind Meld 73.33 31 Jedi Mind Meld 3.67 31 S2_QM 14.45 31 FSL-Seg* 90
32 CVSS 72.59 32 mlmi2014ss 3.77 32 SJCE 14.99 32 BIGR2 90
33 drai 70.95 33 S2_QM 3.79 33 VIBOT10 M-T1+F 16.06 33 CVSS 96
34 SPM12_T1* 70.69 34 SPM12_T1_IR* 4.01 34 bigr_neuro 16.47 34 Jedi Mind Meld 97
35 mlmi2014ss 70.59 35 LUH-TNT 4.07 35 Jedi Mind Meld 17.60 35 S2_QM 104
36 FSL-Seg* 69.95 36 SPM12_T1_IR_F* 4.15 36 CVSS 17.94 36 UB VPML Med 110
37 FSL-PVSeg* 69.49 37 FreeSurfer* 4.31 37 LNMBrains 19.87 37 mlmi2014ss 112
38 LNMBrains 68.80 38 UB VPML Med 4.31 38 ISTB UniBe 19.89 38 SJCE 113
39 MNAB 68.08 39 SPM12_T1_F* 4.59 39 Robarts 20.36 39 CSIM-Lab 116
40 S2_QM 67.87 40 SJCE 4.78 40 LUH-TNT 20.40 40 Narsil 117
41 SJCE 67.67 41 MNAB 4.88 41 BIGR2 22.76 41 LUH-TNT 118
42 Narsil 66.57 42 SPM12_T1* 5.34 42 SPM12_T1* 23.24 42 SPM12_T1* 118
43 LUH-TNT 66.47 43 CSIM-Lab 5.44 43 MNAB 28.56 43 LNMBrains 120
44 FreeSurfer* 65.79 44 ISTB UniBe 6.94 44 UB VPML Med 31.19 44 MNAB 123
45 CSIM-Lab 59.82 45 LNMBrains 7.66 45 mlmi2014ss 33.45 45 FreeSurfer* 128
46 ISTB UniBe 54.69 46 Narsil 13.30 46 ECOESH 36.59 46 ISTB UniBe 128
47 ECOESH 51.48 47 ECOESH 18.75 47 FreeSurfer* 50.27 47 ECOESH 140

Brain (GM and WM segmentations combined) Results

Rank DC Rank HD Rank AVD Brain Score
1 CU_DL2 95.74 1 LIVIA_ETS 1.99 1 UB VPML Med 2.35 1 LIVIA_ETS 8
2 LIVIA_ETS 95.70 2 LRDE 2.07 2 STH 2.51 2 LRDE 11
3 CU_DL 95.70 3 ISI-Neonatology 2.18 3 CMIV 2.58 3 MSL-SKKU 19
4 MSL-SKKU 95.67 4 CU_DL 2.19 4 LRDE 2.62 4 CU_DL 19
5 LRDE 95.65 5 CU_DL2 2.24 5 LIVIA_ETS 2.67 5 ISI-Neonatology 20
6 ISI-Neonatology 95.65 6 IDSIA 2.27 6 PyraMiD-LSTM2 2.73 6 CU_DL2 20
7 MDGRU 95.59 7 MDGRU 2.29 7 MSL-SKKU 2.73 7 STH 21
8 FBI/LMB Freiburg 95.40 8 MSL-SKKU 2.29 8 VBM12 2.77 8 MDGRU 24
9 STH 95.37 9 FBI/LMB Freiburg 2.33 9 S2_QM2 2.78 9 PyraMiD-LSTM2 29
10 PyraMiD-LSTM2 95.30 10 STH 2.38 10 MDGRU 2.79 10 IDSIA 35
11 IDSIA 95.29 11 MNAB2 2.41 11 ISI-Neonatology 2.80 11 FBI/LMB Freiburg 39
12 MNAB2 95.16 12 UofL BioImaging 2.41 12 CU_DL 2.89 12 UB VPML Med 41
13 KSOM GHMF 95.13 13 PyraMiD-LSTM2 2.45 13 Narsil 2.91 13 S2_QM2 41
14 BIGR2 95.13 14 UNC-IDEA 2.48 14 CU_DL2 2.94 14 MNAB2 44
15 UNC-IDEA 95.05 15 S2_QM2 2.73 15 FSL-Seg* 2.95 15 Narsil 53
16 UofL BioImaging 94.93 16 BIGR2 2.74 16 vicorob UdG T1 2.97 16 KSOM GHMF 54
17 S2_QM2 94.90 17 KM-MRF-MAS 2.76 17 vicorob UdG T1_F 2.98 17 BIGR2 54
18 VIBOT10 M-T1+F 94.89 18 Robarts 2.78 18 IDSIA 3.10 18 VBM12 57
19 Narsil 94.78 19 UB VPML Med 2.80 19 KSOM GHMF 3.15 19 CMIV 57
20 WTA 94.67 20 CVSS 2.84 20 drai 3.20 20 UofL BioImaging 59
21 UB VPML Med 94.59 21 Narsil 2.86 21 MNAB2 3.21 21 UNC-IDEA 63
22 VBM12 94.50 22 KSOM GHMF 2.86 22 FBI/LMB Freiburg 3.22 22 vicorob UdG T1_F 71
23 CMIV 94.48 23 LUH-TNT 2.90 23 SPM12_T1* 3.23 23 vicorob UdG T1 72
24 MNAB 94.47 24 WTA 3.01 24 BIGR2 3.24 24 WTA 76
25 vicorob UdG T1_F 94.27 25 drai 3.05 25 SPM12_T1_IR* 3.38 25 LUH-TNT 83
26 vicorob UdG T1 94.25 26 mlmi2014ss 3.23 26 Jedi Mind Meld 3.46 26 CVSS 84
27 LUH-TNT 94.17 27 VBM12 3.36 27 FSL-PVSeg* 3.46 27 drai 87
28 CVSS 94.08 28 FreeSurfer* 3.55 28 bigr_neuro 3.57 28 KM-MRF-MAS 87
29 bigr_neuro 93.99 29 vicorob UdG T1_F 3.73 29 MNAB 3.76 29 MNAB 88
30 KM-MRF-MAS 93.97 30 vicorob UdG T1 3.74 30 SJCE 3.79 30 SPM12_T1* 89
31 SPM12_T1_IR* 93.93 31 CMIV 3.82 31 UofL BioImaging 3.88 31 VIBOT10 M-T1+F 91
32 SPM12_T1_F* 93.87 32 ISTB UniBe 4.39 32 WTA 3.96 32 FSL-Seg* 92
33 SPM12_T1* 93.85 33 SPM12_T1* 4.45 33 LUH-TNT 4.11 33 bigr_neuro 93
34 FSL-PVSeg* 93.59 34 SJCE 4.52 34 UNC-IDEA 4.21 34 SPM12_T1_IR* 93
35 SPM12_T1_IR_F* 93.59 35 MNAB 4.54 35 VIBOT10 M-T1+F 4.84 35 SJCE 100
36 SJCE 93.48 36 bigr_neuro 4.57 36 CVSS 4.91 36 Robarts 101
37 FSL-Seg* 93.30 37 SPM12_T1_IR* 4.63 37 SPM12_T1_IR_F* 5.11 37 FSL-PVSeg* 104
38 S2_QM 93.27 38 VIBOT10 M-T1+F 4.91 38 SPM12_T1_F* 5.33 38 Jedi Mind Meld 104
39 Jedi Mind Meld 93.24 39 Jedi Mind Meld 5.44 39 S2_QM 5.48 39 FreeSurfer* 110
40 Robarts 93.13 40 FSL-Seg* 5.53 40 KM-MRF-MAS 5.58 40 SPM12_T1_F* 111
41 FreeSurfer* 92.32 41 SPM12_T1_F* 5.85 41 FreeSurfer* 6.27 41 SPM12_T1_IR_F* 114
42 drai 91.97 42 SPM12_T1_IR_F* 5.91 42 LNMBrains 7.37 42 mlmi2014ss 114
43 CSIM-Lab 91.20 43 FSL-PVSeg* 6.09 43 Robarts 7.88 43 S2_QM 121
44 mlmi2014ss 90.75 44 S2_QM 6.98 44 mlmi2014ss 12.05 44 ISTB UniBe 124
45 LNMBrains 88.51 45 LNMBrains 8.56 45 CSIM-Lab 15.76 45 LNMBrains 132
46 ISTB UniBe 87.80 46 CSIM-Lab 11.24 46 ISTB UniBe 17.26 46 CSIM-Lab 134
47 ECOESH 78.24 47 ECOESH 35.99 47 ECOESH 32.06 47 ECOESH 141

Intracranial cavity (GM, WM, and CSF segmentations combined) Results

Rank DC Rank HD Rank AVD ICV Score
1 IDSIA 98.15 1 MDGRU 2.37 1 UNC-IDEA 0.68 1 MDGRU 7
2 MDGRU 98.15 2 IDSIA 2.44 2 PyraMiD-LSTM2 0.69 2 IDSIA 9
3 CU_DL2 98.10 3 FBI/LMB Freiburg 2.51 3 STH 0.69 3 PyraMiD-LSTM2 13
4 PyraMiD-LSTM2 98.04 4 Robarts 2.55 4 MDGRU 0.86 4 UNC-IDEA 15
5 CU_DL 97.99 5 UNC-IDEA 2.72 5 Robarts 0.91 5 Robarts 17
6 FBI/LMB Freiburg 97.99 6 CU_DL2 2.75 6 IDSIA 0.95 6 FBI/LMB Freiburg 17
7 MSL-SKKU 97.96 7 PyraMiD-LSTM2 2.86 7 SPM12_T1_IR* 0.99 7 CU_DL2 22
8 Robarts 97.92 8 LRDE 2.87 8 FBI/LMB Freiburg 1.06 8 STH 24
9 UNC-IDEA 97.92 9 STH 2.92 9 SPM12_T1_IR_F* 1.17 9 MSL-SKKU 35
10 LIVIA_ETS 97.82 10 MNAB2 2.95 10 LRDE 1.44 10 LRDE 37
11 SPM12_T1_IR* 97.73 11 LIVIA_ETS 2.96 11 SPM12_T1_F* 1.46 11 LIVIA_ETS 38
12 STH 97.72 12 CU_DL 3.17 12 MSL-SKKU 1.46 12 CU_DL 38
13 SPM12_T1_IR_F* 97.71 13 KSOM GHMF 3.23 13 CU_DL2 1.54 13 MNAB2 43
14 MNAB2 97.66 14 UofL BioImaging 3.43 14 vicorob UdG T1 1.62 14 vicorob UdG T1 47
15 vicorob UdG T1 97.65 15 S2_QM2 3.72 15 VIBOT10 M-T1+F 1.64 15 SPM12_T1_IR* 49
16 vicorob UdG T1_F 97.64 16 MSL-SKKU 3.75 16 vicorob UdG T1_F 1.65 16 vicorob UdG T1_F 52
17 VIBOT10 M-T1+F 97.63 17 CMIV 3.76 17 LIVIA_ETS 1.67 17 VIBOT10 M-T1+F 53
18 KSOM GHMF 97.56 18 vicorob UdG T1 3.85 18 ISI-Neonatology 1.74 18 KSOM GHMF 54
19 LRDE 97.53 19 drai 3.89 19 MNAB2 1.77 19 UofL BioImaging 57
20 WTA 97.36 20 vicorob UdG T1_F 3.90 20 UofL BioImaging 1.81 20 SPM12_T1_IR_F* 62
21 ISI-Neonatology 96.92 21 VIBOT10 M-T1+F 3.91 21 CU_DL 1.83 21 ISI-Neonatology 63
22 CMIV 96.79 22 BIGR2 3.93 22 drai 1.85 22 S2_QM2 66
23 UofL BioImaging 96.71 23 bigr_neuro 3.93 23 KSOM GHMF 1.95 23 drai 70
24 SPM12_T1_F* 96.59 24 ISI-Neonatology 4.29 24 WTA 2.09 24 SPM12_T1_F* 74
25 S2_QM2 96.44 25 CVSS 4.87 25 VBM12 2.37 25 CMIV 74
26 bigr_neuro 96.33 26 VBM12 4.89 26 S2_QM2 2.38 26 bigr_neuro 80
27 KM-MRF-MAS 96.10 27 KM-MRF-MAS 5.08 27 CVSS 2.55 27 VBM12 81
28 BIGR2 96.00 28 FSL-Seg* 5.29 28 KM-MRF-MAS 2.99 28 KM-MRF-MAS 82
29 drai 95.99 29 FSL-PVSeg* 5.29 29 FSL-Seg* 3.37 29 CVSS 86
30 VBM12 95.95 30 S2_QM 6.49 30 FSL-PVSeg* 3.37 30 BIGR2 86
31 mlmi2014ss 95.84 31 SPM12_T1_IR* 6.51 31 bigr_neuro 3.46 31 WTA 87
32 SPM12_T1* 95.28 32 FreeSurfer* 6.62 32 mlmi2014ss 3.60 32 FSL-Seg* 93
33 UB VPML Med 94.83 33 UB VPML Med 6.63 33 Narsil 3.69 33 FSL-PVSeg* 96
34 CVSS 94.62 34 LUH-TNT 6.85 34 S2_QM 4.01 34 S2_QM 102
35 Jedi Mind Meld 94.26 35 MNAB 7.06 35 CMIV 4.87 35 mlmi2014ss 104
36 FSL-Seg* 94.24 36 SJCE 7.31 36 BIGR2 5.18 36 UB VPML Med 106
37 FSL-PVSeg* 94.24 37 CSIM-Lab 8.09 37 SPM12_T1* 5.53 37 SPM12_T1* 107
38 S2_QM 93.71 38 SPM12_T1* 8.09 38 SJCE 6.77 38 SJCE 113
39 SJCE 93.66 39 SPM12_T1_F* 8.21 39 Jedi Mind Meld 6.82 39 LUH-TNT 116
40 LUH-TNT 93.18 40 SPM12_T1_IR_F* 8.23 40 UB VPML Med 7.67 40 Jedi Mind Meld 118
41 MNAB 92.52 41 mlmi2014ss 8.69 41 LNMBrains 7.88 41 MNAB 119
42 Narsil 92.49 42 ISTB UniBe 9.84 42 LUH-TNT 9.14 42 FreeSurfer* 120
43 FreeSurfer* 92.39 43 WTA 10.27 43 MNAB 9.71 43 Narsil 122
44 CSIM-Lab 92.34 44 Jedi Mind Meld 20.34 44 CSIM-Lab 10.06 44 CSIM-Lab 125
45 LNMBrains 89.17 45 LNMBrains 20.36 45 FreeSurfer* 10.19 45 LNMBrains 131
46 ISTB UniBe 88.53 46 ECOESH 21.43 46 ISTB UniBe 17.52 46 ISTB UniBe 134
47 ECOESH 78.14 47 Narsil 23.65 47 ECOESH 30.13 47 ECOESH 140

DC = Dice Coefficient, HD = 95th percentile of Hausdorff Distance, AVD = Absolute Volume Difference
Score = Rank DC + Rank HD + Rank AVD





© 2013 Image Sciences Institute.