Home    Details    Workshop    Register    Download    Submit    Results    Organizers 

Results

When teams submit their segmentation results, the evaluation results will be sent to the team contact person by e-mail and will be listed below.

Rank Team name Submission name Date Sum Scores Sequences used Speed Doc
1CU_DL2 3D Deep Learning; voxnet2 28-06-16 50 T1; T1_IR; FLAIR ~2 min pdf
2CU_DL 3D Deep Learning; voxnet13 16-06-16 51 T1; T1_IR; FLAIR ~2 min pdf
3LRDE Fully Convolutional Network 20-12-16 55 T1 ~2 sec pdf
4MSL-SKKU Deep Convolutional Neural Network 19-06-17 58 T1; T1-IR; FLAIR ~1.5 min pdf
5MDGRU Multi-Dimensional Gated Recurrent Units3 27-07-16 76 T1; T1_IR; FLAIR ~2 min pdf
6LIVIA_ETS HyperDenseNet 01-12-17 80 T1; FLAIR ~2 min pdf
7PyraMiD-LSTM2 NOCC with rounds3 23-05-16 81 T1; T1-IR; FLAIR ~2 min pdf
8FBI/LMB Freiburg U-Net (3D) 01-05-16 81 T1-1mm;T1-IR;F ~2 min pdf
9IDSIA PyraMiD-LSTM 05-06-15 100 T1; T1_IR; FLAIR ~2 min pdf
10STH Hybrid ANN-based Auto-context method2 03-06-16 109 T1; T1-IR; FLAIR ~ 5 min pdf
11ISI-Neonatology Multi-stage voxel classification 31-05-14 115 T1 ~1.5 hours pdf
12UNC-IDEA LINKS:Learning-based multi-source integration 09-02-15 120 T1; T1_IR; FLAIR ~3 min pdf
13MNAB2 Random Forests 21-02-14 139 T1; T1_IR; FLAIR ~25 min pdf
14KSOM GHMF ASeTs: MAP-Based with Manifold learning 13-05-14 143 T1; T1_IR; FLAIR ~23 min pdf
15vicorob UdG T1_F MSSEG using T1 + FLAIR (T1-IR skull) 14-01-16 161 T1; IR; FLAIR ~2 min pdf
16VBM12 VBM12_r738 with WMHC=2 07-10-15 162 T1 ~6 min pdf
17BIGR2 Multi-Feature SVM Classification 26-09-13 167 T1; T1_IR; FLAIR ~35 min pdf
18vicorob UdG T1 MSSEG using only T1 (T1-IR skull) 21-01-16 179 T1; IR ~2 min pdf
19UofL BioImaging MAP-Based Framework 26-09-13 185 T1 ~6 sec pdf
20CMIV Model-guided Level Sets and Skeletons 26-09-13 203 T1; FLAIR ~3 min pdf
21UB VPML Med Multi-Atlas with Multiway Cut 26-09-13 206 T1; T1_IR; FLAIR ~30 min pdf
22Narsil Segmentation using Ensemble Trees 26-09-13 219 T1; FLAIR < 2 min pdf
23CVSS Multi-atlas segmentation based on supervoxels 14-02-17 222 T1; T1_IR; FLAIR ~2 min pdf
24VIBOT10 M-T1+F Convolutional Neural Network 27-02-17 223 T1; FLAIR ~3 min pdf
25bigr_neuro Automatically Trained kNN Classifier 26-09-13 228 T1; FLAIR ~2 hours pdf
26S2_QM2 Atlas-based segmentation and AdaBoost 28-07-14 228 T1; T1-IR; FLAIR ~45 min pdf
27drai VGG based Fully Convolutional Neural Network 20-01-17 232 T1 ~2 sec pdf
28KM-MRF-MAS MAP on Intensity, and Local and Multi-atlas Priors 28-10-16 234 T1 ~10 min pdf
29Robarts Multi-Atlas with Hierarchical Max-Flow 26-09-13 240 T1-1mm; T1-IR ~16 min pdf
30SPM12_T1_F* SPM12 with T1 and FLAIR sequence 31-08-15 242 T1; FLAIR ~3 min pdf
31SPM12_T1_IR* SPM12 with T1 and IR sequence 31-08-15 258 T1; IR ~3 min pdf
32SJCE Fuzzy Clustering 12-04-17 262 T1 <1 min pdf
33MNAB Random Decision Forests 26-09-13 269 T1; T1-IR; FLAIR ~15 min pdf
34SPM12_T1* SPM12 with T1 sequence 31-08-15 272 T1 ~3 min pdf
35SPM12_T1_IR_F* SPM12 with T1; IR and FLAIR sequence 31-08-15 303 T1; IR; FLAIR ~4 min pdf
36FSL-Seg* FSL (v5.0) seg file 31-08-15 305 T1 ~10 min pdf
37LUH-TNT Level-sets with dictionary learning 27-10-14 313 T1 < 1 min pdf
38FreeSurfer* FreeSurfer (v5.3.0) 31-08-15 315 T1-1mm ~1 hour pdf
39FSL-PVSeg* FSL (v5.0) PVSeg file 31-08-15 317 T1 ~10 min pdf
40Jedi Mind Meld Automated Walks using Machine Learning 26-09-13 329 T1; T1-IR; FLAIR ~27 sec pdf
41mlmi2014ss AdaBoostM2 28-07-14 335 T1; T1-IR; FLAIR ~5 min pdf
42S2_QM Bayesian-based Adaptive Mean-Shift 26-09-13 346 T1; T1-IR; FLAIR ~1.5 hours pdf
43CSIM-Lab Multiple Logistic Classification 24-10-17 357 T1 pdf
44ISTB UniBe Decision Forests with spatial regularization 04-06-14 373 T1; T1-IR; FLAIR ~3 min pdf
45LNMBrains Gaussian Intensity Model 26-09-13 373 T1; T1-IR; FLAIR ~5 min pdf
46ECOESH Modified Expectation Maximization 06-01-14 413 T1 ~5 min pdf
*These methods (SPM, FSL and FreeSurfer) were applied by the MRBrainS organizers as described in the MRBrainS journal paper.
2,3At the end of the submission name indicates that this is the 2nd or 3rd submission (max 3 resubmissions allowed).

Note: As described below, when teams have equal scores, the standard deviations of the three tissue types and the three evaluation measures over all patients are taken into account.

How is the ranking determined?

Ranking is based on the evaluation results of all 15 test datasets and determined as follows: For each evaluation measure (Dice Coefficient (DC), Modified Hausdorff Distance (HD) and Absolute Volume Difference(AVD)), the mean value over all 15 datasets is determined for white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF). Each team receives a rank (1=best) for each tissue type (GM, WM, CSF) and each evaluation measure (DC, HD-95, AVD) based on the mean value of the evaluation measures over all 15 datasets. The final score is determined by adding the ranks of all tissue types and evaluation measures for each team. The team with the lowest score is ranked number 1. In case two teams would have an equal score, the team with the lowest standard deviation over the tissue types will be ranked first.

Per tissue rankings and per measure rankings are presented below.

Overall Segmentation Results

GM Score WM Score CSF Score Rank Sum
1 LRDE 37 1 LRDE 37 1 IDSIA 9 1 CU_DL2 50
2 CU_DL2 22 2 CU_DL 37 2 MDGRU 7 2 CU_DL 51
3 CU_DL 37 3 CU_DL2 22 3 CU_DL2 22 3 LRDE 55
4 MDGRU 7 4 MSL-SKKU 35 4 MSL-SKKU 35 4 MSL-SKKU 58
5 LIVIA_ETS 48 5 LIVIA_ETS 48 5 STH 23 5 MDGRU 76
6 MSL-SKKU 35 6 PyraMiD-LSTM2 13 6 PyraMiD-LSTM2 13 6 LIVIA_ETS 80
7 FBI/LMB Freiburg 17 7 FBI/LMB Freiburg 17 7 CU_DL 37 7 PyraMiD-LSTM2 81
8 ISI-Neonatology 62 8 UNC-IDEA 15 8 FBI/LMB Freiburg 17 8 FBI/LMB Freiburg 81
9 PyraMiD-LSTM2 13 9 ISI-Neonatology 62 9 MNAB2 42 9 IDSIA 100
10 STH 23 10 BIGR2 84 10 LRDE 37 10 STH 109
11 KSOM GHMF 53 11 MDGRU 7 11 LIVIA_ETS 48 11 ISI-Neonatology 115
12 BIGR2 84 12 VBM12 79 12 vicorob UdG T1 46 12 UNC-IDEA 120
13 Narsil 119 13 IDSIA 9 13 UNC-IDEA 15 13 MNAB2 139
14 IDSIA 9 14 vicorob UdG T1_F 51 14 vicorob UdG T1_F 51 14 KSOM GHMF 143
15 UB VPML Med 104 15 KSOM GHMF 53 15 ISI-Neonatology 62 15 vicorob UdG T1_F 161
16 UNC-IDEA 15 16 UB VPML Med 104 16 UofL BioImaging 55 16 VBM12 162
17 MNAB2 42 17 STH 23 17 VBM12 79 17 BIGR2 167
18 VIBOT10 M-T1+F 52 18 MNAB2 42 18 KSOM GHMF 53 18 vicorob UdG T1 179
19 CVSS 84 19 SPM12_T1_F* 73 19 S2_QM2 64 19 UofL BioImaging 185
20 UofL BioImaging 55 20 Narsil 119 20 Robarts 17 20 CMIV 203
21 VBM12 79 21 CVSS 84 21 CMIV 72 21 UB VPML Med 206
22 vicorob UdG T1_F 51 22 vicorob UdG T1 46 22 drai 69 22 Narsil 219
23 drai 69 23 CMIV 72 23 VIBOT10 M-T1+F 52 23 CVSS 222
24 CMIV 72 24 UofL BioImaging 55 24 KM-MRF-MAS 80 24 VIBOT10 M-T1+F 223
25 SJCE 111 25 MNAB 117 25 SPM12_T1_IR* 48 25 bigr_neuro 228
26 bigr_neuro 78 26 SPM12_T1* 105 26 bigr_neuro 78 26 S2_QM2 228
27 S2_QM2 64 27 bigr_neuro 78 27 SPM12_T1_IR_F* 61 27 drai 232
28 vicorob UdG T1 46 28 SJCE 111 28 SPM12_T1_F* 73 28 KM-MRF-MAS 234
29 KM-MRF-MAS 80 29 Robarts 17 29 FSL-PVSeg* 92 29 Robarts 240
30 MNAB 117 30 KM-MRF-MAS 80 30 FSL-Seg* 93 30 SPM12_T1_F* 242
31 SPM12_T1* 105 31 SPM12_T1_IR* 48 31 BIGR2 84 31 SPM12_T1_IR* 258
32 Robarts 17 32 FreeSurfer* 118 32 CVSS 84 32 SJCE 262
33 SPM12_T1_IR* 48 33 drai 69 33 Jedi Mind Meld 115 33 MNAB 269
34 SPM12_T1_F* 73 34 S2_QM2 64 34 S2_QM 100 34 SPM12_T1* 272
35 FreeSurfer* 118 35 LUH-TNT 114 35 UB VPML Med 104 35 SPM12_T1_IR_F* 303
36 LUH-TNT 114 36 VIBOT10 M-T1+F 52 36 mlmi2014ss 102 36 FSL-Seg* 305
37 SPM12_T1_IR_F* 61 37 mlmi2014ss 102 37 SJCE 111 37 LUH-TNT 313
38 FSL-PVSeg* 92 38 FSL-Seg* 93 38 CSIM-Lab 123 38 FreeSurfer* 315
39 FSL-Seg* 93 39 SPM12_T1_IR_F* 61 39 Narsil 119 39 FSL-PVSeg* 317
40 Jedi Mind Meld 115 40 CSIM-Lab 123 40 LUH-TNT 114 40 Jedi Mind Meld 329
41 S2_QM 100 41 ISTB UniBe 132 41 SPM12_T1* 105 41 mlmi2014ss 335
42 mlmi2014ss 102 42 FSL-PVSeg* 92 42 LNMBrains 128 42 S2_QM 346
43 LNMBrains 128 43 Jedi Mind Meld 115 43 MNAB 117 43 CSIM-Lab 357
44 ISTB UniBe 132 44 S2_QM 100 44 FreeSurfer* 118 44 ISTB UniBe 373
45 CSIM-Lab 123 45 LNMBrains 128 45 ISTB UniBe 132 45 LNMBrains 373
46 ECOESH 137 46 ECOESH 137 46 ECOESH 137 46 ECOESH 413

GM = Gray matter, WM = White matter, CSF = Cerebrospinal fluid
Sum = Score GM + Score WM + Score CSF
Score = Rank DC + Rank HD + Rank AVD

Gray Matter Segmentation Results

Rank DC Rank HD Rank AVD GM Score
1 CU_DL2 86.15 1 CU_DL2 1.44 1 SJCE 5.14 1 LRDE 16
2 CU_DL 86.12 2 LRDE 1.44 2 drai 5.29 2 CU_DL2 21
3 MSL-SKKU 86.06 3 CU_DL 1.47 3 KSOM GHMF 5.44 3 CU_DL 21
4 LRDE 86.03 4 LIVIA_ETS 1.52 4 Narsil 5.52 4 MDGRU 24
5 ISI-Neonatology 85.77 5 MSL-SKKU 1.52 5 UB VPML Med 5.87 5 LIVIA_ETS 24
6 FBI/LMB Freiburg 85.44 6 MDGRU 1.54 6 bigr_neuro 5.90 6 MSL-SKKU 25
7 MDGRU 85.40 7 FBI/LMB Freiburg 1.58 7 VBM12 5.91 7 FBI/LMB Freiburg 31
8 LIVIA_ETS 85.31 8 UNC-IDEA 1.62 8 vicorob UdG T1_F 5.98 8 ISI-Neonatology 34
9 VIBOT10 M-T1+F 85.07 9 ISI-Neonatology 1.62 9 STH 6.02 9 PyraMiD-LSTM2 35
10 PyraMiD-LSTM2 84.89 10 PyraMiD-LSTM2 1.67 10 LRDE 6.05 10 STH 35
11 IDSIA 84.82 11 MNAB2 1.70 11 MDGRU 6.09 11 KSOM GHMF 36
12 STH 84.77 12 IDSIA 1.70 12 LIVIA_ETS 6.11 12 BIGR2 42
13 BIGR2 84.65 13 UofL BioImaging 1.70 13 BIGR2 6.13 13 Narsil 43
14 MNAB2 84.50 14 STH 1.71 14 vicorob UdG T1 6.15 14 IDSIA 45
15 UNC-IDEA 84.36 15 VIBOT10 M-T1+F 1.87 15 PyraMiD-LSTM2 6.35 15 UB VPML Med 45
16 KSOM GHMF 84.13 16 BIGR2 1.89 16 CU_DL 6.42 16 UNC-IDEA 49
17 MNAB 83.86 17 KSOM GHMF 1.92 17 MSL-SKKU 6.60 17 MNAB2 52
18 Narsil 83.47 18 Robarts 1.95 18 FBI/LMB Freiburg 6.60 18 VIBOT10 M-T1+F 54
19 S2_QM2 83.35 19 CVSS 1.98 19 CU_DL2 6.60 19 CVSS 66
20 UB VPML Med 83.31 20 UB VPML Med 2.09 20 ISI-Neonatology 6.62 20 UofL BioImaging 66
21 UofL BioImaging 82.96 21 Narsil 2.27 21 CMIV 6.76 21 VBM12 66
22 CMIV 82.43 22 FreeSurfer* 2.31 22 IDSIA 6.77 22 vicorob UdG T1_F 67
23 CVSS 82.35 23 S2_QM2 2.36 23 KM-MRF-MAS 6.79 23 drai 68
24 VBM12 82.29 24 drai 2.48 24 CVSS 6.86 24 CMIV 69
25 vicorob UdG T1_F 82.19 25 LUH-TNT 2.62 25 SPM12_T1* 6.95 25 SJCE 69
26 vicorob UdG T1 82.07 26 CMIV 2.69 26 UNC-IDEA 7.04 26 bigr_neuro 70
27 bigr_neuro 81.46 27 KM-MRF-MAS 2.73 27 MNAB2 7.10 27 S2_QM2 71
28 SPM12_T1_F* 81.17 28 MNAB 2.79 28 SPM12_T1_IR* 7.23 28 vicorob UdG T1 76
29 KM-MRF-MAS 80.85 29 SPM12_T1_F* 2.90 29 S2_QM2 7.23 29 KM-MRF-MAS 79
30 SJCE 80.76 30 SPM12_T1* 2.93 30 VIBOT10 M-T1+F 8.16 30 MNAB 80
31 SPM12_T1* 80.34 31 mlmi2014ss 2.96 31 FSL-PVSeg* 8.40 31 SPM12_T1* 86
32 SPM12_T1_IR_F* 80.15 32 SPM12_T1_IR* 3.01 32 UofL BioImaging 8.61 32 Robarts 89
33 Robarts 79.70 33 SPM12_T1_IR_F* 3.03 33 FSL-Seg* 8.65 33 SPM12_T1_IR* 94
34 SPM12_T1_IR* 79.41 34 vicorob UdG T1_F 3.17 34 Jedi Mind Meld 8.94 34 SPM12_T1_F* 96
35 LUH-TNT 79.35 35 VBM12 3.20 35 MNAB 9.11 35 FreeSurfer* 101
36 FSL-Seg* 78.66 36 vicorob UdG T1 3.31 36 S2_QM 9.28 36 LUH-TNT 102
37 Jedi Mind Meld 77.84 37 bigr_neuro 3.67 37 LNMBrains 9.47 37 SPM12_T1_IR_F* 106
38 FSL-PVSeg* 77.66 38 SJCE 3.71 38 Robarts 9.77 38 FSL-PVSeg* 110
39 FreeSurfer* 77.41 39 ISTB UniBe 3.86 39 SPM12_T1_F* 10.59 39 FSL-Seg* 111
40 S2_QM 76.41 40 Jedi Mind Meld 3.90 40 FreeSurfer* 12.15 40 Jedi Mind Meld 111
41 CSIM-Lab 75.65 41 FSL-PVSeg* 4.29 41 SPM12_T1_IR_F* 13.92 41 S2_QM 119
42 drai 74.53 42 FSL-Seg* 4.35 42 LUH-TNT 15.52 42 mlmi2014ss 120
43 LNMBrains 72.75 43 S2_QM 5.51 43 CSIM-Lab 18.07 43 LNMBrains 124
44 mlmi2014ss 71.70 44 LNMBrains 6.80 44 ISTB UniBe 19.11 44 ISTB UniBe 128
45 ISTB UniBe 68.62 45 CSIM-Lab 7.50 45 mlmi2014ss 24.56 45 CSIM-Lab 129
46 ECOESH 63.36 46 ECOESH 34.07 46 ECOESH 38.34 46 ECOESH 138

White Matter Segmentation Results

Rank DC Rank HD Rank AVD WM Score
1 CU_DL2 89.46 1 LRDE 1.86 1 SPM12_T1_F* 5.21 1 LRDE 8
2 CU_DL 89.39 2 CU_DL2 1.93 2 MSL-SKKU 5.54 2 CU_DL 10
3 LRDE 89.29 3 CU_DL 1.93 3 Narsil 5.78 3 CU_DL2 14
4 MSL-SKKU 89.00 4 FBI/LMB Freiburg 1.95 4 LRDE 5.83 4 MSL-SKKU 17
5 MDGRU 88.98 5 MDGRU 2.02 5 CU_DL 5.84 5 LIVIA_ETS 23
6 FBI/LMB Freiburg 88.86 6 LIVIA_ETS 2.02 6 PyraMiD-LSTM2 5.93 6 PyraMiD-LSTM2 26
7 LIVIA_ETS 88.75 7 UNC-IDEA 2.06 7 vicorob UdG T1_F 5.94 7 FBI/LMB Freiburg 27
8 UNC-IDEA 88.68 8 ISI-Neonatology 2.07 8 SPM12_T1* 5.99 8 UNC-IDEA 31
9 ISI-Neonatology 88.66 9 PyraMiD-LSTM2 2.07 9 BIGR2 6.02 9 ISI-Neonatology 36
10 UB VPML Med 88.61 10 IDSIA 2.08 10 LIVIA_ETS 6.04 10 BIGR2 38
11 PyraMiD-LSTM2 88.53 11 MSL-SKKU 2.11 11 CU_DL2 6.05 11 MDGRU 39
12 STH 88.45 12 MNAB2 2.12 12 VBM12 6.06 12 VBM12 44
13 BIGR2 88.42 13 UofL BioImaging 2.24 13 vicorob UdG T1 6.21 13 IDSIA 45
14 IDSIA 88.33 14 VBM12 2.32 14 SPM12_T1_IR* 6.34 14 vicorob UdG T1_F 52
15 MNAB2 88.04 15 STH 2.34 15 SJCE 6.43 15 KSOM GHMF 53
16 CVSS 88.00 16 BIGR2 2.36 16 UNC-IDEA 6.46 16 UB VPML Med 54
17 KSOM GHMF 87.96 17 CMIV 2.43 17 FBI/LMB Freiburg 6.47 17 STH 55
18 VBM12 87.95 18 KSOM GHMF 2.49 18 KSOM GHMF 6.59 18 MNAB2 57
19 MNAB 87.95 19 MNAB 2.65 19 ISI-Neonatology 6.96 19 SPM12_T1_F* 60
20 UofL BioImaging 87.88 20 KM-MRF-MAS 2.70 20 drai 6.99 20 Narsil 62
21 CMIV 87.71 21 UB VPML Med 2.72 21 IDSIA 7.05 21 CVSS 63
22 vicorob UdG T1_F 87.34 22 CVSS 2.86 22 Robarts 7.06 22 vicorob UdG T1 64
23 VIBOT10 M-T1+F 87.32 23 vicorob UdG T1_F 2.88 23 UB VPML Med 7.13 23 CMIV 65
24 bigr_neuro 87.31 24 mlmi2014ss 2.89 24 FreeSurfer* 7.18 24 UofL BioImaging 68
25 Narsil 87.10 25 vicorob UdG T1 2.91 25 CVSS 7.20 25 MNAB 69
26 vicorob UdG T1 87.06 26 LUH-TNT 2.96 26 bigr_neuro 7.31 26 SPM12_T1* 71
27 SJCE 86.83 27 SPM12_T1_F* 3.00 27 CMIV 7.34 27 bigr_neuro 78
28 KM-MRF-MAS 86.73 28 bigr_neuro 3.01 28 STH 7.67 28 SJCE 83
29 LUH-TNT 86.47 29 SPM12_T1* 3.06 29 MDGRU 7.69 29 Robarts 84
30 S2_QM2 86.34 30 FreeSurfer* 3.06 30 MNAB2 7.74 30 KM-MRF-MAS 84
31 Robarts 86.15 31 Robarts 3.06 31 MNAB 7.75 31 SPM12_T1_IR* 89
32 SPM12_T1_F* 86.03 32 drai 3.23 32 S2_QM2 7.91 32 FreeSurfer* 89
33 FSL-Seg* 85.98 33 S2_QM2 3.29 33 VIBOT10 M-T1+F 8.01 33 drai 95
34 SPM12_T1* 85.58 34 Narsil 3.31 34 SPM12_T1_IR_F* 8.40 34 S2_QM2 95
35 FreeSurfer* 85.25 35 SPM12_T1_IR* 3.60 35 UofL BioImaging 8.74 35 LUH-TNT 96
36 CSIM-Lab 85.24 36 CSIM-Lab 3.65 36 KM-MRF-MAS 9.19 36 VIBOT10 M-T1+F 100
37 FSL-PVSeg* 84.84 37 FSL-Seg* 3.65 37 FSL-Seg* 11.47 37 mlmi2014ss 106
38 S2_QM 83.86 38 SPM12_T1_IR_F* 3.84 38 Jedi Mind Meld 13.66 38 FSL-Seg* 107
39 SPM12_T1_IR_F* 83.64 39 FSL-PVSeg* 3.85 39 ISTB UniBe 13.71 39 SPM12_T1_IR_F* 111
40 SPM12_T1_IR* 83.54 40 ISTB UniBe 3.98 40 mlmi2014ss 14.00 40 CSIM-Lab 115
41 ISTB UniBe 82.50 41 SJCE 4.29 41 LUH-TNT 14.20 41 ISTB UniBe 120
42 mlmi2014ss 81.98 42 Jedi Mind Meld 4.52 42 LNMBrains 15.34 42 FSL-PVSeg* 120
43 drai 80.75 43 S2_QM 4.94 43 CSIM-Lab 17.39 43 Jedi Mind Meld 124
44 Jedi Mind Meld 80.64 44 VIBOT10 M-T1+F 6.63 44 FSL-PVSeg* 19.69 44 S2_QM 126
45 LNMBrains 78.32 45 LNMBrains 6.77 45 S2_QM 24.79 45 LNMBrains 132
46 ECOESH 75.82 46 ECOESH 38.46 46 ECOESH 25.27 46 ECOESH 138

Cerebrospinal Fluid Segmentation Results

Rank DC Rank HD Rank AVD CSF Score
1 CU_DL2 84.25 1 IDSIA 2.14 1 STH 6.73 1 IDSIA 10
2 MDGRU 84.13 2 MDGRU 2.17 2 MSL-SKKU 6.77 2 MDGRU 13
3 CU_DL 83.96 3 CU_DL2 2.19 3 VBM12 6.80 3 CU_DL2 15
4 MSL-SKKU 83.76 4 FBI/LMB Freiburg 2.22 4 IDSIA 7.09 4 MSL-SKKU 16
5 IDSIA 83.72 5 MNAB2 2.27 5 PyraMiD-LSTM2 7.17 5 STH 19
6 FBI/LMB Freiburg 83.47 6 LRDE 2.28 6 vicorob UdG T1 7.17 6 PyraMiD-LSTM2 20
7 PyraMiD-LSTM2 83.05 7 CU_DL 2.28 7 vicorob UdG T1_F 7.21 7 CU_DL 20
8 UNC-IDEA 82.81 8 PyraMiD-LSTM2 2.30 8 LIVIA_ETS 7.29 8 FBI/LMB Freiburg 23
9 STH 82.77 9 STH 2.31 9 MDGRU 7.44 9 MNAB2 30
10 LRDE 82.44 10 MSL-SKKU 2.32 10 CU_DL 7.44 10 LRDE 31
11 MNAB2 82.30 11 UNC-IDEA 2.35 11 CU_DL2 7.69 11 LIVIA_ETS 33
12 KSOM GHMF 82.10 12 LIVIA_ETS 2.37 12 drai 8.14 12 vicorob UdG T1 39
13 LIVIA_ETS 82.06 13 ISI-Neonatology 2.65 13 FBI/LMB Freiburg 8.63 13 UNC-IDEA 40
14 ISI-Neonatology 81.08 14 Robarts 2.66 14 MNAB2 8.73 14 vicorob UdG T1_F 42
15 Robarts 80.28 15 UofL BioImaging 2.66 15 LRDE 9.03 15 ISI-Neonatology 45
16 vicorob UdG T1 80.18 16 KSOM GHMF 2.71 16 S2_QM2 9.36 16 UofL BioImaging 51
17 vicorob UdG T1_F 80.17 17 vicorob UdG T1 2.81 17 UofL BioImaging 9.68 17 VBM12 52
18 VIBOT10 M-T1+F 79.73 18 vicorob UdG T1_F 2.81 18 ISI-Neonatology 9.77 18 KSOM GHMF 54
19 UofL BioImaging 78.86 19 VIBOT10 M-T1+F 2.98 19 SPM12_T1_F* 10.07 19 S2_QM2 62
20 CMIV 78.57 20 CMIV 3.00 20 SPM12_T1_IR* 10.47 20 Robarts 67
21 BIGR2 78.31 21 VBM12 3.03 21 UNC-IDEA 10.52 21 CMIV 69
22 SPM12_T1_IR* 78.25 22 S2_QM2 3.05 22 FSL-PVSeg* 10.69 22 drai 69
23 bigr_neuro 78.16 23 KM-MRF-MAS 3.08 23 KM-MRF-MAS 10.95 23 VIBOT10 M-T1+F 69
24 S2_QM2 77.97 24 bigr_neuro 3.15 24 FSL-Seg* 11.83 24 KM-MRF-MAS 71
25 KM-MRF-MAS 76.97 25 drai 3.17 25 SPM12_T1_IR_F* 12.21 25 SPM12_T1_IR* 75
26 SPM12_T1_IR_F* 76.87 26 BIGR2 3.19 26 KSOM GHMF 12.78 26 bigr_neuro 80
27 UB VPML Med 74.82 27 CVSS 3.25 27 CSIM-Lab 13.31 27 SPM12_T1_IR_F* 86
28 VBM12 74.56 28 FSL-Seg* 3.41 28 Narsil 13.54 28 SPM12_T1_F* 86
29 SPM12_T1_F* 74.03 29 FSL-PVSeg* 3.44 29 CMIV 14.31 29 FSL-PVSeg* 87
30 Jedi Mind Meld 73.33 30 Jedi Mind Meld 3.67 30 S2_QM 14.45 30 FSL-Seg* 87
31 CVSS 72.59 31 mlmi2014ss 3.77 31 SJCE 14.99 31 BIGR2 87
32 drai 70.95 32 S2_QM 3.79 32 VIBOT10 M-T1+F 16.06 32 CVSS 93
33 SPM12_T1* 70.69 33 SPM12_T1_IR* 4.01 33 bigr_neuro 16.47 33 Jedi Mind Meld 94
34 mlmi2014ss 70.59 34 LUH-TNT 4.07 34 Jedi Mind Meld 17.60 34 S2_QM 101
35 FSL-Seg* 69.95 35 SPM12_T1_IR_F* 4.15 35 CVSS 17.94 35 UB VPML Med 107
36 FSL-PVSeg* 69.49 36 FreeSurfer* 4.31 36 LNMBrains 19.87 36 mlmi2014ss 109
37 LNMBrains 68.80 37 UB VPML Med 4.31 37 ISTB UniBe 19.89 37 SJCE 110
38 MNAB 68.08 38 SPM12_T1_F* 4.59 38 Robarts 20.36 38 CSIM-Lab 113
39 S2_QM 67.87 39 SJCE 4.78 39 LUH-TNT 20.40 39 Narsil 114
40 SJCE 67.67 40 MNAB 4.88 40 BIGR2 22.76 40 LUH-TNT 115
41 Narsil 66.57 41 SPM12_T1* 5.34 41 SPM12_T1* 23.24 41 SPM12_T1* 115
42 LUH-TNT 66.47 42 CSIM-Lab 5.44 42 MNAB 28.56 42 LNMBrains 117
43 FreeSurfer* 65.79 43 ISTB UniBe 6.94 43 UB VPML Med 31.19 43 MNAB 120
44 CSIM-Lab 59.82 44 LNMBrains 7.66 44 mlmi2014ss 33.45 44 FreeSurfer* 125
45 ISTB UniBe 54.69 45 Narsil 13.30 45 ECOESH 36.59 45 ISTB UniBe 125
46 ECOESH 51.48 46 ECOESH 18.75 46 FreeSurfer* 50.27 46 ECOESH 137

Brain (GM and WM segmentations combined) Results

Rank DC Rank HD Rank AVD Brain Score
1 CU_DL2 95.74 1 LRDE 2.07 1 UB VPML Med 2.35 1 LRDE 9
2 CU_DL 95.70 2 ISI-Neonatology 2.18 2 STH 2.51 2 ISI-Neonatology 17
3 MSL-SKKU 95.67 3 CU_DL 2.19 3 CMIV 2.58 3 MSL-SKKU 17
4 LRDE 95.65 4 LIVIA_ETS 2.22 4 LRDE 2.62 4 CU_DL 17
5 ISI-Neonatology 95.65 5 CU_DL2 2.24 5 PyraMiD-LSTM2 2.73 5 STH 20
6 MDGRU 95.59 6 IDSIA 2.27 6 MSL-SKKU 2.73 6 CU_DL2 20
7 FBI/LMB Freiburg 95.40 7 MDGRU 2.29 7 VBM12 2.77 7 MDGRU 22
8 STH 95.37 8 MSL-SKKU 2.29 8 S2_QM2 2.78 8 LIVIA_ETS 24
9 LIVIA_ETS 95.36 9 FBI/LMB Freiburg 2.33 9 MDGRU 2.79 9 PyraMiD-LSTM2 28
10 PyraMiD-LSTM2 95.30 10 STH 2.38 10 ISI-Neonatology 2.80 10 IDSIA 35
11 IDSIA 95.29 11 MNAB2 2.41 11 LIVIA_ETS 2.85 11 FBI/LMB Freiburg 38
12 MNAB2 95.16 12 UofL BioImaging 2.41 12 CU_DL 2.89 12 UB VPML Med 40
13 KSOM GHMF 95.13 13 PyraMiD-LSTM2 2.45 13 Narsil 2.91 13 S2_QM2 40
14 BIGR2 95.13 14 UNC-IDEA 2.48 14 CU_DL2 2.94 14 MNAB2 44
15 UNC-IDEA 95.05 15 S2_QM2 2.73 15 FSL-Seg* 2.95 15 Narsil 53
16 UofL BioImaging 94.93 16 BIGR2 2.74 16 vicorob UdG T1 2.97 16 KSOM GHMF 54
17 S2_QM2 94.90 17 KM-MRF-MAS 2.76 17 vicorob UdG T1_F 2.98 17 VBM12 54
18 VIBOT10 M-T1+F 94.89 18 Robarts 2.78 18 IDSIA 3.10 18 BIGR2 54
19 Narsil 94.78 19 UB VPML Med 2.80 19 KSOM GHMF 3.15 19 CMIV 55
20 UB VPML Med 94.59 20 CVSS 2.84 20 drai 3.20 20 UofL BioImaging 59
21 VBM12 94.50 21 Narsil 2.86 21 MNAB2 3.21 21 UNC-IDEA 62
22 CMIV 94.48 22 KSOM GHMF 2.86 22 FBI/LMB Freiburg 3.22 22 vicorob UdG T1_F 69
23 MNAB 94.47 23 LUH-TNT 2.90 23 SPM12_T1* 3.23 23 vicorob UdG T1 70
24 vicorob UdG T1_F 94.27 24 drai 3.05 24 BIGR2 3.24 24 LUH-TNT 81
25 vicorob UdG T1 94.25 25 mlmi2014ss 3.23 25 SPM12_T1_IR* 3.38 25 CVSS 82
26 LUH-TNT 94.17 26 VBM12 3.36 26 Jedi Mind Meld 3.46 26 drai 85
27 CVSS 94.08 27 FreeSurfer* 3.55 27 FSL-PVSeg* 3.46 27 KM-MRF-MAS 85
28 bigr_neuro 93.99 28 vicorob UdG T1_F 3.73 28 bigr_neuro 3.57 28 MNAB 86
29 KM-MRF-MAS 93.97 29 vicorob UdG T1 3.74 29 MNAB 3.76 29 SPM12_T1* 87
30 SPM12_T1_IR* 93.93 30 CMIV 3.82 30 SJCE 3.79 30 VIBOT10 M-T1+F 89
31 SPM12_T1_F* 93.87 31 ISTB UniBe 4.39 31 UofL BioImaging 3.88 31 FSL-Seg* 90
32 SPM12_T1* 93.85 32 SPM12_T1* 4.45 32 LUH-TNT 4.11 32 bigr_neuro 91
33 FSL-PVSeg* 93.59 33 SJCE 4.52 33 UNC-IDEA 4.21 33 SPM12_T1_IR* 91
34 SPM12_T1_IR_F* 93.59 34 MNAB 4.54 34 VIBOT10 M-T1+F 4.84 34 SJCE 98
35 SJCE 93.48 35 bigr_neuro 4.57 35 CVSS 4.91 35 Robarts 99
36 FSL-Seg* 93.30 36 SPM12_T1_IR* 4.63 36 SPM12_T1_IR_F* 5.11 36 FSL-PVSeg* 102
37 S2_QM 93.27 37 VIBOT10 M-T1+F 4.91 37 SPM12_T1_F* 5.33 37 Jedi Mind Meld 102
38 Jedi Mind Meld 93.24 38 Jedi Mind Meld 5.44 38 S2_QM 5.48 38 FreeSurfer* 107
39 Robarts 93.13 39 FSL-Seg* 5.53 39 KM-MRF-MAS 5.58 39 SPM12_T1_F* 108
40 FreeSurfer* 92.32 40 SPM12_T1_F* 5.85 40 FreeSurfer* 6.27 40 SPM12_T1_IR_F* 111
41 drai 91.97 41 SPM12_T1_IR_F* 5.91 41 LNMBrains 7.37 41 mlmi2014ss 111
42 CSIM-Lab 91.20 42 FSL-PVSeg* 6.09 42 Robarts 7.88 42 S2_QM 118
43 mlmi2014ss 90.75 43 S2_QM 6.98 43 mlmi2014ss 12.05 43 ISTB UniBe 121
44 LNMBrains 88.51 44 LNMBrains 8.56 44 CSIM-Lab 15.76 44 LNMBrains 129
45 ISTB UniBe 87.80 45 CSIM-Lab 11.24 45 ISTB UniBe 17.26 45 CSIM-Lab 131
46 ECOESH 78.24 46 ECOESH 35.99 46 ECOESH 32.06 46 ECOESH 138

Intracranial cavity (GM, WM, and CSF segmentations combined) Results

Rank DC Rank HD Rank AVD ICV Score
1 IDSIA 98.15 1 MDGRU 2.37 1 UNC-IDEA 0.68 1 MDGRU 7
2 MDGRU 98.15 2 IDSIA 2.44 2 PyraMiD-LSTM2 0.69 2 IDSIA 9
3 CU_DL2 98.10 3 FBI/LMB Freiburg 2.51 3 STH 0.69 3 PyraMiD-LSTM2 13
4 PyraMiD-LSTM2 98.04 4 Robarts 2.55 4 MDGRU 0.86 4 UNC-IDEA 15
5 CU_DL 97.99 5 UNC-IDEA 2.72 5 Robarts 0.91 5 Robarts 17
6 FBI/LMB Freiburg 97.99 6 CU_DL2 2.75 6 IDSIA 0.95 6 FBI/LMB Freiburg 17
7 MSL-SKKU 97.96 7 PyraMiD-LSTM2 2.86 7 SPM12_T1_IR* 0.99 7 CU_DL2 22
8 Robarts 97.92 8 LRDE 2.87 8 FBI/LMB Freiburg 1.06 8 STH 23
9 UNC-IDEA 97.92 9 STH 2.92 9 SPM12_T1_IR_F* 1.17 9 MSL-SKKU 35
10 SPM12_T1_IR* 97.73 10 MNAB2 2.95 10 LRDE 1.44 10 CU_DL 37
11 STH 97.72 11 CU_DL 3.17 11 SPM12_T1_F* 1.46 11 LRDE 37
12 SPM12_T1_IR_F* 97.71 12 KSOM GHMF 3.23 12 MSL-SKKU 1.46 12 MNAB2 42
13 MNAB2 97.66 13 UofL BioImaging 3.43 13 CU_DL2 1.54 13 vicorob UdG T1 46
14 vicorob UdG T1 97.65 14 LIVIA_ETS 3.45 14 vicorob UdG T1 1.62 14 LIVIA_ETS 48
15 vicorob UdG T1_F 97.64 15 S2_QM2 3.72 15 VIBOT10 M-T1+F 1.64 15 SPM12_T1_IR* 48
16 VIBOT10 M-T1+F 97.63 16 MSL-SKKU 3.75 16 vicorob UdG T1_F 1.65 16 vicorob UdG T1_F 51
17 LIVIA_ETS 97.58 17 CMIV 3.76 17 LIVIA_ETS 1.69 17 VIBOT10 M-T1+F 52
18 KSOM GHMF 97.56 18 vicorob UdG T1 3.85 18 ISI-Neonatology 1.74 18 KSOM GHMF 53
19 LRDE 97.53 19 drai 3.89 19 MNAB2 1.77 19 UofL BioImaging 55
20 ISI-Neonatology 96.92 20 vicorob UdG T1_F 3.90 20 UofL BioImaging 1.81 20 SPM12_T1_IR_F* 61
21 CMIV 96.79 21 VIBOT10 M-T1+F 3.91 21 CU_DL 1.83 21 ISI-Neonatology 62
22 UofL BioImaging 96.71 22 BIGR2 3.93 22 drai 1.85 22 S2_QM2 64
23 SPM12_T1_F* 96.59 23 bigr_neuro 3.93 23 KSOM GHMF 1.95 23 drai 69
24 S2_QM2 96.44 24 ISI-Neonatology 4.29 24 VBM12 2.37 24 CMIV 72
25 bigr_neuro 96.33 25 CVSS 4.87 25 S2_QM2 2.38 25 SPM12_T1_F* 73
26 KM-MRF-MAS 96.10 26 VBM12 4.89 26 CVSS 2.55 26 bigr_neuro 78
27 BIGR2 96.00 27 KM-MRF-MAS 5.08 27 KM-MRF-MAS 2.99 27 VBM12 79
28 drai 95.99 28 FSL-PVSeg* 5.29 28 FSL-Seg* 3.37 28 KM-MRF-MAS 80
29 VBM12 95.95 29 FSL-Seg* 5.29 29 FSL-PVSeg* 3.37 29 CVSS 84
30 mlmi2014ss 95.84 30 S2_QM 6.49 30 bigr_neuro 3.46 30 BIGR2 84
31 SPM12_T1* 95.28 31 SPM12_T1_IR* 6.51 31 mlmi2014ss 3.60 31 FSL-PVSeg* 92
32 UB VPML Med 94.83 32 FreeSurfer* 6.62 32 Narsil 3.69 32 FSL-Seg* 93
33 CVSS 94.62 33 UB VPML Med 6.63 33 S2_QM 4.01 33 S2_QM 100
34 Jedi Mind Meld 94.26 34 LUH-TNT 6.85 34 CMIV 4.87 34 mlmi2014ss 102
35 FSL-PVSeg* 94.24 35 MNAB 7.06 35 BIGR2 5.18 35 UB VPML Med 104
36 FSL-Seg* 94.24 36 SJCE 7.31 36 SPM12_T1* 5.53 36 SPM12_T1* 105
37 S2_QM 93.71 37 CSIM-Lab 8.09 37 SJCE 6.77 37 SJCE 111
38 SJCE 93.66 38 SPM12_T1* 8.09 38 Jedi Mind Meld 6.82 38 LUH-TNT 114
39 LUH-TNT 93.18 39 SPM12_T1_F* 8.21 39 UB VPML Med 7.67 39 Jedi Mind Meld 115
40 MNAB 92.52 40 SPM12_T1_IR_F* 8.23 40 LNMBrains 7.88 40 MNAB 117
41 Narsil 92.49 41 mlmi2014ss 8.69 41 LUH-TNT 9.14 41 FreeSurfer* 118
42 FreeSurfer* 92.39 42 ISTB UniBe 9.84 42 MNAB 9.71 42 Narsil 119
43 CSIM-Lab 92.34 43 Jedi Mind Meld 20.34 43 CSIM-Lab 10.06 43 CSIM-Lab 123
44 LNMBrains 89.17 44 LNMBrains 20.36 44 FreeSurfer* 10.19 44 LNMBrains 128
45 ISTB UniBe 88.53 45 ECOESH 21.43 45 ISTB UniBe 17.52 45 ISTB UniBe 132
46 ECOESH 78.14 46 Narsil 23.65 46 ECOESH 30.13 46 ECOESH 137

DC = Dice Coefficient, HD = 95th percentile of Hausdorff Distance, AVD = Absolute Volume Difference
Score = Rank DC + Rank HD + Rank AVD





© 2013 Image Sciences Institute.