Home    Details    Workshop    Register    Download    Submit    Results    Organizers 

Results

When teams submit their segmentation results, the evaluation results will be sent to the team contact person by e-mail and will be listed below.

Rank Team name Submission name Date Sum Scores Sequences used Speed Doc
1XMU_SmartDSP2 3D Spatial Weighted U-Net for Multi-modality Brain MRI Segmentation 29‑08‑18 32 T1; T1_IR; FLAIR ~10 min doc
2TailHot Multi-modality aggregation network3 13‑04‑18 57 T1; T1_IR; FLAIR ~13 sec doc
3WTA2 3D Cascade convolutional architecture - Method 22 23‑05‑18 68 T1; T1_IR; FLAIR ~2 min doc
4XMU SmartDSP 3D CNN with a Cross-modality Channel Attention Scheme3 17‑08‑18 77 T1; T1_IR; FLAIR ~10 min doc
5XLab 3D Fully CNN with Multi-Modality Feature Fusion3 10‑08‑18 86 T1; T1_IR; FLAIR ~2 min doc
6LIVIA_ETS HyperDenseNet2 06‑02‑18 91 T1; T1_IR; FLAIR ~4 min doc
7CU_DL2 3D Deep Learning; voxnet2 28‑06‑16 102 T1; T1_IR; FLAIR ~2 min doc
8CU_DL 3D Deep Learning; voxnet13 16‑06‑16 109 T1; T1_IR; FLAIR ~2 min doc
9LRDE Fully Convolutional Network 20‑12‑16 117 T1 ~2 sec doc
10MSL-SKKU Deep Convolutional Neural Network 19‑06‑17 121 T1; T1-IR; FLAIR ~1.5 min doc
11MDGRU Multi-Dimensional Gated Recurrent Units3 27‑07‑16 147 T1; T1_IR; FLAIR ~2 min doc
12FBI/LMB Freiburg U-Net (3D) 01‑05‑16 150 T1-1mm; T1-IR; FLAIR ~2 min doc
13ASTRI_DL U-Net inspired CNN model with 3D context information2 25‑07‑18 151 T1; T1_IR; FLAIR ~7 min doc
14THUity Modified U-Net3 15‑08‑18 155 T1 ~40 sec doc
15PyraMiD-LSTM2 NOCC with rounds3 23‑05‑16 156 T1; T1-IR; FLAIR ~2 min doc
16NIST Fully CNN for Multi-Modality Brain Tissue Segmentation 14‑08‑18 160 T1; T1_IR; FLAIR ~2 min doc
17AOC Atlas of Classifiers 24‑12‑17 178 T1 ~6 sec doc
18IDSIA PyraMiD-LSTM 05‑06‑15 180 T1; T1_IR; FLAIR ~2 min doc
19STH Hybrid ANN-based Auto-context method2 03‑06‑16 196 T1; T1-IR; FLAIR ~ 5 min doc
20nanand2 DeepLab-v3+ with pre-training on FreeSurfer automated labels3 16‑08‑18 199 T1 ~15 sec doc
21ISI-Neonatology Multi-stage voxel classification 31‑05‑14 201 T1 ~1.5 hours doc
22UNC-IDEA LINKS:Learning-based multi-source integration 09‑02‑15 203 T1; T1_IR; FLAIR ~3 min doc
23ASTRI_MSA Revised VoxResNet 27‑08‑18 225 T1; T1_IR; FLAIR ~1 min doc
24LfB Multi-modality Mix Network 17‑01‑19 228 T1; T1_IR; FLAIR ~40 sec doc
25BCH_CRL_IMAGINE 3D patch-wise DenseNet and Patch Fusion2 24‑05‑18 234 T1; T1-IR; FLAIR ~2 min doc
26KSOM GHMF ASeTs: MAP-Based with Manifold learning 13‑05‑14 239 T1; T1_IR; FLAIR ~23 min doc
27MNAB2 Random Forests 21‑02‑14 239 T1; T1_IR; FLAIR ~25 min doc
28WTA 3D Cascade convolutional architecture - Method 13 15‑05‑18 251 T1; T1_IR; FLAIR ~5 min doc
29vicorob UdG T1_F MSSEG using T1 + FLAIR (T1-IR skull) 14‑01‑16 261 T1; IR; FLAIR ~2 min doc
30VBM12 VBM12_r738 with WMHC=2 07‑10‑15 263 T1 ~6 min doc
31BIGR2 Multi-Feature SVM Classification 26‑09‑13 268 T1; T1_IR; FLAIR ~35 min doc
32vicorob UdG T1 MSSEG using only T1 (T1-IR skull) 21‑01‑16 280 T1; IR ~2 min doc
33UofL BioImaging MAP-Based Framework 26‑09‑13 300 T1 ~6 sec doc
34CMIV Model-guided Level Sets and Skeletons 26‑09‑13 319 T1; FLAIR ~3 min doc
35UB VPML Med Multi-Atlas with Multiway Cut 26‑09‑13 323 T1; T1_IR; FLAIR ~30 min doc
36Narsil Segmentation using Ensemble Trees 26‑09‑13 326 T1; FLAIR < 2 min doc
37drai VGG based Fully Convolutional Neural Network 20‑01‑17 337 T1 ~2 sec doc
38VIBOT10 M-T1+F Convolutional Neural Network 27‑02‑17 340 T1; FLAIR ~3 min doc
39CVSS Multi-atlas segmentation based on supervoxels 14‑02‑17 342 T1; T1_IR; FLAIR ~2 min doc
40bigr_neuro Automatically Trained kNN Classifier 26‑09‑13 344 T1; FLAIR ~2 hours doc
41S2_QM2 Atlas-based segmentation and AdaBoost 28‑07‑14 348 T1; T1-IR; FLAIR ~45 min doc
42SPM12_T1_F* SPM12 with T1 and FLAIR sequence 31‑08‑15 356 T1; FLAIR ~3 min doc
43KM-MRF-MAS MAP on Intensity, and Local and Multi-atlas Priors 28‑10‑16 356 T1 ~10 min doc
44Robarts Multi-Atlas with Hierarchical Max-Flow 26‑09‑13 357 T1-1mm; T1-IR ~16 min doc
45CSIM-lab_Mqe-MMRF Hybrid Modified Entropy-Based Segmentation with Modified MRF 25‑06‑18 368 T1 ~6 min doc
46SJCE Fuzzy Clustering 12‑04‑17 369 T1 <1 min doc
47SPM12_T1_IR* SPM12 with T1 and IR sequence 31‑08‑15 375 T1; IR ~3 min doc
48SPM12_T1* SPM12 with T1 sequence 31‑08‑15 390 T1 ~3 min doc
49MNAB Random Decision Forests 26‑09‑13 397 T1; T1-IR; FLAIR ~15 min doc
50SPM12_T1_IR_F* SPM12 with T1; IR and FLAIR sequence 31‑08‑15 430 T1; IR; FLAIR ~4 min doc
51FSL-Seg* FSL (v5.0) seg file 31‑08‑15 434 T1 ~10 min doc
52LUH-TNT Level-sets with dictionary learning 27‑10‑14 443 T1 < 1 min doc
53FreeSurfer* FreeSurfer (v5.3.0) 31‑08‑15 444 T1-1mm ~1 hour doc
54FSL-PVSeg* FSL (v5.0) PVSeg file 31‑08‑15 446 T1 ~10 min doc
55Jedi Mind Meld Automated Walks using Machine Learning 26‑09‑13 459 T1; T1-IR; FLAIR ~27 sec doc
56mlmi2014ss AdaBoostM2 28‑07‑14 465 T1; T1-IR; FLAIR ~5 min doc
57S2_QM Bayesian-based Adaptive Mean-Shift 26‑09‑13 477 T1; T1-IR; FLAIR ~1.5 hours doc
58CSIM-Lab Multiple Logistic Classification 24‑10‑17 490 T1 doc
59ISTB UniBe Decision Forests with spatial regularization 04‑06‑14 506 T1; T1-IR; FLAIR ~3 min doc
60LNMBrains Gaussian Intensity Model 26‑09‑13 506 T1; T1-IR; FLAIR ~5 min doc
61ECOESH Modified Expectation Maximization 06‑01‑14 548 T1 ~5 min doc
*These methods (SPM, FSL and FreeSurfer) were applied by the MRBrainS organizers as described in the MRBrainS journal paper.
2,3At the end of the submission name indicates that this is the 2nd or 3rd submission (max 3 resubmissions allowed).

Note: As described below, when teams have equal scores, the standard deviations of the three tissue types and the three evaluation measures over all patients are taken into account.

How is the ranking determined?

Ranking is based on the evaluation results of all 15 test datasets and determined as follows: For each evaluation measure (Dice Coefficient (DC), Modified Hausdorff Distance (HD) and Absolute Volume Difference(AVD)), the mean value over all 15 datasets is determined for white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF). Each team receives a rank (1=best) for each tissue type (GM, WM, CSF) and each evaluation measure (DC, HD-95, AVD) based on the mean value of the evaluation measures over all 15 datasets. The final score is determined by adding the ranks of all tissue types and evaluation measures for each team. The team with the lowest score is ranked number 1. In case two teams would have an equal score, the team with the lowest standard deviation over the tissue types will be ranked first.

Per tissue rankings and per measure rankings are presented below.

Overall Segmentation Results

GM Score WM Score CSF Score Rank Sum
1 XMU_SmartDSP2 13 1 XMU_SmartDSP2 5 1 XMU SmartDSP 4 1 XMU_SmartDSP2 32
2 TailHot 16 2 WTA2 8 2 TailHot 11 2 TailHot 57
3 WTA2 22 3 LIVIA_ETS 24 3 XMU_SmartDSP2 14 3 WTA2 68
4 XLab 24 4 LRDE 24 4 XLab 14 4 XMU SmartDSP 77
5 LIVIA_ETS 28 5 CU_DL 28 5 NIST 20 5 XLab 86
6 XMU SmartDSP 31 6 TailHot 30 6 IDSIA 28 6 LIVIA_ETS 91
7 LRDE 34 7 CU_DL2 31 7 MDGRU 31 7 CU_DL2 102
8 THUity 34 8 ASTRI_DL 37 8 CU_DL2 31 8 CU_DL 109
9 CU_DL2 40 9 MSL-SKKU 39 9 MSL-SKKU 35 9 LRDE 117
10 CU_DL 41 10 THUity 40 10 STH 37 10 MSL-SKKU 121
11 MDGRU 47 11 XMU SmartDSP 42 11 WTA2 38 11 MDGRU 147
12 MSL-SKKU 47 12 XLab 48 12 LIVIA_ETS 39 12 FBI/LMB Freiburg 150
13 nanand2 51 13 FBI/LMB Freiburg 49 13 CU_DL 40 13 ASTRI_DL 151
14 WTA 55 14 WTA 50 14 PyraMiD-LSTM2 42 14 THUity 155
15 FBI/LMB Freiburg 56 15 PyraMiD-LSTM2 51 15 FBI/LMB Freiburg 45 15 PyraMiD-LSTM2 156
16 ISI-Neonatology 60 16 AOC 51 16 ASTRI_DL 51 16 NIST 160
17 PyraMiD-LSTM2 63 17 UNC-IDEA 54 17 MNAB2 58 17 AOC 178
18 ASTRI_DL 63 18 NIST 62 18 AOC 59 18 IDSIA 180
19 STH 64 19 ISI-Neonatology 64 19 LRDE 59 19 STH 196
20 KSOM GHMF 65 20 ASTRI_MSA 66 20 nanand2 63 20 nanand2 199
21 AOC 68 21 LfB 67 21 BCH_CRL_IMAGINE 66 21 ISI-Neonatology 201
22 BCH_CRL_IMAGINE 69 22 MDGRU 69 22 UNC-IDEA 67 22 UNC-IDEA 203
23 BIGR2 72 23 BIGR2 70 23 ASTRI_MSA 69 23 ASTRI_MSA 225
24 Narsil 74 24 IDSIA 77 24 vicorob UdG T1 71 24 LfB 228
25 IDSIA 75 25 VBM12 77 25 vicorob UdG T1_F 72 25 BCH_CRL_IMAGINE 234
26 NIST 78 26 nanand2 85 26 LfB 75 26 KSOM GHMF 239
27 UNC-IDEA 82 27 vicorob UdG T1_F 85 27 ISI-Neonatology 77 27 MNAB2 239
28 UB VPML Med 82 28 KSOM GHMF 88 28 THUity 81 28 WTA 251
29 LfB 86 29 SPM12_T1_F* 90 29 VBM12 83 29 vicorob UdG T1_F 261
30 MNAB2 87 30 UB VPML Med 91 30 UofL BioImaging 85 30 VBM12 263
31 ASTRI_MSA 90 31 MNAB2 94 31 KSOM GHMF 86 31 BIGR2 268
32 VIBOT10 M-T1+F 90 32 Narsil 95 32 S2_QM2 98 32 vicorob UdG T1 280
33 SJCE 98 33 STH 95 33 Robarts 103 33 UofL BioImaging 300
34 drai 99 34 vicorob UdG T1 97 34 drai 105 34 CMIV 319
35 VBM12 103 35 BCH_CRL_IMAGINE 99 35 CMIV 106 35 UB VPML Med 323
36 CSIM-lab_Mqe-MMRF 103 36 CVSS 103 36 VIBOT10 M-T1+F 107 36 Narsil 326
37 vicorob UdG T1_F 104 37 CMIV 105 37 KM-MRF-MAS 110 37 drai 337
38 UofL BioImaging 105 38 SPM12_T1* 105 38 SPM12_T1_IR* 113 38 VIBOT10 M-T1+F 340
39 CVSS 106 39 MNAB 110 39 bigr_neuro 119 39 CVSS 342
40 bigr_neuro 107 40 UofL BioImaging 110 40 FSL-PVSeg* 126 40 bigr_neuro 344
41 CMIV 108 41 bigr_neuro 118 41 SPM12_T1_IR_F* 126 41 S2_QM2 348
42 vicorob UdG T1 112 42 SJCE 118 42 BIGR2 126 42 SPM12_T1_F* 356
43 S2_QM2 113 43 CSIM-lab_Mqe-MMRF 118 43 FSL-Seg* 127 43 KM-MRF-MAS 356
44 KM-MRF-MAS 119 44 Robarts 123 44 SPM12_T1_F* 127 44 Robarts 357
45 MNAB 123 45 SPM12_T1_IR* 125 45 CVSS 133 45 CSIM-lab_Mqe-MMRF 368
46 SPM12_T1* 127 46 KM-MRF-MAS 127 46 Jedi Mind Meld 135 46 SJCE 369
47 Robarts 131 47 FreeSurfer* 130 47 S2_QM 142 47 SPM12_T1_IR* 375
48 SPM12_T1_IR* 137 48 drai 133 48 WTA 146 48 SPM12_T1* 390
49 SPM12_T1_F* 139 49 S2_QM2 137 49 CSIM-lab_Mqe-MMRF 147 49 MNAB 397
50 FreeSurfer* 145 50 LUH-TNT 140 50 UB VPML Med 150 50 SPM12_T1_IR_F* 430
51 LUH-TNT 146 51 VIBOT10 M-T1+F 143 51 mlmi2014ss 151 51 FSL-Seg* 434
52 SPM12_T1_IR_F* 149 52 mlmi2014ss 150 52 SJCE 153 52 LUH-TNT 443
53 FSL-PVSeg* 155 53 FSL-Seg* 151 53 CSIM-Lab 156 53 FreeSurfer* 444
54 Jedi Mind Meld 155 54 SPM12_T1_IR_F* 155 54 Narsil 157 54 FSL-PVSeg* 446
55 FSL-Seg* 156 55 CSIM-Lab 160 55 LUH-TNT 157 55 Jedi Mind Meld 459
56 S2_QM 164 56 ISTB UniBe 165 56 SPM12_T1* 158 56 mlmi2014ss 465
57 mlmi2014ss 164 57 FSL-PVSeg* 165 57 LNMBrains 160 57 S2_QM 477
58 LNMBrains 169 58 Jedi Mind Meld 169 58 MNAB 164 58 CSIM-Lab 490
59 ISTB UniBe 172 59 S2_QM 171 59 FreeSurfer* 169 59 ISTB UniBe 506
60 CSIM-Lab 174 60 LNMBrains 177 60 ISTB UniBe 169 60 LNMBrains 506
61 ECOESH 183 61 ECOESH 183 61 ECOESH 182 61 ECOESH 548

GM = Gray matter, WM = White matter, CSF = Cerebrospinal fluid
Sum = Score GM + Score WM + Score CSF
Score = Rank DC + Rank HD + Rank AVD

Gray Matter Segmentation Results

Rank DC Rank HD Rank AVD GM Score
1 XMU_SmartDSP2 86.58 1 XMU_SmartDSP2 1.29 1 CSIM-lab_Mqe-MMRF 4.87 1 XMU_SmartDSP2 13
2 TailHot 86.40 2 LIVIA_ETS 1.34 2 SJCE 5.14 2 TailHot 16
3 LIVIA_ETS 86.33 3 XMU SmartDSP 1.35 3 THUity 5.24 3 WTA2 22
4 XMU SmartDSP 86.25 4 TailHot 1.38 4 drai 5.29 4 XLab 24
5 CU_DL2 86.15 5 CU_DL2 1.44 5 WTA2 5.43 5 LIVIA_ETS 28
6 CU_DL 86.12 6 LRDE 1.44 6 KSOM GHMF 5.44 6 XMU SmartDSP 31
7 XLab 86.09 7 WTA2 1.45 7 Narsil 5.52 7 LRDE 34
8 MSL-SKKU 86.06 8 XLab 1.45 8 BCH_CRL_IMAGINE 5.70 8 THUity 34
9 LRDE 86.03 9 CU_DL 1.47 9 XLab 5.71 9 CU_DL2 40
10 WTA2 86.00 10 nanand2 1.50 10 TailHot 5.72 10 CU_DL 41
11 ASTRI_DL 85.97 11 MSL-SKKU 1.52 11 XMU_SmartDSP2 5.75 11 MDGRU 47
12 ISI-Neonatology 85.77 12 MDGRU 1.54 12 nanand2 5.77 12 MSL-SKKU 47
13 WTA 85.70 13 FBI/LMB Freiburg 1.58 13 AOC 5.81 13 nanand2 51
14 FBI/LMB Freiburg 85.44 14 THUity 1.61 14 UB VPML Med 5.87 14 WTA 55
15 MDGRU 85.40 15 WTA 1.61 15 bigr_neuro 5.90 15 FBI/LMB Freiburg 56
16 NIST 85.26 16 UNC-IDEA 1.62 16 VBM12 5.91 16 ISI-Neonatology 60
17 THUity 85.24 17 ISI-Neonatology 1.62 17 vicorob UdG T1_F 5.98 17 PyraMiD-LSTM2 63
18 VIBOT10 M-T1+F 85.07 18 ASTRI_DL 1.63 18 STH 6.02 18 ASTRI_DL 63
19 PyraMiD-LSTM2 84.89 19 PyraMiD-LSTM2 1.67 19 LRDE 6.05 19 STH 64
20 IDSIA 84.82 20 LfB 1.69 20 MDGRU 6.09 20 KSOM GHMF 65
21 ASTRI_MSA 84.80 21 MNAB2 1.70 21 BIGR2 6.13 21 AOC 68
22 STH 84.77 22 IDSIA 1.70 22 vicorob UdG T1 6.15 22 BCH_CRL_IMAGINE 69
23 BIGR2 84.65 23 UofL BioImaging 1.70 23 LIVIA_ETS 6.19 23 BIGR2 72
24 AOC 84.59 24 STH 1.71 24 XMU SmartDSP 6.22 24 Narsil 74
25 LfB 84.56 25 ASTRI_MSA 1.82 25 PyraMiD-LSTM2 6.35 25 IDSIA 75
26 MNAB2 84.50 26 NIST 1.83 26 CU_DL 6.42 26 NIST 78
27 UNC-IDEA 84.36 27 VIBOT10 M-T1+F 1.87 27 WTA 6.56 27 UNC-IDEA 82
28 BCH_CRL_IMAGINE 84.27 28 BIGR2 1.89 28 MSL-SKKU 6.60 28 UB VPML Med 82
29 nanand2 84.21 29 KSOM GHMF 1.92 29 FBI/LMB Freiburg 6.60 29 LfB 86
30 KSOM GHMF 84.13 30 Robarts 1.95 30 CU_DL2 6.60 30 MNAB2 87
31 MNAB 83.86 31 AOC 1.97 31 ISI-Neonatology 6.62 31 ASTRI_MSA 90
32 Narsil 83.47 32 CVSS 1.98 32 CMIV 6.76 32 VIBOT10 M-T1+F 90
33 S2_QM2 83.35 33 BCH_CRL_IMAGINE 2.03 33 IDSIA 6.77 33 SJCE 98
34 UB VPML Med 83.31 34 UB VPML Med 2.09 34 ASTRI_DL 6.78 34 drai 99
35 UofL BioImaging 82.96 35 Narsil 2.27 35 KM-MRF-MAS 6.79 35 VBM12 103
36 CMIV 82.43 36 FreeSurfer* 2.31 36 NIST 6.82 36 CSIM-lab_Mqe-MMRF 103
37 CVSS 82.35 37 S2_QM2 2.36 37 CVSS 6.86 37 vicorob UdG T1_F 104
38 VBM12 82.29 38 drai 2.48 38 SPM12_T1* 6.95 38 UofL BioImaging 105
39 vicorob UdG T1_F 82.19 39 LUH-TNT 2.62 39 UNC-IDEA 7.04 39 CVSS 106
40 vicorob UdG T1 82.07 40 CMIV 2.69 40 MNAB2 7.10 40 bigr_neuro 107
41 bigr_neuro 81.46 41 KM-MRF-MAS 2.73 41 LfB 7.20 41 CMIV 108
42 SPM12_T1_F* 81.17 42 MNAB 2.79 42 SPM12_T1_IR* 7.23 42 vicorob UdG T1 112
43 KM-MRF-MAS 80.85 43 SPM12_T1_F* 2.90 43 S2_QM2 7.23 43 S2_QM2 113
44 SJCE 80.76 44 SPM12_T1* 2.93 44 ASTRI_MSA 7.25 44 KM-MRF-MAS 119
45 SPM12_T1* 80.34 45 mlmi2014ss 2.96 45 VIBOT10 M-T1+F 8.16 45 MNAB 123
46 SPM12_T1_IR_F* 80.15 46 SPM12_T1_IR* 3.01 46 FSL-PVSeg* 8.40 46 SPM12_T1* 127
47 CSIM-lab_Mqe-MMRF 80.09 47 SPM12_T1_IR_F* 3.03 47 UofL BioImaging 8.61 47 Robarts 131
48 Robarts 79.70 48 vicorob UdG T1_F 3.17 48 FSL-Seg* 8.65 48 SPM12_T1_IR* 137
49 SPM12_T1_IR* 79.41 49 VBM12 3.20 49 Jedi Mind Meld 8.94 49 SPM12_T1_F* 139
50 LUH-TNT 79.35 50 vicorob UdG T1 3.31 50 MNAB 9.11 50 FreeSurfer* 145
51 FSL-Seg* 78.66 51 bigr_neuro 3.67 51 S2_QM 9.28 51 LUH-TNT 146
52 Jedi Mind Meld 77.84 52 SJCE 3.71 52 LNMBrains 9.47 52 SPM12_T1_IR_F* 149
53 FSL-PVSeg* 77.66 53 ISTB UniBe 3.86 53 Robarts 9.77 53 FSL-PVSeg* 155
54 FreeSurfer* 77.41 54 Jedi Mind Meld 3.90 54 SPM12_T1_F* 10.59 54 Jedi Mind Meld 155
55 S2_QM 76.41 55 CSIM-lab_Mqe-MMRF 3.93 55 FreeSurfer* 12.15 55 FSL-Seg* 156
56 CSIM-Lab 75.65 56 FSL-PVSeg* 4.29 56 SPM12_T1_IR_F* 13.92 56 S2_QM 164
57 drai 74.53 57 FSL-Seg* 4.35 57 LUH-TNT 15.52 57 mlmi2014ss 164
58 LNMBrains 72.75 58 S2_QM 5.51 58 CSIM-Lab 18.07 58 LNMBrains 169
59 mlmi2014ss 71.70 59 LNMBrains 6.80 59 ISTB UniBe 19.11 59 ISTB UniBe 172
60 ISTB UniBe 68.62 60 CSIM-Lab 7.50 60 mlmi2014ss 24.56 60 CSIM-Lab 174
61 ECOESH 63.36 61 ECOESH 34.07 61 ECOESH 38.34 61 ECOESH 183

White Matter Segmentation Results

Rank DC Rank HD Rank AVD WM Score
1 XMU_SmartDSP2 89.87 1 XMU_SmartDSP2 1.73 1 WTA2 5.20 1 XMU_SmartDSP2 5
2 XLab 89.81 2 XMU SmartDSP 1.76 2 SPM12_T1_F* 5.21 2 WTA2 8
3 WTA2 89.74 3 LIVIA_ETS 1.78 3 XMU_SmartDSP2 5.47 3 LIVIA_ETS 24
4 TailHot 89.70 4 WTA2 1.82 4 THUity 5.52 4 LRDE 24
5 XMU SmartDSP 89.54 5 LRDE 1.86 5 MSL-SKKU 5.54 5 CU_DL 28
6 LIVIA_ETS 89.46 6 XLab 1.87 6 ASTRI_DL 5.67 6 TailHot 30
7 CU_DL2 89.46 7 TailHot 1.88 7 AOC 5.72 7 CU_DL2 31
8 WTA 89.40 8 CU_DL2 1.93 8 Narsil 5.78 8 ASTRI_DL 37
9 CU_DL 89.39 9 CU_DL 1.93 9 LRDE 5.83 9 MSL-SKKU 39
10 LRDE 89.29 10 FBI/LMB Freiburg 1.95 10 CU_DL 5.84 10 THUity 40
11 ASTRI_DL 89.24 11 nanand2 1.98 11 PyraMiD-LSTM2 5.93 11 XMU SmartDSP 42
12 THUity 89.00 12 WTA 2.00 12 vicorob UdG T1_F 5.94 12 XLab 48
13 MSL-SKKU 89.00 13 MDGRU 2.02 13 SPM12_T1* 5.99 13 FBI/LMB Freiburg 49
14 MDGRU 88.98 14 NIST 2.05 14 BIGR2 6.02 14 WTA 50
15 NIST 88.88 15 UNC-IDEA 2.06 15 LIVIA_ETS 6.03 15 PyraMiD-LSTM2 51
16 FBI/LMB Freiburg 88.86 16 ISI-Neonatology 2.07 16 CU_DL2 6.05 16 AOC 51
17 UNC-IDEA 88.68 17 PyraMiD-LSTM2 2.07 17 VBM12 6.06 17 UNC-IDEA 54
18 LfB 88.68 18 ASTRI_MSA 2.08 18 vicorob UdG T1 6.21 18 NIST 62
19 AOC 88.68 19 IDSIA 2.08 19 TailHot 6.28 19 ISI-Neonatology 64
20 ISI-Neonatology 88.66 20 ASTRI_DL 2.10 20 SPM12_T1_IR* 6.34 20 ASTRI_MSA 66
21 BCH_CRL_IMAGINE 88.63 21 MSL-SKKU 2.11 21 SJCE 6.43 21 LfB 67
22 UB VPML Med 88.61 22 MNAB2 2.12 22 UNC-IDEA 6.46 22 MDGRU 69
23 PyraMiD-LSTM2 88.53 23 LfB 2.13 23 FBI/LMB Freiburg 6.47 23 BIGR2 70
24 ASTRI_MSA 88.46 24 THUity 2.16 24 ASTRI_MSA 6.52 24 IDSIA 77
25 STH 88.45 25 AOC 2.19 25 KSOM GHMF 6.59 25 VBM12 77
26 BIGR2 88.42 26 BCH_CRL_IMAGINE 2.23 26 LfB 6.71 26 nanand2 85
27 IDSIA 88.33 27 UofL BioImaging 2.24 27 CSIM-lab_Mqe-MMRF 6.92 27 vicorob UdG T1_F 85
28 nanand2 88.32 28 VBM12 2.32 28 ISI-Neonatology 6.96 28 KSOM GHMF 88
29 MNAB2 88.04 29 STH 2.34 29 drai 6.99 29 SPM12_T1_F* 90
30 CVSS 88.00 30 BIGR2 2.36 30 WTA 7.02 30 UB VPML Med 91
31 KSOM GHMF 87.96 31 CMIV 2.43 31 IDSIA 7.05 31 MNAB2 94
32 VBM12 87.95 32 KSOM GHMF 2.49 32 Robarts 7.06 32 Narsil 95
33 MNAB 87.95 33 MNAB 2.65 33 NIST 7.11 33 STH 95
34 UofL BioImaging 87.88 34 KM-MRF-MAS 2.70 34 UB VPML Med 7.13 34 vicorob UdG T1 97
35 CMIV 87.71 35 UB VPML Med 2.72 35 XMU SmartDSP 7.15 35 BCH_CRL_IMAGINE 99
36 vicorob UdG T1_F 87.34 36 CVSS 2.86 36 FreeSurfer* 7.18 36 CVSS 103
37 VIBOT10 M-T1+F 87.32 37 vicorob UdG T1_F 2.88 37 CVSS 7.20 37 CMIV 105
38 bigr_neuro 87.31 38 mlmi2014ss 2.89 38 bigr_neuro 7.31 38 SPM12_T1* 105
39 Narsil 87.10 39 vicorob UdG T1 2.91 39 CMIV 7.34 39 MNAB 110
40 vicorob UdG T1 87.06 40 LUH-TNT 2.96 40 XLab 7.61 40 UofL BioImaging 110
41 SJCE 86.83 41 SPM12_T1_F* 3.00 41 STH 7.67 41 bigr_neuro 118
42 CSIM-lab_Mqe-MMRF 86.76 42 bigr_neuro 3.01 42 MDGRU 7.69 42 SJCE 118
43 KM-MRF-MAS 86.73 43 SPM12_T1* 3.06 43 MNAB2 7.74 43 CSIM-lab_Mqe-MMRF 118
44 LUH-TNT 86.47 44 FreeSurfer* 3.06 44 MNAB 7.75 44 Robarts 123
45 S2_QM2 86.34 45 Robarts 3.06 45 S2_QM2 7.91 45 SPM12_T1_IR* 125
46 Robarts 86.15 46 drai 3.23 46 nanand2 7.99 46 KM-MRF-MAS 127
47 SPM12_T1_F* 86.03 47 S2_QM2 3.29 47 VIBOT10 M-T1+F 8.01 47 FreeSurfer* 130
48 FSL-Seg* 85.98 48 Narsil 3.31 48 SPM12_T1_IR_F* 8.40 48 drai 133
49 SPM12_T1* 85.58 49 CSIM-lab_Mqe-MMRF 3.33 49 UofL BioImaging 8.74 49 S2_QM2 137
50 FreeSurfer* 85.25 50 SPM12_T1_IR* 3.60 50 KM-MRF-MAS 9.19 50 LUH-TNT 140
51 CSIM-Lab 85.24 51 CSIM-Lab 3.65 51 FSL-Seg* 11.47 51 VIBOT10 M-T1+F 143
52 FSL-PVSeg* 84.84 52 FSL-Seg* 3.65 52 BCH_CRL_IMAGINE 12.38 52 mlmi2014ss 150
53 S2_QM 83.86 53 SPM12_T1_IR_F* 3.84 53 Jedi Mind Meld 13.66 53 FSL-Seg* 151
54 SPM12_T1_IR_F* 83.64 54 FSL-PVSeg* 3.85 54 ISTB UniBe 13.71 54 SPM12_T1_IR_F* 155
55 SPM12_T1_IR* 83.54 55 ISTB UniBe 3.98 55 mlmi2014ss 14.00 55 CSIM-Lab 160
56 ISTB UniBe 82.50 56 SJCE 4.29 56 LUH-TNT 14.20 56 ISTB UniBe 165
57 mlmi2014ss 81.98 57 Jedi Mind Meld 4.52 57 LNMBrains 15.34 57 FSL-PVSeg* 165
58 drai 80.75 58 S2_QM 4.94 58 CSIM-Lab 17.39 58 Jedi Mind Meld 169
59 Jedi Mind Meld 80.64 59 VIBOT10 M-T1+F 6.63 59 FSL-PVSeg* 19.69 59 S2_QM 171
60 LNMBrains 78.32 60 LNMBrains 6.77 60 S2_QM 24.79 60 LNMBrains 177
61 ECOESH 75.82 61 ECOESH 38.46 61 ECOESH 25.27 61 ECOESH 183

Cerebrospinal Fluid Segmentation Results

Rank DC Rank HD Rank AVD CSF Score
1 XMU SmartDSP 85.16 1 XMU_SmartDSP2 1.84 1 XMU SmartDSP 6.15 1 XMU SmartDSP 4
2 TailHot 84.86 2 XMU SmartDSP 1.90 2 WTA2 6.20 2 TailHot 11
3 XMU_SmartDSP2 84.81 3 TailHot 2.03 3 AOC 6.51 3 XMU_SmartDSP2 14
4 CU_DL2 84.25 4 XLab 2.03 4 STH 6.73 4 XLab 14
5 XLab 84.24 5 NIST 2.07 5 XLab 6.74 5 NIST 20
6 ASTRI_DL 84.23 6 IDSIA 2.14 6 TailHot 6.75 6 IDSIA 28
7 MDGRU 84.13 7 MDGRU 2.17 7 NIST 6.75 7 MDGRU 31
8 NIST 84.01 8 CU_DL2 2.19 8 MSL-SKKU 6.77 8 CU_DL2 31
9 CU_DL 83.96 9 FBI/LMB Freiburg 2.22 9 VBM12 6.80 9 MSL-SKKU 35
10 MSL-SKKU 83.76 10 LIVIA_ETS 2.26 10 XMU_SmartDSP2 6.84 10 STH 37
11 IDSIA 83.72 11 MNAB2 2.27 11 IDSIA 7.09 11 WTA2 38
12 FBI/LMB Freiburg 83.47 12 LRDE 2.28 12 BCH_CRL_IMAGINE 7.12 12 LIVIA_ETS 39
13 LIVIA_ETS 83.42 13 CU_DL 2.28 13 PyraMiD-LSTM2 7.17 13 CU_DL 40
14 BCH_CRL_IMAGINE 83.26 14 PyraMiD-LSTM2 2.30 14 vicorob UdG T1 7.17 14 PyraMiD-LSTM2 42
15 PyraMiD-LSTM2 83.05 15 STH 2.31 15 vicorob UdG T1_F 7.21 15 FBI/LMB Freiburg 45
16 UNC-IDEA 82.81 16 nanand2 2.32 16 LIVIA_ETS 7.31 16 ASTRI_DL 51
17 WTA2 82.77 17 MSL-SKKU 2.32 17 MDGRU 7.44 17 MNAB2 58
18 STH 82.77 18 UNC-IDEA 2.35 18 CU_DL 7.44 18 AOC 59
19 LfB 82.61 19 WTA2 2.41 19 CU_DL2 7.69 19 LRDE 59
20 LRDE 82.44 20 ASTRI_DL 2.54 20 ASTRI_MSA 7.98 20 nanand2 63
21 MNAB2 82.30 21 LfB 2.60 21 nanand2 8.03 21 BCH_CRL_IMAGINE 66
22 KSOM GHMF 82.10 22 ISI-Neonatology 2.65 22 drai 8.14 22 UNC-IDEA 67
23 ASTRI_MSA 81.73 23 Robarts 2.66 23 THUity 8.28 23 ASTRI_MSA 69
24 THUity 81.27 24 UofL BioImaging 2.66 24 FBI/LMB Freiburg 8.63 24 vicorob UdG T1 71
25 ISI-Neonatology 81.08 25 KSOM GHMF 2.71 25 ASTRI_DL 8.70 25 vicorob UdG T1_F 72
26 nanand2 80.80 26 ASTRI_MSA 2.77 26 MNAB2 8.73 26 LfB 75
27 AOC 80.46 27 vicorob UdG T1_F 2.81 27 LRDE 9.03 27 ISI-Neonatology 77
28 Robarts 80.28 28 vicorob UdG T1 2.81 28 S2_QM2 9.36 28 THUity 81
29 vicorob UdG T1 80.18 29 AOC 2.84 29 UofL BioImaging 9.68 29 VBM12 83
30 vicorob UdG T1_F 80.17 30 VIBOT10 M-T1+F 2.98 30 ISI-Neonatology 9.77 30 UofL BioImaging 85
31 VIBOT10 M-T1+F 79.73 31 CMIV 3.00 31 SPM12_T1_F* 10.07 31 KSOM GHMF 86
32 UofL BioImaging 78.86 32 VBM12 3.03 32 SPM12_T1_IR* 10.47 32 S2_QM2 98
33 CMIV 78.57 33 S2_QM2 3.05 33 UNC-IDEA 10.52 33 Robarts 103
34 BIGR2 78.31 34 THUity 3.07 34 FSL-PVSeg* 10.69 34 drai 105
35 SPM12_T1_IR* 78.25 35 KM-MRF-MAS 3.08 35 LfB 10.92 35 CMIV 106
36 bigr_neuro 78.16 36 bigr_neuro 3.15 36 KM-MRF-MAS 10.95 36 VIBOT10 M-T1+F 107
37 S2_QM2 77.97 37 drai 3.17 37 FSL-Seg* 11.83 37 KM-MRF-MAS 110
38 WTA 77.77 38 BIGR2 3.19 38 SPM12_T1_IR_F* 12.21 38 SPM12_T1_IR* 113
39 KM-MRF-MAS 76.97 39 CVSS 3.25 39 KSOM GHMF 12.78 39 bigr_neuro 119
40 SPM12_T1_IR_F* 76.87 40 BCH_CRL_IMAGINE 3.28 40 CSIM-Lab 13.31 40 FSL-PVSeg* 126
41 UB VPML Med 74.82 41 FSL-Seg* 3.41 41 Narsil 13.54 41 SPM12_T1_IR_F* 126
42 VBM12 74.56 42 FSL-PVSeg* 3.44 42 CMIV 14.31 42 BIGR2 126
43 SPM12_T1_F* 74.03 43 Jedi Mind Meld 3.67 43 S2_QM 14.45 43 FSL-Seg* 127
44 Jedi Mind Meld 73.33 44 mlmi2014ss 3.77 44 SJCE 14.99 44 SPM12_T1_F* 127
45 CVSS 72.59 45 S2_QM 3.79 45 CSIM-lab_Mqe-MMRF 15.97 45 CVSS 133
46 drai 70.95 46 SPM12_T1_IR* 4.01 46 VIBOT10 M-T1+F 16.06 46 Jedi Mind Meld 135
47 SPM12_T1* 70.69 47 LUH-TNT 4.07 47 bigr_neuro 16.47 47 S2_QM 142
48 mlmi2014ss 70.59 48 SPM12_T1_IR_F* 4.15 48 Jedi Mind Meld 17.60 48 WTA 146
49 FSL-Seg* 69.95 49 CSIM-lab_Mqe-MMRF 4.24 49 CVSS 17.94 49 CSIM-lab_Mqe-MMRF 147
50 FSL-PVSeg* 69.49 50 FreeSurfer* 4.31 50 LNMBrains 19.87 50 UB VPML Med 150
51 LNMBrains 68.80 51 UB VPML Med 4.31 51 ISTB UniBe 19.89 51 mlmi2014ss 151
52 MNAB 68.08 52 WTA 4.35 52 Robarts 20.36 52 SJCE 153
53 CSIM-lab_Mqe-MMRF 68.03 53 SPM12_T1_F* 4.59 53 LUH-TNT 20.40 53 CSIM-Lab 156
54 S2_QM 67.87 54 SJCE 4.78 54 BIGR2 22.76 54 Narsil 157
55 SJCE 67.67 55 MNAB 4.88 55 SPM12_T1* 23.24 55 LUH-TNT 157
56 Narsil 66.57 56 SPM12_T1* 5.34 56 WTA 24.67 56 SPM12_T1* 158
57 LUH-TNT 66.47 57 CSIM-Lab 5.44 57 MNAB 28.56 57 LNMBrains 160
58 FreeSurfer* 65.79 58 ISTB UniBe 6.94 58 UB VPML Med 31.19 58 MNAB 164
59 CSIM-Lab 59.82 59 LNMBrains 7.66 59 mlmi2014ss 33.45 59 FreeSurfer* 169
60 ISTB UniBe 54.69 60 Narsil 13.30 60 ECOESH 36.59 60 ISTB UniBe 169
61 ECOESH 51.48 61 ECOESH 18.75 61 FreeSurfer* 50.27 61 ECOESH 182

Brain (GM and WM segmentations combined) Results

Rank DC Rank HD Rank AVD Brain Score
1 TailHot 95.83 1 XMU SmartDSP 1.89 1 UB VPML Med 2.35 1 LIVIA_ETS 17
2 XMU_SmartDSP2 95.79 2 XLab 1.93 2 STH 2.51 2 LRDE 21
3 XMU SmartDSP 95.78 3 XMU_SmartDSP2 1.95 3 AOC 2.52 3 TailHot 21
4 XLab 95.77 4 LIVIA_ETS 1.99 4 CMIV 2.58 4 XLab 26
5 CU_DL2 95.74 5 LRDE 2.07 5 THUity 2.62 5 WTA2 27
6 LIVIA_ETS 95.70 6 TailHot 2.09 6 LRDE 2.62 6 XMU SmartDSP 34
7 CU_DL 95.70 7 WTA2 2.12 7 LIVIA_ETS 2.67 7 MSL-SKKU 34
8 ASTRI_DL 95.67 8 nanand2 2.17 8 WTA2 2.68 8 CU_DL 35
9 MSL-SKKU 95.67 9 ISI-Neonatology 2.18 9 WTA 2.73 9 ISI-Neonatology 36
10 LRDE 95.65 10 CU_DL 2.19 10 PyraMiD-LSTM2 2.73 10 STH 37
11 ISI-Neonatology 95.65 11 CU_DL2 2.24 11 MSL-SKKU 2.73 11 CU_DL2 37
12 WTA2 95.62 12 IDSIA 2.27 12 VBM12 2.77 12 WTA 38
13 WTA 95.59 13 MDGRU 2.29 13 S2_QM2 2.78 13 MDGRU 42
14 MDGRU 95.59 14 MSL-SKKU 2.29 14 TailHot 2.79 14 XMU_SmartDSP2 44
15 ASTRI_MSA 95.40 15 FBI/LMB Freiburg 2.33 15 MDGRU 2.79 15 THUity 46
16 FBI/LMB Freiburg 95.40 16 WTA 2.35 16 ISI-Neonatology 2.80 16 AOC 50
17 BCH_CRL_IMAGINE 95.39 17 STH 2.38 17 ASTRI_DL 2.88 17 PyraMiD-LSTM2 50
18 STH 95.37 18 THUity 2.39 18 CU_DL 2.89 18 ASTRI_DL 50
19 PyraMiD-LSTM2 95.30 19 MNAB2 2.41 19 Narsil 2.91 19 nanand2 52
20 IDSIA 95.29 20 UofL BioImaging 2.41 20 XLab 2.93 20 IDSIA 60
21 NIST 95.29 21 PyraMiD-LSTM2 2.45 21 CU_DL2 2.94 21 FBI/LMB Freiburg 65
22 nanand2 95.22 22 UNC-IDEA 2.48 22 nanand2 2.95 22 UB VPML Med 65
23 THUity 95.22 23 AOC 2.53 23 FSL-Seg* 2.95 23 ASTRI_MSA 65
24 AOC 95.19 24 ASTRI_MSA 2.54 24 vicorob UdG T1 2.97 24 S2_QM2 69
25 MNAB2 95.16 25 ASTRI_DL 2.64 25 vicorob UdG T1_F 2.98 25 MNAB2 77
26 KSOM GHMF 95.13 26 S2_QM2 2.73 26 ASTRI_MSA 3.02 26 Narsil 84
27 BIGR2 95.13 27 BIGR2 2.74 27 BCH_CRL_IMAGINE 3.06 27 CMIV 84
28 UNC-IDEA 95.05 28 KM-MRF-MAS 2.76 28 IDSIA 3.10 28 BCH_CRL_IMAGINE 85
29 UofL BioImaging 94.93 29 Robarts 2.78 29 KSOM GHMF 3.15 29 VBM12 86
30 S2_QM2 94.90 30 UB VPML Med 2.80 30 XMU SmartDSP 3.17 30 NIST 86
31 VIBOT10 M-T1+F 94.89 31 CVSS 2.84 31 NIST 3.18 31 KSOM GHMF 88
32 LfB 94.87 32 Narsil 2.86 32 drai 3.20 32 BIGR2 90
33 Narsil 94.78 33 KSOM GHMF 2.86 33 MNAB2 3.21 33 UofL BioImaging 95
34 UB VPML Med 94.59 34 NIST 2.86 34 FBI/LMB Freiburg 3.22 34 UNC-IDEA 98
35 VBM12 94.50 35 LfB 2.88 35 SPM12_T1* 3.23 35 vicorob UdG T1_F 105
36 CMIV 94.48 36 LUH-TNT 2.90 36 BIGR2 3.24 36 vicorob UdG T1 106
37 MNAB 94.47 37 drai 3.05 37 CSIM-lab_Mqe-MMRF 3.35 37 LfB 109
38 vicorob UdG T1_F 94.27 38 mlmi2014ss 3.23 38 SPM12_T1_IR* 3.38 38 CVSS 122
39 vicorob UdG T1 94.25 39 VBM12 3.36 39 XMU_SmartDSP2 3.41 39 LUH-TNT 123
40 LUH-TNT 94.17 40 FreeSurfer* 3.55 40 Jedi Mind Meld 3.46 40 drai 125
41 CVSS 94.08 41 BCH_CRL_IMAGINE 3.64 41 FSL-PVSeg* 3.46 41 KM-MRF-MAS 125
42 bigr_neuro 93.99 42 vicorob UdG T1_F 3.73 42 LfB 3.56 42 FSL-Seg* 128
43 KM-MRF-MAS 93.97 43 vicorob UdG T1 3.74 43 bigr_neuro 3.57 43 SPM12_T1* 128
44 SPM12_T1_IR* 93.93 44 CMIV 3.82 44 MNAB 3.76 44 CSIM-lab_Mqe-MMRF 129
45 SPM12_T1_F* 93.87 45 CSIM-lab_Mqe-MMRF 4.26 45 SJCE 3.79 45 MNAB 130
46 SPM12_T1* 93.85 46 ISTB UniBe 4.39 46 UofL BioImaging 3.88 46 VIBOT10 M-T1+F 132
47 CSIM-lab_Mqe-MMRF 93.66 47 SPM12_T1* 4.45 47 LUH-TNT 4.11 47 SPM12_T1_IR* 133
48 FSL-PVSeg* 93.59 48 SJCE 4.52 48 UNC-IDEA 4.21 48 bigr_neuro 135
49 SPM12_T1_IR_F* 93.59 49 MNAB 4.54 49 VIBOT10 M-T1+F 4.84 49 Robarts 140
50 SJCE 93.48 50 bigr_neuro 4.57 50 CVSS 4.91 50 SJCE 143
51 FSL-Seg* 93.30 51 SPM12_T1_IR* 4.63 51 SPM12_T1_IR_F* 5.11 51 FSL-PVSeg* 146
52 S2_QM 93.27 52 VIBOT10 M-T1+F 4.91 52 SPM12_T1_F* 5.33 52 Jedi Mind Meld 146
53 Jedi Mind Meld 93.24 53 Jedi Mind Meld 5.44 53 S2_QM 5.48 53 FreeSurfer* 150
54 Robarts 93.13 54 FSL-Seg* 5.53 54 KM-MRF-MAS 5.58 54 SPM12_T1_F* 152
55 FreeSurfer* 92.32 55 SPM12_T1_F* 5.85 55 FreeSurfer* 6.27 55 mlmi2014ss 154
56 drai 91.97 56 SPM12_T1_IR_F* 5.91 56 LNMBrains 7.37 56 SPM12_T1_IR_F* 156
57 CSIM-Lab 91.20 57 FSL-PVSeg* 6.09 57 Robarts 7.88 57 S2_QM 163
58 mlmi2014ss 90.75 58 S2_QM 6.98 58 mlmi2014ss 12.05 58 ISTB UniBe 166
59 LNMBrains 88.51 59 LNMBrains 8.56 59 CSIM-Lab 15.76 59 LNMBrains 174
60 ISTB UniBe 87.80 60 CSIM-Lab 11.24 60 ISTB UniBe 17.26 60 CSIM-Lab 176
61 ECOESH 78.24 61 ECOESH 35.99 61 ECOESH 32.06 61 ECOESH 183

Intracranial cavity (GM, WM, and CSF segmentations combined) Results

Rank DC Rank HD Rank AVD ICV Score
1 NIST 98.36 1 NIST 2.03 1 XLab 0.53 1 NIST 8
2 XMU SmartDSP 98.25 2 XMU_SmartDSP2 2.28 2 UNC-IDEA 0.68 2 XMU SmartDSP 18
3 XMU_SmartDSP2 98.22 3 XMU SmartDSP 2.34 3 PyraMiD-LSTM2 0.69 3 MDGRU 18
4 TailHot 98.17 4 MDGRU 2.37 4 STH 0.69 4 IDSIA 20
5 ASTRI_DL 98.16 5 IDSIA 2.44 5 BCH_CRL_IMAGINE 0.75 5 XLab 22
6 IDSIA 98.15 6 ASTRI_DL 2.47 6 NIST 0.77 6 XMU_SmartDSP2 23
7 MDGRU 98.15 7 FBI/LMB Freiburg 2.51 7 MDGRU 0.86 7 ASTRI_DL 23
8 CU_DL2 98.10 8 Robarts 2.55 8 Robarts 0.91 8 PyraMiD-LSTM2 25
9 PyraMiD-LSTM2 98.04 9 XLab 2.67 9 IDSIA 0.95 9 UNC-IDEA 27
10 CU_DL 97.99 10 UNC-IDEA 2.72 10 SPM12_T1_IR* 0.99 10 FBI/LMB Freiburg 29
11 FBI/LMB Freiburg 97.99 11 CU_DL2 2.75 11 FBI/LMB Freiburg 1.06 11 Robarts 30
12 XLab 97.96 12 TailHot 2.78 12 ASTRI_DL 1.09 12 TailHot 33
13 MSL-SKKU 97.96 13 PyraMiD-LSTM2 2.86 13 XMU SmartDSP 1.10 13 STH 39
14 Robarts 97.92 14 LRDE 2.87 14 THUity 1.13 14 CU_DL2 42
15 UNC-IDEA 97.92 15 STH 2.92 15 SPM12_T1_IR_F* 1.17 15 MSL-SKKU 61
16 LfB 97.87 16 MNAB2 2.95 16 LfB 1.19 16 LRDE 62
17 BCH_CRL_IMAGINE 97.82 17 LIVIA_ETS 2.96 17 TailHot 1.23 17 LIVIA_ETS 63
18 LIVIA_ETS 97.82 18 nanand2 3.00 18 XMU_SmartDSP2 1.35 18 CU_DL 63
19 SPM12_T1_IR* 97.73 19 WTA2 3.00 19 LRDE 1.44 19 ASTRI_MSA 66
20 STH 97.72 20 CU_DL 3.17 20 ASTRI_MSA 1.44 20 LfB 67
21 SPM12_T1_IR_F* 97.71 21 KSOM GHMF 3.23 21 SPM12_T1_F* 1.46 21 MNAB2 70
22 ASTRI_MSA 97.71 22 UofL BioImaging 3.43 22 MSL-SKKU 1.46 22 nanand2 72
23 MNAB2 97.66 23 AOC 3.53 23 CU_DL2 1.54 23 SPM12_T1_IR* 73
24 vicorob UdG T1 97.65 24 ASTRI_MSA 3.60 24 nanand2 1.58 24 vicorob UdG T1 77
25 vicorob UdG T1_F 97.64 25 S2_QM2 3.72 25 vicorob UdG T1 1.62 25 BCH_CRL_IMAGINE 79
26 VIBOT10 M-T1+F 97.63 26 MSL-SKKU 3.75 26 VIBOT10 M-T1+F 1.64 26 vicorob UdG T1_F 82
27 WTA2 97.61 27 CMIV 3.76 27 vicorob UdG T1_F 1.65 27 WTA2 82
28 KSOM GHMF 97.56 28 vicorob UdG T1 3.85 28 LIVIA_ETS 1.67 28 AOC 83
29 LRDE 97.53 29 drai 3.89 29 AOC 1.73 29 VIBOT10 M-T1+F 83
30 nanand2 97.30 30 vicorob UdG T1_F 3.90 30 ISI-Neonatology 1.74 30 KSOM GHMF 84
31 AOC 97.22 31 VIBOT10 M-T1+F 3.91 31 MNAB2 1.77 31 UofL BioImaging 89
32 THUity 96.95 32 BIGR2 3.93 32 UofL BioImaging 1.81 32 SPM12_T1_IR_F* 90
33 ISI-Neonatology 96.92 33 bigr_neuro 3.93 33 CU_DL 1.83 33 THUity 96
34 CMIV 96.79 34 ISI-Neonatology 4.29 34 drai 1.85 34 ISI-Neonatology 97
35 UofL BioImaging 96.71 35 LfB 4.83 35 KSOM GHMF 1.95 35 S2_QM2 100
36 SPM12_T1_F* 96.59 36 CVSS 4.87 36 WTA2 1.98 36 drai 104
37 S2_QM2 96.44 37 VBM12 4.89 37 VBM12 2.37 37 CMIV 108
38 bigr_neuro 96.33 38 KM-MRF-MAS 5.08 38 S2_QM2 2.38 38 SPM12_T1_F* 110
39 KM-MRF-MAS 96.10 39 FSL-PVSeg* 5.29 39 CVSS 2.55 39 bigr_neuro 114
40 BIGR2 96.00 40 FSL-Seg* 5.29 40 KM-MRF-MAS 2.99 40 VBM12 116
41 drai 95.99 41 WTA 5.32 41 FSL-Seg* 3.37 41 KM-MRF-MAS 117
42 VBM12 95.95 42 CSIM-lab_Mqe-MMRF 6.09 42 FSL-PVSeg* 3.37 42 BIGR2 120
43 mlmi2014ss 95.84 43 S2_QM 6.49 43 bigr_neuro 3.46 43 CVSS 122
44 WTA 95.34 44 SPM12_T1_IR* 6.51 44 mlmi2014ss 3.60 44 FSL-PVSeg* 130
45 SPM12_T1* 95.28 45 FreeSurfer* 6.62 45 Narsil 3.69 45 FSL-Seg* 131
46 UB VPML Med 94.83 46 UB VPML Med 6.63 46 S2_QM 4.01 46 WTA 138
47 CVSS 94.62 47 LUH-TNT 6.85 47 CMIV 4.87 47 S2_QM 141
48 Jedi Mind Meld 94.26 48 MNAB 7.06 48 BIGR2 5.18 48 mlmi2014ss 142
49 FSL-PVSeg* 94.24 49 SJCE 7.31 49 SPM12_T1* 5.53 49 CSIM-lab_Mqe-MMRF 143
50 FSL-Seg* 94.24 50 THUity 7.67 50 CSIM-lab_Mqe-MMRF 6.47 50 SPM12_T1* 146
51 CSIM-lab_Mqe-MMRF 94.03 51 CSIM-Lab 8.09 51 SJCE 6.77 51 UB VPML Med 146
52 S2_QM 93.71 52 SPM12_T1* 8.09 52 Jedi Mind Meld 6.82 52 SJCE 153
53 SJCE 93.66 53 SPM12_T1_F* 8.21 53 WTA 6.86 53 LUH-TNT 157
54 LUH-TNT 93.18 54 SPM12_T1_IR_F* 8.23 54 UB VPML Med 7.67 54 Jedi Mind Meld 158
55 MNAB 92.52 55 mlmi2014ss 8.69 55 LNMBrains 7.88 55 MNAB 160
56 Narsil 92.49 56 ISTB UniBe 9.84 56 LUH-TNT 9.14 56 FreeSurfer* 161
57 FreeSurfer* 92.39 57 BCH_CRL_IMAGINE 11.34 57 MNAB 9.71 57 Narsil 162
58 CSIM-Lab 92.34 58 Jedi Mind Meld 20.34 58 CSIM-Lab 10.06 58 CSIM-Lab 167
59 LNMBrains 89.17 59 LNMBrains 20.36 59 FreeSurfer* 10.19 59 LNMBrains 173
60 ISTB UniBe 88.53 60 ECOESH 21.43 60 ISTB UniBe 17.52 60 ISTB UniBe 176
61 ECOESH 78.14 61 Narsil 23.65 61 ECOESH 30.13 61 ECOESH 182

DC = Dice Coefficient, HD = 95th percentile of Hausdorff Distance, AVD = Absolute Volume Difference
Score = Rank DC + Rank HD + Rank AVD





© 2013 Image Sciences Institute.