Home    Details    Workshop    Register    Download    Submit    Results    Organizers 

Results

When teams submit their segmentation results, the evaluation results will be sent to the team contact person by e-mail and will be listed below.

Rank Team name Submission name Date Sum Scores Sequences used Speed Doc
1XMU_SmartDSP2 3D Spatial Weighted U-Net for Multi-modality Brain MRI Segmentation 29‑08‑18 32 T1; T1_IR; FLAIR ~10 min doc
2TailHot Multi-modality aggregation network3 13‑04‑18 57 T1; T1_IR; FLAIR ~13 sec doc
3WTA2 3D Cascade convolutional architecture - Method 22 23‑05‑18 68 T1; T1_IR; FLAIR ~2 min doc
4XMU SmartDSP 3D CNN with a Cross-modality Channel Attention Scheme3 17‑08‑18 76 T1; T1_IR; FLAIR ~10 min doc
5XLab 3D Fully CNN with Multi-Modality Feature Fusion3 10‑08‑18 85 T1; T1_IR; FLAIR ~2 min doc
6LIVIA_ETS HyperDenseNet2 06‑02‑18 91 T1; T1_IR; FLAIR ~4 min doc
7CU_DL2 3D Deep Learning; voxnet2 28‑06‑16 102 T1; T1_IR; FLAIR ~2 min doc
8CU_DL 3D Deep Learning; voxnet13 16‑06‑16 109 T1; T1_IR; FLAIR ~2 min doc
9LRDE Fully Convolutional Network 20‑12‑16 116 T1 ~2 sec doc
10MSL-SKKU Deep Convolutional Neural Network 19‑06‑17 121 T1; T1-IR; FLAIR ~1.5 min doc
11MDGRU Multi-Dimensional Gated Recurrent Units3 27‑07‑16 146 T1; T1_IR; FLAIR ~2 min doc
12FBI/LMB Freiburg U-Net (3D) 01‑05‑16 150 T1-1mm; T1-IR; FLAIR ~2 min doc
13ASTRI_DL U-Net inspired CNN model with 3D context information2 25‑07‑18 151 T1; T1_IR; FLAIR ~7 min doc
14THUity Modified U-Net3 15‑08‑18 152 T1 ~40 sec doc
15PyraMiD-LSTM2 NOCC with rounds3 23‑05‑16 155 T1; T1-IR; FLAIR ~2 min doc
16NIST Fully CNN for Multi-Modality Brain Tissue Segmentation 14‑08‑18 158 T1; T1_IR; FLAIR ~2 min doc
17AOC Atlas of Classifiers 24‑12‑17 173 T1 ~6 sec doc
18IDSIA PyraMiD-LSTM 05‑06‑15 177 T1; T1_IR; FLAIR ~2 min doc
19STH Hybrid ANN-based Auto-context method2 03‑06‑16 192 T1; T1-IR; FLAIR ~ 5 min doc
20nanand2 DeepLab-v3+ with pre-training on FreeSurfer automated labels3 16‑08‑18 195 T1 ~15 sec doc
21ISI-Neonatology Multi-stage voxel classification 31‑05‑14 197 T1 ~1.5 hours doc
22UNC-IDEA LINKS:Learning-based multi-source integration 09‑02‑15 202 T1; T1_IR; FLAIR ~3 min doc
23ASTRI_MSA Revised VoxResNet 27‑08‑18 220 T1; T1_IR; FLAIR ~1 min doc
24BCH_CRL_IMAGINE 3D patch-wise DenseNet and Patch Fusion2 24‑05‑18 228 T1; T1-IR; FLAIR ~2 min doc
25KSOM GHMF ASeTs: MAP-Based with Manifold learning 13‑05‑14 232 T1; T1_IR; FLAIR ~23 min doc
26MNAB2 Random Forests 21‑02‑14 234 T1; T1_IR; FLAIR ~25 min doc
27WTA 3D Cascade convolutional architecture - Method 13 15‑05‑18 247 T1; T1_IR; FLAIR ~5 min doc
28vicorob UdG T1_F MSSEG using T1 + FLAIR (T1-IR skull) 14‑01‑16 256 T1; IR; FLAIR ~2 min doc
29VBM12 VBM12_r738 with WMHC=2 07‑10‑15 257 T1 ~6 min doc
30BIGR2 Multi-Feature SVM Classification 26‑09‑13 262 T1; T1_IR; FLAIR ~35 min doc
31vicorob UdG T1 MSSEG using only T1 (T1-IR skull) 21‑01‑16 273 T1; IR ~2 min doc
32UofL BioImaging MAP-Based Framework 26‑09‑13 292 T1 ~6 sec doc
33CMIV Model-guided Level Sets and Skeletons 26‑09‑13 311 T1; FLAIR ~3 min doc
34UB VPML Med Multi-Atlas with Multiway Cut 26‑09‑13 315 T1; T1_IR; FLAIR ~30 min doc
35Narsil Segmentation using Ensemble Trees 26‑09‑13 319 T1; FLAIR < 2 min doc
36drai VGG based Fully Convolutional Neural Network 20‑01‑17 330 T1 ~2 sec doc
37VIBOT10 M-T1+F Convolutional Neural Network 27‑02‑17 332 T1; FLAIR ~3 min doc
38CVSS Multi-atlas segmentation based on supervoxels 14‑02‑17 334 T1; T1_IR; FLAIR ~2 min doc
39bigr_neuro Automatically Trained kNN Classifier 26‑09‑13 336 T1; FLAIR ~2 hours doc
40S2_QM2 Atlas-based segmentation and AdaBoost 28‑07‑14 340 T1; T1-IR; FLAIR ~45 min doc
41Robarts Multi-Atlas with Hierarchical Max-Flow 26‑09‑13 348 T1-1mm; T1-IR ~16 min doc
42KM-MRF-MAS MAP on Intensity, and Local and Multi-atlas Priors 28‑10‑16 348 T1 ~10 min doc
43SPM12_T1_F* SPM12 with T1 and FLAIR sequence 31‑08‑15 349 T1; FLAIR ~3 min doc
44CSIM-lab_Mqe-MMRF Hybrid Modified Entropy-Based Segmentation with Modified MRF 25‑06‑18 360 T1 ~6 min doc
45SJCE Fuzzy Clustering 12‑04‑17 362 T1 <1 min doc
46SPM12_T1_IR* SPM12 with T1 and IR sequence 31‑08‑15 368 T1; IR ~3 min doc
47SPM12_T1* SPM12 with T1 sequence 31‑08‑15 383 T1 ~3 min doc
48MNAB Random Decision Forests 26‑09‑13 388 T1; T1-IR; FLAIR ~15 min doc
49SPM12_T1_IR_F* SPM12 with T1; IR and FLAIR sequence 31‑08‑15 421 T1; IR; FLAIR ~4 min doc
50FSL-Seg* FSL (v5.0) seg file 31‑08‑15 425 T1 ~10 min doc
51LUH-TNT Level-sets with dictionary learning 27‑10‑14 434 T1 < 1 min doc
52FreeSurfer* FreeSurfer (v5.3.0) 31‑08‑15 435 T1-1mm ~1 hour doc
53FSL-PVSeg* FSL (v5.0) PVSeg file 31‑08‑15 438 T1 ~10 min doc
54Jedi Mind Meld Automated Walks using Machine Learning 26‑09‑13 450 T1; T1-IR; FLAIR ~27 sec doc
55mlmi2014ss AdaBoostM2 28‑07‑14 456 T1; T1-IR; FLAIR ~5 min doc
56S2_QM Bayesian-based Adaptive Mean-Shift 26‑09‑13 468 T1; T1-IR; FLAIR ~1.5 hours doc
57CSIM-Lab Multiple Logistic Classification 24‑10‑17 481 T1 doc
58ISTB UniBe Decision Forests with spatial regularization 04‑06‑14 497 T1; T1-IR; FLAIR ~3 min doc
59LNMBrains Gaussian Intensity Model 26‑09‑13 497 T1; T1-IR; FLAIR ~5 min doc
60ECOESH Modified Expectation Maximization 06‑01‑14 539 T1 ~5 min doc
*These methods (SPM, FSL and FreeSurfer) were applied by the MRBrainS organizers as described in the MRBrainS journal paper.
2,3At the end of the submission name indicates that this is the 2nd or 3rd submission (max 3 resubmissions allowed).

Note: As described below, when teams have equal scores, the standard deviations of the three tissue types and the three evaluation measures over all patients are taken into account.

How is the ranking determined?

Ranking is based on the evaluation results of all 15 test datasets and determined as follows: For each evaluation measure (Dice Coefficient (DC), Modified Hausdorff Distance (HD) and Absolute Volume Difference(AVD)), the mean value over all 15 datasets is determined for white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF). Each team receives a rank (1=best) for each tissue type (GM, WM, CSF) and each evaluation measure (DC, HD-95, AVD) based on the mean value of the evaluation measures over all 15 datasets. The final score is determined by adding the ranks of all tissue types and evaluation measures for each team. The team with the lowest score is ranked number 1. In case two teams would have an equal score, the team with the lowest standard deviation over the tissue types will be ranked first.

Per tissue rankings and per measure rankings are presented below.

Overall Segmentation Results

GM Score WM Score CSF Score Rank Sum
1 XMU_SmartDSP2 13 1 XMU_SmartDSP2 5 1 XMU SmartDSP 4 1 XMU_SmartDSP2 32
2 TailHot 16 2 WTA2 8 2 TailHot 11 2 TailHot 57
3 WTA2 22 3 LIVIA_ETS 24 3 XMU_SmartDSP2 14 3 WTA2 68
4 XLab 24 4 LRDE 24 4 XLab 14 4 XMU SmartDSP 76
5 LIVIA_ETS 28 5 CU_DL 28 5 NIST 20 5 XLab 85
6 XMU SmartDSP 31 6 TailHot 30 6 IDSIA 28 6 LIVIA_ETS 91
7 LRDE 34 7 CU_DL2 31 7 MDGRU 31 7 CU_DL2 102
8 THUity 34 8 ASTRI_DL 37 8 CU_DL2 31 8 CU_DL 109
9 CU_DL2 40 9 MSL-SKKU 39 9 MSL-SKKU 35 9 LRDE 116
10 CU_DL 41 10 THUity 39 10 STH 37 10 MSL-SKKU 121
11 MDGRU 47 11 XMU SmartDSP 41 11 WTA2 38 11 MDGRU 146
12 MSL-SKKU 47 12 XLab 47 12 LIVIA_ETS 39 12 FBI/LMB Freiburg 150
13 nanand2 50 13 AOC 49 13 CU_DL 40 13 ASTRI_DL 151
14 WTA 55 14 FBI/LMB Freiburg 49 14 PyraMiD-LSTM2 42 14 THUity 152
15 FBI/LMB Freiburg 56 15 WTA 49 15 FBI/LMB Freiburg 45 15 PyraMiD-LSTM2 155
16 ISI-Neonatology 60 16 PyraMiD-LSTM2 50 16 ASTRI_DL 51 16 NIST 158
17 KSOM GHMF 63 17 UNC-IDEA 54 17 AOC 57 17 AOC 173
18 PyraMiD-LSTM2 63 18 NIST 61 18 MNAB2 57 18 IDSIA 177
19 STH 63 19 ISI-Neonatology 62 19 LRDE 58 19 STH 192
20 ASTRI_DL 63 20 ASTRI_MSA 65 20 nanand2 62 20 nanand2 195
21 AOC 67 21 BIGR2 68 21 BCH_CRL_IMAGINE 65 21 ISI-Neonatology 197
22 BCH_CRL_IMAGINE 67 22 MDGRU 68 22 ASTRI_MSA 67 22 UNC-IDEA 202
23 BIGR2 71 23 IDSIA 75 23 UNC-IDEA 67 23 ASTRI_MSA 220
24 Narsil 72 24 VBM12 75 24 vicorob UdG T1 68 24 BCH_CRL_IMAGINE 228
25 IDSIA 74 25 nanand2 83 25 vicorob UdG T1_F 71 25 KSOM GHMF 232
26 NIST 77 26 vicorob UdG T1_F 83 26 ISI-Neonatology 75 26 MNAB2 234
27 UB VPML Med 80 27 KSOM GHMF 86 27 THUity 79 27 WTA 247
28 UNC-IDEA 81 28 SPM12_T1_F* 88 28 VBM12 81 28 vicorob UdG T1_F 256
29 MNAB2 85 29 UB VPML Med 88 29 UofL BioImaging 83 29 VBM12 257
30 ASTRI_MSA 88 30 MNAB2 92 30 KSOM GHMF 83 30 BIGR2 262
31 VIBOT10 M-T1+F 88 31 STH 92 31 S2_QM2 96 31 vicorob UdG T1 273
32 SJCE 96 32 Narsil 93 32 Robarts 100 32 UofL BioImaging 292
33 drai 97 33 vicorob UdG T1 95 33 CMIV 103 33 CMIV 311
34 VBM12 101 34 BCH_CRL_IMAGINE 96 34 drai 103 34 UB VPML Med 315
35 CSIM-lab_Mqe-MMRF 101 35 CVSS 100 35 VIBOT10 M-T1+F 104 35 Narsil 319
36 vicorob UdG T1_F 102 36 CMIV 102 36 KM-MRF-MAS 107 36 drai 330
37 UofL BioImaging 102 37 SPM12_T1* 103 37 SPM12_T1_IR* 111 37 VIBOT10 M-T1+F 332
38 CVSS 104 38 MNAB 107 38 bigr_neuro 116 38 CVSS 334
39 bigr_neuro 105 39 UofL BioImaging 107 39 SPM12_T1_IR_F* 123 39 bigr_neuro 336
40 CMIV 106 40 bigr_neuro 115 40 BIGR2 123 40 S2_QM2 340
41 vicorob UdG T1 110 41 CSIM-lab_Mqe-MMRF 115 41 FSL-PVSeg* 124 41 Robarts 348
42 S2_QM2 110 42 SJCE 116 42 FSL-Seg* 124 42 KM-MRF-MAS 348
43 KM-MRF-MAS 117 43 Robarts 120 43 SPM12_T1_F* 125 43 SPM12_T1_F* 349
44 MNAB 120 44 SPM12_T1_IR* 123 44 CVSS 130 44 CSIM-lab_Mqe-MMRF 360
45 SPM12_T1* 125 45 KM-MRF-MAS 124 45 Jedi Mind Meld 132 45 SJCE 362
46 Robarts 128 46 FreeSurfer* 127 46 S2_QM 139 46 SPM12_T1_IR* 368
47 SPM12_T1_IR* 134 47 drai 130 47 WTA 143 47 SPM12_T1* 383
48 SPM12_T1_F* 136 48 S2_QM2 134 48 CSIM-lab_Mqe-MMRF 144 48 MNAB 388
49 FreeSurfer* 142 49 LUH-TNT 137 49 UB VPML Med 147 49 SPM12_T1_IR_F* 421
50 LUH-TNT 143 50 VIBOT10 M-T1+F 140 50 mlmi2014ss 148 50 FSL-Seg* 425
51 SPM12_T1_IR_F* 146 51 mlmi2014ss 147 51 SJCE 150 51 LUH-TNT 434
52 FSL-PVSeg* 152 52 FSL-Seg* 148 52 CSIM-Lab 153 52 FreeSurfer* 435
53 Jedi Mind Meld 152 53 SPM12_T1_IR_F* 152 53 Narsil 154 53 FSL-PVSeg* 438
54 FSL-Seg* 153 54 CSIM-Lab 157 54 LUH-TNT 154 54 Jedi Mind Meld 450
55 S2_QM 161 55 ISTB UniBe 162 55 SPM12_T1* 155 55 mlmi2014ss 456
56 mlmi2014ss 161 56 FSL-PVSeg* 162 56 LNMBrains 157 56 S2_QM 468
57 LNMBrains 166 57 Jedi Mind Meld 166 57 MNAB 161 57 CSIM-Lab 481
58 ISTB UniBe 169 58 S2_QM 168 58 FreeSurfer* 166 58 ISTB UniBe 497
59 CSIM-Lab 171 59 LNMBrains 174 59 ISTB UniBe 166 59 LNMBrains 497
60 ECOESH 180 60 ECOESH 180 60 ECOESH 179 60 ECOESH 539

GM = Gray matter, WM = White matter, CSF = Cerebrospinal fluid
Sum = Score GM + Score WM + Score CSF
Score = Rank DC + Rank HD + Rank AVD

Gray Matter Segmentation Results

Rank DC Rank HD Rank AVD GM Score
1 XMU_SmartDSP2 86.58 1 XMU_SmartDSP2 1.29 1 CSIM-lab_Mqe-MMRF 4.87 1 XMU_SmartDSP2 13
2 TailHot 86.40 2 LIVIA_ETS 1.34 2 SJCE 5.14 2 TailHot 16
3 LIVIA_ETS 86.33 3 XMU SmartDSP 1.35 3 THUity 5.24 3 WTA2 22
4 XMU SmartDSP 86.25 4 TailHot 1.38 4 drai 5.29 4 XLab 24
5 CU_DL2 86.15 5 CU_DL2 1.44 5 WTA2 5.43 5 LIVIA_ETS 28
6 CU_DL 86.12 6 LRDE 1.44 6 KSOM GHMF 5.44 6 XMU SmartDSP 31
7 XLab 86.09 7 WTA2 1.45 7 Narsil 5.52 7 LRDE 34
8 MSL-SKKU 86.06 8 XLab 1.45 8 BCH_CRL_IMAGINE 5.70 8 THUity 34
9 LRDE 86.03 9 CU_DL 1.47 9 XLab 5.71 9 CU_DL2 40
10 WTA2 86.00 10 nanand2 1.50 10 TailHot 5.72 10 CU_DL 41
11 ASTRI_DL 85.97 11 MSL-SKKU 1.52 11 XMU_SmartDSP2 5.75 11 MDGRU 47
12 ISI-Neonatology 85.77 12 MDGRU 1.54 12 nanand2 5.77 12 MSL-SKKU 47
13 WTA 85.70 13 FBI/LMB Freiburg 1.58 13 AOC 5.81 13 nanand2 50
14 FBI/LMB Freiburg 85.44 14 THUity 1.61 14 UB VPML Med 5.87 14 WTA 55
15 MDGRU 85.40 15 WTA 1.61 15 bigr_neuro 5.90 15 FBI/LMB Freiburg 56
16 NIST 85.26 16 UNC-IDEA 1.62 16 VBM12 5.91 16 ISI-Neonatology 60
17 THUity 85.24 17 ISI-Neonatology 1.62 17 vicorob UdG T1_F 5.98 17 KSOM GHMF 63
18 VIBOT10 M-T1+F 85.07 18 ASTRI_DL 1.63 18 STH 6.02 18 PyraMiD-LSTM2 63
19 PyraMiD-LSTM2 84.89 19 PyraMiD-LSTM2 1.67 19 LRDE 6.05 19 STH 63
20 IDSIA 84.82 20 MNAB2 1.70 20 MDGRU 6.09 20 ASTRI_DL 63
21 ASTRI_MSA 84.80 21 IDSIA 1.70 21 BIGR2 6.13 21 AOC 67
22 STH 84.77 22 UofL BioImaging 1.70 22 vicorob UdG T1 6.15 22 BCH_CRL_IMAGINE 67
23 BIGR2 84.65 23 STH 1.71 23 LIVIA_ETS 6.19 23 BIGR2 71
24 AOC 84.59 24 ASTRI_MSA 1.82 24 XMU SmartDSP 6.22 24 Narsil 72
25 MNAB2 84.50 25 NIST 1.83 25 PyraMiD-LSTM2 6.35 25 IDSIA 74
26 UNC-IDEA 84.36 26 VIBOT10 M-T1+F 1.87 26 CU_DL 6.42 26 NIST 77
27 BCH_CRL_IMAGINE 84.27 27 BIGR2 1.89 27 WTA 6.56 27 UB VPML Med 80
28 nanand2 84.21 28 KSOM GHMF 1.92 28 MSL-SKKU 6.60 28 UNC-IDEA 81
29 KSOM GHMF 84.13 29 Robarts 1.95 29 FBI/LMB Freiburg 6.60 29 MNAB2 85
30 MNAB 83.86 30 AOC 1.97 30 CU_DL2 6.60 30 ASTRI_MSA 88
31 Narsil 83.47 31 CVSS 1.98 31 ISI-Neonatology 6.62 31 VIBOT10 M-T1+F 88
32 S2_QM2 83.35 32 BCH_CRL_IMAGINE 2.03 32 CMIV 6.76 32 SJCE 96
33 UB VPML Med 83.31 33 UB VPML Med 2.09 33 IDSIA 6.77 33 drai 97
34 UofL BioImaging 82.96 34 Narsil 2.27 34 ASTRI_DL 6.78 34 VBM12 101
35 CMIV 82.43 35 FreeSurfer* 2.31 35 KM-MRF-MAS 6.79 35 CSIM-lab_Mqe-MMRF 101
36 CVSS 82.35 36 S2_QM2 2.36 36 NIST 6.82 36 vicorob UdG T1_F 102
37 VBM12 82.29 37 drai 2.48 37 CVSS 6.86 37 UofL BioImaging 102
38 vicorob UdG T1_F 82.19 38 LUH-TNT 2.62 38 SPM12_T1* 6.95 38 CVSS 104
39 vicorob UdG T1 82.07 39 CMIV 2.69 39 UNC-IDEA 7.04 39 bigr_neuro 105
40 bigr_neuro 81.46 40 KM-MRF-MAS 2.73 40 MNAB2 7.10 40 CMIV 106
41 SPM12_T1_F* 81.17 41 MNAB 2.79 41 SPM12_T1_IR* 7.23 41 vicorob UdG T1 110
42 KM-MRF-MAS 80.85 42 SPM12_T1_F* 2.90 42 S2_QM2 7.23 42 S2_QM2 110
43 SJCE 80.76 43 SPM12_T1* 2.93 43 ASTRI_MSA 7.25 43 KM-MRF-MAS 117
44 SPM12_T1* 80.34 44 mlmi2014ss 2.96 44 VIBOT10 M-T1+F 8.16 44 MNAB 120
45 SPM12_T1_IR_F* 80.15 45 SPM12_T1_IR* 3.01 45 FSL-PVSeg* 8.40 45 SPM12_T1* 125
46 CSIM-lab_Mqe-MMRF 80.09 46 SPM12_T1_IR_F* 3.03 46 UofL BioImaging 8.61 46 Robarts 128
47 Robarts 79.70 47 vicorob UdG T1_F 3.17 47 FSL-Seg* 8.65 47 SPM12_T1_IR* 134
48 SPM12_T1_IR* 79.41 48 VBM12 3.20 48 Jedi Mind Meld 8.94 48 SPM12_T1_F* 136
49 LUH-TNT 79.35 49 vicorob UdG T1 3.31 49 MNAB 9.11 49 FreeSurfer* 142
50 FSL-Seg* 78.66 50 bigr_neuro 3.67 50 S2_QM 9.28 50 LUH-TNT 143
51 Jedi Mind Meld 77.84 51 SJCE 3.71 51 LNMBrains 9.47 51 SPM12_T1_IR_F* 146
52 FSL-PVSeg* 77.66 52 ISTB UniBe 3.86 52 Robarts 9.77 52 FSL-PVSeg* 152
53 FreeSurfer* 77.41 53 Jedi Mind Meld 3.90 53 SPM12_T1_F* 10.59 53 Jedi Mind Meld 152
54 S2_QM 76.41 54 CSIM-lab_Mqe-MMRF 3.93 54 FreeSurfer* 12.15 54 FSL-Seg* 153
55 CSIM-Lab 75.65 55 FSL-PVSeg* 4.29 55 SPM12_T1_IR_F* 13.92 55 S2_QM 161
56 drai 74.53 56 FSL-Seg* 4.35 56 LUH-TNT 15.52 56 mlmi2014ss 161
57 LNMBrains 72.75 57 S2_QM 5.51 57 CSIM-Lab 18.07 57 LNMBrains 166
58 mlmi2014ss 71.70 58 LNMBrains 6.80 58 ISTB UniBe 19.11 58 ISTB UniBe 169
59 ISTB UniBe 68.62 59 CSIM-Lab 7.50 59 mlmi2014ss 24.56 59 CSIM-Lab 171
60 ECOESH 63.36 60 ECOESH 34.07 60 ECOESH 38.34 60 ECOESH 180

White Matter Segmentation Results

Rank DC Rank HD Rank AVD WM Score
1 XMU_SmartDSP2 89.87 1 XMU_SmartDSP2 1.73 1 WTA2 5.20 1 XMU_SmartDSP2 5
2 XLab 89.81 2 XMU SmartDSP 1.76 2 SPM12_T1_F* 5.21 2 WTA2 8
3 WTA2 89.74 3 LIVIA_ETS 1.78 3 XMU_SmartDSP2 5.47 3 LIVIA_ETS 24
4 TailHot 89.70 4 WTA2 1.82 4 THUity 5.52 4 LRDE 24
5 XMU SmartDSP 89.54 5 LRDE 1.86 5 MSL-SKKU 5.54 5 CU_DL 28
6 LIVIA_ETS 89.46 6 XLab 1.87 6 ASTRI_DL 5.67 6 TailHot 30
7 CU_DL2 89.46 7 TailHot 1.88 7 AOC 5.72 7 CU_DL2 31
8 WTA 89.40 8 CU_DL2 1.93 8 Narsil 5.78 8 ASTRI_DL 37
9 CU_DL 89.39 9 CU_DL 1.93 9 LRDE 5.83 9 MSL-SKKU 39
10 LRDE 89.29 10 FBI/LMB Freiburg 1.95 10 CU_DL 5.84 10 THUity 39
11 ASTRI_DL 89.24 11 nanand2 1.98 11 PyraMiD-LSTM2 5.93 11 XMU SmartDSP 41
12 THUity 89.00 12 WTA 2.00 12 vicorob UdG T1_F 5.94 12 XLab 47
13 MSL-SKKU 89.00 13 MDGRU 2.02 13 SPM12_T1* 5.99 13 AOC 49
14 MDGRU 88.98 14 NIST 2.05 14 BIGR2 6.02 14 FBI/LMB Freiburg 49
15 NIST 88.88 15 UNC-IDEA 2.06 15 LIVIA_ETS 6.03 15 WTA 49
16 FBI/LMB Freiburg 88.86 16 ISI-Neonatology 2.07 16 CU_DL2 6.05 16 PyraMiD-LSTM2 50
17 UNC-IDEA 88.68 17 PyraMiD-LSTM2 2.07 17 VBM12 6.06 17 UNC-IDEA 54
18 AOC 88.68 18 ASTRI_MSA 2.08 18 vicorob UdG T1 6.21 18 NIST 61
19 ISI-Neonatology 88.66 19 IDSIA 2.08 19 TailHot 6.28 19 ISI-Neonatology 62
20 BCH_CRL_IMAGINE 88.63 20 ASTRI_DL 2.10 20 SPM12_T1_IR* 6.34 20 ASTRI_MSA 65
21 UB VPML Med 88.61 21 MSL-SKKU 2.11 21 SJCE 6.43 21 BIGR2 68
22 PyraMiD-LSTM2 88.53 22 MNAB2 2.12 22 UNC-IDEA 6.46 22 MDGRU 68
23 ASTRI_MSA 88.46 23 THUity 2.16 23 FBI/LMB Freiburg 6.47 23 IDSIA 75
24 STH 88.45 24 AOC 2.19 24 ASTRI_MSA 6.52 24 VBM12 75
25 BIGR2 88.42 25 BCH_CRL_IMAGINE 2.23 25 KSOM GHMF 6.59 25 nanand2 83
26 IDSIA 88.33 26 UofL BioImaging 2.24 26 CSIM-lab_Mqe-MMRF 6.92 26 vicorob UdG T1_F 83
27 nanand2 88.32 27 VBM12 2.32 27 ISI-Neonatology 6.96 27 KSOM GHMF 86
28 MNAB2 88.04 28 STH 2.34 28 drai 6.99 28 SPM12_T1_F* 88
29 CVSS 88.00 29 BIGR2 2.36 29 WTA 7.02 29 UB VPML Med 88
30 KSOM GHMF 87.96 30 CMIV 2.43 30 IDSIA 7.05 30 MNAB2 92
31 VBM12 87.95 31 KSOM GHMF 2.49 31 Robarts 7.06 31 STH 92
32 MNAB 87.95 32 MNAB 2.65 32 NIST 7.11 32 Narsil 93
33 UofL BioImaging 87.88 33 KM-MRF-MAS 2.70 33 UB VPML Med 7.13 33 vicorob UdG T1 95
34 CMIV 87.71 34 UB VPML Med 2.72 34 XMU SmartDSP 7.15 34 BCH_CRL_IMAGINE 96
35 vicorob UdG T1_F 87.34 35 CVSS 2.86 35 FreeSurfer* 7.18 35 CVSS 100
36 VIBOT10 M-T1+F 87.32 36 vicorob UdG T1_F 2.88 36 CVSS 7.20 36 CMIV 102
37 bigr_neuro 87.31 37 mlmi2014ss 2.89 37 bigr_neuro 7.31 37 SPM12_T1* 103
38 Narsil 87.10 38 vicorob UdG T1 2.91 38 CMIV 7.34 38 MNAB 107
39 vicorob UdG T1 87.06 39 LUH-TNT 2.96 39 XLab 7.61 39 UofL BioImaging 107
40 SJCE 86.83 40 SPM12_T1_F* 3.00 40 STH 7.67 40 bigr_neuro 115
41 CSIM-lab_Mqe-MMRF 86.76 41 bigr_neuro 3.01 41 MDGRU 7.69 41 CSIM-lab_Mqe-MMRF 115
42 KM-MRF-MAS 86.73 42 SPM12_T1* 3.06 42 MNAB2 7.74 42 SJCE 116
43 LUH-TNT 86.47 43 FreeSurfer* 3.06 43 MNAB 7.75 43 Robarts 120
44 S2_QM2 86.34 44 Robarts 3.06 44 S2_QM2 7.91 44 SPM12_T1_IR* 123
45 Robarts 86.15 45 drai 3.23 45 nanand2 7.99 45 KM-MRF-MAS 124
46 SPM12_T1_F* 86.03 46 S2_QM2 3.29 46 VIBOT10 M-T1+F 8.01 46 FreeSurfer* 127
47 FSL-Seg* 85.98 47 Narsil 3.31 47 SPM12_T1_IR_F* 8.40 47 drai 130
48 SPM12_T1* 85.58 48 CSIM-lab_Mqe-MMRF 3.33 48 UofL BioImaging 8.74 48 S2_QM2 134
49 FreeSurfer* 85.25 49 SPM12_T1_IR* 3.60 49 KM-MRF-MAS 9.19 49 LUH-TNT 137
50 CSIM-Lab 85.24 50 CSIM-Lab 3.65 50 FSL-Seg* 11.47 50 VIBOT10 M-T1+F 140
51 FSL-PVSeg* 84.84 51 FSL-Seg* 3.65 51 BCH_CRL_IMAGINE 12.38 51 mlmi2014ss 147
52 S2_QM 83.86 52 SPM12_T1_IR_F* 3.84 52 Jedi Mind Meld 13.66 52 FSL-Seg* 148
53 SPM12_T1_IR_F* 83.64 53 FSL-PVSeg* 3.85 53 ISTB UniBe 13.71 53 SPM12_T1_IR_F* 152
54 SPM12_T1_IR* 83.54 54 ISTB UniBe 3.98 54 mlmi2014ss 14.00 54 CSIM-Lab 157
55 ISTB UniBe 82.50 55 SJCE 4.29 55 LUH-TNT 14.20 55 ISTB UniBe 162
56 mlmi2014ss 81.98 56 Jedi Mind Meld 4.52 56 LNMBrains 15.34 56 FSL-PVSeg* 162
57 drai 80.75 57 S2_QM 4.94 57 CSIM-Lab 17.39 57 Jedi Mind Meld 166
58 Jedi Mind Meld 80.64 58 VIBOT10 M-T1+F 6.63 58 FSL-PVSeg* 19.69 58 S2_QM 168
59 LNMBrains 78.32 59 LNMBrains 6.77 59 S2_QM 24.79 59 LNMBrains 174
60 ECOESH 75.82 60 ECOESH 38.46 60 ECOESH 25.27 60 ECOESH 180

Cerebrospinal Fluid Segmentation Results

Rank DC Rank HD Rank AVD CSF Score
1 XMU SmartDSP 85.16 1 XMU_SmartDSP2 1.84 1 XMU SmartDSP 6.15 1 XMU SmartDSP 4
2 TailHot 84.86 2 XMU SmartDSP 1.90 2 WTA2 6.20 2 TailHot 11
3 XMU_SmartDSP2 84.81 3 TailHot 2.03 3 AOC 6.51 3 XMU_SmartDSP2 14
4 CU_DL2 84.25 4 XLab 2.03 4 STH 6.73 4 XLab 14
5 XLab 84.24 5 NIST 2.07 5 XLab 6.74 5 NIST 20
6 ASTRI_DL 84.23 6 IDSIA 2.14 6 TailHot 6.75 6 IDSIA 28
7 MDGRU 84.13 7 MDGRU 2.17 7 NIST 6.75 7 MDGRU 31
8 NIST 84.01 8 CU_DL2 2.19 8 MSL-SKKU 6.77 8 CU_DL2 31
9 CU_DL 83.96 9 FBI/LMB Freiburg 2.22 9 VBM12 6.80 9 MSL-SKKU 35
10 MSL-SKKU 83.76 10 LIVIA_ETS 2.26 10 XMU_SmartDSP2 6.84 10 STH 37
11 IDSIA 83.72 11 MNAB2 2.27 11 IDSIA 7.09 11 WTA2 38
12 FBI/LMB Freiburg 83.47 12 LRDE 2.28 12 BCH_CRL_IMAGINE 7.12 12 LIVIA_ETS 39
13 LIVIA_ETS 83.42 13 CU_DL 2.28 13 PyraMiD-LSTM2 7.17 13 CU_DL 40
14 BCH_CRL_IMAGINE 83.26 14 PyraMiD-LSTM2 2.30 14 vicorob UdG T1 7.17 14 PyraMiD-LSTM2 42
15 PyraMiD-LSTM2 83.05 15 STH 2.31 15 vicorob UdG T1_F 7.21 15 FBI/LMB Freiburg 45
16 UNC-IDEA 82.81 16 nanand2 2.32 16 LIVIA_ETS 7.31 16 ASTRI_DL 51
17 WTA2 82.77 17 MSL-SKKU 2.32 17 MDGRU 7.44 17 AOC 57
18 STH 82.77 18 UNC-IDEA 2.35 18 CU_DL 7.44 18 MNAB2 57
19 LRDE 82.44 19 WTA2 2.41 19 CU_DL2 7.69 19 LRDE 58
20 MNAB2 82.30 20 ASTRI_DL 2.54 20 ASTRI_MSA 7.98 20 nanand2 62
21 KSOM GHMF 82.10 21 ISI-Neonatology 2.65 21 nanand2 8.03 21 BCH_CRL_IMAGINE 65
22 ASTRI_MSA 81.73 22 Robarts 2.66 22 drai 8.14 22 ASTRI_MSA 67
23 THUity 81.27 23 UofL BioImaging 2.66 23 THUity 8.28 23 UNC-IDEA 67
24 ISI-Neonatology 81.08 24 KSOM GHMF 2.71 24 FBI/LMB Freiburg 8.63 24 vicorob UdG T1 68
25 nanand2 80.80 25 ASTRI_MSA 2.77 25 ASTRI_DL 8.70 25 vicorob UdG T1_F 71
26 AOC 80.46 26 vicorob UdG T1 2.81 26 MNAB2 8.73 26 ISI-Neonatology 75
27 Robarts 80.28 27 vicorob UdG T1_F 2.81 27 LRDE 9.03 27 THUity 79
28 vicorob UdG T1 80.18 28 AOC 2.84 28 S2_QM2 9.36 28 VBM12 81
29 vicorob UdG T1_F 80.17 29 VIBOT10 M-T1+F 2.98 29 UofL BioImaging 9.68 29 UofL BioImaging 83
30 VIBOT10 M-T1+F 79.73 30 CMIV 3.00 30 ISI-Neonatology 9.77 30 KSOM GHMF 83
31 UofL BioImaging 78.86 31 VBM12 3.03 31 SPM12_T1_F* 10.07 31 S2_QM2 96
32 CMIV 78.57 32 S2_QM2 3.05 32 SPM12_T1_IR* 10.47 32 Robarts 100
33 BIGR2 78.31 33 THUity 3.07 33 UNC-IDEA 10.52 33 CMIV 103
34 SPM12_T1_IR* 78.25 34 KM-MRF-MAS 3.08 34 FSL-PVSeg* 10.69 34 drai 103
35 bigr_neuro 78.16 35 bigr_neuro 3.15 35 KM-MRF-MAS 10.95 35 VIBOT10 M-T1+F 104
36 S2_QM2 77.97 36 drai 3.17 36 FSL-Seg* 11.83 36 KM-MRF-MAS 107
37 WTA 77.77 37 BIGR2 3.19 37 SPM12_T1_IR_F* 12.21 37 SPM12_T1_IR* 111
38 KM-MRF-MAS 76.97 38 CVSS 3.25 38 KSOM GHMF 12.78 38 bigr_neuro 116
39 SPM12_T1_IR_F* 76.87 39 BCH_CRL_IMAGINE 3.28 39 CSIM-Lab 13.31 39 SPM12_T1_IR_F* 123
40 UB VPML Med 74.82 40 FSL-Seg* 3.41 40 Narsil 13.54 40 BIGR2 123
41 VBM12 74.56 41 FSL-PVSeg* 3.44 41 CMIV 14.31 41 FSL-PVSeg* 124
42 SPM12_T1_F* 74.03 42 Jedi Mind Meld 3.67 42 S2_QM 14.45 42 FSL-Seg* 124
43 Jedi Mind Meld 73.33 43 mlmi2014ss 3.77 43 SJCE 14.99 43 SPM12_T1_F* 125
44 CVSS 72.59 44 S2_QM 3.79 44 CSIM-lab_Mqe-MMRF 15.97 44 CVSS 130
45 drai 70.95 45 SPM12_T1_IR* 4.01 45 VIBOT10 M-T1+F 16.06 45 Jedi Mind Meld 132
46 SPM12_T1* 70.69 46 LUH-TNT 4.07 46 bigr_neuro 16.47 46 S2_QM 139
47 mlmi2014ss 70.59 47 SPM12_T1_IR_F* 4.15 47 Jedi Mind Meld 17.60 47 WTA 143
48 FSL-Seg* 69.95 48 CSIM-lab_Mqe-MMRF 4.24 48 CVSS 17.94 48 CSIM-lab_Mqe-MMRF 144
49 FSL-PVSeg* 69.49 49 FreeSurfer* 4.31 49 LNMBrains 19.87 49 UB VPML Med 147
50 LNMBrains 68.80 50 UB VPML Med 4.31 50 ISTB UniBe 19.89 50 mlmi2014ss 148
51 MNAB 68.08 51 WTA 4.35 51 Robarts 20.36 51 SJCE 150
52 CSIM-lab_Mqe-MMRF 68.03 52 SPM12_T1_F* 4.59 52 LUH-TNT 20.40 52 CSIM-Lab 153
53 S2_QM 67.87 53 SJCE 4.78 53 BIGR2 22.76 53 Narsil 154
54 SJCE 67.67 54 MNAB 4.88 54 SPM12_T1* 23.24 54 LUH-TNT 154
55 Narsil 66.57 55 SPM12_T1* 5.34 55 WTA 24.67 55 SPM12_T1* 155
56 LUH-TNT 66.47 56 CSIM-Lab 5.44 56 MNAB 28.56 56 LNMBrains 157
57 FreeSurfer* 65.79 57 ISTB UniBe 6.94 57 UB VPML Med 31.19 57 MNAB 161
58 CSIM-Lab 59.82 58 LNMBrains 7.66 58 mlmi2014ss 33.45 58 FreeSurfer* 166
59 ISTB UniBe 54.69 59 Narsil 13.30 59 ECOESH 36.59 59 ISTB UniBe 166
60 ECOESH 51.48 60 ECOESH 18.75 60 FreeSurfer* 50.27 60 ECOESH 179

Brain (GM and WM segmentations combined) Results

Rank DC Rank HD Rank AVD Brain Score
1 TailHot 95.83 1 XMU SmartDSP 1.89 1 UB VPML Med 2.35 1 LIVIA_ETS 17
2 XMU_SmartDSP2 95.79 2 XLab 1.93 2 STH 2.51 2 LRDE 21
3 XMU SmartDSP 95.78 3 XMU_SmartDSP2 1.95 3 AOC 2.52 3 TailHot 21
4 XLab 95.77 4 LIVIA_ETS 1.99 4 CMIV 2.58 4 XLab 26
5 CU_DL2 95.74 5 LRDE 2.07 5 THUity 2.62 5 WTA2 27
6 LIVIA_ETS 95.70 6 TailHot 2.09 6 LRDE 2.62 6 XMU SmartDSP 34
7 CU_DL 95.70 7 WTA2 2.12 7 LIVIA_ETS 2.67 7 MSL-SKKU 34
8 ASTRI_DL 95.67 8 nanand2 2.17 8 WTA2 2.68 8 CU_DL 35
9 MSL-SKKU 95.67 9 ISI-Neonatology 2.18 9 WTA 2.73 9 ISI-Neonatology 36
10 LRDE 95.65 10 CU_DL 2.19 10 PyraMiD-LSTM2 2.73 10 STH 37
11 ISI-Neonatology 95.65 11 CU_DL2 2.24 11 MSL-SKKU 2.73 11 CU_DL2 37
12 WTA2 95.62 12 IDSIA 2.27 12 VBM12 2.77 12 WTA 38
13 WTA 95.59 13 MDGRU 2.29 13 S2_QM2 2.78 13 MDGRU 42
14 MDGRU 95.59 14 MSL-SKKU 2.29 14 TailHot 2.79 14 XMU_SmartDSP2 44
15 ASTRI_MSA 95.40 15 FBI/LMB Freiburg 2.33 15 MDGRU 2.79 15 THUity 46
16 FBI/LMB Freiburg 95.40 16 WTA 2.35 16 ISI-Neonatology 2.80 16 AOC 50
17 BCH_CRL_IMAGINE 95.39 17 STH 2.38 17 ASTRI_DL 2.88 17 PyraMiD-LSTM2 50
18 STH 95.37 18 THUity 2.39 18 CU_DL 2.89 18 ASTRI_DL 50
19 PyraMiD-LSTM2 95.30 19 MNAB2 2.41 19 Narsil 2.91 19 nanand2 52
20 IDSIA 95.29 20 UofL BioImaging 2.41 20 XLab 2.93 20 IDSIA 60
21 NIST 95.29 21 PyraMiD-LSTM2 2.45 21 CU_DL2 2.94 21 UB VPML Med 64
22 nanand2 95.22 22 UNC-IDEA 2.48 22 nanand2 2.95 22 FBI/LMB Freiburg 65
23 THUity 95.22 23 AOC 2.53 23 FSL-Seg* 2.95 23 ASTRI_MSA 65
24 AOC 95.19 24 ASTRI_MSA 2.54 24 vicorob UdG T1 2.97 24 S2_QM2 69
25 MNAB2 95.16 25 ASTRI_DL 2.64 25 vicorob UdG T1_F 2.98 25 MNAB2 77
26 KSOM GHMF 95.13 26 S2_QM2 2.73 26 ASTRI_MSA 3.02 26 CMIV 82
27 BIGR2 95.13 27 BIGR2 2.74 27 BCH_CRL_IMAGINE 3.06 27 Narsil 83
28 UNC-IDEA 95.05 28 KM-MRF-MAS 2.76 28 IDSIA 3.10 28 VBM12 84
29 UofL BioImaging 94.93 29 Robarts 2.78 29 KSOM GHMF 3.15 29 BCH_CRL_IMAGINE 84
30 S2_QM2 94.90 30 UB VPML Med 2.80 30 XMU SmartDSP 3.17 30 NIST 86
31 VIBOT10 M-T1+F 94.89 31 CVSS 2.84 31 NIST 3.18 31 KSOM GHMF 88
32 Narsil 94.78 32 Narsil 2.86 32 drai 3.20 32 BIGR2 90
33 UB VPML Med 94.59 33 KSOM GHMF 2.86 33 MNAB2 3.21 33 UofL BioImaging 94
34 VBM12 94.50 34 NIST 2.86 34 FBI/LMB Freiburg 3.22 34 UNC-IDEA 97
35 CMIV 94.48 35 LUH-TNT 2.90 35 SPM12_T1* 3.23 35 vicorob UdG T1_F 103
36 MNAB 94.47 36 drai 3.05 36 BIGR2 3.24 36 vicorob UdG T1 104
37 vicorob UdG T1_F 94.27 37 mlmi2014ss 3.23 37 CSIM-lab_Mqe-MMRF 3.35 37 LUH-TNT 120
38 vicorob UdG T1 94.25 38 VBM12 3.36 38 SPM12_T1_IR* 3.38 38 CVSS 120
39 LUH-TNT 94.17 39 FreeSurfer* 3.55 39 XMU_SmartDSP2 3.41 39 drai 123
40 CVSS 94.08 40 BCH_CRL_IMAGINE 3.64 40 Jedi Mind Meld 3.46 40 KM-MRF-MAS 123
41 bigr_neuro 93.99 41 vicorob UdG T1_F 3.73 41 FSL-PVSeg* 3.46 41 FSL-Seg* 126
42 KM-MRF-MAS 93.97 42 vicorob UdG T1 3.74 42 bigr_neuro 3.57 42 SPM12_T1* 126
43 SPM12_T1_IR* 93.93 43 CMIV 3.82 43 MNAB 3.76 43 CSIM-lab_Mqe-MMRF 127
44 SPM12_T1_F* 93.87 44 CSIM-lab_Mqe-MMRF 4.26 44 SJCE 3.79 44 MNAB 127
45 SPM12_T1* 93.85 45 ISTB UniBe 4.39 45 UofL BioImaging 3.88 45 VIBOT10 M-T1+F 130
46 CSIM-lab_Mqe-MMRF 93.66 46 SPM12_T1* 4.45 46 LUH-TNT 4.11 46 SPM12_T1_IR* 131
47 FSL-PVSeg* 93.59 47 SJCE 4.52 47 UNC-IDEA 4.21 47 bigr_neuro 132
48 SPM12_T1_IR_F* 93.59 48 MNAB 4.54 48 VIBOT10 M-T1+F 4.84 48 Robarts 138
49 SJCE 93.48 49 bigr_neuro 4.57 49 CVSS 4.91 49 SJCE 140
50 FSL-Seg* 93.30 50 SPM12_T1_IR* 4.63 50 SPM12_T1_IR_F* 5.11 50 FSL-PVSeg* 144
51 S2_QM 93.27 51 VIBOT10 M-T1+F 4.91 51 SPM12_T1_F* 5.33 51 Jedi Mind Meld 144
52 Jedi Mind Meld 93.24 52 Jedi Mind Meld 5.44 52 S2_QM 5.48 52 FreeSurfer* 147
53 Robarts 93.13 53 FSL-Seg* 5.53 53 KM-MRF-MAS 5.58 53 SPM12_T1_F* 149
54 FreeSurfer* 92.32 54 SPM12_T1_F* 5.85 54 FreeSurfer* 6.27 54 mlmi2014ss 151
55 drai 91.97 55 SPM12_T1_IR_F* 5.91 55 LNMBrains 7.37 55 SPM12_T1_IR_F* 153
56 CSIM-Lab 91.20 56 FSL-PVSeg* 6.09 56 Robarts 7.88 56 S2_QM 160
57 mlmi2014ss 90.75 57 S2_QM 6.98 57 mlmi2014ss 12.05 57 ISTB UniBe 163
58 LNMBrains 88.51 58 LNMBrains 8.56 58 CSIM-Lab 15.76 58 LNMBrains 171
59 ISTB UniBe 87.80 59 CSIM-Lab 11.24 59 ISTB UniBe 17.26 59 CSIM-Lab 173
60 ECOESH 78.24 60 ECOESH 35.99 60 ECOESH 32.06 60 ECOESH 180

Intracranial cavity (GM, WM, and CSF segmentations combined) Results

Rank DC Rank HD Rank AVD ICV Score
1 NIST 98.36 1 NIST 2.03 1 XLab 0.53 1 NIST 8
2 XMU SmartDSP 98.25 2 XMU_SmartDSP2 2.28 2 UNC-IDEA 0.68 2 XMU SmartDSP 18
3 XMU_SmartDSP2 98.22 3 XMU SmartDSP 2.34 3 PyraMiD-LSTM2 0.69 3 MDGRU 18
4 TailHot 98.17 4 MDGRU 2.37 4 STH 0.69 4 IDSIA 20
5 ASTRI_DL 98.16 5 IDSIA 2.44 5 BCH_CRL_IMAGINE 0.75 5 XLab 22
6 IDSIA 98.15 6 ASTRI_DL 2.47 6 NIST 0.77 6 XMU_SmartDSP2 22
7 MDGRU 98.15 7 FBI/LMB Freiburg 2.51 7 MDGRU 0.86 7 ASTRI_DL 23
8 CU_DL2 98.10 8 Robarts 2.55 8 Robarts 0.91 8 PyraMiD-LSTM2 25
9 PyraMiD-LSTM2 98.04 9 XLab 2.67 9 IDSIA 0.95 9 UNC-IDEA 27
10 CU_DL 97.99 10 UNC-IDEA 2.72 10 SPM12_T1_IR* 0.99 10 FBI/LMB Freiburg 29
11 FBI/LMB Freiburg 97.99 11 CU_DL2 2.75 11 FBI/LMB Freiburg 1.06 11 Robarts 30
12 XLab 97.96 12 TailHot 2.78 12 ASTRI_DL 1.09 12 TailHot 32
13 MSL-SKKU 97.96 13 PyraMiD-LSTM2 2.86 13 XMU SmartDSP 1.10 13 STH 38
14 Robarts 97.92 14 LRDE 2.87 14 THUity 1.13 14 CU_DL2 41
15 UNC-IDEA 97.92 15 STH 2.92 15 SPM12_T1_IR_F* 1.17 15 MSL-SKKU 60
16 BCH_CRL_IMAGINE 97.82 16 MNAB2 2.95 16 TailHot 1.23 16 LRDE 60
17 LIVIA_ETS 97.82 17 LIVIA_ETS 2.96 17 XMU_SmartDSP2 1.35 17 LIVIA_ETS 61
18 SPM12_T1_IR* 97.73 18 nanand2 3.00 18 LRDE 1.44 18 CU_DL 62
19 STH 97.72 19 WTA2 3.00 19 ASTRI_MSA 1.44 19 ASTRI_MSA 64
20 SPM12_T1_IR_F* 97.71 20 CU_DL 3.17 20 SPM12_T1_F* 1.46 20 MNAB2 68
21 ASTRI_MSA 97.71 21 KSOM GHMF 3.23 21 MSL-SKKU 1.46 21 nanand2 70
22 MNAB2 97.66 22 UofL BioImaging 3.43 22 CU_DL2 1.54 22 SPM12_T1_IR* 71
23 vicorob UdG T1 97.65 23 AOC 3.53 23 nanand2 1.58 23 vicorob UdG T1 75
24 vicorob UdG T1_F 97.64 24 ASTRI_MSA 3.60 24 vicorob UdG T1 1.62 24 BCH_CRL_IMAGINE 77
25 VIBOT10 M-T1+F 97.63 25 S2_QM2 3.72 25 VIBOT10 M-T1+F 1.64 25 vicorob UdG T1_F 80
26 WTA2 97.61 26 MSL-SKKU 3.75 26 vicorob UdG T1_F 1.65 26 WTA2 80
27 KSOM GHMF 97.56 27 CMIV 3.76 27 LIVIA_ETS 1.67 27 AOC 81
28 LRDE 97.53 28 vicorob UdG T1 3.85 28 AOC 1.73 28 VIBOT10 M-T1+F 81
29 nanand2 97.30 29 drai 3.89 29 ISI-Neonatology 1.74 29 KSOM GHMF 82
30 AOC 97.22 30 vicorob UdG T1_F 3.90 30 MNAB2 1.77 30 UofL BioImaging 87
31 THUity 96.95 31 VIBOT10 M-T1+F 3.91 31 UofL BioImaging 1.81 31 SPM12_T1_IR_F* 88
32 ISI-Neonatology 96.92 32 BIGR2 3.93 32 CU_DL 1.83 32 THUity 94
33 CMIV 96.79 33 bigr_neuro 3.93 33 drai 1.85 33 ISI-Neonatology 95
34 UofL BioImaging 96.71 34 ISI-Neonatology 4.29 34 KSOM GHMF 1.95 34 S2_QM2 98
35 SPM12_T1_F* 96.59 35 CVSS 4.87 35 WTA2 1.98 35 drai 102
36 S2_QM2 96.44 36 VBM12 4.89 36 VBM12 2.37 36 CMIV 106
37 bigr_neuro 96.33 37 KM-MRF-MAS 5.08 37 S2_QM2 2.38 37 SPM12_T1_F* 107
38 KM-MRF-MAS 96.10 38 FSL-PVSeg* 5.29 38 CVSS 2.55 38 bigr_neuro 112
39 BIGR2 96.00 39 FSL-Seg* 5.29 39 KM-MRF-MAS 2.99 39 VBM12 113
40 drai 95.99 40 WTA 5.32 40 FSL-PVSeg* 3.37 40 KM-MRF-MAS 114
41 VBM12 95.95 41 CSIM-lab_Mqe-MMRF 6.09 41 FSL-Seg* 3.37 41 BIGR2 118
42 mlmi2014ss 95.84 42 S2_QM 6.49 42 bigr_neuro 3.46 42 CVSS 119
43 WTA 95.34 43 SPM12_T1_IR* 6.51 43 mlmi2014ss 3.60 43 FSL-PVSeg* 126
44 SPM12_T1* 95.28 44 FreeSurfer* 6.62 44 Narsil 3.69 44 FSL-Seg* 129
45 UB VPML Med 94.83 45 UB VPML Med 6.63 45 S2_QM 4.01 45 WTA 135
46 CVSS 94.62 46 LUH-TNT 6.85 46 CMIV 4.87 46 S2_QM 138
47 Jedi Mind Meld 94.26 47 MNAB 7.06 47 BIGR2 5.18 47 mlmi2014ss 139
48 FSL-PVSeg* 94.24 48 SJCE 7.31 48 SPM12_T1* 5.53 48 CSIM-lab_Mqe-MMRF 140
49 FSL-Seg* 94.24 49 THUity 7.67 49 CSIM-lab_Mqe-MMRF 6.47 49 SPM12_T1* 143
50 CSIM-lab_Mqe-MMRF 94.03 50 CSIM-Lab 8.09 50 SJCE 6.77 50 UB VPML Med 143
51 S2_QM 93.71 51 SPM12_T1* 8.09 51 Jedi Mind Meld 6.82 51 SJCE 150
52 SJCE 93.66 52 SPM12_T1_F* 8.21 52 WTA 6.86 52 LUH-TNT 154
53 LUH-TNT 93.18 53 SPM12_T1_IR_F* 8.23 53 UB VPML Med 7.67 53 Jedi Mind Meld 155
54 MNAB 92.52 54 mlmi2014ss 8.69 54 LNMBrains 7.88 54 MNAB 157
55 Narsil 92.49 55 ISTB UniBe 9.84 55 LUH-TNT 9.14 55 FreeSurfer* 158
56 FreeSurfer* 92.39 56 BCH_CRL_IMAGINE 11.34 56 MNAB 9.71 56 Narsil 159
57 CSIM-Lab 92.34 57 Jedi Mind Meld 20.34 57 CSIM-Lab 10.06 57 CSIM-Lab 164
58 LNMBrains 89.17 58 LNMBrains 20.36 58 FreeSurfer* 10.19 58 LNMBrains 170
59 ISTB UniBe 88.53 59 ECOESH 21.43 59 ISTB UniBe 17.52 59 ISTB UniBe 173
60 ECOESH 78.14 60 Narsil 23.65 60 ECOESH 30.13 60 ECOESH 179

DC = Dice Coefficient, HD = 95th percentile of Hausdorff Distance, AVD = Absolute Volume Difference
Score = Rank DC + Rank HD + Rank AVD





© 2013 Image Sciences Institute.