×
Note: As of March 2025, the cumulative results are based on the minimum number of datasets to reach n datapoints (default=500). This number is adjustable through the 'minimum # of trailing data points' dropdown menu. This change was made to help smooth out the effects of small sample sizes and make the interface more flexible.
MHC II Automated Server Benchmarks
This is a live ranking of MHC II servers based on performance, which continues to be reevaluated over time. The weekly IEDB releases are automatically checked for datasets large enough to add to the benchmarks. The benchmark metrics in the table below will only be updated on releases where such new data is becoming available.
Accumulated overall ranking scores
Cumulative scores are based on datasets from the most recent references in the IEDB.
| Server | 2024-08-30 (n:1372) | 2024-04-19 (n:561) | 2024-04-05 (n:502) | 2023-11-10 (n:500) | 2023-09-01 (n:528) | 2023-07-28 (n:502) | 2023-04-21 (n:504) | 2023-03-03 (n:33107) | 2023-01-27 (n:33009) | 2022-10-28 (n:32887) | 2022-09-16 (n:32655) | 2022-09-02 (n:574) | 2022-06-17 (n:550) | 2022-06-10 (n:529) | 2022-04-08 (n:505) | 2022-04-01 (n:777) | 2021-12-10 (n:581) | 2021-11-05 (n:553) | 2021-10-29 (n:624) | 2021-07-23 (n:639) | 2021-04-23 (n:1066) | 2021-04-16 (n:904) | 2021-02-19 (n:885) | 2021-01-22 (n:686) | 2020-12-18 (n:511) | 2020-10-30 (n:630) | 2020-10-23 (n:1046) | 2020-08-07 (n:1046) | 2020-06-26 (n:1001) | 2020-05-01 (n:936) | 2020-03-27 (n:734) | 2020-03-16 (n:692) | 2020-01-03 (n:662) | 2019-07-02 (n:662) | 2019-05-24 (n:514) | 2019-03-22 (n:1308) | 2018-11-23 (n:1203) | 2017-12-29 (n:1192) | 2017-11-24 (n:1179) | 2017-08-18 (n:1163) | 2017-06-30 (n:1163) | 2017-04-28 (n:1039) | 2017-04-11 (n:1039) | 2016-12-31 (n:16938) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NetMHCIIpan-4.2 BA | 86 | 73 | 82 | 76 | 73 | 74 | 68 | 70 | 70 | 69 | 72 | 68 | 68 | 67 | 67 | 61 | 65 | 64 | 69 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-4.1 BA | 80 | 65 | 68 | 79 | 80 | 82 | 70 | 69 | 67 | 66 | 64 | 63 | 63 | 62 | 62 | 65 | 66 | 65 | 63 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-4.3 BA | 78 | 77 | 82 | 75 | 68 | 69 | 67 | 72 | 73 | 72 | 77 | 67 | 66 | 66 | 65 | 64 | 72 | 73 | 78 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-4.0 BA | 74 | 64 | 64 | 73 | 77 | 78 | 69 | 67 | 66 | 65 | 57 | 63 | 64 | 63 | 62 | 64 | 63 | 62 | 58 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NN-align 2.3 | 67 | 38 | 56 | 54 | 57 | 58 | 51 | 48 | 49 | 50 | 46 | 62 | 65 | 67 | 65 | 67 | 65 | 67 | 66 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-3.2 | 64 | 56 | 79 | 71 | 64 | 64 | 62 | 60 | 60 | 60 | 47 | 50 | 52 | 51 | 48 | 53 | 68 | 70 | 75 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NN-align | 56 | 59 | 66 | 46 | 43 | 42 | 43 | 41 | 41 | 41 | 29 | 59 | 60 | 62 | 61 | 57 | 55 | 56 | 56 | 56 | 65 | 76 | 76 | 84 | 59 | 72 | 77 | 77 | 79 | 81 | 96 | 100 | 100 | 100 | 67 | 69 | 72 | 73 | 73 | 75 | 75 | 80 | 80 | 65 |
| NetMHCIIpan-3.1 | 49 | 68 | 79 | 55 | 51 | 52 | 65 | 55 | 54 | 54 | 30 | 48 | 49 | 47 | 45 | 41 | 46 | 47 | 52 | 56 | 58 | 63 | 61 | 61 | 46 | 56 | 60 | 60 | 58 | 61 | 63 | 50 | 25 | 25 | 72 | 84 | 84 | 84 | 85 | 84 | 84 | 92 | 92 | 81 |
| Consensus IEDB method | 47 | 55 | 56 | 54 | 54 | 56 | 54 | 55 | 55 | 56 | 53 | 64 | 66 | 66 | 67 | 71 | 65 | 65 | 60 | 65 | 67 | 70 | 72 | 68 | 73 | 67 | 60 | 60 | 61 | 59 | 50 | 63 | 75 | 75 | 62 | 53 | 52 | 49 | 47 | 47 | 47 | 38 | 38 | 52 |
| NetMHCIIpan-4.2 EL | 30 | 40 | 15 | 37 | 41 | 38 | 50 | 54 | 55 | 57 | 68 | 38 | 37 | 36 | 41 | 39 | 42 | 40 | 43 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| SMM-align | 29 | 47 | 36 | 40 | 43 | 43 | 51 | 49 | 48 | 48 | 38 | 55 | 58 | 57 | 56 | 53 | 43 | 44 | 54 | 62 | 52 | 38 | 38 | 33 | 57 | 58 | 55 | 55 | 54 | 55 | 46 | 38 | 50 | 50 | 37 | 42 | 39 | 39 | 42 | 39 | 39 | 48 | 48 | 45 |
| NetMHCIIpan-4.3 EL | 28 | 28 | 7 | 28 | 38 | 35 | 49 | 51 | 52 | 53 | 57 | 37 | 36 | 37 | 40 | 37 | 33 | 32 | 32 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-4.0 EL | 27 | 30 | 10 | 20 | 26 | 24 | 47 | 45 | 46 | 47 | 42 | 33 | 29 | 29 | 34 | 32 | 37 | 35 | 37 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-4.1 EL | 25 | 31 | 10 | 37 | 41 | 39 | 52 | 51 | 53 | 55 | 55 | 30 | 27 | 28 | 32 | 33 | 39 | 37 | 39 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Comblib matrices | 10 | 32 | 37 | 24 | 11 | 12 | 7 | 5 | 5 | 5 | 0 | 18 | 18 | 18 | 18 | 13 | 19 | 19 | 17 | 11 | 11 | 11 | 11 | 10 | 30 | 19 | 19 | 19 | 19 | 9 | 0 | 0 | 0 | 0 | 3 | 5 | 5 | 3 | 3 | 3 | 3 | 7 | 7 | 14 |
| Tepitope (Sturniolo) | 9 | 45 | 48 | 33 | 32 | 30 | 39 | 38 | 38 | 38 | 28 | 30 | 27 | 26 | 26 | 44 | 45 | 45 | 33 | 30 | 21 | 14 | 15 | 10 | 21 | 23 | 25 | 25 | 27 | 26 | 0 | - | - | - | 35 | 22 | 24 | 25 | 25 | 22 | 22 | 4 | 4 | 25 |
Weekly ranking scores
Ranking scores based on data sets submitted to the IEDB within a single week.
| Server | 2024-08-30 (n:1372) | 2024-04-19 (n:59) | 2024-04-05 (n:146) | 2023-11-10 (n:356) | 2023-09-01 (n:26) | 2023-07-28 (n:118) | 2023-04-21 (n:52) | 2023-03-03 (n:98) | 2023-01-27 (n:122) | 2022-10-28 (n:232) | 2022-09-16 (n:32655) | 2022-09-02 (n:24) | 2022-06-17 (n:21) | 2022-06-10 (n:52) | 2022-04-08 (n:29) | 2022-04-01 (n:448) | 2021-12-10 (n:28) | 2021-11-05 (n:301) | 2021-10-29 (n:252) | 2021-07-23 (n:210) | 2021-04-23 (n:162) | 2021-04-16 (n:19) | 2021-02-19 (n:248) | 2021-01-22 (n:686) | 2020-12-18 (n:83) | 2020-10-30 (n:318) | 2020-10-23 (n:0) | 2020-08-07 (n:45) | 2020-06-26 (n:65) | 2020-05-01 (n:202) | 2020-03-27 (n:42) | 2020-03-16 (n:30) | 2020-01-03 (n:0) | 2019-07-02 (n:662) | 2019-05-24 (n:245) | 2019-03-22 (n:105) | 2018-11-23 (n:11) | 2017-12-29 (n:13) | 2017-11-24 (n:16) | 2017-08-18 (n:0) | 2017-06-30 (n:124) | 2017-04-28 (n:0) | 2017-04-11 (n:10) | 2016-12-31 (n:16938) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NetMHCIIpan-4.2 BA | 86 | 62 | 100 | 77 | 40 | 79 | 50 | 86 | 86 | 68 | 72 | 79 | 82 | 77 | 97 | 64 | 75 | 52 | 69 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-4.1 BA | 80 | 61 | 64 | 68 | 33 | 89 | 71 | 100 | 96 | 67 | 64 | 71 | 71 | 96 | 57 | 60 | 88 | 71 | 63 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-4.3 BA | 78 | 70 | 79 | 83 | 50 | 74 | 34 | 64 | 89 | 70 | 77 | 79 | 64 | 85 | 50 | 66 | 67 | 58 | 78 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-4.0 BA | 74 | 65 | 71 | 62 | 47 | 82 | 56 | 93 | 86 | 68 | 57 | 43 | 75 | 96 | 77 | 60 | 83 | 71 | 58 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NN-align 2.3 | 67 | 16 | 57 | 55 | 40 | 56 | 100 | 32 | 25 | 51 | 46 | 11 | 14 | 54 | 57 | 69 | 17 | 72 | 66 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-3.2 | 64 | 27 | 93 | 76 | 53 | 71 | 39 | 57 | 64 | 64 | 47 | 25 | 68 | 62 | 0 | 53 | 17 | 57 | 75 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NN-align | 56 | 51 | 86 | 61 | 63 | 37 | 0 | 50 | 39 | 46 | 29 | 39 | 29 | 54 | 93 | 60 | 42 | 51 | 57 | 100 | 44 | 75 | 54 | 84 | 50 | 69 | - | 38 | 60 | 77 | 88 | 100 | - | 100 | 83 | 53 | 60 | 67 | 40 | - | 69 | - | 75 | 65 |
| NetMHCIIpan-3.1 | 49 | 54 | 50 | 86 | 23 | 44 | 78 | 79 | 50 | 64 | 30 | 18 | 89 | 50 | 63 | 46 | 21 | 33 | 52 | 63 | 49 | 100 | - | 61 | 50 | 41 | - | 100 | 0 | 61 | 88 | 75 | - | 25 | 51 | 83 | 90 | 67 | 100 | - | 75 | - | 63 | 81 |
| Consensus IEDB method | 47 | 54 | 43 | 59 | 3 | 57 | 43 | 43 | 32 | 57 | 53 | 21 | 71 | 50 | 50 | 68 | - | 79 | 59 | 63 | 61 | 25 | 85 | 68 | 50 | 88 | - | 38 | 90 | 62 | 25 | 50 | - | 75 | 64 | 57 | 90 | 83 | 50 | - | 60 | - | 38 | 52 |
| NetMHCIIpan-4.2 EL | 30 | 72 | 21 | 13 | 100 | 40 | 55 | 21 | 14 | 53 | 68 | 68 | 54 | 4 | 20 | 39 | 92 | 32 | 43 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| SMM-align | 29 | 61 | 29 | 38 | 47 | 41 | 14 | 71 | 43 | 52 | 38 | 0 | 75 | 27 | 63 | 58 | 8 | 43 | 45 | 13 | 78 | 50 | 52 | 33 | 50 | 63 | - | 75 | 30 | 58 | 63 | 25 | - | 50 | 34 | 53 | 40 | 0 | 90 | - | 26 | - | 100 | 45 |
| NetMHCIIpan-4.3 EL | 28 | 55 | 0 | 9 | 83 | 31 | 58 | 7 | 46 | 51 | 57 | 75 | 14 | 8 | 53 | 37 | 63 | 31 | 32 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-4.0 EL | 27 | 55 | 7 | 11 | 73 | 17 | 59 | 14 | 25 | 49 | 42 | 100 | 36 | 12 | 47 | 29 | 100 | 29 | 37 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| NetMHCIIpan-4.1 EL | 25 | 57 | 14 | 9 | 83 | 44 | 68 | 0 | 7 | 55 | 55 | 75 | 11 | 27 | 20 | 29 | 96 | 34 | 39 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Comblib matrices | 10 | 23 | - | 37 | 3 | 23 | - | - | - | 7 | 0 | - | - | - | 47 | 15 | - | 7 | 23 | 0 | 12 | - | 13 | 10 | - | 0 | - | - | 90 | 12 | - | 0 | - | 0 | 0 | - | 20 | - | 0 | - | 0 | - | 0 | 14 |
| Tepitope (Sturniolo) | 9 | 42 | 36 | 51 | 57 | 20 | 7 | 32 | 46 | 42 | 28 | 57 | 43 | - | 7 | 28 | - | 68 | 30 | 25 | 38 | 0 | 27 | 10 | 50 | 7 | - | 0 | 30 | 29 | 0 | - | - | - | 40 | 15 | 10 | - | 60 | - | 52 | - | - | 25 |
Download initial benchmark datasets
Click here to download the initial benchmark datasets.
Benchmark results get recalculated as new servers are added to the benchmarks. Numbers in light grey represent scores on datasets before the server was incorporated into the benchmarks. Previous versions of the benchmark results can be downloaded below
2025-02-26
2024-02-09
2023-09-19