IEDB Analysis Resource

MHC II Automated Server Benchmarks


This is a live ranking of MHC II servers based on performance, which continues to be reevaluated over time. The weekly IEDB releases are automatically checked for datasets large enough to add to the benchmarks. The benchmark metrics in the table below will only be updated on releases where such new data is becoming available.

Accumulated overall ranking scores

Ranking scores based on data sets submitted to the IEDB for the last at least 5 references.

Server 2021-02-19 2021-01-22 2020-12-18 2020-10-30 2020-10-23 2020-08-07 2020-06-26 2020-05-01 2020-03-27 2020-03-16 2020-01-02 2019-07-02 2019-05-24 2019-03-22 2018-11-23 2017-12-29 2017-11-24 2017-08-18 2017-06-30 2017-04-28 2017-04-11 2016-12-31
Comblib matrices 8 7 23 30 21 21 19 10 0 0 5 5 5 10 4 0 0 0 0 13 6 -
NN-align 73 75 54 55 67 68 72 79 88 75 71 71 66 54 63 65 65 69 69 79 75 -
Consensus IEDB method 73 69 66 68 60 58 59 58 58 61 64 66 64 64 64 61 58 57 57 42 50 -
SMM-align 43 43 52 54 54 54 51 56 38 41 43 39 43 49 35 31 34 36 36 44 49 -
Tepitope (Sturniolo) 18 14 44 49 40 38 40 26 33 28 26 26 29 21 47 53 53 52 52 6 8 -
NetMHCIIpan-3.1 - - - 47 - - - - 55 64 65 65 71 84 79 76 78 73 73 93 - -


Weekly ranking scores

Ranking scores based on data sets submitted to the IEDB within a single week.

Server 2021-02-19 2021-01-22 2020-12-18 2020-10-30 2020-10-23 2020-08-07 2020-06-26 2020-05-01 2020-03-27 2020-03-16 2020-01-02 2019-07-02 2019-05-24 2019-03-22 2018-11-23 2017-12-29 2017-11-24 2017-08-18 2017-06-30 2017-04-28 2017-04-11 2016-12-31
Comblib matrices 13 10 - 0 - - 45 12 - 0 - 0 0 - 20 - 0 - 0 - 0 14
NN-align 54 84 50 69 - 38 46 77 88 100 - 100 83 53 60 67 40 - 69 - 75 65
Consensus IEDB method 85 68 50 88 - 38 60 62 25 50 - 75 64 57 90 83 50 - 60 - 38 52
SMM-align 52 33 50 63 - 75 36 58 63 25 - 50 34 53 40 0 90 - 26 - 100 45
Tepitope (Sturniolo) 27 10 50 7 - 0 74 29 0 - - - 40 15 10 - 60 - 52 - - 25
NetMHCIIpan-3.1 - - - 41 - 100 34 - 88 75 - 25 51 83 90 67 100 - 75 - 63 -


Download initial benchmark datasets

Click here to download the initial benchmark datasets.