IEDB Analysis Resource
× Note: As of March 2025, the cumulative results are based on the minimum number of datasets to reach n datapoints (default=500). This number is adjustable through the 'minimum # of trailing data points' dropdown menu. This change was made to help smooth out the effects of small sample sizes and make the interface more flexible.

MHC I Automated Server Benchmarks


This is a live ranking of MHC I servers based on performance, which continues to be reevaluated over time. The weekly IEDB releases are automatically checked for datasets large enough to add to the benchmarks. The benchmark metrics in the table below will only be updated on releases where such new data is becoming available.

Accumulated overall ranking scores

Cumulative scores are based on datasets from the most recent references in the IEDB.



Server 2025-03-27 (n:503) 2025-03-13 (n:700) 2025-03-06 (n:679) 2025-02-20 (n:666) 2025-02-13 (n:638) 2025-01-23 (n:615) 2024-11-28 (n:601) 2024-08-15 (n:591) 2024-07-11 (n:571) 2024-05-30 (n:571) 2024-05-23 (n:514) 2024-05-16 (n:502) 2024-04-18 (n:501) 2024-02-29 (n:684) 2024-02-15 (n:657) 2023-10-19 (n:657) 2023-08-10 (n:603) 2023-08-03 (n:518) 2023-06-15 (n:523) 2023-05-11 (n:554) 2023-04-20 (n:554) 2022-11-24 (n:560) 2022-10-28 (n:504) 2022-10-06 (n:537) 2022-07-22 (n:525) 2022-05-20 (n:508) 2022-04-29 (n:511) 2021-12-24 (n:611) 2021-12-10 (n:504) 2021-11-05 (n:505) 2021-10-08 (n:558) 2021-10-01 (n:517) 2021-09-03 (n:608) 2021-08-20 (n:506) 2021-08-06 (n:563) 2021-06-11 (n:563) 2021-05-21 (n:551) 2021-04-16 (n:541) 2021-03-05 (n:516) 2021-02-19 (n:516) 2021-01-29 (n:517) 2021-01-15 (n:517) 2021-01-01 (n:511) 2020-12-25 (n:519) 2020-12-18 (n:813) 2020-12-11 (n:802) 2020-11-13 (n:786) 2020-10-02 (n:768) 2020-09-11 (n:716) 2020-07-10 (n:704) 2020-04-24 (n:691) 2020-03-13 (n:624) 2019-11-01 (n:624) 2019-10-04 (n:588) 2019-08-30 (n:537) 2019-06-21 (n:537) 2019-06-07 (n:527) 2019-05-24 (n:682) 2019-03-15 (n:669) 2019-02-01 (n:521) 2018-05-11 (n:26579) 2018-01-26 (n:26389) 2017-12-22 (n:26389) 2017-10-27 (n:26362) 2017-09-01 (n:26352) 2017-03-23 (n:627) 2016-12-09 (n:588) 2016-05-03 (n:562) 2016-02-19 (n:502) 2015-08-07 (n:502) 2015-07-31 (n:750) 2015-07-17 (n:687) 2015-06-26 (n:661) 2015-06-19 (n:647) 2015-05-15 (n:622) 2015-02-06 (n:678) 2015-01-16 (n:685) 2014-10-31 (n:7642) 2014-06-20 (n:3564) 2014-05-23 (n:3545) 2014-03-28 (n:3500) 2014-03-21 (n:3635)
NetMHCpan 4.0 BA 73 69 70 69 67 68 67 66 68 68 68 68 69 69 69 69 70 61 62 68 68 72 75 74 75 75 75 72 70 68 67 67 71 67 74 74 76 76 75 75 73 73 72 70 72 72 70 69 70 70 72 66 66 69 74 74 67 81 83 65 63 60 77 93 - - - - - - - - - - - - - - - - - -
ANN 4.0 72 63 62 61 63 61 60 58 58 58 56 55 56 55 54 54 51 60 64 61 61 61 63 55 55 54 54 50 54 51 55 57 56 59 59 59 59 59 58 58 57 54 53 56 57 55 56 54 52 51 49 67 67 79 79 79 79 85 81 63 50 41 54 46 35 63 58 61 61 61 58 55 58 58 54 58 57 55 69 68 68 69
NetMHCpan 4.1 BA 71 69 69 68 69 68 67 66 68 68 69 69 70 71 71 71 74 74 70 72 72 72 74 70 70 70 70 68 67 68 68 69 73 72 77 77 78 77 77 77 76 78 78 78 80 83 81 80 83 85 91 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
NetMHCpan 3.0 68 65 65 64 62 63 62 61 61 61 60 59 63 64 63 63 64 64 67 69 69 71 72 69 70 69 69 65 63 62 64 64 65 64 65 65 66 66 65 65 63 64 65 65 66 66 66 65 66 67 70 74 74 80 74 74 68 70 69 57 56 53 70 60 73 67 67 67 71 71 65 64 63 60 56 57 52 56 58 57 59 59
NetMHCcons 67 69 69 69 69 70 69 68 67 67 67 66 67 69 72 72 74 65 60 59 59 63 63 57 58 57 60 58 57 57 58 59 61 65 70 70 70 71 70 70 68 65 64 67 68 69 70 69 72 73 73 70 70 73 84 84 79 61 56 64 71 73 80 80 89 70 69 70 67 67 66 67 69 70 68 66 62 71 63 64 64 63
mhcflurry 1.2.0 64 65 66 65 68 69 68 67 68 68 70 71 71 68 68 68 61 51 52 54 54 55 55 55 53 55 56 64 65 64 64 65 68 66 54 54 56 54 54 54 54 58 56 60 60 60 62 60 59 59 65 76 76 74 74 74 74 61 64 69 57 53 53 38 50 83 82 87 90 90 91 92 92 92 93 93 93 55 87 87 86 85
ANN 3.4 61 64 64 65 65 66 65 64 63 63 64 63 63 63 65 65 68 62 60 54 54 51 48 45 45 45 48 47 51 53 61 61 64 69 69 69 69 70 69 69 69 64 63 66 65 65 66 63 63 68 66 72 72 77 77 77 77 57 54 61 71 73 76 82 92 71 73 71 69 69 63 64 65 65 60 64 64 59 45 45 46 48
IEDB Consensus 60 60 59 58 58 56 55 53 54 54 51 50 48 45 44 44 48 58 65 65 65 61 60 59 58 58 55 56 58 55 61 59 58 61 58 58 56 56 57 57 58 53 51 52 47 46 47 43 40 39 34 31 31 39 39 39 39 50 57 48 40 36 46 40 36 52 50 45 43 43 46 47 48 48 40 38 38 48 57 58 59 58
NetMHCpan 4.0 EL 56 52 54 54 53 54 53 52 53 53 52 53 51 50 51 51 44 37 43 40 40 43 42 44 46 45 46 45 47 46 47 48 40 42 40 40 42 39 37 37 36 32 37 39 41 39 37 34 36 38 40 50 50 50 39 39 23 31 25 27 31 38 57 89 - - - - - - - - - - - - - - - - - -
NetMHCpan 4.1 EL 56 45 46 47 47 48 46 45 46 46 47 45 43 40 42 42 35 32 43 43 43 46 46 50 51 52 53 49 49 44 41 42 37 30 41 41 42 39 41 41 42 39 42 45 51 51 45 40 41 46 50 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
NetMHCpan 2.8 55 61 61 60 60 62 60 59 58 58 58 57 58 59 59 59 67 59 57 54 54 62 66 57 58 57 58 56 58 60 53 54 56 56 60 60 61 59 60 60 56 60 60 61 61 64 65 64 64 65 66 65 65 65 71 71 63 56 51 59 63 65 72 69 74 59 57 57 57 57 55 54 53 53 48 53 49 43 62 62 61 60
SMM 48 54 54 53 52 50 49 47 47 47 44 45 44 43 43 43 47 54 56 54 54 50 49 51 50 51 47 52 54 52 59 58 58 60 55 55 53 53 54 54 56 53 51 50 45 46 49 46 41 37 32 24 24 29 29 29 29 41 47 36 35 35 40 45 39 52 55 51 50 50 50 52 51 51 45 41 45 53 41 41 40 40
SMMPMBEC 46 51 51 50 50 49 47 46 47 47 46 47 46 45 44 44 45 73 63 57 57 52 50 54 53 51 49 53 55 54 62 61 62 63 60 60 59 59 61 61 66 59 57 56 51 50 52 50 45 41 34 27 27 27 27 27 27 35 42 43 47 49 45 51 61 61 63 59 57 57 48 45 46 46 39 35 37 53 42 41 40 41
PickPocket 44 40 41 39 41 42 40 38 37 37 34 34 36 34 33 33 32 46 55 52 52 50 49 49 49 47 45 46 49 49 48 47 47 40 46 46 44 44 44 44 52 50 50 48 47 49 48 46 47 46 48 40 40 25 35 35 19 39 35 44 38 42 15 22 27 41 40 35 37 37 35 35 32 34 29 27 21 25 45 47 46 42
ARB 42 38 36 37 38 37 35 33 33 33 27 27 25 25 22 22 22 48 46 43 43 37 32 30 29 29 30 29 27 29 41 43 45 45 51 51 50 52 55 55 58 49 51 50 45 41 43 40 43 41 41 25 25 14 14 14 14 20 25 26 14 13 13 5 0 31 32 34 37 37 26 27 29 29 20 30 38 18 24 25 24 21

Weekly ranking scores

Ranking scores based on data sets submitted to the IEDB within a single week.

Server 2025-03-27 (n:198) 2025-03-13 (n:21) 2025-03-06 (n:13) 2025-02-20 (n:28) 2025-02-13 (n:23) 2025-01-23 (n:14) 2024-11-28 (n:10) 2024-08-15 (n:20) 2024-07-11 (n:0) 2024-05-30 (n:57) 2024-05-23 (n:12) 2024-05-16 (n:13) 2024-04-18 (n:13) 2024-02-29 (n:27) 2024-02-15 (n:0) 2023-10-19 (n:54) 2023-08-10 (n:407) 2023-08-03 (n:330) 2023-06-15 (n:74) 2023-05-11 (n:0) 2023-04-20 (n:114) 2022-11-24 (n:56) 2022-10-28 (n:144) 2022-10-06 (n:12) 2022-07-22 (n:17) 2022-05-20 (n:25) 2022-04-29 (n:32) 2021-12-24 (n:154) 2021-12-10 (n:34) 2021-11-05 (n:86) 2021-10-08 (n:41) 2021-10-01 (n:62) 2021-09-03 (n:102) 2021-08-20 (n:132) 2021-08-06 (n:0) 2021-06-11 (n:12) 2021-05-21 (n:10) 2021-04-16 (n:25) 2021-03-05 (n:0) 2021-02-19 (n:35) 2021-01-29 (n:35) 2021-01-15 (n:22) 2021-01-01 (n:82) 2020-12-25 (n:153) 2020-12-18 (n:11) 2020-12-11 (n:16) 2020-11-13 (n:18) 2020-10-02 (n:52) 2020-09-11 (n:12) 2020-07-10 (n:13) 2020-04-24 (n:67) 2020-03-13 (n:0) 2019-11-01 (n:36) 2019-10-04 (n:51) 2019-08-30 (n:0) 2019-06-21 (n:10) 2019-06-07 (n:80) 2019-05-24 (n:13) 2019-03-15 (n:434) 2019-02-01 (n:235) 2018-05-11 (n:190) 2018-01-26 (n:69) 2017-12-22 (n:27) 2017-10-27 (n:10) 2017-09-01 (n:26352) 2017-03-23 (n:39) 2016-12-09 (n:26) 2016-05-03 (n:60) 2016-02-19 (n:0) 2015-08-07 (n:14) 2015-07-31 (n:63) 2015-07-17 (n:26) 2015-06-26 (n:14) 2015-06-19 (n:25) 2015-05-15 (n:371) 2015-02-06 (n:295) 2015-01-16 (n:383) 2014-10-31 (n:7642) 2014-06-20 (n:19) 2014-05-23 (n:45) 2014-03-28 (n:18) 2014-03-21 (n:3635)
NetMHCpan 4.0 BA 85 60 96 93 54 96 93 36 - 64 71 71 86 68 - 61 70 69 46 - 59 44 65 57 62 88 80 78 90 80 71 38 80 53 - 21 93 93 - 73 73 71 100 59 79 100 93 43 75 43 83 - 55 62 - 100 52 75 89 81 77 52 69 93 - - - - - - - - - - - - - - - - - -
ANN 4.0 65 90 96 29 95 96 93 71 - 69 71 93 57 89 - 66 51 64 61 - 50 44 73 79 62 75 82 42 74 50 21 71 46 40 - 57 57 86 - 50 75 68 57 73 82 43 86 71 61 71 31 - 23 - - - 77 100 61 88 88 16 71 79 35 89 40 55 - 95 100 9 - 89 52 59 57 55 100 73 36 69
NetMHCpan 4.1 BA 92 60 96 68 73 96 93 29 - 59 71 57 71 57 - 57 74 77 71 - 71 55 68 79 62 88 93 74 79 69 57 42 74 66 - 50 93 86 - 82 65 75 86 66 50 100 86 61 71 57 91 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
NetMHCpan 3.0 68 - 96 91 57 96 93 61 - 63 75 0 57 71 - 63 63 71 63 - 39 63 76 29 85 75 86 70 82 62 79 54 68 45 - 39 57 96 - 69 68 82 93 61 68 79 86 36 61 21 61 - 47 90 - 100 57 75 82 64 75 36 89 21 73 65 65 36 - 95 72 77 100 89 54 58 56 56 91 9 82 59
NetMHCcons 69 - 96 68 50 100 93 96 - 65 100 21 57 14 - 62 72 66 71 - 54 62 60 21 85 38 55 67 65 75 29 49 50 44 - 64 57 93 - 69 85 57 71 - 46 54 86 29 50 71 80 - 55 56 - 100 80 82 75 50 61 66 80 54 89 74 65 88 - 95 60 41 50 89 69 70 63 71 18 82 82 63
mhcflurry 1.2.0 41 40 96 29 46 96 93 54 - 54 36 100 100 86 - 100 61 44 54 - 64 52 58 100 0 71 4 55 74 56 50 46 74 93 - 14 93 43 - 64 45 79 64 - 61 25 86 79 54 0 51 - 85 75 - - 88 50 71 62 68 - 82 4 50 89 10 59 - 95 87 86 - 89 93 92 95 55 91 95 91 85
ANN 3.4 59 - 15 59 55 96 100 86 - 55 100 86 64 7 - 55 68 57 71 - 59 86 57 57 23 27 64 44 39 46 43 59 48 50 - 50 57 100 - 58 99 82 50 82 57 57 96 64 14 79 61 - 54 - - - 86 68 68 50 64 66 64 50 92 59 85 100 - 95 46 55 - 95 64 66 62 59 32 36 36 48
IEDB Consensus 35 80 100 61 86 96 100 46 - 70 79 79 64 86 - 25 50 58 53 - 71 76 69 89 31 93 54 52 55 47 93 68 52 61 - 100 57 29 - 33 85 79 43 64 57 29 100 86 50 93 36 - 0 - - - 54 21 29 67 57 16 57 50 36 61 85 73 - 9 27 36 - 100 36 44 33 48 36 36 0 58
NetMHCpan 4.0 EL 53 10 - 57 37 96 93 25 - 56 36 71 57 21 - 80 46 28 56 - 36 54 46 7 62 7 34 41 61 48 7 79 35 29 - 0 93 86 - 51 73 14 14 7 82 75 93 7 0 7 21 - 49 69 - 100 12 57 11 30 4 28 41 89 - - - - - - - - - - - - - - - - - -
NetMHCpan 4.1 EL 77 0 8 55 27 96 93 7 - 39 93 57 86 4 - 71 36 13 50 - 75 50 46 7 23 16 43 45 80 52 14 57 54 23 - 14 100 0 - 36 56 0 7 11 54 100 86 36 7 29 50 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
NetMHCpan 2.8 52 - 96 57 43 96 93 100 - 57 71 21 57 61 - 25 66 66 62 - 29 23 79 21 85 38 48 51 70 83 36 46 55 37 - 50 93 50 - 87 31 57 79 61 7 43 86 61 43 57 69 - 63 56 - 100 63 75 54 50 52 59 77 54 74 70 60 56 - 95 60 77 50 89 46 54 52 43 64 86 82 60
SMM 10 75 96 59 84 96 93 43 - 65 18 57 57 57 - 23 48 55 58 - 43 58 58 79 8 95 36 47 43 27 86 61 55 75 - 96 57 25 - 26 71 89 29 61 32 11 86 100 89 86 40 - 8 - - - 30 18 36 51 34 21 30 61 39 35 85 68 - 0 9 68 - 89 49 41 42 53 64 55 18 40
SMMPMBEC 14 40 96 55 63 96 93 21 - 53 18 57 57 57 - 41 46 69 79 - 75 69 48 93 100 75 46 44 43 38 100 51 58 75 - 79 57 25 - 33 99 86 21 57 75 14 86 100 89 100 40 - - - - - 29 7 43 42 38 60 21 21 61 49 90 82 - 95 100 32 - 89 40 36 35 53 91 55 18 41
PickPocket 26 20 96 4 30 96 93 71 - 56 21 21 100 64 - 37 30 42 74 - 4 62 67 57 100 64 21 39 27 38 64 52 64 38 - 86 57 36 - 27 40 7 36 50 4 75 86 14 68 21 63 - 100 10 - 100 0 54 21 39 20 68 0 7 27 47 85 24 - 95 34 82 0 70 27 31 24 25 0 77 82 42
ARB 21 100 0 16 61 96 93 39 - 68 18 57 0 100 - 21 23 58 44 - 25 82 42 57 - 25 39 35 21 11 0 33 44 27 - 79 0 7 - 43 100 21 0 - 100 11 86 0 68 43 56 - 69 - - - 23 0 11 30 16 - 29 21 0 26 0 0 - 100 0 0 - 89 25 20 37 18 9 36 82 21

Benchmark results get recalculated as new servers are added to the benchmarks. Numbers in light grey represent scores on datasets before the server was incorporated into the benchmarks. Previous versions of the benchmark results can be downloaded below