CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of MaxExpect - scored higher in this pairwise comparison

  4. Performance of Mastr(20) - scored lower in this pairwise comparison

  5. Compile and download dataset for MaxExpect & Mastr(20) [.zip] - may take several seconds...


Overview

Metric MaxExpect Mastr(20)
MCC 0.588 > 0.521
Average MCC ± 95% Confidence Intervals 0.595 ± 0.085 > 0.502 ± 0.120
Sensitivity 0.516 > 0.342
Positive Predictive Value 0.675 < 0.799
Total TP 515 > 341
Total TN 201556 < 201892
Total FP 329 > 114
Total FP CONTRA 30 > 13
Total FP INCONS 218 > 73
Total FP COMP 81 > 28
Total FN 483 < 657
P-value 3.56938820447e-08

^top




Performance plots


^top





Performance of MaxExpect - scored higher in this pairwise comparison

1. Total counts & total scores for MaxExpect

Total Base Pair Counts
Total TP 515
Total TN 201556
Total FP 329
Total FP CONTRA 30
Total FP INCONS 218
Total FP COMP 81
Total FN 483
Total Scores
MCC 0.588
Average MCC ± 95% Confidence Intervals 0.595 ± 0.085
Sensitivity 0.516
Positive Predictive Value 0.675
Nr of predictions 26

^top



2. Individual counts for MaxExpect [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2WRQ_Y 0.53 0.53 0.53 9 2833 13 5 3 5 8
2XKV_B 0.51 0.50 0.53 10 4541 24 0 9 15 10
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.25 0.24 0.27 10 5114 27 1 26 0 32
3A2K_C 0.42 0.39 0.46 11 2902 13 2 11 0 17
3AMU_B 0.64 0.59 0.70 16 2980 9 0 7 2 11
3GX2_A 0.77 0.63 0.96 25 4345 2 0 1 1 15
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IZ4_A 0.54 0.46 0.64 61 70781 39 3 31 5 71
3IZF_C 0.71 0.61 0.83 33 6863 7 1 6 0 21
3JYV_7 0.41 0.31 0.56 10 2832 8 0 8 0 22
3JYX_4 0.31 0.30 0.31 10 12214 34 4 18 12 23
3JYX_3 0.64 0.63 0.65 17 6302 19 1 8 10 10
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NPB_A 0.71 0.61 0.82 28 6987 9 0 6 3 18
3O58_3 0.35 0.34 0.35 12 12369 35 2 20 13 23
3O58_2 0.75 0.76 0.74 29 7221 11 3 7 1 9
3PDR_A 0.76 0.63 0.94 45 12832 5 0 3 2 27
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.58 0.48 0.71 20 3888 8 1 7 0 22
4A1C_3 0.69 0.57 0.84 31 7103 6 0 6 0 23
4A1C_2 0.14 0.15 0.14 5 11746 41 4 26 11 28
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.31 0.26 0.38 5 1313 8 1 7 0 14

^top



Performance of Mastr(20) - scored lower in this pairwise comparison

1. Total counts & total scores for Mastr(20)

Total Base Pair Counts
Total TP 341
Total TN 201892
Total FP 114
Total FP CONTRA 13
Total FP INCONS 73
Total FP COMP 28
Total FN 657
Total Scores
MCC 0.521
Average MCC ± 95% Confidence Intervals 0.502 ± 0.120
Sensitivity 0.342
Positive Predictive Value 0.799
Nr of predictions 26

^top



2. Individual counts for Mastr(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2L94_A 0.87 0.80 0.94 16 973 1 0 1 0 4
2WRQ_Y 0.57 0.59 0.56 10 2832 12 5 3 4 7
2XKV_B 0.45 0.20 1.00 4 4556 3 0 0 3 16
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.41 0.17 1.00 7 5144 0 0 0 0 35
3A2K_C 0.72 0.61 0.85 17 2906 3 0 3 0 11
3AMU_B 0.77 0.59 1.00 16 2987 1 0 0 1 11
3GX2_A 0.39 0.28 0.55 11 4351 10 0 9 1 29
3IVN_B 0.78 0.65 0.95 20 2325 1 1 0 0 11
3IZ4_A 0.00 0.00 0.00 0 70876 0 0 0 0 132
3IZF_C 0.73 0.63 0.85 34 6863 7 1 5 1 20
3JYV_7 0.81 0.66 1.00 21 2829 0 0 0 0 11
3JYX_4 0.00 0.00 0.00 0 12246 0 0 0 0 33
3JYX_3 0.56 0.56 0.58 15 6302 23 1 10 12 12
3LA5_A 0.76 0.59 1.00 20 2465 0 0 0 0 14
3NPB_A 0.30 0.24 0.39 11 6993 18 1 16 1 35
3O58_3 0.00 0.00 0.00 0 12403 0 0 0 0 35
3O58_2 0.76 0.76 0.76 29 7222 12 3 6 3 9
3PDR_A 0.00 0.00 0.00 0 12880 0 0 0 0 72
3RKF_A 0.70 0.50 1.00 17 2194 0 0 0 0 17
3SD1_A 0.61 0.50 0.75 21 3888 7 1 6 0 21
4A1C_3 0.70 0.59 0.84 32 7102 7 0 6 1 22
4A1C_2 0.00 0.00 0.00 0 11781 0 0 0 0 33
4AOB_A 0.39 0.26 0.58 11 4352 9 0 8 1 31
4ENB_A 0.39 0.16 1.00 3 1272 0 0 0 0 16
4ENC_A 0.51 0.26 1.00 5 1321 0 0 0 0 14

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.