CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Fold - scored higher in this pairwise comparison

  4. Performance of McQFold - scored lower in this pairwise comparison

  5. Compile and download dataset for Fold & McQFold [.zip] - may take several seconds...


Overview

Metric Fold McQFold
MCC 0.677 > 0.646
Average MCC ± 95% Confidence Intervals 0.721 ± 0.065 > 0.713 ± 0.061
Sensitivity 0.616 > 0.568
Positive Predictive Value 0.749 > 0.740
Total TP 1252 > 1156
Total TN 322881 < 322990
Total FP 502 > 473
Total FP CONTRA 63 > 62
Total FP INCONS 357 > 345
Total FP COMP 82 > 66
Total FN 782 < 878
P-value 3.56938820447e-08

^top




Performance plots


^top





Performance of Fold - scored higher in this pairwise comparison

1. Total counts & total scores for Fold

Total Base Pair Counts
Total TP 1252
Total TN 322881
Total FP 502
Total FP CONTRA 63
Total FP INCONS 357
Total FP COMP 82
Total FN 782
Total Scores
MCC 0.677
Average MCC ± 95% Confidence Intervals 0.721 ± 0.065
Sensitivity 0.616
Positive Predictive Value 0.749
Nr of predictions 81

^top



2. Individual counts for Fold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.76 0.60 0.96 24 5126 5 0 1 4 16
2KU0_A - 0.83 0.69 1.00 11 692 0 0 0 0 5
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.83 0.70 1.00 7 344 0 0 0 0 3
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_B 0.90 0.88 0.92 22 2121 2 0 2 0 3
2L1F_A 0.89 0.88 0.91 21 2057 2 0 2 0 3
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.39 0.26 0.63 5 622 3 1 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.85 0.79 0.91 31 6071 5 0 3 2 8
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.96 0.92 1.00 12 484 0 0 0 0 1
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2WWQ_V 0.76 0.64 0.90 18 2906 3 0 2 1 10
2XKV_B 0.51 0.50 0.53 10 4541 24 0 9 15 10
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.93 0.86 1.00 36 5115 0 0 0 0 6
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.65 0.63 0.68 15 2256 8 1 6 1 9
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2YIE_X - 0.25 0.25 0.27 3 1367 8 2 6 0 9
3ADB_C - 0.80 0.74 0.88 28 4154 4 0 4 0 10
3AKZ_H 0.84 0.75 0.95 21 2679 1 1 0 0 7
3AM1_B - 0.78 0.71 0.86 25 3211 4 0 4 0 10
3AMU_B 0.64 0.59 0.70 16 2980 9 0 7 2 11
3IYQ_A 0.29 0.31 0.27 29 60618 83 20 59 4 65
3IZ4_A 0.53 0.46 0.61 61 70776 44 5 34 5 71
3IZF_C 0.70 0.59 0.82 32 6864 7 1 6 0 22
3J0L_h - 0.81 0.65 1.00 28 6077 2 0 0 2 15
3J0L_2 - 0.25 0.24 0.26 8 6185 25 2 21 2 25
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.20 0.19 0.23 3 1115 10 2 8 0 13
3J0L_7 - -0.01 0.00 0.00 0 1213 12 0 12 0 17
3J0L_1 - 0.76 0.63 0.92 12 1212 2 0 1 1 7
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J16_L 0.63 0.53 0.76 16 2754 5 0 5 0 14
3NDB_M - 0.84 0.74 0.96 45 9133 3 0 2 1 16
3NKB_B - 0.35 0.31 0.42 8 1997 11 0 11 0 18
3NMU_E - -0.01 0.00 0.00 0 552 11 2 7 2 6
3NPB_A 0.70 0.61 0.80 28 6986 10 1 6 3 18
3O58_3 0.29 0.31 0.28 11 12363 41 3 26 12 24
3O58_2 0.71 0.71 0.71 27 7222 12 3 8 1 11
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.77 0.64 0.94 46 12831 5 0 3 2 26
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.57 0.48 0.69 20 3887 9 1 8 0 22
3SIU_F - 0.85 0.73 1.00 8 370 0 0 0 0 3
3SN2_B 1.00 1.00 1.00 12 394 0 0 0 0 0
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.45 0.35 0.59 13 3138 9 1 8 0 24
3UZL_B 0.77 0.62 0.96 23 3546 1 0 1 0 14
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.68 0.57 0.82 31 7102 7 1 6 0 23
4A1C_2 0.14 0.15 0.14 5 11744 43 5 27 11 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.32 0.26 0.42 5 1263 7 1 6 0 14
4ENC_A 0.31 0.26 0.38 5 1313 8 1 7 0 14

^top



Performance of McQFold - scored lower in this pairwise comparison

1. Total counts & total scores for McQFold

Total Base Pair Counts
Total TP 1156
Total TN 322990
Total FP 473
Total FP CONTRA 62
Total FP INCONS 345
Total FP COMP 66
Total FN 878
Total Scores
MCC 0.646
Average MCC ± 95% Confidence Intervals 0.713 ± 0.061
Sensitivity 0.568
Positive Predictive Value 0.740
Nr of predictions 81

^top



2. Individual counts for McQFold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.59 0.53 0.68 21 5120 13 3 7 3 19
2KU0_A - 0.75 0.56 1.00 9 694 0 0 0 0 7
2KUR_A 0.87 0.76 1.00 16 1112 0 0 0 0 5
2KUU_A 0.84 0.71 1.00 15 1113 1 0 0 1 6
2KUV_A 0.85 0.73 1.00 16 1112 0 0 0 0 6
2KUW_A 0.87 0.76 1.00 16 1112 0 0 0 0 5
2KX8_A 0.88 0.83 0.94 15 845 1 0 1 0 3
2KXM_A - 0.70 0.50 1.00 5 346 0 0 0 0 5
2KZL_A - 0.86 0.74 1.00 14 1471 1 0 0 1 5
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L2K_A - 0.97 0.95 1.00 18 843 0 0 0 0 1
2L3C_B - 0.94 0.88 1.00 15 546 0 0 0 0 2
2L3E_A - 1.00 1.00 1.00 13 582 1 0 0 1 0
2L3J_B 0.89 0.79 1.00 27 2458 0 0 0 0 7
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.46 0.26 0.83 5 624 1 0 1 0 14
2LBS_A - 1.00 1.00 1.00 14 482 1 0 0 1 0
2LC8_A 0.61 0.55 0.69 11 1524 5 0 5 0 9
2LDL_A - 0.73 0.55 1.00 6 345 0 0 0 0 5
2LDT_A - 0.68 0.47 1.00 7 458 0 0 0 0 8
2LHP_A - 1.00 1.00 1.00 16 650 0 0 0 0 0
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.51 0.46 0.58 18 6074 13 2 11 0 21
2LQZ_A - 0.91 0.91 0.91 10 340 1 1 0 0 1
2LWK_A - 0.83 0.77 0.91 10 485 2 0 1 1 3
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2WWQ_V 0.00 0.00 0.00 0 2926 0 0 0 0 28
2XKV_B 0.31 0.30 0.33 6 4542 25 1 11 13 14
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.27 0.24 0.32 10 5120 21 0 21 0 32
2Y8W_B - 1.00 1.00 1.00 6 184 2 0 0 2 0
2Y9C_V - 0.59 0.54 0.65 13 2258 8 1 6 1 11
2YIE_Z - 0.43 0.42 0.45 5 1529 6 3 3 0 7
2YIE_X - 0.36 0.33 0.40 4 1368 6 2 4 0 8
3ADB_C - 0.92 0.84 1.00 32 4154 1 0 0 1 6
3AKZ_H 0.68 0.61 0.77 17 2679 6 1 4 1 11
3AM1_B - 0.91 0.83 1.00 29 3211 1 0 0 1 6
3AMU_B 0.75 0.59 0.94 16 2986 3 0 1 2 11
3IYQ_A 0.28 0.31 0.26 29 60614 87 19 64 4 65
3IZ4_A 0.42 0.36 0.49 47 70780 53 6 43 4 85
3IZF_C 0.68 0.56 0.83 30 6867 6 0 6 0 24
3J0L_h - 0.65 0.49 0.88 21 6081 3 0 3 0 22
3J0L_2 - 0.26 0.24 0.30 8 6189 21 0 19 2 25
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.26 0.19 0.38 3 1120 5 1 4 0 13
3J0L_7 - -0.01 0.00 0.00 0 1215 10 0 10 0 17
3J0L_1 - 0.65 0.47 0.90 9 1215 3 0 1 2 10
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3NDB_M - 0.81 0.70 0.93 43 9134 4 1 2 1 18
3NKB_B - 0.36 0.31 0.44 8 1998 10 1 9 0 18
3NMU_E - 0.41 0.17 1.00 1 560 3 0 0 3 5
3NPB_A 0.81 0.67 0.97 31 6989 4 1 0 3 15
3O58_3 0.26 0.26 0.26 9 12368 26 10 16 0 26
3O58_2 0.83 0.71 0.96 27 7232 2 0 1 1 11
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.69 0.56 0.87 40 12834 9 0 6 3 32
3R4F_A - 0.96 0.92 1.00 23 2122 1 0 0 1 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.71 0.60 0.86 25 3887 4 0 4 0 17
3SIU_F - 0.73 0.55 1.00 6 372 0 0 0 0 5
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 2 0 0 2 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.73 0.57 0.95 21 3138 1 0 1 0 16
3UZL_B 0.45 0.41 0.52 15 3541 14 0 14 0 22
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.25 0.22 0.29 12 7099 29 1 28 0 42
4A1C_2 0.15 0.15 0.15 5 11748 33 5 23 5 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.42 0.33 0.54 14 4345 13 1 11 1 28
4ENB_A 0.89 0.79 1.00 15 1260 0 0 0 0 4
4ENC_A 0.86 0.79 0.94 15 1310 1 1 0 0 4

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.