CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of RNAfold - scored higher in this pairwise comparison

  4. Performance of McQFold - scored lower in this pairwise comparison

  5. Compile and download dataset for RNAfold & McQFold [.zip] - may take several seconds...


Overview

Metric RNAfold McQFold
MCC 0.503 > 0.443
Average MCC ± 95% Confidence Intervals 0.697 ± 0.052 > 0.671 ± 0.054
Sensitivity 0.453 > 0.348
Positive Predictive Value 0.558 < 0.564
Total TP 2779 > 2134
Total TN 13411823 < 13413021
Total FP 2421 > 1751
Total FP CONTRA 314 > 143
Total FP INCONS 1889 > 1507
Total FP COMP 218 > 101
Total FN 3351 < 3996
P-value 3.56938820447e-08

^top




Performance plots


^top





Performance of RNAfold - scored higher in this pairwise comparison

1. Total counts & total scores for RNAfold

Total Base Pair Counts
Total TP 2779
Total TN 13411823
Total FP 2421
Total FP CONTRA 314
Total FP INCONS 1889
Total FP COMP 218
Total FN 3351
Total Scores
MCC 0.503
Average MCC ± 95% Confidence Intervals 0.697 ± 0.052
Sensitivity 0.453
Positive Predictive Value 0.558
Nr of predictions 120

^top



2. Individual counts for RNAfold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2K5Z_A - 1.00 1.00 1.00 11 395 0 0 0 0 0
2K63_A - 0.95 0.90 1.00 9 397 0 0 0 0 1
2K66_A - 0.95 0.90 1.00 9 222 0 0 0 0 1
2KD8_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.97 0.95 1.00 18 1110 1 0 0 1 1
2KEZ_A - 0.89 0.80 1.00 8 268 0 0 0 0 2
2KFC_A - -0.02 0.00 0.00 0 623 7 0 7 0 20
2KGP_A - 1.00 1.00 1.00 9 291 1 0 0 1 0
2KMJ_A - 1.00 1.00 1.00 11 367 0 0 0 0 0
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.76 0.60 0.96 24 5126 5 0 1 4 16
2KU0_A - 0.86 0.75 1.00 12 691 0 0 0 0 4
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.89 0.80 1.00 8 343 0 0 0 0 2
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.39 0.26 0.63 5 622 3 1 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A 0.61 0.55 0.69 11 1524 5 0 5 0 9
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.93 0.87 1.00 34 6071 3 0 0 3 5
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
2RP0_A - 0.64 0.42 1.00 5 346 0 0 0 0 7
2RPT_A - 1.00 1.00 1.00 7 183 0 0 0 0 0
2RRC_A - 0.83 0.70 1.00 7 224 0 0 0 0 3
2WDL_A - 0.41 0.36 0.48 428 3937321 473 27 445 1 776
2WRQ_Y 0.57 0.59 0.56 10 2832 13 5 3 5 7
2WW9_F - 0.59 0.60 0.60 6 290 4 0 4 0 4
2WW9_E - 0.53 0.29 1.00 4 557 0 0 0 0 10
2WW9_D - 0.14 0.12 0.19 3 1937 13 0 13 0 23
2WWQ_V 0.76 0.68 0.86 19 2904 5 0 3 2 9
2XKV_B 0.51 0.50 0.53 10 4541 23 0 9 14 10
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.34 0.31 0.39 13 5118 20 1 19 0 29
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.65 0.63 0.68 15 2256 8 1 6 1 9
2YIE_X - 0.25 0.25 0.27 3 1367 11 1 7 3 9
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2ZY6_A - 0.58 0.58 0.58 7 691 5 1 4 0 5
2ZZM_B 0.21 0.19 0.25 6 3462 18 0 18 0 26
2ZZN_D 0.82 0.78 0.88 21 2461 3 0 3 0 6
3A2K_C 0.42 0.39 0.46 11 2902 13 2 11 0 17
3A3A_A 0.87 0.76 1.00 28 3627 0 0 0 0 9
3ADB_C - 0.33 0.32 0.35 12 4152 22 0 22 0 26
3AKZ_H 0.43 0.39 0.48 11 2678 12 2 10 0 17
3AM1_B - 0.68 0.63 0.73 22 3210 8 1 7 0 13
3AMU_B 0.70 0.59 0.84 16 2984 5 0 3 2 11
3DW4_A - -0.02 0.00 0.00 0 345 6 0 6 0 10
3G4S_9 0.51 0.39 0.69 22 7349 10 1 9 0 35
3GCA_A - 0.54 0.29 1.00 5 523 0 0 0 0 12
3GX2_A 0.68 0.55 0.85 22 4345 5 0 4 1 18
3HAY_E - 0.91 0.83 1.00 15 2263 6 0 0 6 3
3HJW_D - 0.94 0.89 1.00 16 1637 2 0 0 2 2
3IAB_R - 0.92 0.86 1.00 12 1023 0 0 0 0 2
3ID5_D - 0.44 0.33 0.60 3 491 5 0 2 3 6
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IWN_A 0.63 0.58 0.70 19 4251 9 0 8 1 14
3IYQ_A 0.31 0.34 0.29 32 60616 80 24 54 2 62
3IZ4_A 0.51 0.47 0.55 62 70763 52 10 41 1 70
3IZF_C 0.59 0.52 0.67 28 6861 14 1 13 0 26
3J0L_2 - 0.25 0.24 0.26 8 6185 25 2 21 2 25
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.23 0.19 0.30 3 1118 7 1 6 0 13
3J0L_1 - 0.76 0.63 0.92 12 1212 2 0 1 1 7
3J0L_h - 0.75 0.60 0.93 26 6077 4 0 2 2 17
3J0L_7 - -0.01 0.00 0.00 0 1213 12 0 12 0 17
3J0L_g - -0.01 0.00 0.00 0 460 5 1 4 0 4
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3JYV_7 -0.01 0.00 0.00 0 2828 22 1 21 0 32
3JYX_5 - 0.31 0.32 0.31 285 5021945 718 179 456 83 608
3JYX_4 0.31 0.30 0.32 10 12215 33 5 16 12 23
3JYX_3 0.62 0.63 0.61 17 6300 22 1 10 11 10
3KIY_A - 0.41 0.35 0.48 431 4053222 484 22 453 9 810
3KTW_C - 0.73 0.63 0.84 27 4528 6 2 3 1 16
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NDB_M - 0.77 0.69 0.86 42 9131 8 0 7 1 19
3NKB_B - 0.59 0.54 0.67 14 1995 7 0 7 0 12
3NMU_E - 0.54 0.50 0.60 3 556 5 0 2 3 3
3NPB_A 0.83 0.72 0.97 33 6987 4 0 1 3 13
3O58_3 0.34 0.34 0.34 12 12368 34 2 21 11 23
3O58_2 0.59 0.61 0.58 23 7220 19 4 13 2 15
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.75 0.63 0.90 45 12830 7 1 4 2 27
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.64 0.52 0.79 22 3888 6 1 5 0 20
3SIU_F - 0.85 0.73 1.00 8 370 0 0 0 0 3
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.48 0.38 0.61 14 3547 9 0 9 0 23
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_2 0.14 0.15 0.14 5 11744 43 5 27 11 28
4A1C_3 0.70 0.59 0.82 32 7101 7 1 6 0 22
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.70 0.58 0.85 11 1262 2 1 1 0 8
4ENC_A 0.32 0.26 0.42 5 1314 7 1 6 0 14

^top



Performance of McQFold - scored lower in this pairwise comparison

1. Total counts & total scores for McQFold

Total Base Pair Counts
Total TP 2134
Total TN 13413021
Total FP 1751
Total FP CONTRA 143
Total FP INCONS 1507
Total FP COMP 101
Total FN 3996
Total Scores
MCC 0.443
Average MCC ± 95% Confidence Intervals 0.671 ± 0.054
Sensitivity 0.348
Positive Predictive Value 0.564
Nr of predictions 120

^top



2. Individual counts for McQFold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2K5Z_A - 0.60 0.36 1.00 4 402 0 0 0 0 7
2K63_A - 0.95 0.90 1.00 9 397 0 0 0 0 1
2K66_A - 0.95 0.90 1.00 9 222 0 0 0 0 1
2KD8_A - 1.00 1.00 1.00 9 222 1 0 0 1 0
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.89 0.79 1.00 15 1113 1 0 0 1 4
2KEZ_A - 0.89 0.80 1.00 8 268 0 0 0 0 2
2KFC_A - 0.49 0.25 1.00 5 625 0 0 0 0 15
2KGP_A - 0.81 0.67 1.00 6 294 1 0 0 1 3
2KMJ_A - 1.00 1.00 1.00 11 367 1 0 0 1 0
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.59 0.53 0.68 21 5120 13 3 7 3 19
2KU0_A - 0.75 0.56 1.00 9 694 0 0 0 0 7
2KUR_A 0.87 0.76 1.00 16 1112 0 0 0 0 5
2KUU_A 0.84 0.71 1.00 15 1113 1 0 0 1 6
2KUV_A 0.85 0.73 1.00 16 1112 0 0 0 0 6
2KUW_A 0.87 0.76 1.00 16 1112 0 0 0 0 5
2KX8_A 0.88 0.83 0.94 15 845 1 0 1 0 3
2KXM_A - 0.70 0.50 1.00 5 346 0 0 0 0 5
2KZL_A - 0.86 0.74 1.00 14 1471 1 0 0 1 5
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L2K_A - 0.97 0.95 1.00 18 843 0 0 0 0 1
2L3C_B - 0.94 0.88 1.00 15 546 0 0 0 0 2
2L3E_A - 1.00 1.00 1.00 13 582 1 0 0 1 0
2L3J_B 0.89 0.79 1.00 27 2458 0 0 0 0 7
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.46 0.26 0.83 5 624 1 0 1 0 14
2LBS_A - 1.00 1.00 1.00 14 482 1 0 0 1 0
2LC8_A 0.61 0.55 0.69 11 1524 5 0 5 0 9
2LDL_A - 0.73 0.55 1.00 6 345 0 0 0 0 5
2LDT_A - 0.68 0.47 1.00 7 458 0 0 0 0 8
2LHP_A - 1.00 1.00 1.00 16 650 0 0 0 0 0
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.51 0.46 0.58 18 6074 13 2 11 0 21
2LQZ_A - 0.91 0.91 0.91 10 340 1 1 0 0 1
2LWK_A - 0.83 0.77 0.91 10 485 2 0 1 1 3
2RP0_A - 0.64 0.42 1.00 5 346 0 0 0 0 7
2RPT_A - 1.00 1.00 1.00 7 183 0 0 0 0 0
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2WDL_A - 0.31 0.26 0.37 308 3937383 531 27 503 1 896
2WRQ_Y 0.57 0.59 0.56 10 2832 13 5 3 5 7
2WW9_F - 0.71 0.60 0.86 6 293 1 0 1 0 4
2WW9_E - -0.01 0.00 0.00 0 556 5 0 5 0 14
2WW9_D - 0.32 0.23 0.46 6 1940 7 2 5 0 20
2WWQ_V 0.00 0.00 0.00 0 2926 0 0 0 0 28
2XKV_B 0.31 0.30 0.33 6 4542 25 1 11 13 14
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.27 0.24 0.32 10 5120 21 0 21 0 32
2Y8W_B - 1.00 1.00 1.00 6 184 2 0 0 2 0
2Y9C_V - 0.59 0.54 0.65 13 2258 8 1 6 1 11
2YIE_X - 0.36 0.33 0.40 4 1368 6 2 4 0 8
2YIE_Z - 0.43 0.42 0.45 5 1529 6 3 3 0 7
2ZY6_A - 0.58 0.58 0.58 7 691 5 1 4 0 5
2ZZM_B 0.21 0.19 0.24 6 3461 19 2 17 0 26
2ZZN_D 0.84 0.78 0.91 21 2462 2 0 2 0 6
3A2K_C 0.86 0.75 1.00 21 2905 0 0 0 0 7
3A3A_A 0.87 0.76 1.00 28 3627 0 0 0 0 9
3ADB_C - 0.92 0.84 1.00 32 4154 1 0 0 1 6
3AKZ_H 0.68 0.61 0.77 17 2679 6 1 4 1 11
3AM1_B - 0.91 0.83 1.00 29 3211 1 0 0 1 6
3AMU_B 0.75 0.59 0.94 16 2986 3 0 1 2 11
3DW4_A - -0.02 0.00 0.00 0 348 3 0 3 0 10
3G4S_9 0.27 0.21 0.36 12 7348 21 1 20 0 45
3GCA_A - 0.54 0.29 1.00 5 523 0 0 0 0 12
3GX2_A 0.47 0.40 0.57 16 4343 13 1 11 1 24
3HAY_E - 0.91 0.83 1.00 15 2263 3 0 0 3 3
3HJW_D - 0.88 0.83 0.94 15 1637 3 0 1 2 3
3IAB_R - 0.92 0.86 1.00 12 1023 0 0 0 0 2
3ID5_D - 0.49 0.33 0.75 3 492 6 0 1 5 6
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IWN_A 0.20 0.18 0.24 6 4253 19 2 17 0 27
3IYQ_A 0.28 0.31 0.26 29 60614 87 19 64 4 65
3IZ4_A 0.42 0.36 0.49 47 70780 53 6 43 4 85
3IZF_C 0.68 0.56 0.83 30 6867 6 0 6 0 24
3J0L_2 - 0.26 0.24 0.30 8 6189 21 0 19 2 25
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.26 0.19 0.38 3 1120 5 1 4 0 13
3J0L_1 - 0.65 0.47 0.90 9 1215 3 0 1 2 10
3J0L_h - 0.65 0.49 0.88 21 6081 3 0 3 0 22
3J0L_7 - -0.01 0.00 0.00 0 1215 10 0 10 0 17
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3JYV_7 -0.01 0.00 0.00 0 2830 20 0 20 0 32
3JYX_5 - 0.00 0.00 0.00 0 5022865 0 0 0 0 893
3JYX_4 0.20 0.21 0.19 7 12210 33 8 21 4 26
3JYX_3 0.21 0.22 0.20 6 6298 24 9 15 0 21
3KIY_A - 0.31 0.26 0.38 317 4053291 529 22 498 9 924
3KTW_C - 0.36 0.30 0.45 13 4531 17 1 15 1 30
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NDB_M - 0.81 0.70 0.93 43 9134 4 1 2 1 18
3NKB_B - 0.36 0.31 0.44 8 1998 10 1 9 0 18
3NMU_E - 0.41 0.17 1.00 1 560 3 0 0 3 5
3NPB_A 0.81 0.67 0.97 31 6989 4 1 0 3 15
3O58_3 0.26 0.26 0.26 9 12368 26 10 16 0 26
3O58_2 0.83 0.71 0.96 27 7232 2 0 1 1 11
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.69 0.56 0.87 40 12834 9 0 6 3 32
3R4F_A - 0.96 0.92 1.00 23 2122 1 0 0 1 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.71 0.60 0.86 25 3887 4 0 4 0 17
3SIU_F - 0.73 0.55 1.00 6 372 0 0 0 0 5
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 2 0 0 2 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.73 0.57 0.95 21 3138 1 0 1 0 16
3UZL_B 0.45 0.41 0.52 15 3541 14 0 14 0 22
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_2 0.15 0.15 0.15 5 11748 33 5 23 5 28
4A1C_3 0.25 0.22 0.29 12 7099 29 1 28 0 42
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.42 0.33 0.54 14 4345 13 1 11 1 28
4ENB_A 0.89 0.79 1.00 15 1260 0 0 0 0 4
4ENC_A 0.86 0.79 0.94 15 1310 1 1 0 0 4

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.