CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of RNAfold - scored higher in this pairwise comparison

  4. Performance of Vsfold4 - scored lower in this pairwise comparison

  5. Compile and download dataset for RNAfold & Vsfold4 [.zip] - may take several seconds...


Overview

Metric RNAfold Vsfold4
MCC 0.651 > 0.562
Average MCC ± 95% Confidence Intervals 0.707 ± 0.052 > 0.629 ± 0.057
Sensitivity 0.587 > 0.481
Positive Predictive Value 0.726 > 0.664
Total TP 1649 > 1351
Total TN 399817 < 400051
Total FP 746 < 766
Total FP CONTRA 86 > 76
Total FP INCONS 535 < 609
Total FP COMP 125 > 81
Total FN 1159 < 1457
P-value 3.56938820447e-08

^top




Performance plots


^top





Performance of RNAfold - scored higher in this pairwise comparison

1. Total counts & total scores for RNAfold

Total Base Pair Counts
Total TP 1649
Total TN 399817
Total FP 746
Total FP CONTRA 86
Total FP INCONS 535
Total FP COMP 125
Total FN 1159
Total Scores
MCC 0.651
Average MCC ± 95% Confidence Intervals 0.707 ± 0.052
Sensitivity 0.587
Positive Predictive Value 0.726
Nr of predictions 118

^top



2. Individual counts for RNAfold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2K5Z_A - 1.00 1.00 1.00 11 395 0 0 0 0 0
2K63_A - 0.95 0.90 1.00 9 397 0 0 0 0 1
2K66_A - 0.95 0.90 1.00 9 222 0 0 0 0 1
2KD8_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.97 0.95 1.00 18 1110 1 0 0 1 1
2KEZ_A - 0.89 0.80 1.00 8 268 0 0 0 0 2
2KFC_A - -0.02 0.00 0.00 0 623 7 0 7 0 20
2KGP_A - 1.00 1.00 1.00 9 291 1 0 0 1 0
2KMJ_A - 1.00 1.00 1.00 11 367 0 0 0 0 0
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.76 0.60 0.96 24 5126 5 0 1 4 16
2KU0_A - 0.86 0.75 1.00 12 691 0 0 0 0 4
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.89 0.80 1.00 8 343 0 0 0 0 2
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.39 0.26 0.63 5 622 3 1 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A 0.61 0.55 0.69 11 1524 5 0 5 0 9
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.93 0.87 1.00 34 6071 3 0 0 3 5
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
2RP0_A - 0.64 0.42 1.00 5 346 0 0 0 0 7
2RPT_A - 1.00 1.00 1.00 7 183 0 0 0 0 0
2RRC_A - 0.83 0.70 1.00 7 224 0 0 0 0 3
2WRQ_Y 0.57 0.59 0.56 10 2832 13 5 3 5 7
2WW9_D - 0.14 0.12 0.19 3 1937 13 0 13 0 23
2WW9_E - 0.53 0.29 1.00 4 557 0 0 0 0 10
2WW9_F - 0.59 0.60 0.60 6 290 4 0 4 0 4
2WWQ_V 0.76 0.68 0.86 19 2904 5 0 3 2 9
2XKV_B 0.51 0.50 0.53 10 4541 23 0 9 14 10
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.34 0.31 0.39 13 5118 20 1 19 0 29
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.65 0.63 0.68 15 2256 8 1 6 1 9
2YIE_X - 0.25 0.25 0.27 3 1367 11 1 7 3 9
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2ZY6_A - 0.58 0.58 0.58 7 691 5 1 4 0 5
2ZZM_B 0.21 0.19 0.25 6 3462 18 0 18 0 26
2ZZN_D 0.82 0.78 0.88 21 2461 3 0 3 0 6
3A2K_C 0.42 0.39 0.46 11 2902 13 2 11 0 17
3A3A_A 0.87 0.76 1.00 28 3627 0 0 0 0 9
3ADB_C - 0.33 0.32 0.35 12 4152 22 0 22 0 26
3AKZ_H 0.43 0.39 0.48 11 2678 12 2 10 0 17
3AM1_B - 0.68 0.63 0.73 22 3210 8 1 7 0 13
3AMU_B 0.70 0.59 0.84 16 2984 5 0 3 2 11
3DW4_A - -0.02 0.00 0.00 0 345 6 0 6 0 10
3G4S_9 0.51 0.39 0.69 22 7349 10 1 9 0 35
3GCA_A - 0.54 0.29 1.00 5 523 0 0 0 0 12
3GX2_A 0.68 0.55 0.85 22 4345 5 0 4 1 18
3HAY_E - 0.91 0.83 1.00 15 2263 6 0 0 6 3
3HJW_D - 0.94 0.89 1.00 16 1637 2 0 0 2 2
3IAB_R - 0.92 0.86 1.00 12 1023 0 0 0 0 2
3ID5_D - 0.44 0.33 0.60 3 491 5 0 2 3 6
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IWN_A 0.63 0.58 0.70 19 4251 9 0 8 1 14
3IYQ_A 0.31 0.34 0.29 32 60616 80 24 54 2 62
3IZ4_A 0.51 0.47 0.55 62 70763 52 10 41 1 70
3IZF_C 0.59 0.52 0.67 28 6861 14 1 13 0 26
3J0L_h - 0.75 0.60 0.93 26 6077 4 0 2 2 17
3J0L_g - -0.01 0.00 0.00 0 460 5 1 4 0 4
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.23 0.19 0.30 3 1118 7 1 6 0 13
3J0L_2 - 0.25 0.24 0.26 8 6185 25 2 21 2 25
3J0L_1 - 0.76 0.63 0.92 12 1212 2 0 1 1 7
3J0L_7 - -0.01 0.00 0.00 0 1213 12 0 12 0 17
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3JYV_7 -0.01 0.00 0.00 0 2828 22 1 21 0 32
3JYX_3 0.62 0.63 0.61 17 6300 22 1 10 11 10
3JYX_4 0.31 0.30 0.32 10 12215 33 5 16 12 23
3KTW_C - 0.73 0.63 0.84 27 4528 6 2 3 1 16
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NDB_M - 0.77 0.69 0.86 42 9131 8 0 7 1 19
3NKB_B - 0.59 0.54 0.67 14 1995 7 0 7 0 12
3NMU_E - 0.54 0.50 0.60 3 556 5 0 2 3 3
3NPB_A 0.83 0.72 0.97 33 6987 4 0 1 3 13
3O58_2 0.59 0.61 0.58 23 7220 19 4 13 2 15
3O58_3 0.34 0.34 0.34 12 12368 34 2 21 11 23
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.75 0.63 0.90 45 12830 7 1 4 2 27
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.64 0.52 0.79 22 3888 6 1 5 0 20
3SIU_F - 0.85 0.73 1.00 8 370 0 0 0 0 3
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.48 0.38 0.61 14 3547 9 0 9 0 23
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_2 0.14 0.15 0.14 5 11744 43 5 27 11 28
4A1C_3 0.70 0.59 0.82 32 7101 7 1 6 0 22
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.70 0.58 0.85 11 1262 2 1 1 0 8
4ENC_A 0.32 0.26 0.42 5 1314 7 1 6 0 14

^top



Performance of Vsfold4 - scored lower in this pairwise comparison

1. Total counts & total scores for Vsfold4

Total Base Pair Counts
Total TP 1351
Total TN 400051
Total FP 766
Total FP CONTRA 76
Total FP INCONS 609
Total FP COMP 81
Total FN 1457
Total Scores
MCC 0.562
Average MCC ± 95% Confidence Intervals 0.629 ± 0.057
Sensitivity 0.481
Positive Predictive Value 0.664
Nr of predictions 118

^top



2. Individual counts for Vsfold4 [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2K5Z_A - 0.37 0.36 0.40 4 396 6 0 6 0 7
2K63_A - 0.95 0.90 1.00 9 397 0 0 0 0 1
2K66_A - 0.95 0.90 1.00 9 222 0 0 0 0 1
2KD8_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.97 0.95 1.00 18 1110 1 0 0 1 1
2KEZ_A - 0.70 0.50 1.00 5 271 0 0 0 0 5
2KFC_A - 0.49 0.25 1.00 5 625 0 0 0 0 15
2KGP_A - -0.02 0.00 0.00 0 296 4 0 4 0 9
2KMJ_A - 1.00 1.00 1.00 11 367 0 0 0 0 0
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.65 0.53 0.81 21 5125 7 0 5 2 19
2KU0_A - -0.02 0.00 0.00 0 694 9 0 9 0 16
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.70 0.50 1.00 5 346 0 0 0 0 5
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_A 0.66 0.54 0.81 13 2064 3 0 3 0 11
2L1F_B 0.68 0.56 0.82 14 2128 3 0 3 0 11
2L2K_A - 0.89 0.79 1.00 15 846 0 0 0 0 4
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.87 0.76 1.00 26 2459 0 0 0 0 8
2L5Z_A - 0.60 0.50 0.75 6 317 2 0 2 0 6
2L94_A 0.92 0.85 1.00 17 973 0 0 0 0 3
2LA5_A - 0.46 0.26 0.83 5 624 1 0 1 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1527 13 0 13 0 20
2LDL_A - 0.85 0.73 1.00 8 343 1 0 0 1 3
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.31 0.28 0.34 11 6073 21 3 18 0 28
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
2RP0_A - 0.64 0.42 1.00 5 346 0 0 0 0 7
2RPT_A - -0.03 0.00 0.00 0 186 4 0 4 0 7
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2WRQ_Y 0.53 0.53 0.53 9 2833 12 5 3 4 8
2WW9_D - 0.19 0.12 0.33 3 1944 6 0 6 0 23
2WW9_E - -0.01 0.00 0.00 0 556 5 0 5 0 14
2WW9_F - 0.59 0.60 0.60 6 290 4 0 4 0 4
2WWQ_V 0.64 0.50 0.82 14 2909 4 0 3 1 14
2XKV_B -0.01 0.00 0.00 0 4533 27 8 19 0 20
2XQD_Y 0.86 0.74 1.00 20 2830 0 0 0 0 7
2XXA_G -0.01 0.00 0.00 0 5122 29 1 28 0 42
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.63 0.50 0.80 12 2263 4 0 3 1 12
2YIE_X - 0.36 0.33 0.40 4 1368 6 2 4 0 8
2YIE_Z - -0.01 0.00 0.00 0 1529 11 3 8 0 12
2ZY6_A - 0.58 0.58 0.58 7 691 5 1 4 0 5
2ZZM_B 0.21 0.19 0.24 6 3461 19 0 19 0 26
2ZZN_D 0.86 0.78 0.95 21 2463 1 0 1 0 6
3A2K_C 0.84 0.71 1.00 20 2906 0 0 0 0 8
3A3A_A 0.85 0.73 1.00 27 3628 0 0 0 0 10
3ADB_C - 0.89 0.79 1.00 30 4156 0 0 0 0 8
3AKZ_H 0.67 0.57 0.80 16 2681 5 1 3 1 12
3AM1_B - 0.84 0.71 1.00 25 3215 0 0 0 0 10
3AMU_B 0.64 0.56 0.75 15 2983 7 0 5 2 12
3DW4_A - 0.70 0.50 1.00 5 346 0 0 0 0 5
3G4S_9 0.30 0.23 0.39 13 7348 20 1 19 0 44
3GCA_A - 0.54 0.29 1.00 5 523 0 0 0 0 12
3GX2_A 0.50 0.40 0.64 16 4346 10 0 9 1 24
3HAY_E - 0.91 0.83 1.00 15 2263 3 0 0 3 3
3HJW_D - 0.51 0.50 0.53 9 1636 8 0 8 0 9
3IAB_R - 0.92 0.86 1.00 12 1023 0 0 0 0 2
3ID5_D - 0.44 0.33 0.60 3 491 4 0 2 2 6
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IWN_A 0.27 0.21 0.35 7 4258 13 1 12 0 26
3IYQ_A 0.29 0.29 0.29 27 60634 71 13 52 6 67
3IZ4_A 0.36 0.31 0.43 41 70780 59 7 48 4 91
3IZF_C 0.69 0.56 0.86 30 6868 5 0 5 0 24
3J0L_h - 0.38 0.28 0.52 12 6082 11 0 11 0 31
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_8 - 0.70 0.50 1.00 4 186 0 0 0 0 4
3J0L_a - 0.39 0.31 0.50 5 1118 5 2 3 0 11
3J0L_2 - 0.38 0.36 0.41 12 6187 18 3 14 1 21
3J0L_1 - 0.28 0.21 0.40 4 1215 6 1 5 0 15
3J0L_7 - 0.51 0.41 0.64 7 1214 4 0 4 0 10
3J16_L 0.82 0.67 1.00 20 2755 0 0 0 0 10
3JYV_7 -0.01 0.00 0.00 0 2831 19 0 19 0 32
3JYX_3 0.60 0.56 0.65 15 6305 11 4 4 3 12
3JYX_4 0.10 0.09 0.12 3 12220 33 2 21 10 30
3KTW_C - 0.36 0.28 0.48 12 4535 13 3 10 0 31
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NDB_M - 0.28 0.23 0.35 14 9140 26 0 26 0 47
3NKB_B - 0.59 0.54 0.67 14 1995 7 0 7 0 12
3NMU_E - 0.41 0.17 1.00 1 560 3 0 0 3 5
3NPB_A 0.61 0.50 0.74 23 6990 9 0 8 1 23
3O58_2 0.47 0.42 0.53 16 7230 16 3 11 2 22
3O58_3 0.09 0.09 0.10 3 12373 35 5 22 8 32
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.57 0.44 0.74 32 12837 13 0 11 2 40
3R4F_A - 0.94 0.88 1.00 22 2123 0 0 0 0 3
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.19 0.17 0.24 7 3887 22 1 21 0 35
3SIU_F - 0.73 0.55 1.00 6 372 0 0 0 0 5
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.53 0.41 0.71 15 3549 6 1 5 0 22
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_2 0.28 0.24 0.33 8 11757 28 0 16 12 25
4A1C_3 0.26 0.22 0.32 12 7103 25 2 23 0 42
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.42 0.33 0.54 14 4345 13 1 11 1 28
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.69 0.47 1.00 9 1317 0 0 0 0 10

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.