CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Fold - scored higher in this pairwise comparison

  4. Performance of UNAFold - scored lower in this pairwise comparison

  5. Compile and download dataset for Fold & UNAFold [.zip] - may take several seconds...


Overview

Metric Fold UNAFold
MCC 0.679 > 0.670
Average MCC ± 95% Confidence Intervals 0.724 ± 0.064 < 0.729 ± 0.059
Sensitivity 0.618 > 0.608
Positive Predictive Value 0.751 > 0.743
Total TP 1266 > 1246
Total TN 323363 < 323371
Total FP 502 < 510
Total FP CONTRA 63 < 64
Total FP INCONS 357 < 368
Total FP COMP 82 > 78
Total FN 784 < 804
P-value 2.82781450476e-07

^top




Performance plots


^top





Performance of Fold - scored higher in this pairwise comparison

1. Total counts & total scores for Fold

Total Base Pair Counts
Total TP 1266
Total TN 323363
Total FP 502
Total FP CONTRA 63
Total FP INCONS 357
Total FP COMP 82
Total FN 784
Total Scores
MCC 0.679
Average MCC ± 95% Confidence Intervals 0.724 ± 0.064
Sensitivity 0.618
Positive Predictive Value 0.751
Nr of predictions 82

^top



2. Individual counts for Fold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.76 0.60 0.96 24 5126 5 0 1 4 16
2KU0_A - 0.83 0.69 1.00 11 692 0 0 0 0 5
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.83 0.70 1.00 7 344 0 0 0 0 3
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_B 0.90 0.88 0.92 22 2121 2 0 2 0 3
2L1F_A 0.89 0.88 0.91 21 2057 2 0 2 0 3
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.39 0.26 0.63 5 622 3 1 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.85 0.79 0.91 31 6071 5 0 3 2 8
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.96 0.92 1.00 12 484 0 0 0 0 1
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2WWQ_V 0.76 0.64 0.90 18 2906 3 0 2 1 10
2XKV_B 0.51 0.50 0.53 10 4541 24 0 9 15 10
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.93 0.86 1.00 36 5115 0 0 0 0 6
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.65 0.63 0.68 15 2256 8 1 6 1 9
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2YIE_X - 0.25 0.25 0.27 3 1367 8 2 6 0 9
3ADB_C - 0.80 0.74 0.88 28 4154 4 0 4 0 10
3AKZ_H 0.84 0.75 0.95 21 2679 1 1 0 0 7
3AM1_B - 0.78 0.71 0.86 25 3211 4 0 4 0 10
3AMU_B 0.64 0.59 0.70 16 2980 9 0 7 2 11
3IYQ_A 0.29 0.31 0.27 29 60618 83 20 59 4 65
3IZ4_A 0.53 0.46 0.61 61 70776 44 5 34 5 71
3IZF_C 0.70 0.59 0.82 32 6864 7 1 6 0 22
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.20 0.19 0.23 3 1115 10 2 8 0 13
3J0L_1 - 0.76 0.63 0.92 12 1212 2 0 1 1 7
3J0L_h - 0.81 0.65 1.00 28 6077 2 0 0 2 15
3J0L_7 - -0.01 0.00 0.00 0 1213 12 0 12 0 17
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_2 - 0.25 0.24 0.26 8 6185 25 2 21 2 25
3J16_L 0.63 0.53 0.76 16 2754 5 0 5 0 14
3NDB_M - 0.84 0.74 0.96 45 9133 3 0 2 1 16
3NKB_B - 0.35 0.31 0.42 8 1997 11 0 11 0 18
3NMU_E - -0.01 0.00 0.00 0 552 11 2 7 2 6
3NPB_A 0.70 0.61 0.80 28 6986 10 1 6 3 18
3O58_3 0.29 0.31 0.28 11 12363 41 3 26 12 24
3O58_2 0.71 0.71 0.71 27 7222 12 3 8 1 11
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.77 0.64 0.94 46 12831 5 0 3 2 26
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.57 0.48 0.69 20 3887 9 1 8 0 22
3SIU_F - 0.85 0.73 1.00 8 370 0 0 0 0 3
3SN2_B 1.00 1.00 1.00 12 394 0 0 0 0 0
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.45 0.35 0.59 13 3138 9 1 8 0 24
3UZL_B 0.77 0.62 0.96 23 3546 1 0 1 0 14
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_2 0.14 0.15 0.14 5 11744 43 5 27 11 28
4A1C_3 0.68 0.57 0.82 31 7102 7 1 6 0 23
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.32 0.26 0.42 5 1263 7 1 6 0 14
4ENC_A 0.31 0.26 0.38 5 1313 8 1 7 0 14

^top



Performance of UNAFold - scored lower in this pairwise comparison

1. Total counts & total scores for UNAFold

Total Base Pair Counts
Total TP 1246
Total TN 323371
Total FP 510
Total FP CONTRA 64
Total FP INCONS 368
Total FP COMP 78
Total FN 804
Total Scores
MCC 0.670
Average MCC ± 95% Confidence Intervals 0.729 ± 0.059
Sensitivity 0.608
Positive Predictive Value 0.743
Nr of predictions 82

^top



2. Individual counts for UNAFold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.76 0.60 0.96 24 5126 5 0 1 4 16
2KU0_A - 0.83 0.69 1.00 11 692 0 0 0 0 5
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.83 0.70 1.00 7 344 0 0 0 0 3
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.39 0.26 0.63 5 622 3 1 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.81 0.67 1.00 10 455 0 0 0 0 5
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.93 0.87 1.00 34 6071 1 0 0 1 5
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2WWQ_V 0.78 0.68 0.90 19 2905 3 0 2 1 9
2XKV_B 0.47 0.45 0.50 9 4542 21 0 9 12 11
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.34 0.31 0.39 13 5118 20 1 19 0 29
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.62 0.58 0.67 14 2257 8 1 6 1 10
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2YIE_X - 0.36 0.33 0.40 4 1368 6 2 4 0 8
3ADB_C - 0.80 0.74 0.88 28 4154 4 0 4 0 10
3AKZ_H 0.43 0.39 0.48 11 2678 12 2 10 0 17
3AM1_B - 0.68 0.63 0.73 22 3210 8 1 7 0 13
3AMU_B 0.70 0.59 0.84 16 2984 5 0 3 2 11
3IYQ_A 0.31 0.33 0.28 31 60617 82 22 56 4 63
3IZ4_A 0.51 0.45 0.58 60 70772 50 4 40 6 72
3IZF_C 0.70 0.61 0.80 33 6862 8 1 7 0 21
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.51 0.50 0.53 8 1113 7 3 4 0 8
3J0L_1 - 0.70 0.58 0.85 11 1212 2 0 2 0 8
3J0L_h - 0.75 0.60 0.93 26 6077 4 0 2 2 17
3J0L_7 - 0.48 0.41 0.58 7 1213 5 0 5 0 10
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_2 - 0.25 0.24 0.26 8 6185 25 2 21 2 25
3J16_L 0.26 0.23 0.30 7 2752 16 1 15 0 23
3NDB_M - 0.84 0.74 0.96 45 9133 3 0 2 1 16
3NKB_B - 0.59 0.54 0.67 14 1995 7 0 7 0 12
3NMU_E - 0.54 0.50 0.60 3 556 5 0 2 3 3
3NPB_A 0.78 0.65 0.94 30 6989 5 0 2 3 16
3O58_3 0.35 0.34 0.35 12 12369 33 1 21 11 23
3O58_2 0.71 0.71 0.71 27 7222 12 4 7 1 11
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.77 0.64 0.94 46 12831 5 0 3 2 26
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.64 0.52 0.79 22 3888 6 1 5 0 20
3SIU_F - 0.85 0.73 1.00 8 370 0 0 0 0 3
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.48 0.38 0.61 14 3547 9 0 9 0 23
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_2 0.14 0.15 0.14 5 11745 42 5 26 11 28
4A1C_3 0.70 0.59 0.82 32 7101 7 1 6 0 22
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.70 0.58 0.85 11 1262 2 1 1 0 8
4ENC_A 0.32 0.26 0.42 5 1314 7 1 6 0 14

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.