CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Fold - scored higher in this pairwise comparison

  4. Performance of RNAsubopt - scored lower in this pairwise comparison

  5. Compile and download dataset for Fold & RNAsubopt [.zip] - may take several seconds...


Overview

Metric Fold RNAsubopt
MCC 0.679 > 0.663
Average MCC ± 95% Confidence Intervals 0.724 ± 0.064 < 0.724 ± 0.059
Sensitivity 0.618 > 0.605
Positive Predictive Value 0.751 > 0.732
Total TP 1266 > 1240
Total TN 323363 > 323354
Total FP 502 < 537
Total FP CONTRA 63 > 61
Total FP INCONS 357 < 394
Total FP COMP 82 = 82
Total FN 784 < 810
P-value 3.56938820447e-08

^top




Performance plots


^top





Performance of Fold - scored higher in this pairwise comparison

1. Total counts & total scores for Fold

Total Base Pair Counts
Total TP 1266
Total TN 323363
Total FP 502
Total FP CONTRA 63
Total FP INCONS 357
Total FP COMP 82
Total FN 784
Total Scores
MCC 0.679
Average MCC ± 95% Confidence Intervals 0.724 ± 0.064
Sensitivity 0.618
Positive Predictive Value 0.751
Nr of predictions 82

^top



2. Individual counts for Fold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.76 0.60 0.96 24 5126 5 0 1 4 16
2KU0_A - 0.83 0.69 1.00 11 692 0 0 0 0 5
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.83 0.70 1.00 7 344 0 0 0 0 3
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_B 0.90 0.88 0.92 22 2121 2 0 2 0 3
2L1F_A 0.89 0.88 0.91 21 2057 2 0 2 0 3
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.39 0.26 0.63 5 622 3 1 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.85 0.79 0.91 31 6071 5 0 3 2 8
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.96 0.92 1.00 12 484 0 0 0 0 1
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2WWQ_V 0.76 0.64 0.90 18 2906 3 0 2 1 10
2XKV_B 0.51 0.50 0.53 10 4541 24 0 9 15 10
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.93 0.86 1.00 36 5115 0 0 0 0 6
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.65 0.63 0.68 15 2256 8 1 6 1 9
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2YIE_X - 0.25 0.25 0.27 3 1367 8 2 6 0 9
3ADB_C - 0.80 0.74 0.88 28 4154 4 0 4 0 10
3AKZ_H 0.84 0.75 0.95 21 2679 1 1 0 0 7
3AM1_B - 0.78 0.71 0.86 25 3211 4 0 4 0 10
3AMU_B 0.64 0.59 0.70 16 2980 9 0 7 2 11
3IYQ_A 0.29 0.31 0.27 29 60618 83 20 59 4 65
3IZ4_A 0.53 0.46 0.61 61 70776 44 5 34 5 71
3IZF_C 0.70 0.59 0.82 32 6864 7 1 6 0 22
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.20 0.19 0.23 3 1115 10 2 8 0 13
3J0L_1 - 0.76 0.63 0.92 12 1212 2 0 1 1 7
3J0L_h - 0.81 0.65 1.00 28 6077 2 0 0 2 15
3J0L_7 - -0.01 0.00 0.00 0 1213 12 0 12 0 17
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_2 - 0.25 0.24 0.26 8 6185 25 2 21 2 25
3J16_L 0.63 0.53 0.76 16 2754 5 0 5 0 14
3NDB_M - 0.84 0.74 0.96 45 9133 3 0 2 1 16
3NKB_B - 0.35 0.31 0.42 8 1997 11 0 11 0 18
3NMU_E - -0.01 0.00 0.00 0 552 11 2 7 2 6
3NPB_A 0.70 0.61 0.80 28 6986 10 1 6 3 18
3O58_3 0.29 0.31 0.28 11 12363 41 3 26 12 24
3O58_2 0.71 0.71 0.71 27 7222 12 3 8 1 11
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.77 0.64 0.94 46 12831 5 0 3 2 26
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.57 0.48 0.69 20 3887 9 1 8 0 22
3SIU_F - 0.85 0.73 1.00 8 370 0 0 0 0 3
3SN2_B 1.00 1.00 1.00 12 394 0 0 0 0 0
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.45 0.35 0.59 13 3138 9 1 8 0 24
3UZL_B 0.77 0.62 0.96 23 3546 1 0 1 0 14
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_2 0.14 0.15 0.14 5 11744 43 5 27 11 28
4A1C_3 0.68 0.57 0.82 31 7102 7 1 6 0 23
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.32 0.26 0.42 5 1263 7 1 6 0 14
4ENC_A 0.31 0.26 0.38 5 1313 8 1 7 0 14

^top



Performance of RNAsubopt - scored lower in this pairwise comparison

1. Total counts & total scores for RNAsubopt

Total Base Pair Counts
Total TP 1240
Total TN 323354
Total FP 537
Total FP CONTRA 61
Total FP INCONS 394
Total FP COMP 82
Total FN 810
Total Scores
MCC 0.663
Average MCC ± 95% Confidence Intervals 0.724 ± 0.059
Sensitivity 0.605
Positive Predictive Value 0.732
Nr of predictions 82

^top



2. Individual counts for RNAsubopt [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.52 0.43 0.65 17 5125 12 3 6 3 23
2KU0_A - 0.83 0.69 1.00 11 692 0 0 0 0 5
2KUR_A 0.85 0.81 0.89 17 1109 2 0 2 0 4
2KUU_A 0.82 0.76 0.89 16 1110 3 0 2 1 5
2KUV_A 0.83 0.77 0.89 17 1109 2 0 2 0 5
2KUW_A 0.90 0.86 0.95 18 1109 1 0 1 0 3
2KX8_A 0.91 0.83 1.00 15 846 0 0 0 0 3
2KXM_A - 0.89 0.80 1.00 8 343 0 0 0 0 2
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_B 0.94 0.88 1.00 22 2123 0 0 0 0 3
2L1F_A 0.93 0.88 1.00 21 2059 0 0 0 0 3
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.87 0.76 1.00 13 548 0 0 0 0 4
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.39 0.26 0.63 5 622 3 1 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.81 0.77 0.86 30 6070 9 0 5 4 9
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
2RRC_A - 0.83 0.70 1.00 7 224 0 0 0 0 3
2WWQ_V 0.76 0.68 0.86 19 2904 5 0 3 2 9
2XKV_B 0.51 0.50 0.53 10 4541 23 0 9 14 10
2XQD_Y 0.75 0.67 0.86 18 2829 3 0 3 0 9
2XXA_G 0.47 0.43 0.53 18 5117 16 1 15 0 24
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.66 0.63 0.71 15 2257 8 1 5 2 9
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2YIE_X - 0.82 0.67 1.00 8 1370 3 0 0 3 4
3ADB_C - 0.92 0.84 1.00 32 4154 0 0 0 0 6
3AKZ_H 0.39 0.36 0.43 10 2678 13 2 11 0 18
3AM1_B - 0.91 0.83 1.00 29 3211 0 0 0 0 6
3AMU_B 0.70 0.59 0.84 16 2984 5 0 3 2 11
3IYQ_A 0.33 0.36 0.30 34 60614 82 17 61 4 60
3IZ4_A 0.51 0.47 0.56 62 70766 49 8 40 1 70
3IZF_C 0.70 0.61 0.80 33 6862 8 1 7 0 21
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.35 0.31 0.42 5 1116 7 1 6 0 11
3J0L_1 - 0.76 0.63 0.92 12 1212 2 0 1 1 7
3J0L_h - 0.75 0.60 0.93 26 6077 4 0 2 2 17
3J0L_7 - -0.01 0.00 0.00 0 1213 12 0 12 0 17
3J0L_g - -0.01 0.00 0.00 0 460 5 1 4 0 4
3J0L_2 - 0.25 0.24 0.28 8 6187 25 0 21 4 25
3J16_L 0.41 0.37 0.48 11 2752 12 1 11 0 19
3NDB_M - 0.77 0.69 0.86 42 9131 8 0 7 1 19
3NKB_B - 0.57 0.50 0.65 13 1996 7 0 7 0 13
3NMU_E - 0.54 0.50 0.60 3 556 5 0 2 3 3
3NPB_A 0.75 0.65 0.86 30 6986 7 1 4 2 16
3O58_3 0.34 0.34 0.34 12 12368 34 2 21 11 23
3O58_2 0.72 0.74 0.70 28 7220 13 4 8 1 10
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.75 0.63 0.90 45 12830 7 1 4 2 27
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.61 0.50 0.75 21 3888 7 1 6 0 21
3SIU_F - 0.85 0.73 1.00 8 370 0 0 0 0 3
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.48 0.38 0.61 14 3547 9 0 9 0 23
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_2 0.14 0.15 0.13 5 11742 43 5 29 9 28
4A1C_3 0.70 0.59 0.82 32 7101 7 1 6 0 22
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.52 0.43 0.64 18 4343 11 2 8 1 24
4ENB_A 0.70 0.58 0.85 11 1262 2 1 1 0 8
4ENC_A 0.32 0.26 0.42 5 1314 7 0 7 0 14

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.