CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Afold - scored higher in this pairwise comparison

  4. Performance of RNAalifold(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for Afold & RNAalifold(seed) [.zip] - may take several seconds...


Overview

Metric Afold RNAalifold(seed)
MCC 0.607 > 0.571
Average MCC ± 95% Confidence Intervals 0.723 ± 0.116 > 0.585 ± 0.112
Sensitivity 0.571 > 0.380
Positive Predictive Value 0.649 < 0.860
Total TP 452 > 301
Total TN 205142 < 205488
Total FP 293 > 60
Total FP CONTRA 48 > 11
Total FP INCONS 196 > 38
Total FP COMP 49 > 11
Total FN 340 < 491
P-value 5.10776592382e-08

^top




Performance plots


^top





Performance of Afold - scored higher in this pairwise comparison

1. Total counts & total scores for Afold

Total Base Pair Counts
Total TP 452
Total TN 205142
Total FP 293
Total FP CONTRA 48
Total FP INCONS 196
Total FP COMP 49
Total FN 340
Total Scores
MCC 0.607
Average MCC ± 95% Confidence Intervals 0.723 ± 0.116
Sensitivity 0.571
Positive Predictive Value 0.649
Nr of predictions 23

^top



2. Individual counts for Afold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.97 0.95 1.00 18 1110 1 0 0 1 1
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2L1F_B 0.96 0.96 0.96 24 2120 1 0 1 0 1
2L1F_A 0.96 0.96 0.96 23 2056 1 0 1 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LC8_A 0.61 0.55 0.69 11 1524 6 0 5 1 9
2XXA_G 0.34 0.31 0.39 13 5118 20 1 19 0 29
3A3A_A 0.84 0.70 1.00 26 3629 0 0 0 0 11
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IYQ_A 0.31 0.34 0.29 32 60616 82 23 55 4 62
3IZ4_A 0.48 0.45 0.51 59 70760 58 11 46 1 73
3JYX_4 0.31 0.30 0.31 10 12214 35 5 17 13 23
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NPB_A 0.74 0.61 0.90 28 6990 5 0 3 2 18
3O58_3 0.34 0.34 0.34 12 12368 37 2 21 14 23
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
4A1C_2 0.14 0.15 0.14 5 11745 43 5 26 12 28
4ENB_A 0.67 0.58 0.79 11 1261 3 1 2 0 8

^top



Performance of RNAalifold(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for RNAalifold(seed)

Total Base Pair Counts
Total TP 301
Total TN 205488
Total FP 60
Total FP CONTRA 11
Total FP INCONS 38
Total FP COMP 11
Total FN 491
Total Scores
MCC 0.571
Average MCC ± 95% Confidence Intervals 0.585 ± 0.112
Sensitivity 0.380
Positive Predictive Value 0.860
Nr of predictions 23

^top



2. Individual counts for RNAalifold(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.52 0.27 1.00 3 403 0 0 0 0 8
2KE6_A 0.97 0.95 1.00 18 1110 1 0 0 1 1
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.84 0.76 0.94 16 1111 1 0 1 0 5
2KX8_A 0.00 0.00 0.00 0 861 0 0 0 0 18
2L1F_B 0.64 0.56 0.74 14 2126 5 0 5 0 11
2L1F_A 0.67 0.58 0.78 14 2062 4 0 4 0 10
2L94_A 0.59 0.40 0.89 8 981 1 0 1 0 12
2LC8_A -0.01 0.00 0.00 0 1528 12 0 12 0 20
2XXA_G 0.46 0.21 1.00 9 5142 0 0 0 0 33
3A3A_A 0.71 0.51 1.00 19 3636 0 0 0 0 18
3IVN_B 0.61 0.48 0.79 15 2327 4 2 2 0 16
3IYQ_A 0.38 0.21 0.69 20 60697 13 5 4 4 74
3IZ4_A 0.42 0.21 0.85 28 70843 5 1 4 0 104
3JYX_4 0.46 0.21 1.00 7 12239 2 0 0 2 26
3LA5_A 0.63 0.47 0.84 16 2466 3 1 2 0 18
3NPB_A 0.66 0.48 0.92 22 6997 3 1 1 1 24
3O58_3 0.51 0.26 1.00 9 12394 0 0 0 0 26
3RKF_A 0.63 0.47 0.84 16 2192 3 1 2 0 18
4A1C_2 0.39 0.15 1.00 5 11776 2 0 0 2 28
4ENB_A 0.56 0.32 1.00 6 1269 0 0 0 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.