CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Afold - scored higher in this pairwise comparison

  4. Performance of Murlet(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for Afold & Murlet(seed) [.zip] - may take several seconds...


Overview

Metric Afold Murlet(seed)
MCC 0.690 > 0.553
Average MCC ± 95% Confidence Intervals 0.745 ± 0.123 > 0.555 ± 0.096
Sensitivity 0.630 > 0.367
Positive Predictive Value 0.760 < 0.841
Total TP 345 > 201
Total TN 72921 < 73136
Total FP 153 > 40
Total FP CONTRA 14 > 5
Total FP INCONS 95 > 33
Total FP COMP 44 > 2
Total FN 203 < 347
P-value 5.1503931209e-08

^top




Performance plots


^top





Performance of Afold - scored higher in this pairwise comparison

1. Total counts & total scores for Afold

Total Base Pair Counts
Total TP 345
Total TN 72921
Total FP 153
Total FP CONTRA 14
Total FP INCONS 95
Total FP COMP 44
Total FN 203
Total Scores
MCC 0.690
Average MCC ± 95% Confidence Intervals 0.745 ± 0.123
Sensitivity 0.630
Positive Predictive Value 0.760
Nr of predictions 20

^top



2. Individual counts for Afold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.97 0.95 1.00 18 1110 1 0 0 1 1
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2L1F_A 0.96 0.96 0.96 23 2056 1 0 1 0 1
2L1F_B 0.96 0.96 0.96 24 2120 1 0 1 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LC8_A 0.61 0.55 0.69 11 1524 6 0 5 1 9
2XXA_G 0.34 0.31 0.39 13 5118 20 1 19 0 29
3A3A_A 0.84 0.70 1.00 26 3629 0 0 0 0 11
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3JYX_4 0.31 0.30 0.31 10 12214 35 5 17 13 23
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NPB_A 0.74 0.61 0.90 28 6990 5 0 3 2 18
3O58_3 0.34 0.34 0.34 12 12368 37 2 21 14 23
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
4A1C_2 0.14 0.15 0.14 5 11745 43 5 26 12 28
4ENB_A 0.67 0.58 0.79 11 1261 3 1 2 0 8

^top



Performance of Murlet(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for Murlet(seed)

Total Base Pair Counts
Total TP 201
Total TN 73136
Total FP 40
Total FP CONTRA 5
Total FP INCONS 33
Total FP COMP 2
Total FN 347
Total Scores
MCC 0.553
Average MCC ± 95% Confidence Intervals 0.555 ± 0.096
Sensitivity 0.367
Positive Predictive Value 0.841
Nr of predictions 20

^top



2. Individual counts for Murlet(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.52 0.27 1.00 3 403 0 0 0 0 8
2KE6_A 0.66 0.53 0.83 10 1116 2 0 2 0 9
2KUR_A 0.63 0.48 0.83 10 1116 2 0 2 0 11
2KUU_A 0.63 0.48 0.83 10 1116 2 0 2 0 11
2KUV_A 0.85 0.73 1.00 16 1112 0 0 0 0 6
2KUW_A 0.84 0.76 0.94 16 1111 1 0 1 0 5
2L1F_A 0.82 0.75 0.90 18 2060 2 0 2 0 6
2L1F_B 0.80 0.72 0.90 18 2125 2 0 2 0 7
2L94_A 0.59 0.40 0.89 8 981 1 0 1 0 12
2LC8_A -0.01 0.00 0.00 0 1528 12 0 12 0 20
2XXA_G 0.38 0.14 1.00 6 5145 0 0 0 0 36
3A3A_A 0.57 0.32 1.00 12 3643 0 0 0 0 25
3IVN_B 0.53 0.39 0.75 12 2330 4 2 2 0 19
3JYX_4 0.23 0.09 0.60 3 12241 4 0 2 2 30
3LA5_A 0.58 0.41 0.82 14 2468 3 1 2 0 20
3NPB_A 0.49 0.28 0.87 13 7006 2 1 1 0 33
3O58_3 0.45 0.20 1.00 7 12396 0 0 0 0 28
3RKF_A 0.53 0.35 0.80 12 2196 3 1 2 0 22
4A1C_2 0.46 0.21 1.00 7 11774 0 0 0 0 26
4ENB_A 0.56 0.32 1.00 6 1269 0 0 0 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.