CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of ContextFold - scored higher in this pairwise comparison

  4. Performance of Afold - scored lower in this pairwise comparison

  5. Compile and download dataset for ContextFold & Afold [.zip] - may take several seconds...


Overview

Metric ContextFold Afold
MCC 0.709 > 0.677
Average MCC ± 95% Confidence Intervals 0.754 ± 0.136 > 0.748 ± 0.148
Sensitivity 0.610 < 0.624
Positive Predictive Value 0.831 > 0.740
Total TP 211 < 216
Total TN 36416 > 36378
Total FP 63 < 99
Total FP CONTRA 1 < 8
Total FP INCONS 42 < 68
Total FP COMP 20 < 23
Total FN 135 > 130
P-value 3.67407019774e-08

^top




Performance plots


^top





Performance of ContextFold - scored higher in this pairwise comparison

1. Total counts & total scores for ContextFold

Total Base Pair Counts
Total TP 211
Total TN 36416
Total FP 63
Total FP CONTRA 1
Total FP INCONS 42
Total FP COMP 20
Total FN 135
Total Scores
MCC 0.709
Average MCC ± 95% Confidence Intervals 0.754 ± 0.136
Sensitivity 0.610
Positive Predictive Value 0.831
Nr of predictions 18

^top



2. Individual counts for ContextFold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A 0.55 0.50 0.63 10 1524 6 0 6 0 10
2LDL_A - 0.90 0.82 1.00 9 342 0 0 0 0 2
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 0.93 0.88 1.00 7 344 2 0 0 2 1
2LK3_A - 0.89 0.80 1.00 8 268 0 0 0 0 2
2LKR_A - 0.65 0.56 0.76 22 6076 9 0 7 2 17
2LQZ_A - 0.80 0.73 0.89 8 342 1 1 0 0 3
2LWK_A - 0.88 0.85 0.92 11 484 1 0 1 0 2
3J0L_1 - 0.70 0.58 0.85 11 1212 3 0 2 1 8
3J0L_h - 0.82 0.67 1.00 29 6076 2 0 0 2 14
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3U4M_B - 0.75 0.57 1.00 21 3139 0 0 0 0 16
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_2 0.20 0.15 0.28 5 11763 26 0 13 13 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4ENB_A 0.69 0.47 1.00 9 1266 0 0 0 0 10

^top



Performance of Afold - scored lower in this pairwise comparison

1. Total counts & total scores for Afold

Total Base Pair Counts
Total TP 216
Total TN 36378
Total FP 99
Total FP CONTRA 8
Total FP INCONS 68
Total FP COMP 23
Total FN 130
Total Scores
MCC 0.677
Average MCC ± 95% Confidence Intervals 0.748 ± 0.148
Sensitivity 0.624
Positive Predictive Value 0.740
Nr of predictions 18

^top



2. Individual counts for Afold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A 0.61 0.55 0.69 11 1524 6 0 5 1 9
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.93 0.87 1.00 34 6071 3 0 0 3 5
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.75 0.69 0.82 9 485 2 0 2 0 4
3J0L_1 - 0.73 0.63 0.86 12 1211 3 0 2 1 7
3J0L_h - 0.73 0.60 0.90 26 6076 5 0 3 2 17
3J0L_7 - -0.01 0.00 0.00 0 1210 15 1 14 0 17
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3VJR_D - 0.96 0.92 1.00 12 618 1 0 0 1 1
4A1C_2 0.14 0.15 0.14 5 11745 43 5 26 12 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4ENB_A 0.67 0.58 0.79 11 1261 3 1 2 0 8

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.