CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Afold - scored higher in this pairwise comparison

  4. Performance of CRWrnafold - scored lower in this pairwise comparison

  5. Compile and download dataset for Afold & CRWrnafold [.zip] - may take several seconds...


Overview

Metric Afold CRWrnafold
MCC 0.638 > 0.564
Average MCC ± 95% Confidence Intervals 0.682 ± 0.165 > 0.629 ± 0.179
Sensitivity 0.592 > 0.515
Positive Predictive Value 0.695 > 0.627
Total TP 216 > 188
Total TN 38761 < 38772
Total FP 118 < 129
Total FP CONTRA 13 < 15
Total FP INCONS 82 < 97
Total FP COMP 23 > 17
Total FN 149 < 177
P-value 3.27388928538e-08

^top




Performance plots


^top





Performance of Afold - scored higher in this pairwise comparison

1. Total counts & total scores for Afold

Total Base Pair Counts
Total TP 216
Total TN 38761
Total FP 118
Total FP CONTRA 13
Total FP INCONS 82
Total FP COMP 23
Total FN 149
Total Scores
MCC 0.638
Average MCC ± 95% Confidence Intervals 0.682 ± 0.165
Sensitivity 0.592
Positive Predictive Value 0.695
Nr of predictions 19

^top



2. Individual counts for Afold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A 0.61 0.55 0.69 11 1524 6 0 5 1 9
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.93 0.87 1.00 34 6071 3 0 0 3 5
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2YIE_X - 0.36 0.33 0.40 4 1368 8 2 4 2 8
2YIE_Z - -0.01 0.00 0.00 0 1525 16 3 12 1 12
3J0L_1 - 0.73 0.63 0.86 12 1211 3 0 2 1 7
3J0L_7 - -0.01 0.00 0.00 0 1210 15 1 14 0 17
3J0L_h - 0.73 0.60 0.90 26 6076 5 0 3 2 17
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
4A1C_2 0.14 0.15 0.14 5 11745 43 5 26 12 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4ENB_A 0.67 0.58 0.79 11 1261 3 1 2 0 8

^top



Performance of CRWrnafold - scored lower in this pairwise comparison

1. Total counts & total scores for CRWrnafold

Total Base Pair Counts
Total TP 188
Total TN 38772
Total FP 129
Total FP CONTRA 15
Total FP INCONS 97
Total FP COMP 17
Total FN 177
Total Scores
MCC 0.564
Average MCC ± 95% Confidence Intervals 0.629 ± 0.179
Sensitivity 0.515
Positive Predictive Value 0.627
Nr of predictions 19

^top



2. Individual counts for CRWrnafold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.85 0.73 1.00 8 343 1 0 0 1 3
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.93 0.88 1.00 14 652 0 0 0 0 2
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.52 0.44 0.63 17 6078 12 2 8 2 22
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2YIE_X - 0.36 0.33 0.40 4 1368 9 2 4 3 8
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
3J0L_1 - 0.76 0.63 0.92 12 1212 3 0 1 2 7
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J0L_h - 0.81 0.65 1.00 28 6077 0 0 0 0 15
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
4A1C_2 0.13 0.15 0.13 5 11741 44 4 31 9 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4ENB_A 0.70 0.58 0.85 11 1262 2 1 1 0 8

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.