CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of ContextFold - scored higher in this pairwise comparison

  4. Performance of CRWrnafold - scored lower in this pairwise comparison

  5. Compile and download dataset for ContextFold & CRWrnafold [.zip] - may take several seconds...


Overview

Metric ContextFold CRWrnafold
MCC 0.690 > 0.589
Average MCC ± 95% Confidence Intervals 0.719 ± 0.114 > 0.656 ± 0.138
Sensitivity 0.579 > 0.521
Positive Predictive Value 0.827 > 0.672
Total TP 310 > 279
Total TN 59168 > 59128
Total FP 86 < 153
Total FP CONTRA 6 < 17
Total FP INCONS 59 < 119
Total FP COMP 21 > 17
Total FN 225 < 256
P-value 5.19332990918e-08

^top




Performance plots


^top





Performance of ContextFold - scored higher in this pairwise comparison

1. Total counts & total scores for ContextFold

Total Base Pair Counts
Total TP 310
Total TN 59168
Total FP 86
Total FP CONTRA 6
Total FP INCONS 59
Total FP COMP 21
Total FN 225
Total Scores
MCC 0.690
Average MCC ± 95% Confidence Intervals 0.719 ± 0.114
Sensitivity 0.579
Positive Predictive Value 0.827
Nr of predictions 26

^top



2. Individual counts for ContextFold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A 0.55 0.50 0.63 10 1524 6 0 6 0 10
2LDL_A - 0.90 0.82 1.00 9 342 0 0 0 0 2
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LK3_A - 0.89 0.80 1.00 8 268 0 0 0 0 2
2LKR_A - 0.65 0.56 0.76 22 6076 9 0 7 2 17
2LQZ_A - 0.80 0.73 0.89 8 342 1 1 0 0 3
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.71 0.56 0.90 9 1118 1 0 1 0 7
3J0L_1 - 0.70 0.58 0.85 11 1212 3 0 2 1 8
3J0L_h - 0.82 0.67 1.00 29 6076 2 0 0 2 14
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J0L_g - -0.01 0.00 0.00 0 462 3 1 2 0 4
3J0L_2 - 0.64 0.61 0.69 20 6187 11 2 7 2 13
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 0 0 0 0 1
3TS0_U - 1.00 1.00 1.00 6 247 0 0 0 0 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.75 0.57 1.00 21 3139 0 0 0 0 16
4A1C_3 0.78 0.63 0.97 34 7105 1 0 1 0 20
4A1C_2 0.20 0.15 0.28 5 11763 26 0 13 13 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.52 0.40 0.68 17 4346 9 1 7 1 25
4ENB_A 0.69 0.47 1.00 9 1266 0 0 0 0 10
4ENC_A 0.65 0.47 0.90 9 1316 1 1 0 0 10

^top



Performance of CRWrnafold - scored lower in this pairwise comparison

1. Total counts & total scores for CRWrnafold

Total Base Pair Counts
Total TP 279
Total TN 59128
Total FP 153
Total FP CONTRA 17
Total FP INCONS 119
Total FP COMP 17
Total FN 256
Total Scores
MCC 0.589
Average MCC ± 95% Confidence Intervals 0.656 ± 0.138
Sensitivity 0.521
Positive Predictive Value 0.672
Nr of predictions 26

^top



2. Individual counts for CRWrnafold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.85 0.73 1.00 8 343 1 0 0 1 3
2LHP_A - 0.93 0.88 1.00 14 652 0 0 0 0 2
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.52 0.44 0.63 17 6078 12 2 8 2 22
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.39 0.31 0.50 5 1118 5 1 4 0 11
3J0L_1 - 0.76 0.63 0.92 12 1212 3 0 1 2 7
3J0L_h - 0.81 0.65 1.00 28 6077 0 0 0 0 15
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_2 - 0.25 0.24 0.28 8 6187 23 2 19 2 25
3J16_L 0.84 0.70 1.00 21 2754 0 0 0 0 9
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 0 0 0 0 1
3TS0_U - 1.00 1.00 1.00 6 247 0 0 0 0 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
4A1C_3 0.70 0.59 0.84 32 7102 6 0 6 0 22
4A1C_2 0.13 0.15 0.13 5 11741 44 4 31 9 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.59 0.48 0.74 20 4344 8 2 5 1 22
4ENB_A 0.70 0.58 0.85 11 1262 2 1 1 0 8
4ENC_A 0.70 0.58 0.85 11 1313 2 1 1 0 8

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.